-- Logs begin at Fri 2022-10-28 12:04:39 UTC, end at Fri 2022-10-28 15:01:24 UTC. -- Oct 28 12:51:47.105433 n-d-862876-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 12:51:47.114228 n-d-862876-2 devstack@n-api.service[111546]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 12:51:47 2022] *** Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: nodename: n-d-862876-2 Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: machine: x86_64 Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: clock source: unix Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: pcre jit disabled Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: detected number of CPU cores: 4 Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: current working directory: / Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: detected binary path: /usr/bin/uwsgi-core Oct 28 12:51:47.116132 n-d-862876-2 devstack@n-api.service[111546]: your processes number limit is 47680 Oct 28 12:51:47.117095 n-d-862876-2 devstack@n-api.service[111546]: your memory page size is 4096 bytes Oct 28 12:51:47.117095 n-d-862876-2 devstack@n-api.service[111546]: detected max file descriptor number: 2048 Oct 28 12:51:47.117095 n-d-862876-2 devstack@n-api.service[111546]: lock engine: pthread robust mutexes Oct 28 12:51:47.117095 n-d-862876-2 devstack@n-api.service[111546]: thunder lock: enabled Oct 28 12:51:47.117095 n-d-862876-2 devstack@n-api.service[111546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 12:51:47.117095 n-d-862876-2 devstack@n-api.service[111546]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 12:51:47.155980 n-d-862876-2 devstack@n-api.service[111546]: Python main interpreter initialized at 0x55696162b9c0 Oct 28 12:51:47.155980 n-d-862876-2 devstack@n-api.service[111546]: python threads support enabled Oct 28 12:51:47.155980 n-d-862876-2 devstack@n-api.service[111546]: your server socket listen backlog is limited to 100 connections Oct 28 12:51:47.155980 n-d-862876-2 devstack@n-api.service[111546]: your mercy for graceful operations on workers is 90 seconds Oct 28 12:51:47.156296 n-d-862876-2 devstack@n-api.service[111546]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 12:51:47.156384 n-d-862876-2 devstack@n-api.service[111546]: *** Operational MODE: preforking *** Oct 28 12:51:47.156638 n-d-862876-2 devstack@n-api.service[111546]: *** uWSGI is running in multiple interpreter mode *** Oct 28 12:51:47.156638 n-d-862876-2 devstack@n-api.service[111546]: spawned uWSGI master process (pid: 111546) Oct 28 12:51:47.156817 n-d-862876-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 12:51:47.158187 n-d-862876-2 devstack@n-api.service[111546]: spawned uWSGI worker 1 (pid: 111547, cores: 1) Oct 28 12:51:47.158187 n-d-862876-2 devstack@n-api.service[111546]: spawned uWSGI worker 2 (pid: 111548, cores: 1) Oct 28 12:51:47.158187 n-d-862876-2 devstack@n-api.service[111546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 12:51:47.814855 n-d-862876-2 devstack@n-api.service[111548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 12:51:47.817321 n-d-862876-2 devstack@n-api.service[111547]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 12:51:48.885761 n-d-862876-2 devstack@n-api.service[111548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:51:48.885761 n-d-862876-2 devstack@n-api.service[111548]: from cryptography.utils import int_from_bytes Oct 28 12:51:48.886348 n-d-862876-2 devstack@n-api.service[111548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:51:48.886348 n-d-862876-2 devstack@n-api.service[111548]: from cryptography.utils import int_from_bytes Oct 28 12:51:48.886465 n-d-862876-2 devstack@n-api.service[111547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:51:48.886465 n-d-862876-2 devstack@n-api.service[111547]: from cryptography.utils import int_from_bytes Oct 28 12:51:48.886465 n-d-862876-2 devstack@n-api.service[111547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 12:51:48.886465 n-d-862876-2 devstack@n-api.service[111547]: from cryptography.utils import int_from_bytes Oct 28 12:51:51.407998 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:51:51.408661 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 12:51:51.409005 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:51:51.409111 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 12:51:51.409183 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:51:51.409258 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 12:51:51.409334 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:51:51.409406 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 12:51:51.409471 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:51:51.409544 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 12:51:51.409754 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.409852 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.410044 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.410140 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.410370 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.410469 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.410688 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.410794 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.411051 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.411153 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.411363 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.411495 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.411678 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.411781 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.411992 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.412111 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.412313 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.412473 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.412560 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.412639 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.412867 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.412965 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.413184 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862876-2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.413279 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862876-2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.413499 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.413603 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.413801 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.413896 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.414108 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.414202 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.414423 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.414516 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.414724 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.414836 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.415066 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.415165 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.415367 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.415465 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.415854 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.415961 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.416286 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.416391 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.416591 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.416688 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.416896 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.416982 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.417265 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.417368 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.417572 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.417658 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.417870 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.418189 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.418495 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.418841 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.419152 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.419556 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862876-2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.419832 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.419909 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.420169 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.420260 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.420482 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.420578 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.420893 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.421203 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.421303 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.421512 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.421704 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.421831 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.422153 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.422295 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862876-2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.422460 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.422598 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.422804 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.423004 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.423117 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.423358 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.423480 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.423740 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.423836 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.424052 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.424131 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.424392 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.424477 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.424904 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.425467 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.425553 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.425885 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.426018 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.426209 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.426548 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.426639 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.426983 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.427073 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.427316 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.427596 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.427691 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.427939 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.428192 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.428276 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.428556 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.428786 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.428872 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.429179 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.429386 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.429475 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.429730 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.429860 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.430038 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.430329 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.430423 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.430671 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.430942 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.431042 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.431263 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.431515 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.431607 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.431836 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.432102 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.432188 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.432453 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.432694 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.432779 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.433600 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.433820 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.433909 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.434210 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.434394 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.434556 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.434999 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.435145 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.435718 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.435821 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.435927 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.436163 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.436260 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.436567 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.436730 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.436882 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.437205 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.437331 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.437609 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.437866 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.437950 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.438176 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.438467 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.438562 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.438832 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.438932 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.439151 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.439426 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.439512 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.439781 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.439874 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.440092 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.440189 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.440397 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.440483 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.440703 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.440793 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.441022 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.441107 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.441353 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.441444 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.441655 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.441742 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.441907 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.442003 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.442209 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.442303 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.442513 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.442598 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.442853 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.442943 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.443161 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.443263 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.443467 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.443568 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.443775 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.443871 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.444062 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.444157 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.444367 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.444466 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.444671 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.444764 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.444971 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.445136 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.445276 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.445362 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.445580 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.445664 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.445884 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.445977 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.446182 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.446268 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.446485 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.446569 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.446813 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.446911 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.447121 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.447213 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.447426 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.447510 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.447732 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.447819 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.448034 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.448128 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.448336 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.448428 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.449202 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.449378 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.449510 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.449596 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.449816 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.449900 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.450122 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.450208 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.450427 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.450513 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.450739 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.450871 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.451067 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.451183 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.451374 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.451469 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.451685 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.451788 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.451976 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.452063 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.452284 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.452385 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.452586 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.452683 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.452884 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.452969 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.453189 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.453279 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.453489 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.453573 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.453799 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.453910 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.454104 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.454198 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.454404 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.454507 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.454705 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.454816 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.455029 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.455134 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.455331 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.455439 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.455631 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.455724 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.455931 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.456023 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.456227 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.456334 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.456527 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.456632 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.456829 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.456921 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.457130 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.457233 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.457431 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.457522 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.457728 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.457833 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.458033 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.458132 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.458329 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.458423 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.458647 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.458761 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.458990 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.459078 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.459298 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.459383 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.459602 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.459687 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.459927 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.460059 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.460217 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 12:51:51.460339 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.460546 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.460642 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.460857 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.460943 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.461178 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.461263 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.461487 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.461580 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.461796 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.461882 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.462107 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.462191 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.462422 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.462559 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.462728 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.462861 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.463058 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.463144 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.463378 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.463480 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.463684 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.463778 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.463993 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.464097 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.464323 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.464419 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.464638 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.464724 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.464956 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.465052 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.465272 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.465412 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.465582 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.465669 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.465894 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.465979 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.466209 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.466304 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.466517 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.466603 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.466857 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.466957 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.467183 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.467269 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.467490 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.467575 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.467798 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.467881 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.468105 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.468191 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.468452 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.468539 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.468762 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.468898 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.469070 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.469158 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.469386 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.469470 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.469696 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.469779 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.470002 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.470094 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.470309 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.470395 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.470616 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.470792 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.470960 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.471047 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.471270 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.471357 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.471579 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.471674 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.471888 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.471972 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.472208 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.472293 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.472520 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.472658 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.472829 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.472916 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.473138 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.473223 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.473445 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.473545 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.473752 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.473838 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.474068 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.474163 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.474376 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.474464 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.474680 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.474807 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.475012 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.475109 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.475314 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.475402 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.475621 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.475718 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.475923 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.476009 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.476229 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.476315 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.476538 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.476623 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.476841 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.476926 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.477142 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.477228 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.477444 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.477529 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.477751 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.477845 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.478054 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.478138 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.478360 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.478447 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.478665 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.478783 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.478998 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.479083 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.479306 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.479390 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.479610 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.479709 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.479957 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.480042 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.480264 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.480348 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.480569 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.480662 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.480879 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.480965 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.481181 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.481265 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.481485 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.481572 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.481786 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.481870 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.482094 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.482179 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.482403 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.482488 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.482708 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.482812 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.483041 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.483125 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.483351 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.483443 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.483653 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.483746 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.483961 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.484046 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.484272 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.484369 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.484579 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.484672 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.484890 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.484990 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.485202 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.485306 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.485519 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.485604 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.485826 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.485928 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.486125 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.486215 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.486431 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.486516 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.486733 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.486865 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.487057 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.487143 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.487358 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.487443 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.487663 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.487762 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.487964 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.488051 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.488267 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.488391 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.488567 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.488654 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.488867 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.488966 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.489167 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.489259 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.489465 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.489557 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.489772 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.489864 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.490071 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.490158 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.490369 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.490455 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.490668 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.490774 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.490999 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.491084 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.491302 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.491389 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.491621 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.491706 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.492182 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.492283 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.492486 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.492572 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.492787 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.492873 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.493086 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.493180 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.493425 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.493511 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.493727 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.493812 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.494040 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.494138 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.494352 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.494448 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.494659 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.494803 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.495002 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.495102 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.495311 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.495933 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.496164 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.496257 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.496472 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.496565 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.496781 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.496867 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.497088 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.497174 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.497395 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.497481 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.497695 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.497787 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.498008 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.498099 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.498325 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.498451 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.498633 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.498718 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.498974 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.499060 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.499282 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.499369 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.499591 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.499682 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.499892 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.499986 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.500200 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.500286 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.500508 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.500595 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.500815 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.500909 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.501121 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.501208 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.501436 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.501529 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.501742 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.501836 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.502056 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.502140 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.502361 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.502446 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.502670 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.502814 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.503002 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.503076 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.503308 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.503380 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.503607 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.503692 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.503919 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.504237 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.504547 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.504865 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.504951 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.505174 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.505261 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.505488 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.505573 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.505789 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.505883 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.506102 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.506186 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.506428 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.506513 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.506738 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.506856 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.507068 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.507154 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.507375 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.507459 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.507677 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.507772 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.507982 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.508067 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.508287 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.508369 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.508596 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.508690 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.508901 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.508986 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.509203 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.509287 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.509502 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.509587 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.509812 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.509895 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.510117 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.510200 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.510420 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.510507 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.510718 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.510879 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.511585 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.511686 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.511918 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.512006 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.512220 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.512313 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.512521 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.512607 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.512828 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.512914 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.513136 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.513221 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.513442 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.513541 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.513759 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.513843 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.514068 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.514153 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.514367 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.514478 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.514669 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.514784 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.514998 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.515083 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.515310 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.515407 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.515617 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.515711 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.515919 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.516005 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.516223 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.516320 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.516546 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.516631 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.516855 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.516941 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.517155 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.517240 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.517495 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.517587 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.517771 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.517858 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.518078 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.518170 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.518390 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.518476 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.518696 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.518799 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.519027 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.519112 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.519334 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.519418 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.519645 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.519728 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.519951 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.520036 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.520257 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.520340 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.520565 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.520662 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.520871 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.520955 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.521178 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.521262 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.521481 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.521576 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.521792 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.521883 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.522097 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.522180 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.522406 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.522666 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.522772 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.523023 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.523109 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.523334 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.523418 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.523649 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.523900 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.524039 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.524236 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.524331 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.524554 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.524676 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.524876 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.524963 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.525229 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.525323 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.525533 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.525662 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.525843 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.525945 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.526149 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.526234 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.526454 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.526539 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.526828 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.526936 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.527142 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.527472 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.527564 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.527780 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.527940 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.528092 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.528399 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.528496 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.528706 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.528876 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.529010 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.529305 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.529391 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.529612 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.529725 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.529922 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.530036 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.530226 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.530316 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.530530 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.530634 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.530863 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.530967 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.531168 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.531269 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.531474 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.531566 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.531783 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.531874 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.532099 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.532198 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.532404 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.532497 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.532707 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.532810 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.533011 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.533104 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.533315 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.533407 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.533641 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.533733 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.533945 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.534053 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.534282 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.534373 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.534610 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.534761 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.534944 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.535063 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.535255 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.535358 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.535555 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.535642 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.535867 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.535956 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.536168 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.536309 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.536468 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.536555 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.536765 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.536851 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.537069 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.537163 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.537370 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.537458 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.537668 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.537788 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.538908 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539034 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539034 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539161 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539227 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539301 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539381 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539448 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539513 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539585 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539651 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539715 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539787 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.539862 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.540060 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.540149 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.540358 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.540454 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.540659 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.540745 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.540957 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.541044 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.541265 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.541398 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.541567 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.541654 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.541861 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.541943 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.542516 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.542590 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.542590 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.542707 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.542803 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.542874 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.543094 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.543197 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.543392 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.543496 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.543695 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.543800 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.544000 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.544096 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.544301 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.544419 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.544602 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.544692 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.544919 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.545018 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.545226 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.545312 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.545527 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.545623 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.545830 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.545917 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.546132 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.546225 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.546434 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.546532 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.546739 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.546857 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.547065 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.547151 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.547384 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.547481 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.547683 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.547769 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.547989 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.548073 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.548290 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.548384 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.548591 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.548677 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.548890 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.548974 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.549189 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.549278 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.549489 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.549589 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.549786 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.549899 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.550086 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.550184 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.550382 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.550467 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.550680 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.550791 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.551005 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.551100 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.551320 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.551405 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.551622 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.551710 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.551923 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.552009 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.552222 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.552309 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.552519 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.552618 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.552852 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.552937 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.553153 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.553244 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.553498 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.553661 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.553801 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.553886 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.554117 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.554214 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.554426 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.554524 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.554731 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.554837 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.555063 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.555157 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.555360 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.555459 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.555664 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.555748 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.555970 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.556061 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.556276 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.556374 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.556576 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.556669 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.556877 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.556962 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.557180 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.557268 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.557490 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.557576 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.557797 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.558406 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.558641 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.558729 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.558985 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.559073 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.559306 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.559394 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.559614 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.559714 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.559916 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.560023 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.560223 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.560367 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.560526 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.560613 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.560831 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.560917 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.561135 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.561228 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.561438 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.561523 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.561747 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.561832 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.562054 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.562149 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.562362 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.562449 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.562668 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.562774 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.563001 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.563100 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.563307 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.563402 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.563613 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.563699 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.563913 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.564013 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.564212 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.564304 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.564525 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.564612 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.564827 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.564914 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.565124 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.565217 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.565430 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.565516 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.565731 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.565817 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.566031 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.566117 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.566331 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.566462 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.566783 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.566885 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.567096 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.567188 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.567401 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.567507 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.567711 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.567804 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.568022 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.568114 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.568335 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.568435 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.568647 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.568739 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.568949 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.569042 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.569247 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.569390 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.569726 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.569823 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.569966 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.570052 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.570272 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.570366 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.570573 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.570658 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.570896 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.570984 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.571199 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.571298 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.571506 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.571596 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.571806 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.571893 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.572107 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.572194 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.572406 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.572490 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.572707 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.572793 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.573011 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.573105 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.573314 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.573399 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.574169 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.574265 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.574560 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.574693 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.574889 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.574977 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.575198 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.575292 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.575601 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.575696 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.575908 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.576000 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.576218 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.576315 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.576533 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.576636 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.576851 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.576946 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.577153 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.577239 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.577467 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.577559 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.577773 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.577866 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.578080 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.578165 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.578397 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.578495 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.578705 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.578820 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.579037 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.579123 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.579338 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.579477 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.579638 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.579724 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.579962 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.580060 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.580269 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.580369 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.580579 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.580672 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.580899 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.580985 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.581295 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.581381 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.581605 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.581691 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.581910 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.581995 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.582232 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.582317 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.582534 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.582620 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.582859 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.582949 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.583164 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.583251 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.583467 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.583551 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.583769 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.583854 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.584074 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.584161 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.584375 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.584460 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.584682 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.584814 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.584988 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.585073 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.585300 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.585414 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.585603 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.585704 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.585901 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.585986 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.586199 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.586338 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.586507 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.586607 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.586826 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.586913 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.587144 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.587231 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.587455 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.587550 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.587775 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.587860 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.588078 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.588173 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.588382 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.588468 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.588690 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.588776 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.588992 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.589087 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.589316 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.589402 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.589617 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.589702 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.589936 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.590069 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.590247 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.590334 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.590547 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.590670 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.590887 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.590975 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.591214 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.591309 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.591532 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.591630 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.591840 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.591934 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.592175 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.592259 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.592493 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.592579 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.592801 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.592902 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.593106 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.593191 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.593421 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.593519 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.593720 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.593882 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.594023 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.594118 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.594322 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.594407 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.594622 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.594719 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.594946 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.595035 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.595250 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.595336 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.595551 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.595647 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.595850 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.595936 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.596148 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.596233 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.596449 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.596537 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.596751 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.596838 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.597061 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.597155 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.597363 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.597449 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.597675 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.597761 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.597977 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.598063 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.598277 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.598364 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.598577 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.598662 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.598910 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.599012 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.599240 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.599326 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.599539 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.599667 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.599864 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.599992 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.600172 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.600272 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.600487 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.600580 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.600800 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.600894 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.601112 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.601197 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.601422 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.601508 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.601731 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.601825 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.602041 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.602127 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.602353 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.602437 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.602659 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.602795 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.602987 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.603072 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.603301 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.603386 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.603612 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.603699 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.603928 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.604151 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.604461 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.604559 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.605294 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.605389 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.605607 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.605693 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.605917 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.606001 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.606225 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.606310 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.606536 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.606627 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.606867 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.606972 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.607178 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.607263 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.607485 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.607571 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.607791 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.607886 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.608097 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.608183 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.608424 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.608510 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.608743 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.608842 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.609063 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.609149 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.609376 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.609461 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.609690 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.609786 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.609999 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.610084 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.610313 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.610409 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.610620 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.610707 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.610988 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.611074 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.611293 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.611393 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.611596 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.611683 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.611909 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.611997 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.612218 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.612313 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.612526 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.612613 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.612832 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.612917 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.613136 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.613222 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.613440 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.613532 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.613747 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.613847 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.614055 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.614150 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.614360 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.614452 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.614667 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.614781 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.615000 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.615096 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.615310 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.615396 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.615632 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.615726 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.615949 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.616036 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.616261 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.616347 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.616569 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.616664 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.617132 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.617221 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.617448 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.617645 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.617955 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.618050 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.618265 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.618359 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.618588 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.618673 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.618932 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.619031 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.619245 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.619330 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.619558 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.619643 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.619873 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.619968 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.620174 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.620260 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.621012 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.621110 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.621320 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.621414 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.621626 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.621713 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.621929 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.622023 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.622237 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.622324 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.622549 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.622646 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.622874 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.622976 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.623180 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.623267 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.623489 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.623574 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.623796 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.624020 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.624325 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.624413 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.624670 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.624756 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.624983 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.625078 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.625308 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.625395 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.625620 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.625712 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.625925 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.626021 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.626228 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.626313 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.626543 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.626636 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.626870 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.626959 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.627177 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.627263 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.627485 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.627571 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.627790 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.627879 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.628091 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.628183 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.628392 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.628479 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.628697 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.628784 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.628999 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.629085 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.629297 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.629381 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.629596 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.629683 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.629897 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.629982 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.630213 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.630308 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.630514 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.630600 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.630836 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.630925 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.631139 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.631237 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.631439 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.631526 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.631742 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.631827 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.632044 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.632137 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.632347 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.632434 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.632650 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.632745 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.632952 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.633047 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.633251 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.633336 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.633556 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.633641 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.633860 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.633954 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.634214 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.634299 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.634517 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.634601 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.634841 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.634929 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.635146 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.635231 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.635458 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.635553 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.635759 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.635849 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.636086 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.636176 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.636394 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.636499 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.636701 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.636787 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.637011 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.637096 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.637319 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.637406 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.637628 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.637716 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.637961 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.638047 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.638274 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.638494 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.638826 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.638917 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.639159 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.639245 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.639476 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.639584 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.639806 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.639899 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.640113 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.640199 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.640418 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.640514 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.640720 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.640805 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.641025 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.641112 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.641339 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.641463 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.641648 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.641734 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.641955 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.642040 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.642263 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.642351 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.642568 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.642652 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.642899 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.642986 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.643208 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.643303 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.643512 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.643597 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.643818 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.643910 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.644123 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.644208 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.644425 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.644510 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.644730 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.644827 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.645034 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.645119 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.645341 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.645427 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.645648 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.645781 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.645960 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.646048 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.646290 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.646382 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.646603 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.646689 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.646941 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.647039 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.647256 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.647342 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.647564 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.647651 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.647871 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.647957 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.648177 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.648261 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.648481 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.648567 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.648789 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.648875 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.649104 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.649190 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.649413 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.649500 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.649716 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.649802 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.650027 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.650387 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.650695 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.650810 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.651033 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.651119 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.651354 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.651451 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.651693 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.651782 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.652005 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.652089 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.652329 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.652428 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.652645 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.652732 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.652953 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.653045 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.653273 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.653360 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.653583 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.653668 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.653912 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.654006 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.654246 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.654339 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.654569 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.654655 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.654901 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.654992 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.655208 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.655297 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.655511 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.655596 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.655814 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.655907 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.656123 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.656209 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.656429 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.656513 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.656732 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.656827 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.657033 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.657117 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.657335 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.657420 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.657637 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.657733 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.657939 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.658065 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.658241 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.658334 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.658541 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.658639 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.658871 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.658972 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.659175 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.659271 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.659474 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.659561 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.659779 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.659864 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.660082 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.660177 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.660385 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.660478 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.660685 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.660770 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.660990 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.661076 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.661291 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.661377 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.661592 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.661677 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.661893 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.661977 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.662195 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.662288 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.662497 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.662582 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.662877 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.663027 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.663146 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.663231 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.663469 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.663556 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.663781 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.663877 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.664093 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.664179 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.664401 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.664485 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.664708 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.664802 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.665014 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.665099 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.665331 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.665417 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.665644 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.665737 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.665953 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.666038 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.666262 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.666348 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.666577 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.666663 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.666913 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.667012 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.667728 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.667825 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.668051 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.668146 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.668360 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.668446 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.668666 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.668752 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.668972 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.669067 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.669300 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.669389 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.669605 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.669699 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.669920 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.670005 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.670232 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.670317 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.670545 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.670640 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.670880 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.670970 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.671192 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.671279 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.671501 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.671603 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.671816 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.671906 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.672125 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.672217 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.672432 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.672518 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.672739 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.672836 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.673046 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.673131 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.673356 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.673443 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.673665 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.673751 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.673972 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.674056 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.674281 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.674368 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.674593 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.674678 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.674928 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.675033 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.675253 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.675338 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.675562 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.675647 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.675872 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.675970 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.676197 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.676296 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.676522 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.676615 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.676842 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.676936 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.677167 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.677296 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.677496 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.677582 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.677809 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.677905 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.678121 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.678215 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.678426 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.678512 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.678668 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:51:51.678787 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 12:51:51.678983 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 12:51:51.831575 n-d-862876-2 devstack@n-api.service[111547]: INFO dbcounter [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Registered counter for database nova_api Oct 28 12:51:51.831801 n-d-862876-2 devstack@n-api.service[111548]: INFO dbcounter [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Registered counter for database nova_api Oct 28 12:51:51.852333 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_db.sqlalchemy.engines [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:51.856306 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_db.sqlalchemy.engines [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:51.859643 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writer thread running {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:51.862851 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writer thread running {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:51.916333 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.context [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=111547) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:51:51.919183 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.context [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=111548) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 12:51:51.920705 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 12:51:51.921179 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 12:51:51.922769 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 12:51:51.922997 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_concurrency.lockutils [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 12:51:51.923466 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_concurrency.lockutils [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 12:51:51.923568 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 12:51:51.923919 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 12:51:51.925028 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_concurrency.lockutils [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 12:51:51.925746 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_concurrency.lockutils [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 12:51:51.925888 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 12:51:51.926188 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_concurrency.lockutils [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 12:51:51.927927 n-d-862876-2 devstack@n-api.service[111547]: INFO dbcounter [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Registered counter for database nova_cell0 Oct 28 12:51:51.928187 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_concurrency.lockutils [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 12:51:51.930283 n-d-862876-2 devstack@n-api.service[111548]: INFO dbcounter [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Registered counter for database nova_cell0 Oct 28 12:51:51.932044 n-d-862876-2 devstack@n-api.service[111547]: INFO dbcounter [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Registered counter for database nova_cell1 Oct 28 12:51:51.935023 n-d-862876-2 devstack@n-api.service[111548]: INFO dbcounter [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Registered counter for database nova_cell1 Oct 28 12:51:51.940049 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_db.sqlalchemy.engines [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:51.942210 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_db.sqlalchemy.engines [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:51.943269 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_db.sqlalchemy.engines [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:51.945718 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_db.sqlalchemy.engines [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:51.947213 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writer thread running {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:51.952366 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writer thread running {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:51.953422 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writer thread running {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:51.953765 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writer thread running {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:52.093146 n-d-862876-2 devstack@n-api.service[111547]: INFO dbcounter [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Registered counter for database nova_cell0 Oct 28 12:51:52.096925 n-d-862876-2 devstack@n-api.service[111548]: INFO dbcounter [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Registered counter for database nova_cell0 Oct 28 12:51:52.100131 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_db.sqlalchemy.engines [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:52.105502 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writer thread running {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:52.106506 n-d-862876-2 devstack@n-api.service[111548]: DEBUG oslo_db.sqlalchemy.engines [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 12:51:52.110767 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writer thread running {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 12:51:52.524691 n-d-862876-2 devstack@n-api.service[111547]: WARNING keystonemiddleware.auth_token [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:51:52.532547 n-d-862876-2 devstack@n-api.service[111547]: WARNING keystonemiddleware.auth_token [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:51:52.557281 n-d-862876-2 devstack@n-api.service[111548]: WARNING keystonemiddleware.auth_token [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:51:52.564742 n-d-862876-2 devstack@n-api.service[111548]: WARNING keystonemiddleware.auth_token [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:51:52.873287 n-d-862876-2 devstack@n-api.service[111547]: WARNING keystonemiddleware.auth_token [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:51:52.879138 n-d-862876-2 devstack@n-api.service[111547]: WARNING keystonemiddleware.auth_token [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:51:52.885190 n-d-862876-2 devstack@n-api.service[111547]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55696162b9c0 pid: 111547 (default app) Oct 28 12:51:52.887822 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:51:52.889011 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Oct 28 12:51:52.889419 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Fri Oct 28 12:51:52 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:51:52.906432 n-d-862876-2 devstack@n-api.service[111548]: WARNING keystonemiddleware.auth_token [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 12:51:52.912333 n-d-862876-2 devstack@n-api.service[111548]: WARNING keystonemiddleware.auth_token [None req-48bb5baf-82cc-43df-a24d-42997888faab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 12:51:52.918348 n-d-862876-2 devstack@n-api.service[111548]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55696162b9c0 pid: 111548 (default app) Oct 28 12:53:17.334289 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:17.335256 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 28 12:53:17.335647 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:17.347588 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_api:SELECT=3 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:17.348748 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_cell0:SELECT=3 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:17.349789 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_cell1:SELECT=3 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:17.350862 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:18.239266 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-294c4178-9e3f-4f2f-a389-fae8bb245c7d admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:18.273251 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-294c4178-9e3f-4f2f-a389-fae8bb245c7d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930758 Oct 28 12:53:18.273989 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 12:53:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:20.880473 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:20.881463 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-96b45d0e-df51-4d4e-b96c-a202575cab2f None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Oct 28 12:53:20.882052 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:21.332161 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-c6045208-8b7d-4cc8-bb17-029e4c8aa06e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:21.424837 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-c6045208-8b7d-4cc8-bb17-029e4c8aa06e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.536901 Oct 28 12:53:21.425405 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:53:21.439027 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writing DB stats nova_api:SELECT=3 {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:21.440507 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writing DB stats nova_cell0:SELECT=3 {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:21.441525 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writing DB stats nova_cell1:SELECT=3 {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:21.442254 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:21.650634 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-98bbd80c-d2a0-47fc-8441-591bc9c6972f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:21.778627 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-98bbd80c-d2a0-47fc-8441-591bc9c6972f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.344251 Oct 28 12:53:21.779253 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Oct 28 12:53:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:24.435968 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-c6045208-8b7d-4cc8-bb17-029e4c8aa06e admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:24.437546 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-c6045208-8b7d-4cc8-bb17-029e4c8aa06e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Oct 28 12:53:24.438366 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:25.214649 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-d9289aeb-ff55-4b9b-a2e9-e19e9c421834 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1"}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:25.339386 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-d9289aeb-ff55-4b9b-a2e9-e19e9c421834 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.894539 Oct 28 12:53:25.340746 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:53:25.355055 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-3d98f4cf-75ae-4dbc-9791-d9539dc3da19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:25.472613 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-3d98f4cf-75ae-4dbc-9791-d9539dc3da19 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122128 Oct 28 12:53:25.480202 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Oct 28 12:53:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:28.245038 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-d9289aeb-ff55-4b9b-a2e9-e19e9c421834 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:28.246052 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-d9289aeb-ff55-4b9b-a2e9-e19e9c421834 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 28 12:53:28.247186 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:28.734565 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-c4dc6b55-dba3-490b-866f-e5055213f9ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "swap": 0}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:28.804696 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-c4dc6b55-dba3-490b-866f-e5055213f9ab admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.551293 Oct 28 12:53:28.805636 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:53:28.817560 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-d08fa6cc-f4f2-4380-99a7-42ab2bf83076 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:28.902175 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-d08fa6cc-f4f2-4380-99a7-42ab2bf83076 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088291 Oct 28 12:53:28.903384 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Oct 28 12:53:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:31.519915 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-c4dc6b55-dba3-490b-866f-e5055213f9ab admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:31.520858 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-c4dc6b55-dba3-490b-866f-e5055213f9ab admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 28 12:53:31.521272 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:31.951506 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-82bd9f9e-2da4-492b-8338-4fbdcdc9cea3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "id": "d3", "name": "ds2G", "vcpus": 2}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:32.073258 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-82bd9f9e-2da4-492b-8338-4fbdcdc9cea3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.545783 Oct 28 12:53:32.073940 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:53:32.088767 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-d25c621a-a98a-4da3-a181-0f87573001d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:32.158299 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-d25c621a-a98a-4da3-a181-0f87573001d5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073436 Oct 28 12:53:32.158843 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Oct 28 12:53:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:34.870712 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-82bd9f9e-2da4-492b-8338-4fbdcdc9cea3 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:34.873255 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-82bd9f9e-2da4-492b-8338-4fbdcdc9cea3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002959 Oct 28 12:53:34.887380 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:35.384022 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-cfcdd5e1-ee88-4aa3-a2f9-a49e8a5e56c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:35.463810 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-cfcdd5e1-ee88-4aa3-a2f9-a49e8a5e56c5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.582206 Oct 28 12:53:35.478651 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-c998ae44-4ea1-4b9e-bf37-b660b16da093 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:35.485331 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:53:35.568888 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-c998ae44-4ea1-4b9e-bf37-b660b16da093 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094353 Oct 28 12:53:35.588503 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Oct 28 12:53:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:38.213709 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-cfcdd5e1-ee88-4aa3-a2f9-a49e8a5e56c5 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:38.214590 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-cfcdd5e1-ee88-4aa3-a2f9-a49e8a5e56c5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 28 12:53:38.215576 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:38.700970 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-d44fb4a9-2453-42d1-b8c9-47487f99473c admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:38.732882 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-d44fb4a9-2453-42d1-b8c9-47487f99473c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.511802 Oct 28 12:53:38.733527 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 12:53:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:53:41.365851 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-cfcdd5e1-ee88-4aa3-a2f9-a49e8a5e56c5 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:41.366889 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-cfcdd5e1-ee88-4aa3-a2f9-a49e8a5e56c5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 28 12:53:41.367295 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:41.797579 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-48fc86b3-570e-4165-829f-232ed8b981e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "swap": 0, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:41.867170 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-48fc86b3-570e-4165-829f-232ed8b981e2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.493188 Oct 28 12:53:41.867722 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:53:41.880776 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-36fa7f8c-fc44-4118-b90c-e36e5539d9aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:41.967744 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-36fa7f8c-fc44-4118-b90c-e36e5539d9aa admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090585 Oct 28 12:53:41.968334 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Oct 28 12:53:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:53:44.602875 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-48fc86b3-570e-4165-829f-232ed8b981e2 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:44.603893 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-48fc86b3-570e-4165-829f-232ed8b981e2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 28 12:53:44.604463 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:44.995109 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-9d749a69-d8f8-45b1-8ea5-b8eaa7911fe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:45.072720 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-9d749a69-d8f8-45b1-8ea5-b8eaa7911fe9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462390 Oct 28 12:53:45.073301 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:53:45.086238 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-22ded42b-92b9-470b-b8e4-1ad603ead9c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:45.161977 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-22ded42b-92b9-470b-b8e4-1ad603ead9c0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079473 Oct 28 12:53:45.162558 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Oct 28 12:53:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:47.763490 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-9d749a69-d8f8-45b1-8ea5-b8eaa7911fe9 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:47.764529 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-9d749a69-d8f8-45b1-8ea5-b8eaa7911fe9 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 28 12:53:47.764933 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:48.192327 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-621e16e9-9286-4347-9269-019bdd7e789e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "ram": 4096, "vcpus": 2, "name": "m1.medium"}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:48.289150 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-621e16e9-9286-4347-9269-019bdd7e789e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.518032 Oct 28 12:53:48.289819 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:53:48.302421 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-d9695e84-dfaa-42e0-85b7-81c1d7e5d4c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:48.307236 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:48.372989 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-d9695e84-dfaa-42e0-85b7-81c1d7e5d4c2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074207 Oct 28 12:53:48.373666 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Oct 28 12:53:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:53:50.971844 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-621e16e9-9286-4347-9269-019bdd7e789e admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:50.972956 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-621e16e9-9286-4347-9269-019bdd7e789e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Oct 28 12:53:50.973571 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:51.407362 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-7694a49c-009c-42fc-8ea1-b30142417c2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "rxtx_factor": 1.0}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:51.490167 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-7694a49c-009c-42fc-8ea1-b30142417c2c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.510702 Oct 28 12:53:51.490716 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:53:51.502941 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-d5f582d4-23d0-44d8-b669-949ed3c0521e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:51.596594 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-d5f582d4-23d0-44d8-b669-949ed3c0521e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097324 Oct 28 12:53:51.597160 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Oct 28 12:53:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:53:54.274323 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-7694a49c-009c-42fc-8ea1-b30142417c2c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:53:54.275892 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-7694a49c-009c-42fc-8ea1-b30142417c2c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Oct 28 12:53:54.276302 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:53:54.703945 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-3c3d40ce-8e64-404e-8035-4d92d757745c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "disk": 160, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:54.709485 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:53:54.775433 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-3c3d40ce-8e64-404e-8035-4d92d757745c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.492548 Oct 28 12:53:54.776296 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Oct 28 12:53:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:53:54.788466 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-096476c6-7997-4cd8-9319-1a7e2c37a49c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:53:54.865023 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-096476c6-7997-4cd8-9319-1a7e2c37a49c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080040 Oct 28 12:53:54.865670 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Oct 28 12:53:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:54:17.459271 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-3c3d40ce-8e64-404e-8035-4d92d757745c admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:17.460279 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-3c3d40ce-8e64-404e-8035-4d92d757745c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 28 12:54:17.460679 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:54:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:17.471493 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:54:17.841721 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-de262b67-21f8-4bfe-ad0e-b990e5b4a5b6 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:17.859965 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-de262b67-21f8-4bfe-ad0e-b990e5b4a5b6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.392956 Oct 28 12:54:17.860498 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 12:54:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:54:19.166693 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-3c3d40ce-8e64-404e-8035-4d92d757745c admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:19.168394 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-3c3d40ce-8e64-404e-8035-4d92d757745c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Oct 28 12:54:19.168798 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:19.698616 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-6594b8b5-facd-412d-86a4-9e3d6899dc55 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:19.703838 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.wsgi [None req-6594b8b5-facd-412d-86a4-9e3d6899dc55 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-6594b8b5-facd-412d-86a4-9e3d6899dc55 admin admin] Request method failure captured: Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: Accept: application/json Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: Accept-Encoding: gzip, deflate Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: Connection: keep-alive Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: Content-Length: 0 Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: Host: 10.222.0.25 Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: Openstack-Api-Version: compute 2.92 Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: Openstack-System-Scope: None Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: User-Agent: python-novaclient Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Auth-Token: gAAAAABjW9D7re5gh8v0_lGSIDYmJYOEXuf70o2ypYMXf3XZvjpG_4YDBgQz3na_NSIGGSLub1Naff4QpnY3g00cZMFE6M8FGcgjn3oTdDSjS47vJvlM7JEOCnksjeIfPsGTAYrTIsHEw7jNVH28ztwxBQkUeZUDhxHD5ZU6H5yXB2z69hbMeF0 Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Domain-Id: None Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Domain-Name: None Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Identity-Status: Confirmed Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Is-Admin-Project: True Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Domain-Id: default Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Domain-Name: Default Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Name: admin Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Role: member,reader,admin Oct 28 12:54:19.707037 n-d-862876-2 devstack@n-api.service[111548]: X-Roles: member,reader,admin Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b1039e655d84ed48122f512ae3583e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant: admin Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant-Name: admin Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-User: admin Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-User-Domain-Id: default Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-User-Domain-Name: Default Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-User-Id: 4622bb524e7a4dcebf70d50538e02e41 Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: X-User-Name: admin Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: method: > Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: exception: Flavor 42 could not be found. Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: action_args: {'id': '42'} Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 12:54:19.708706 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:19.709932 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.711364 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-6594b8b5-facd-412d-86a4-9e3d6899dc55 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 12:54:19.712660 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-6594b8b5-facd-412d-86a4-9e3d6899dc55 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387690 Oct 28 12:54:19.712660 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Oct 28 12:54:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:54:19.718681 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-8462aef5-c50f-4205-a1b6-7ea122c75d6c admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:19.740246 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-8462aef5-c50f-4205-a1b6-7ea122c75d6c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025842 Oct 28 12:54:19.740701 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Oct 28 12:54:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:54:19.762670 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-ddf9d14c-71da-401a-87c7-d2ee8a754b4a admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:19.783944 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-ddf9d14c-71da-401a-87c7-d2ee8a754b4a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026276 Oct 28 12:54:19.784468 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Oct 28 12:54:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:54:19.793808 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-afd40d6b-a4bb-47a1-9cbd-dfec6a6ad1cb admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:19.799192 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.wsgi [None req-afd40d6b-a4bb-47a1-9cbd-dfec6a6ad1cb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-afd40d6b-a4bb-47a1-9cbd-dfec6a6ad1cb admin admin] Request method failure captured: Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: Accept: application/json Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: Accept-Encoding: gzip, deflate Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: Connection: keep-alive Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: Content-Length: 0 Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: Host: 10.222.0.25 Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: Openstack-Api-Version: compute 2.92 Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: Openstack-System-Scope: None Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: User-Agent: python-novaclient Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Auth-Token: gAAAAABjW9D7re5gh8v0_lGSIDYmJYOEXuf70o2ypYMXf3XZvjpG_4YDBgQz3na_NSIGGSLub1Naff4QpnY3g00cZMFE6M8FGcgjn3oTdDSjS47vJvlM7JEOCnksjeIfPsGTAYrTIsHEw7jNVH28ztwxBQkUeZUDhxHD5ZU6H5yXB2z69hbMeF0 Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Domain-Id: None Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Domain-Name: None Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Identity-Status: Confirmed Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Is-Admin-Project: True Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Domain-Id: default Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Domain-Name: Default Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Name: admin Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Role: member,reader,admin Oct 28 12:54:19.802376 n-d-862876-2 devstack@n-api.service[111547]: X-Roles: member,reader,admin Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b1039e655d84ed48122f512ae3583e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant: admin Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant-Name: admin Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-User: admin Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-User-Domain-Id: default Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-User-Domain-Name: Default Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-User-Id: 4622bb524e7a4dcebf70d50538e02e41 Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: X-User-Name: admin Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: method: > Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: exception: Flavor 42 could not be found. Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: action_args: {'id': '42'} Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 12:54:19.810102 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:19.811150 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:19.812420 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-afd40d6b-a4bb-47a1-9cbd-dfec6a6ad1cb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 12:54:19.813635 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-afd40d6b-a4bb-47a1-9cbd-dfec6a6ad1cb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013793 Oct 28 12:54:19.813635 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Oct 28 12:54:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 12:54:21.003960 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-ddf9d14c-71da-401a-87c7-d2ee8a754b4a admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:21.004971 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-ddf9d14c-71da-401a-87c7-d2ee8a754b4a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 28 12:54:21.005359 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:21.516262 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-ce9d5da2-2c6f-44cb-b092-6f6325418648 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:21.521342 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.wsgi [None req-ce9d5da2-2c6f-44cb-b092-6f6325418648 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-ce9d5da2-2c6f-44cb-b092-6f6325418648 admin admin] Request method failure captured: Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: Accept: application/json Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: Accept-Encoding: gzip, deflate Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: Connection: keep-alive Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: Content-Length: 0 Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: Host: 10.222.0.25 Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: Openstack-Api-Version: compute 2.92 Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: Openstack-System-Scope: None Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: User-Agent: python-novaclient Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Auth-Token: gAAAAABjW9D80_GHHi2OOTSXfPX35XogkIs5-E0RVW8X8yiHYaRPYvK53IgaSRI0NLoHiRoXPJ05e2aJwEionVoUI1-IFoCsGeIDrbPC7oYGWLkfGgdX40YtZFXVRb_N1O7thlKMcy8W-SWXkrdehyAUu1TKoDEo9NEQ-9fGloUAnZnWpdnI16I Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Domain-Id: None Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Domain-Name: None Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Identity-Status: Confirmed Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Is-Admin-Project: True Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Domain-Id: default Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Domain-Name: Default Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Name: admin Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Role: member,reader,admin Oct 28 12:54:21.522861 n-d-862876-2 devstack@n-api.service[111547]: X-Roles: member,reader,admin Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b1039e655d84ed48122f512ae3583e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant: admin Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant-Name: admin Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-User: admin Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-User-Domain-Id: default Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-User-Domain-Name: Default Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-User-Id: 4622bb524e7a4dcebf70d50538e02e41 Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: X-User-Name: admin Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: method: > Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: exception: Flavor 84 could not be found. Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: action_args: {'id': '84'} Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 12:54:21.524441 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:21.525511 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.526910 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-ce9d5da2-2c6f-44cb-b092-6f6325418648 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 12:54:21.528143 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-ce9d5da2-2c6f-44cb-b092-6f6325418648 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.382284 Oct 28 12:54:21.528143 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Oct 28 12:54:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:54:21.533980 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-b745185b-f887-44d4-afd7-6f1305949849 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:21.549366 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-b745185b-f887-44d4-afd7-6f1305949849 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018973 Oct 28 12:54:21.549908 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Oct 28 12:54:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:54:21.559948 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-dcb11ac2-f70e-4244-a62b-9b54e51fcfee admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:21.575096 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-dcb11ac2-f70e-4244-a62b-9b54e51fcfee admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019216 Oct 28 12:54:21.575606 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Oct 28 12:54:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:54:21.584571 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-671bd9a3-e392-442d-96d0-ab255f97024e admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:21.589595 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.wsgi [None req-671bd9a3-e392-442d-96d0-ab255f97024e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-671bd9a3-e392-442d-96d0-ab255f97024e admin admin] Request method failure captured: Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: Accept: application/json Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: Accept-Encoding: gzip, deflate Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: Connection: keep-alive Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: Content-Length: 0 Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: Host: 10.222.0.25 Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: Openstack-Api-Version: compute 2.92 Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: Openstack-System-Scope: None Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: User-Agent: python-novaclient Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Auth-Token: gAAAAABjW9D80_GHHi2OOTSXfPX35XogkIs5-E0RVW8X8yiHYaRPYvK53IgaSRI0NLoHiRoXPJ05e2aJwEionVoUI1-IFoCsGeIDrbPC7oYGWLkfGgdX40YtZFXVRb_N1O7thlKMcy8W-SWXkrdehyAUu1TKoDEo9NEQ-9fGloUAnZnWpdnI16I Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Domain-Id: None Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Domain-Name: None Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Identity-Status: Confirmed Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Is-Admin-Project: True Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Domain-Id: default Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Domain-Name: Default Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Name: admin Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Role: member,reader,admin Oct 28 12:54:21.591120 n-d-862876-2 devstack@n-api.service[111548]: X-Roles: member,reader,admin Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b1039e655d84ed48122f512ae3583e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant: admin Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant-Name: admin Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-User: admin Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-User-Domain-Id: default Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-User-Domain-Name: Default Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-User-Id: 4622bb524e7a4dcebf70d50538e02e41 Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: X-User-Name: admin Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: method: > Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: exception: Flavor 84 could not be found. Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: action_args: {'id': '84'} Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 12:54:21.592621 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:21.593555 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:21.594902 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-671bd9a3-e392-442d-96d0-ab255f97024e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 12:54:21.596114 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-671bd9a3-e392-442d-96d0-ab255f97024e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011449 Oct 28 12:54:21.596114 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Oct 28 12:54:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 12:54:22.785595 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-dcb11ac2-f70e-4244-a62b-9b54e51fcfee admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:22.786600 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-dcb11ac2-f70e-4244-a62b-9b54e51fcfee admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 28 12:54:22.787041 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:23.300210 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-0d70101e-a64c-4f40-b045-360ea212cf1f admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:23.305926 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.wsgi [None req-0d70101e-a64c-4f40-b045-360ea212cf1f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-0d70101e-a64c-4f40-b045-360ea212cf1f admin admin] Request method failure captured: Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: Accept: application/json Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: Accept-Encoding: gzip, deflate Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: Connection: keep-alive Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: Content-Length: 0 Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: Host: 10.222.0.25 Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: Openstack-Api-Version: compute 2.92 Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: Openstack-System-Scope: None Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: User-Agent: python-novaclient Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Auth-Token: gAAAAABjW9D-0zbRvPYJExy3ZbcJ43keobFuS7Y2U6erewODjPT_V7nL5wncJv6G3pDWmGM0qQNfzoTN1G9wQCi-f20Xx-M51bHW0ubb6qHlRQQepdUgcF_Y6-5KPoNbpmMP_aNxgW2HktsiU41T9tleXX6qZfyeGJYM82doYzvxbbE0Iq4EQK0 Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Domain-Id: None Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Domain-Name: None Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Identity-Status: Confirmed Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Is-Admin-Project: True Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Domain-Id: default Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Domain-Name: Default Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Project-Name: admin Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Role: member,reader,admin Oct 28 12:54:23.307458 n-d-862876-2 devstack@n-api.service[111548]: X-Roles: member,reader,admin Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b1039e655d84ed48122f512ae3583e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant: admin Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-Tenant-Name: admin Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-User: admin Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-User-Domain-Id: default Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-User-Domain-Name: Default Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-User-Id: 4622bb524e7a4dcebf70d50538e02e41 Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: X-User-Name: admin Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: method: > Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: exception: Flavor 451 could not be found. Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: action_args: {'id': '451'} Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 12:54:23.309088 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:23.310054 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.311211 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-0d70101e-a64c-4f40-b045-360ea212cf1f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 12:54:23.312197 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-0d70101e-a64c-4f40-b045-360ea212cf1f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.386686 Oct 28 12:54:23.312197 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 12:54:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:54:23.318261 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-ab30684b-e525-43e6-897a-58ea3a95a9d0 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:23.333444 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-ab30684b-e525-43e6-897a-58ea3a95a9d0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018745 Oct 28 12:54:23.333959 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Oct 28 12:54:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:54:23.343720 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:23.358733 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018518 Oct 28 12:54:23.359280 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Oct 28 12:54:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 12:54:23.368157 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-af07abe3-17bc-4d6c-8d0c-ba3a1e894550 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:23.373188 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.wsgi [None req-af07abe3-17bc-4d6c-8d0c-ba3a1e894550 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-af07abe3-17bc-4d6c-8d0c-ba3a1e894550 admin admin] Request method failure captured: Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: Accept: application/json Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: Accept-Encoding: gzip, deflate Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: Connection: keep-alive Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: Content-Length: 0 Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: Host: 10.222.0.25 Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: Openstack-Api-Version: compute 2.92 Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: Openstack-System-Scope: None Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: User-Agent: python-novaclient Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Auth-Token: gAAAAABjW9D-0zbRvPYJExy3ZbcJ43keobFuS7Y2U6erewODjPT_V7nL5wncJv6G3pDWmGM0qQNfzoTN1G9wQCi-f20Xx-M51bHW0ubb6qHlRQQepdUgcF_Y6-5KPoNbpmMP_aNxgW2HktsiU41T9tleXX6qZfyeGJYM82doYzvxbbE0Iq4EQK0 Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Domain-Id: None Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Domain-Name: None Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Identity-Status: Confirmed Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Is-Admin-Project: True Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Domain-Id: default Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Domain-Name: Default Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Project-Name: admin Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Role: member,reader,admin Oct 28 12:54:23.374664 n-d-862876-2 devstack@n-api.service[111547]: X-Roles: member,reader,admin Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6b1039e655d84ed48122f512ae3583e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6b1039e655d84ed48122f512ae3583e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant: admin Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant-Id: 6b1039e655d84ed48122f512ae3583e5 Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-Tenant-Name: admin Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-User: admin Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-User-Domain-Id: default Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-User-Domain-Name: Default Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-User-Id: 4622bb524e7a4dcebf70d50538e02e41 Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: X-User-Name: admin Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: method: > Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: exception: Flavor 451 could not be found. Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: action_args: {'id': '451'} Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 12:54:23.376202 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:23.377141 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: ERROR nova.api.openstack.wsgi Oct 28 12:54:23.378380 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-af07abe3-17bc-4d6c-8d0c-ba3a1e894550 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 12:54:23.379676 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-af07abe3-17bc-4d6c-8d0c-ba3a1e894550 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011343 Oct 28 12:54:23.379676 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 12:54:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 12:54:24.555598 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:24.556590 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 28 12:54:24.556972 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:25.074915 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-c6c2d657-ec09-4b60-92af-cd3752134633 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:54:25.151443 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-c6c2d657-ec09-4b60-92af-cd3752134633 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.458981 Oct 28 12:54:25.152499 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Oct 28 12:54:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:54:26.354421 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:26.355464 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 28 12:54:26.355846 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:26.880342 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-fc503046-c38a-404b-be91-d8c95b326962 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:54:26.963254 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-fc503046-c38a-404b-be91-d8c95b326962 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.471595 Oct 28 12:54:26.963795 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Oct 28 12:54:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:54:28.154447 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:28.155463 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 28 12:54:28.155853 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 12:54:28.673124 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-b6a63c1e-b1db-41e0-852e-b91350810aa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:54:28.728695 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-b6a63c1e-b1db-41e0-852e-b91350810aa7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.434165 Oct 28 12:54:28.729231 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Oct 28 12:54:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 12:54:29.924471 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:29.925479 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 28 12:54:29.925871 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:30.443492 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-cae1991d-2f3d-4630-a1d3-25a0edf7b2b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 12:54:30.511446 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-cae1991d-2f3d-4630-a1d3-25a0edf7b2b9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.449559 Oct 28 12:54:30.511901 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Oct 28 12:54:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 12:54:31.716085 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:31.717092 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 28 12:54:31.717485 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 12:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:54:32.254520 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-9a997124-5f74-46e7-be6d-1162613942d8 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:54:32.274509 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-9a997124-5f74-46e7-be6d-1162613942d8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.421960 Oct 28 12:54:32.275077 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Fri Oct 28 12:54:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:55:28.741118 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:55:28.742125 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-324eef95-0c30-401c-a54f-fd9e0d1e301c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 28 12:55:28.742522 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Fri Oct 28 12:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 12:55:28.753303 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:55:29.131864 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-b8c84bb5-32f3-4e0e-a782-aca90bbbc32f admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:55:29.153077 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-b8c84bb5-32f3-4e0e-a782-aca90bbbc32f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404190 Oct 28 12:55:29.157968 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 12:55:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 12:55:29.174310 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_api:SELECT=14 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 12:55:29.178025 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-14fd5193-d7c5-4d65-a7e3-fb914ef3a854 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:55:29.185274 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-14fd5193-d7c5-4d65-a7e3-fb914ef3a854 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012386 Oct 28 12:55:29.185779 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Oct 28 12:55:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:55:29.197064 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-f46da8f9-fbb4-4905-ad7e-d73f70592fe8 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:55:29.204933 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-f46da8f9-fbb4-4905-ad7e-d73f70592fe8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011377 Oct 28 12:55:29.205450 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Oct 28 12:55:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 12:55:29.217516 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-e99e797a-79a7-4efd-bb60-2b6c5dd93624 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:55:29.225369 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-e99e797a-79a7-4efd-bb60-2b6c5dd93624 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Oct 28 12:55:29.225884 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Oct 28 12:55:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 12:55:29.237842 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-648ff348-3195-4999-8b83-3667c0752026 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 12:55:29.245961 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-648ff348-3195-4999-8b83-3667c0752026 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011453 Oct 28 12:55:29.246536 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Oct 28 12:55:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:00:38.958322 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-e99e797a-79a7-4efd-bb60-2b6c5dd93624 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:00:38.959430 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-e99e797a-79a7-4efd-bb60-2b6c5dd93624 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Oct 28 13:00:38.959842 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 13:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:00:39.101751 n-d-862876-2 devstack@n-api.service[111547]: DEBUG dbcounter [-] [111547] Writing DB stats nova_api:SELECT=6 {{(pid=111547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:00:39.241023 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:00:39.245740 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:00:39.246239 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:00:39.246662 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:00:39.247391 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:00:39.247840 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:00:39.248254 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:00:39.286373 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-f1205a79-98cb-49ed-a0c7-63f01c473089 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.185844 Oct 28 13:00:39.286957 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 13:00:39 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:00:40.346199 n-d-862876-2 devstack@n-api.service[111548]: DEBUG nova.api.openstack.wsgi [None req-e99e797a-79a7-4efd-bb60-2b6c5dd93624 admin admin] Calling method '>' {{(pid=111548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:00:40.347240 n-d-862876-2 devstack@n-api.service[111548]: INFO nova.api.openstack.requestlog [None req-e99e797a-79a7-4efd-bb60-2b6c5dd93624 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 28 13:00:40.347636 n-d-862876-2 devstack@n-api.service[111548]: [pid: 111548|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Oct 28 13:00:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:00:40.537019 n-d-862876-2 devstack@n-api.service[111547]: DEBUG nova.api.openstack.wsgi [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] Calling method '>' {{(pid=111547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:00:40.540483 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:00:40.540962 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:00:40.541398 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:00:40.542109 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:00:40.542559 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:00:40.543009 n-d-862876-2 devstack@n-api.service[111547]: DEBUG oslo_concurrency.lockutils [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:00:40.566669 n-d-862876-2 devstack@n-api.service[111547]: INFO nova.api.openstack.requestlog [None req-542430aa-d4db-4f23-a265-3b3f8f029303 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079873 Oct 28 13:00:40.567241 n-d-862876-2 devstack@n-api.service[111547]: [pid: 111547|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 13:00:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:01:23.684685 n-d-862876-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 13:01:23.685454 n-d-862876-2 devstack@n-api.service[111546]: Fri Oct 28 13:01:23 2022 - graceful shutdown triggered... Oct 28 13:01:23.686405 n-d-862876-2 devstack@n-api.service[111547]: Gracefully killing worker 1 (pid: 111547)... Oct 28 13:01:23.687366 n-d-862876-2 devstack@n-api.service[111548]: Gracefully killing worker 2 (pid: 111548)... Oct 28 13:01:23.813685 n-d-862876-2 devstack@n-api.service[111548]: DEBUG dbcounter [-] [111548] Writing DB stats nova_api:SELECT=4 {{(pid=111548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:01:24.688935 n-d-862876-2 devstack@n-api.service[111546]: worker 1 buried after 1 seconds Oct 28 13:01:24.689376 n-d-862876-2 devstack@n-api.service[111546]: worker 2 buried after 1 seconds Oct 28 13:01:24.689376 n-d-862876-2 devstack@n-api.service[111546]: goodbye to uWSGI. Oct 28 13:01:24.690461 n-d-862876-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 28 13:01:24.691041 n-d-862876-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 13:01:24.693738 n-d-862876-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 13:01:24.705799 n-d-862876-2 devstack@n-api.service[127780]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 13:01:24 2022] *** Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: nodename: n-d-862876-2 Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: machine: x86_64 Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: clock source: unix Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: pcre jit disabled Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: detected number of CPU cores: 4 Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: current working directory: / Oct 28 13:01:24.728397 n-d-862876-2 devstack@n-api.service[127780]: detected binary path: /usr/bin/uwsgi-core Oct 28 13:01:24.729224 n-d-862876-2 devstack@n-api.service[127780]: your processes number limit is 47680 Oct 28 13:01:24.729224 n-d-862876-2 devstack@n-api.service[127780]: your memory page size is 4096 bytes Oct 28 13:01:24.729224 n-d-862876-2 devstack@n-api.service[127780]: detected max file descriptor number: 2048 Oct 28 13:01:24.729224 n-d-862876-2 devstack@n-api.service[127780]: lock engine: pthread robust mutexes Oct 28 13:01:24.729224 n-d-862876-2 devstack@n-api.service[127780]: thunder lock: enabled Oct 28 13:01:24.729224 n-d-862876-2 devstack@n-api.service[127780]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 13:01:24.729224 n-d-862876-2 devstack@n-api.service[127780]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 13:01:24.769435 n-d-862876-2 devstack@n-api.service[127780]: Python main interpreter initialized at 0x557371fd09c0 Oct 28 13:01:24.769435 n-d-862876-2 devstack@n-api.service[127780]: python threads support enabled Oct 28 13:01:24.769435 n-d-862876-2 devstack@n-api.service[127780]: your server socket listen backlog is limited to 100 connections Oct 28 13:01:24.769435 n-d-862876-2 devstack@n-api.service[127780]: your mercy for graceful operations on workers is 90 seconds Oct 28 13:01:24.769889 n-d-862876-2 devstack@n-api.service[127780]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 13:01:24.769889 n-d-862876-2 devstack@n-api.service[127780]: *** Operational MODE: preforking *** Oct 28 13:01:24.770145 n-d-862876-2 devstack@n-api.service[127780]: *** uWSGI is running in multiple interpreter mode *** Oct 28 13:01:24.770145 n-d-862876-2 devstack@n-api.service[127780]: spawned uWSGI master process (pid: 127780) Oct 28 13:01:24.770348 n-d-862876-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 13:01:24.770948 n-d-862876-2 devstack@n-api.service[127780]: spawned uWSGI worker 1 (pid: 127793, cores: 1) Oct 28 13:01:24.771462 n-d-862876-2 devstack@n-api.service[127780]: spawned uWSGI worker 2 (pid: 127794, cores: 1) Oct 28 13:01:24.771743 n-d-862876-2 devstack@n-api.service[127780]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 13:01:25.435993 n-d-862876-2 devstack@n-api.service[127793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 13:01:25.438291 n-d-862876-2 devstack@n-api.service[127794]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 13:01:26.688476 n-d-862876-2 devstack@n-api.service[127794]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 13:01:26.688476 n-d-862876-2 devstack@n-api.service[127794]: from cryptography.utils import int_from_bytes Oct 28 13:01:26.689179 n-d-862876-2 devstack@n-api.service[127793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 13:01:26.689179 n-d-862876-2 devstack@n-api.service[127793]: from cryptography.utils import int_from_bytes Oct 28 13:01:26.689179 n-d-862876-2 devstack@n-api.service[127793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 13:01:26.689179 n-d-862876-2 devstack@n-api.service[127793]: from cryptography.utils import int_from_bytes Oct 28 13:01:26.689762 n-d-862876-2 devstack@n-api.service[127794]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 13:01:26.689762 n-d-862876-2 devstack@n-api.service[127794]: from cryptography.utils import int_from_bytes Oct 28 13:01:29.145034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 13:01:29.145578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 13:01:29.145725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 13:01:29.146089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 13:01:29.146346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 13:01:29.146562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 13:01:29.146991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.147091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 13:01:29.147184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.147366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 13:01:29.147476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.147689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.147801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 13:01:29.147984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 13:01:29.148107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.148315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.148432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.148639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.148750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.148962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.149063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.149290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.149400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.149550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.149674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.149865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.149987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.150188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862876-2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.150318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.150509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.150621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.150839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.150948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.151151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.151250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.151467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.151563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.151774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.151883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862876-2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.152100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.152202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.152410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.152525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.152724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.152908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.154101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.154101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.154359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.154359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.155948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.156060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.156156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.156254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.156339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.156528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.156633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.156841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.157063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862876-2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.157192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.157355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.157477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.157666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.157768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.157980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.158073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.158388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.158537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862876-2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.158719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.158888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.159048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.159152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.159371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.159471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.159691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.159794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.159998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.160104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.160333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.160424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.160656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.160768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.160973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.161073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.161296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.161436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.161604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.161736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.161898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.162007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.162206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.162351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.162528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.162678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.162852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.162976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.163157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.163302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.163437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.163558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.163701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.163826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.164022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.164149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.164343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.164468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.164628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.164756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.164907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.165034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.165145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.165259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.165463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.165592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.165787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.165906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.166096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.166226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.166356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.166466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.166661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.168044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.168044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.168399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.168582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.168722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.168886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.169889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.170601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.170927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.171922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.172957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.173061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.173281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.173385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.173596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.173688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.173919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.174017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.174242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.174347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.174546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.174635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.174820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.174915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.175122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.175227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.175428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.175530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.175753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.175856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.176061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.176153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.176347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.176436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.176652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.176754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.176950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.177040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.177257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.177346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.177564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.177665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.177872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.177964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.178181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.178292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.178482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.178630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.178804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.178898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.179111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.179222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.179419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.179528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.179723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.179813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.180026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.180118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.180334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.180435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.180644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.180743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.180948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.181041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.181244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.181350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.181549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.181647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.181853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.181943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.182171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.182262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.182479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.182576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.182802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.182898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.183115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.183225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.183417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.183507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.183721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.183820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.184036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.184142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.184344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.184440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.184648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.184736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.184963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.185061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.185260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.185349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.185606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.185704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.185901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.186000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.186207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.186298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.186511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.186602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.186835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.186942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.187144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.187247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.187449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.187589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.187755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.187930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.188058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.188168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.188371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.188493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.188617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.188734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.188939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.189066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.189250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.189533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.189655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.189782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.189949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.190079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.190233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.190388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.190530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.190661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.190799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.190932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.191117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.191246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.191363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.191481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.191668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.191804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.191995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 13:01:29.192143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.192332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.192452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.192670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.192797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.192989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.193306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.193635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.193949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.194261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.194572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.194912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.195450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.195795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.196117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.196437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.196760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.197075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.197397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.197729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.198054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.198422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.198713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.199188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.199409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.199736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.200064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.200379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.200692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.201005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.201884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.202202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.202518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.203150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.203257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.203345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.203540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.203661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.203859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.203948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.204172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.204289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.204484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.204592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.204797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.204931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.205223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.205372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.205447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.205610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.205746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.205970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.206123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.206252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.206371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.206575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.206685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.206933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.207032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.207271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.207360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.207619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.207722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.207953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.208245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.208556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.208863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.209294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.209607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.209930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.210260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.210569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.210938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.211250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.211564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.211877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.212188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.212496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.212812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.213122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.213428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.213752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.214065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.214371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.214696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.214926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.215027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.215321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.215430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.215638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.215735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.215955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.216120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.216279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.216423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.216576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.216738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.216937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.217092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.217247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.217403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.217557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.217703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.217849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.218079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.218252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.218410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.218516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.218774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.218879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.219115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.219209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.219440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.219611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.219759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.219910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.220070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.220230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.220396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.220551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.220703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.220861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.221016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.221238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.221399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.221546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.221698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.221858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.222005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.222149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.222861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.223012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.223163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.223318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.223482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.223691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.223845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.223992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.224137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.224296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.224450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.224594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.224737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.224888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.225035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.225193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.225345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.225509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.225655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.225799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.225957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.226111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.226256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.226400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.226573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.226726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.227030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.227179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.227330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.227475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.227637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.227782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.227936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.228090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.228403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.228556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.228702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.228846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.229000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.229152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.229297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.229441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.229593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.229756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.229910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.230055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.230207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.230353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.230498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.230655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.230889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.231041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.231186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.231439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.231738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.231980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.232152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.232303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.233135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.233294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.233479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.233720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.233877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.234022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.234174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.234327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.234489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.234644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.234839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.235000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.235153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.235307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.235468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.235614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.235758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.235909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.236052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.236196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.236352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.236503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.236656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.236823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.236975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.237127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.237280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.237465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.237616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.237761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.237905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.238057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.238220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.238531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.238693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.238875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.239977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.240370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.240518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.240670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.240835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.241006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.241166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.241352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.241604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.241757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.241952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.242105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.242277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.242437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.242583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.242727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.242929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.243085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.243241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.243393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.243538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.243680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.243832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.243988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.244181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.244382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.244584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.244746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.244900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.245071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.245231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.245387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.245533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.245676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.245857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.246024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.246218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.246414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.246570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.246726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.246914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.247084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.247232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.247376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.247532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.247685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.247844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.247989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.248135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.248278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.248444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.248770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.248933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.249142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.249304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.249716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.249874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.250095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.250261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.250968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.251156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.251322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.251517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.251765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.251967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.252155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.252308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.252470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.252661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.252841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.252988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.253140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.253293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.253438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.253595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.253824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.254107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.254258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.254411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.254564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.254710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.254967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.255126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.255270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.255414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.255566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.255712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.255869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.256015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.256015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.256296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.256440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.256614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.256850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.257912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.258186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.258339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.258498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.258670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.258873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.259947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.260221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.260221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.260500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.260645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.260799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.260966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.261117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.261262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.261412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.261561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.261732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.261922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.262071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.262224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.262376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.262604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.262879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.263045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.263206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.263351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.263494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.263647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.264362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.264516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.264661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.264805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.264957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.265117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.265262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.265406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.265574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.265732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.265884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.266043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.266198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.266349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.266501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.266653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.266834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.266988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.267133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.267286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.267430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.267573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.267740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.267893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.268046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.268190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.268341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.268507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.268664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.268817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.268962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.269154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.269313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.269468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.269620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.269775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.269920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.270072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.270218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.270378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.270523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.270674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.270882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.271032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.271188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.271348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.271511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.271674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.271826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.271971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.272115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.272269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.272415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.272566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.272711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.272862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.273015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.273168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.273338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.273497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.273661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.273816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.273970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.274116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.274266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.274514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.274666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.274857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.275145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.275301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.275465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.275621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.275766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.275972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.276146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.276300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.276454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.276600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.276769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.276926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.277078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.277230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.277375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.277520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.277671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.277831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.278002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.278163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.278163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.278458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.278612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.278808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.280029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.280198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.280364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.280525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.280679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.280679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.280997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.281160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.281330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.281495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.281647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.281809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.281960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.282120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.282283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.282442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.282594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.282765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.282927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.283091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.283256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.283409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.283568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.283728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.283888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.284055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.284225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.284407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.284710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.284872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.285030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.285193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.285365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.285518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.285669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.285820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.285979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.286142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.286293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.286453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.286612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.286801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.286963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.287128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.287280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.287451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.287611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.287772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.287931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.288138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.288300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.288461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.288619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.288771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.288930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.289084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.289243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.289407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.289558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.289717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.289879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.290039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.290199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.290353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.290503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.290655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.290845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.291014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.291167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.291326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.291500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.291663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.291815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.291966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.292124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.292285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.292438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.292604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.292756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.292907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.293066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.293227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.293386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.293565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.293719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.293876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.294035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.294188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.294348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.294513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.294693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.294902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.295098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.295262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.295422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.295657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.295831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.295983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.296141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.296301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.296467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.296620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.296771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.296921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.297071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.297223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.297386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.297540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.297700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.297852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.298003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.298154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.298314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.298467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.298625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.298797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.298970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.299132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.299297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.299457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.299616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.299787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.299948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.300109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.300269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.300422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.300580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.300732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.300883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.301044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.301204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.301379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.301580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.301747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.301921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.302171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.302402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.302565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.302773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.303472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.303651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.303808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.304017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.304197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.304352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.304352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.304705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.304874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.305036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.305204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.305356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.305517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.305685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.305840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.305999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.306151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.306313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.306481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.306481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.306813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.306986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.307148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.307301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.307463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.307623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.307776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.307936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.308089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.308241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.308406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.308560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.308711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.308881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.309044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.309211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.309365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.309515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.309673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.309833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.309995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.310231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.310395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.310582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.310782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.310945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.311111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.311284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.311452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.311605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.311757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.311908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.312060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.312220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.312381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.312534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.312685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.312836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.312996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.313166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.313327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.313488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.313641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.313791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.313957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.314115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.314276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.314427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.314587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.314777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.314957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.315122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.315283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.315444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.315598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.315748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.315916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.316070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.316222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.316373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.316533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.316694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.316847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.316998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.317160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.317320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.317481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.317706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.317861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.318013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.318165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.318315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.318315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.318612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.318827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.319000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.319155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.319155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.319475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.319636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.319798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.319957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.320109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.320260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.320422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.320582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.320734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.320893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.321045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.321218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.321400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.321556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.321709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.321860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.322020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.322172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.322338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.322497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.322658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.322832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.323000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.323153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.323325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.323478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.323631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.323781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.323946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.324108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.324269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.324269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.324269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.324710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.324872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.325024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.325183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.325358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.325520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.325682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.325844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.326003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.326163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.326865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.327020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.327185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.327340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.327491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.327643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.327795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.327957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.328119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.328280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.328433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.328593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.328753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.328914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.329080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.329233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.329392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.329552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.329703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.329864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.330028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.330180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.330332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.330492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.330651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.330834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.330996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.331806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.332395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.332555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.332716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.332869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.332869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.333157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.333317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.333478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.333638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.333798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.333964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.334116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.334277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.334444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.334604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.334776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.334938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.335089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.335243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.335407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.335568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.335734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.335888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.336051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.336213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.336375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.336535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.336689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.336841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.337008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.337179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.337340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.337501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.337661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.337813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.337964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.338135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.338296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.338449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.338607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.338797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.338797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.339109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.339263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.339415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.339574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.339726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.339878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.340116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.340273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.340426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.340578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.340729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.340890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.341049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.341206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.341359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.341520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.341672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.341859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.342545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.342714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.342894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.343060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.343223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.343223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.343533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.343533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.343822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.343822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.344125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.344286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.344440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.344592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.344755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.344908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.345073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.345233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.345394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.345546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.345706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.345866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.346033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.346204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.346360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.346513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.346677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.346883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.347052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.347214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.347367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.347367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.347367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.347801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.347955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.348107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.348267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.348429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.348592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.348758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.348913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.349075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.349236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.349396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.349586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.349759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.349914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.350065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.350224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.350376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.350548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.350702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.350883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.351047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.351212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.351372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.351539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.351700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.351853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.351853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.352150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.352305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.352466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.352637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.352791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.352943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.353096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.353261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.353415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.353567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.353718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.353871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.354508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.355706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.356869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.357023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.357174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.357326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.357511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.357680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.357841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.357995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.358155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.358316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.358486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.358649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.358831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.358999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.359153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.359320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.359480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.359642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.359803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.359964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.360124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.360276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.360437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.360604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.360763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.360932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.361089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.361242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.361408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.361595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.361766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.361962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.362121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.362282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.362449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.362620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.362803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.362975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.363137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.363291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.363453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.363608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.363767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.363921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.364079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.364241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.364400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.364561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.364725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.364878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.365037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.365199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.365359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.365511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.365711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.365870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.366029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.366197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.366351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.366511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.366671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.366871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.366871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.367183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.367336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.367489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.367643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.367803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.367970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.368130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.368284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.368284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.368580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.368742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.368918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.369080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.369285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.369452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.369605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.369758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.369992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.370163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.370324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.370478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.370629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.370835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.371023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.371185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.371339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.371492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.371643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.371804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.371958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.372111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.372263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.372422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.372585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.372749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.372909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.373132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.373400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.373592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.373747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.373916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.374070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.374231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.374385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.374812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.374986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.374986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.375291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.375451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.375604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.375604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.375987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.376144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.376304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.376459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.376459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.376766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.376920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.377079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.377233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.377404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.377565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.377727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.377881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.378039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.378194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.378356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.378509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.378670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.378884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.379050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.379206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.379206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.379506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.379668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.379822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.379974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.380124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.380277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.380437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.380598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.380758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.380915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.380915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.381212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.381390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.381551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.381711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.381863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.382021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.382174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.382336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.382488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.382640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.382809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.382970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.383136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.383315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.383471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.383638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.383799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.383959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.384125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.384285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.384443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.384595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.384747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.384905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.385066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.385227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.385399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.385553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.385705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.385867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.386038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.386192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.386343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.386495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.386647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.386849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.387019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.387174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.387174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.387508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.387668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.387829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.387982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.388141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.388294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.388445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.388605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.389286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.389453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.389605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.389758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.389934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.390098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.390250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.390410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.390570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.390732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.390970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.391143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.391312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.391474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.391627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.391781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.391933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.392105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.392259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.392419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.392571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.392723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.392889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.393044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.393204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.393365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.393516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.393676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.393841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.394006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.394006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.394296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.394448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.394600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.394801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.394965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.395170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.395333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.395486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.395646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.395810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.395964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.396129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.396282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.396443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.396603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.396765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.396919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.397081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.397243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.397403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.397566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.397720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.397880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.398041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.398206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.398367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.398534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.398695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.398897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.399069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.399224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.399384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.399546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.399701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.399859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.400012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.400174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.400339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.400558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.400715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.400867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.401990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.402301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.402464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.402617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.402790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.402961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.403117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.403278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.403440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.403601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.403754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.403754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.404055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.404216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.404457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.404620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.404781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.404942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.405110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.405110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.405404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.405404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.405706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.405865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.406028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.406190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.406352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.406352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.406644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.406870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.407039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.407193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.407346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.407507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.407661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.407828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.407982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.408134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.408295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.408459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.408615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.408777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.408939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.409092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.409244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.409396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.409548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.409709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.409878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.410031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.410202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.410202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.410515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.410671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.410858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.411024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.411191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.411358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.411526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.411681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.411842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.411996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.412147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.412299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.412471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.412625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.412779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.412932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.413082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.413244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.413404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.413564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.413717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.413871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.414031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.415227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.416397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.417556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.418684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.418684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.418684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.418684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.418684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.419437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.419437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.419726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.419886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.420763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.421307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.421854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.422379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.423598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.423598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.423947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.424139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.424472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.424808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.425142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.425473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.425792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.426135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.426457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.426896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.427110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.427432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.427749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.428066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.428406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.428741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.429055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.429390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.429714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.430038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.430362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.430682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.431045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.431367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.431687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.432004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.432328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.432647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.432973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.432973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.434077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.434077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.434387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.434651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.435015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.435335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.435723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.436060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.436415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.436734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.437084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.437420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.437743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.438064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.438375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 13:01:29.438623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 13:01:29.470811 n-d-862876-2 devstack@n-api.service[127793]: INFO dbcounter [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Registered counter for database nova_api Oct 28 13:01:29.491561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_db.sqlalchemy.engines [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.498705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writer thread running {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:29.502933 n-d-862876-2 devstack@n-api.service[127794]: INFO dbcounter [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Registered counter for database nova_api Oct 28 13:01:29.523489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_db.sqlalchemy.engines [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.530092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writer thread running {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:29.556088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.context [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=127793) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 13:01:29.560106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:01:29.560605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:01:29.562703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:01:29.563437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:01:29.563883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:01:29.565874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:01:29.567902 n-d-862876-2 devstack@n-api.service[127793]: INFO dbcounter [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Registered counter for database nova_cell0 Oct 28 13:01:29.571929 n-d-862876-2 devstack@n-api.service[127793]: INFO dbcounter [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Registered counter for database nova_cell1 Oct 28 13:01:29.581553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_db.sqlalchemy.engines [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.583276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_db.sqlalchemy.engines [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.587402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.context [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=127794) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 13:01:29.589689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writer thread running {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:29.590976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writer thread running {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:29.591645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:01:29.592672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:01:29.594267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:01:29.595009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:01:29.595458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:01:29.597483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:01:29.599548 n-d-862876-2 devstack@n-api.service[127794]: INFO dbcounter [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Registered counter for database nova_cell0 Oct 28 13:01:29.603689 n-d-862876-2 devstack@n-api.service[127794]: INFO dbcounter [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Registered counter for database nova_cell1 Oct 28 13:01:29.613106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_db.sqlalchemy.engines [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.613875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_db.sqlalchemy.engines [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.621852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writer thread running {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:29.622202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writer thread running {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:29.739925 n-d-862876-2 devstack@n-api.service[127793]: INFO dbcounter [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Registered counter for database nova_cell0 Oct 28 13:01:29.746614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_db.sqlalchemy.engines [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.752063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writer thread running {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:29.767969 n-d-862876-2 devstack@n-api.service[127794]: INFO dbcounter [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Registered counter for database nova_cell0 Oct 28 13:01:29.775172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_db.sqlalchemy.engines [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 13:01:29.779951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writer thread running {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 13:01:30.070964 n-d-862876-2 devstack@n-api.service[127793]: WARNING keystonemiddleware.auth_token [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 13:01:30.078583 n-d-862876-2 devstack@n-api.service[127793]: WARNING keystonemiddleware.auth_token [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 13:01:30.098181 n-d-862876-2 devstack@n-api.service[127794]: WARNING keystonemiddleware.auth_token [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 13:01:30.105399 n-d-862876-2 devstack@n-api.service[127794]: WARNING keystonemiddleware.auth_token [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 13:01:30.425346 n-d-862876-2 devstack@n-api.service[127793]: WARNING keystonemiddleware.auth_token [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 13:01:30.431244 n-d-862876-2 devstack@n-api.service[127793]: WARNING keystonemiddleware.auth_token [None req-af45456d-e3e2-40fb-8b6a-3510510ff36c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 13:01:30.436561 n-d-862876-2 devstack@n-api.service[127793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557371fd09c0 pid: 127793 (default app) Oct 28 13:01:30.452553 n-d-862876-2 devstack@n-api.service[127794]: WARNING keystonemiddleware.auth_token [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 13:01:30.458541 n-d-862876-2 devstack@n-api.service[127794]: WARNING keystonemiddleware.auth_token [None req-a14014b1-8632-4185-9fe0-496306a5fb69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 13:01:30.463876 n-d-862876-2 devstack@n-api.service[127794]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557371fd09c0 pid: 127794 (default app) Oct 28 13:02:12.281555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:12.282693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:12.283171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:12.283890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:13.056060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:13.056060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:13.056060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:13.056060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:13.784855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f72494b0-05ff-4435-8dc3-b294abb5c1da tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-461064198", "ram": 512, "vcpus": 1, "disk": 10, "id": 1753328295, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:13.912116 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f72494b0-05ff-4435-8dc3-b294abb5c1da tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.635698 Oct 28 13:02:13.912723 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:12 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:14.197901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:14.202659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.215740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.215740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.215740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.216353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.216353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.245877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9d5aaca4-71cd-447e-84a2-06d891aa4775 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.289208 Oct 28 13:02:14.256774 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:02:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:14.292790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-05838867-81f8-4754-9f3b-b8d7fe1ce607 tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1215745050", "id": 1047271847, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:14.380830 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-05838867-81f8-4754-9f3b-b8d7fe1ce607 tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.457947 Oct 28 13:02:14.381420 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2/3] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:02:13 2022] POST /compute/v2.1/flavors => generated 449 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:14.458429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Calling method '.version_select at 0x7f27bb0af700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:14.464893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=127794) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 13:02:14.467104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.467104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.467104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.493484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.493971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.494403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.507283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.507762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.508188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.514395 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9e13f15d-5301-4289-8063-9f5381a1b535 tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.266536 Oct 28 13:02:14.515269 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2/4] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:02:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:14.519308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2999ef66-27ae-46a9-82ef-b07cab8aab86 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:14.609164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '.version_select at 0x7f27bb0b5dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:14.616940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=127793) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 13:02:14.617654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.618239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.618614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.646468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.647052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.653468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.657011 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2999ef66-27ae-46a9-82ef-b07cab8aab86 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1753328295/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.141021 Oct 28 13:02:14.657802 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3/5] 10.222.0.25 () {60 vars in 1224 bytes} [Fri Oct 28 13:02:14 2022] POST /compute/v2.1/flavors/1753328295/os-extra_specs => generated 66 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:14.662899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.662899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.662899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.668801 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e6c4912-b83d-4cf5-bc5b-d5a5b10f656c tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.286300 Oct 28 13:02:14.669428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Oct 28 13:02:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:14.673883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a4bd945-01c4-41e4-a5e9-b5eb3caaba4d tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-812716186"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:14.677302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-7a4bd945-01c4-41e4-a5e9-b5eb3caaba4d tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid 1cd3c09f-62f1-4c95-9322-206a126dd775 for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:14.834040 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7a4bd945-01c4-41e4-a5e9-b5eb3caaba4d tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.163579 Oct 28 13:02:14.835661 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4/7] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:14 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:14.951551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c23e87c7-f9a3-43e6-946a-b42f62c21bdb tempest-AZAdminNegativeTestJSON-680809975 tempest-AZAdminNegativeTestJSON-680809975-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:14.953056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c23e87c7-f9a3-43e6-946a-b42f62c21bdb tempest-AZAdminNegativeTestJSON-680809975 tempest-AZAdminNegativeTestJSON-680809975-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e91f2bc73a8a481d87f7440c81f85779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f9d81b7c034539904a9e7b96e75a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c23e87c7-f9a3-43e6-946a-b42f62c21bdb tempest-AZAdminNegativeTestJSON-680809975 tempest-AZAdminNegativeTestJSON-680809975-project] Request method failure captured: Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LTLDydN_ddSXKp2w3GB9Ekg81FtCQPs9MpCFAEifQ1e9jt5hdZS_mZ5vl8DYQe6-Afy2MYna0cgSzjPLT9DuQT6wOtAfv9NQ7yNXAPzIAMwFtTV5deD5LKxnwFNG93qQ3pMeJ5A6tyky810c-y4wo5UZZZmF363_SK30BLYIvAITM Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 95f9d81b7c034539904a9e7b96e75a76 Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AZAdminNegativeTestJSON-680809975 Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:14.956663 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95f9d81b7c034539904a9e7b96e75a76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95f9d81b7c034539904a9e7b96e75a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95f9d81b7c034539904a9e7b96e75a76", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95f9d81b7c034539904a9e7b96e75a76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AZAdminNegativeTestJSON-680809975 Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 95f9d81b7c034539904a9e7b96e75a76 Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-680809975 Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AZAdminNegativeTestJSON-680809975-project Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e91f2bc73a8a481d87f7440c81f85779 Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AZAdminNegativeTestJSON-680809975-project Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 13:02:14.957906 n-d-862876-2 devstack@n-api.service[127794]: action_args: {} Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:14.958689 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:14.959639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c23e87c7-f9a3-43e6-946a-b42f62c21bdb tempest-AZAdminNegativeTestJSON-680809975 tempest-AZAdminNegativeTestJSON-680809975-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:14.960419 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c23e87c7-f9a3-43e6-946a-b42f62c21bdb tempest-AZAdminNegativeTestJSON-680809975 tempest-AZAdminNegativeTestJSON-680809975-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.298106 Oct 28 13:02:14.960419 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Oct 28 13:02:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:14.966627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Calling method '.version_select at 0x7f27bbb94f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:14.969766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.970250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.970685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.988078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:14.988680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:14.989170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:14.995518 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87d5dc58-fbdc-4b7f-9792-61e9f4a8af5d tempest-HypervisorAdminV228Test-1224267883 tempest-HypervisorAdminV228Test-1224267883-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.035524 Oct 28 13:02:14.996155 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 5/9] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 13:02:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:15.096306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f71b940a-e836-4aaf-be04-36e71b55dca7 tempest-FlavorsV255TestJSON-2044513286 tempest-FlavorsV255TestJSON-2044513286-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:15.117691 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f71b940a-e836-4aaf-be04-36e71b55dca7 tempest-FlavorsV255TestJSON-2044513286 tempest-FlavorsV255TestJSON-2044513286-project] 10.222.0.25 "GET /compute/v2.1/flavors/1047271847" status: 200 len: 449 microversion: 2.55 time: 0.280803 Oct 28 13:02:15.118439 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 5/10] 10.222.0.25 () {60 vars in 1199 bytes} [Fri Oct 28 13:02:14 2022] GET /compute/v2.1/flavors/1047271847 => generated 449 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:15.124115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-39aa0dca-7ac2-4bce-894d-c1af829d081c tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:15.140007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39aa0dca-7ac2-4bce-894d-c1af829d081c tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:15.140411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39aa0dca-7ac2-4bce-894d-c1af829d081c tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:15.140997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39aa0dca-7ac2-4bce-894d-c1af829d081c tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:15.223266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4cd1f2d0-fb99-4ac6-b305-a1f0cea199fd tempest-FlavorsExtraSpecsTestJSON-627385898 tempest-FlavorsExtraSpecsTestJSON-627385898-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:15.241554 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4cd1f2d0-fb99-4ac6-b305-a1f0cea199fd tempest-FlavorsExtraSpecsTestJSON-627385898 tempest-FlavorsExtraSpecsTestJSON-627385898-project] 10.222.0.25 "GET /compute/v2.1/flavors/1753328295/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.244146 Oct 28 13:02:15.245642 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1203 bytes} [Fri Oct 28 13:02:14 2022] GET /compute/v2.1/flavors/1753328295/os-extra_specs => generated 66 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:15.768753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-374d4051-4130-432d-a874-96a57d1f4675 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1939516393", "id": 1355737965, "os-flavor-access:is_public": "False"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:15.907811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-374d4051-4130-432d-a874-96a57d1f4675 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.664334 Oct 28 13:02:15.908476 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 7/12] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:15 2022] POST /compute/v2.1/flavors => generated 439 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:15.913132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d464a71-0bb3-46c1-9dd6-7c90a30a713b tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] Action: 'update', calling method: .version_select at 0x7f27bb5b0c10>, body: {"flavor": {"description": "new"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:16.014174 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d464a71-0bb3-46c1-9dd6-7c90a30a713b tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1047271847" status: 200 len: 450 microversion: 2.55 time: 0.103278 Oct 28 13:02:16.016098 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 8/13] 10.222.0.25 () {62 vars in 1219 bytes} [Fri Oct 28 13:02:15 2022] PUT /compute/v2.1/flavors/1047271847 => generated 450 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:16.022040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-965eea61-b9ef-476a-9765-be04adc3f28c tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:16.054549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-965eea61-b9ef-476a-9765-be04adc3f28c tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1753328295/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037282 Oct 28 13:02:16.060044 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 9/14] 10.222.0.25 () {60 vars in 1224 bytes} [Fri Oct 28 13:02:16 2022] POST /compute/v2.1/flavors/1753328295/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:16.063812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a622739-f934-4653-86bc-cda9a198af1b tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:16.254909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-39aa0dca-7ac2-4bce-894d-c1af829d081c tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.135114 Oct 28 13:02:16.255657 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 6/15] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:15 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:16.263050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-840e3294-eac5-4f74-b99a-b8253bbff1c2 tempest-FlavorsV255TestJSON-2044513286 tempest-FlavorsV255TestJSON-2044513286-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:16.301152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-840e3294-eac5-4f74-b99a-b8253bbff1c2 tempest-FlavorsV255TestJSON-2044513286 tempest-FlavorsV255TestJSON-2044513286-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.043754 Oct 28 13:02:16.301936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 7/16] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:02:16 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:02:16.308817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf55b40a-4906-4381-a263-285428f989de tempest-FlavorsExtraSpecsTestJSON-627385898 tempest-FlavorsExtraSpecsTestJSON-627385898-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:16.316786 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf55b40a-4906-4381-a263-285428f989de tempest-FlavorsExtraSpecsTestJSON-627385898 tempest-FlavorsExtraSpecsTestJSON-627385898-project] 10.222.0.25 "GET /compute/v2.1/flavors/1753328295/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.013548 Oct 28 13:02:16.317806 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 8/17] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:02:16 2022] GET /compute/v2.1/flavors/1753328295/os-extra_specs/hw:numa_nodes => generated 22 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:16.322855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:16.337318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:16.338103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:16.338716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:16.426765 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-862876-2. Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 39 Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:16.445236 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: {"add_host": {"host": "n-h2-862876-2"}} Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:16.446267 n-d-862876-2 devstack@n-api.service[127793]: exception: Aggregate 1 already has host n-h2-862876-2. Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-862876-2'}}} Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result.read() Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 13:02:16.447011 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-862876-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 13:02:16.447870 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 13:02:16.448742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 13:02:16.449558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result.read() Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-862876-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 13, 2, 16, 358030), 'updated_at': None, 'host': 'n-h2-862876-2', 'aggregate_id': 1}] Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.451076 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-862876-2. Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.451837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-862876-2. Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:16.452809 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:16.453761 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-862876-2. Oct 28 13:02:16.453761 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.457988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a622739-f934-4653-86bc-cda9a198af1b tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1355737965/action" status: 200 len: 97 microversion: 2.1 time: 0.401372 Oct 28 13:02:16.460909 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 10/18] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:16 2022] POST /compute/v2.1/flavors/1355737965/action => generated 97 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:16.461390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-862876-2. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:16.462419 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e8b4ade5-2dae-4603-83ec-3db0198bee27 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.143370 Oct 28 13:02:16.463262 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 9/19] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:16 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 28 13:02:16.465770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b832d5b1-a526-4afb-af62-ece7c067992e tempest-FlavorsV255TestJSON-2044513286 tempest-FlavorsV255TestJSON-2044513286-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:16.472123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c240ba6-b4de-4197-b909-470973ee7137 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:16.508060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b832d5b1-a526-4afb-af62-ece7c067992e tempest-FlavorsV255TestJSON-2044513286 tempest-FlavorsV255TestJSON-2044513286-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3409 microversion: 2.55 time: 0.048069 Oct 28 13:02:16.510475 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c240ba6-b4de-4197-b909-470973ee7137 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1753328295/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044449 Oct 28 13:02:16.511133 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1224 bytes} [Fri Oct 28 13:02:16 2022] POST /compute/v2.1/flavors/1753328295/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:16.515277 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 11/21] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Oct 28 13:02:16 2022] GET /compute/v2.1/flavors => generated 3409 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:02:16.516290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b002f4bd-7d8e-49de-a05a-09116600d718 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:16.522956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6727ccf-f464-494c-b748-054f678b9ace tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:16.555030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6727ccf-f464-494c-b748-054f678b9ace tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:16.555705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6727ccf-f464-494c-b748-054f678b9ace tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:16.556139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6727ccf-f464-494c-b748-054f678b9ace tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:16.819818 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-b002f4bd-7d8e-49de-a05a-09116600d718 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 9930429925cb43449ad9ffecf77878b1 combination. Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b002f4bd-7d8e-49de-a05a-09116600d718 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Request method failure captured: Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/flavors/1355737965/action HTTP/1.1 Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 67 Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LV8-007Ak25SD_JBkfLk1fFIsIJWB0wD1GYmkgwR55i2soEBv0HCU-I-QEY1Bdq_K7YXzb91otmQz7M6etmEnVCdJQMZrAXq2Cjh2fHakhlzDeUGAxLFiPL572ZqIfa0lLq3P_yblBywsGTTYr8k82T7-33TASGQPRQ8qOxK6JxLE Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 4cb0552e34664b6e97ef105421fdb6b2 Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:16.825850 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cb0552e34664b6e97ef105421fdb6b2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 4cb0552e34664b6e97ef105421fdb6b2 Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4fc519e3a99a4f76843fa636436d6213 Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: {"addTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} Oct 28 13:02:16.827027 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor access already exists for flavor 17 and project 9930429925cb43449ad9ffecf77878b1 combination. Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1355737965', 'body': {'addTenantAccess': {'tenant': '9930429925cb43449ad9ffecf77878b1'}}} Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result.read() Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 13:02:16.827739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-9930429925cb43449ad9ffecf77878b1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 13:02:16.828556 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 13:02:16.829529 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 13:02:16.830652 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result.read() Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-9930429925cb43449ad9ffecf77878b1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 13, 2, 16, 738051), 'updated_at': None, 'flavor_id': 17, 'project_id': '9930429925cb43449ad9ffecf77878b1'}] Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:16.831819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 9930429925cb43449ad9ffecf77878b1 combination. Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:16.833480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 9930429925cb43449ad9ffecf77878b1 combination. Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:16.835483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:16.839364 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 9930429925cb43449ad9ffecf77878b1 combination. Oct 28 13:02:16.839364 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:16.839364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b002f4bd-7d8e-49de-a05a-09116600d718 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 9930429925cb43449ad9ffecf77878b1 combination. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:16.839364 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b002f4bd-7d8e-49de-a05a-09116600d718 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1355737965/action" status: 409 len: 152 microversion: 2.1 time: 0.316036 Oct 28 13:02:16.839364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 11/22] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:16 2022] POST /compute/v2.1/flavors/1355737965/action => generated 152 bytes in 317 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:02:16.839364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-08869a92-6cc5-4348-b54f-d5293e220fb9 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:16.847799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-08869a92-6cc5-4348-b54f-d5293e220fb9 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1753328295/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017567 Oct 28 13:02:16.848192 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1203 bytes} [Fri Oct 28 13:02:16 2022] GET /compute/v2.1/flavors/1753328295/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:16.855814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-738538cf-8d5c-4687-8c71-f2f81c2602ea tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:16.997735 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-738538cf-8d5c-4687-8c71-f2f81c2602ea tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1047271847" status: 202 len: 0 microversion: 2.55 time: 0.145757 Oct 28 13:02:16.998462 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 13/24] 10.222.0.25 () {60 vars in 1202 bytes} [Fri Oct 28 13:02:16 2022] DELETE /compute/v2.1/flavors/1047271847 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:02:17.004030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e1445d4-8abc-4a28-ae44-dd80e498e689 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:17.592593 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6727ccf-f464-494c-b748-054f678b9ace tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 1.075842 Oct 28 13:02:17.593230 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 12/25] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:16 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:17.598359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59a8ef4b-1d28-41c5-a8f8-a6c3fe787134 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:17.717270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59a8ef4b-1d28-41c5-a8f8-a6c3fe787134 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1753328295/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.122731 Oct 28 13:02:17.726249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 13/26] 10.222.0.25 () {60 vars in 1265 bytes} [Fri Oct 28 13:02:17 2022] PUT /compute/v2.1/flavors/1753328295/os-extra_specs/hw:numa_nodes => generated 22 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:17.726249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f60d9ddc-8874-458b-9526-a12d3ca9f987 tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:17.753418 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f60d9ddc-8874-458b-9526-a12d3ca9f987 tempest-FlavorsV255TestJSON-1876971706 tempest-FlavorsV255TestJSON-1876971706-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5711 microversion: 2.55 time: 0.034144 Oct 28 13:02:17.754471 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 14/27] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:02:17 2022] GET /compute/v2.1/flavors/detail => generated 5711 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:02:17.765420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-850aace7-9a3b-4bec-9cfb-1d7083750008 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:17.865167 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-850aace7-9a3b-4bec-9cfb-1d7083750008 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.109308 Oct 28 13:02:17.865849 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:17 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:17.876316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50e33685-7d42-4975-b05d-ba51cf1490fe tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:17.885601 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50e33685-7d42-4975-b05d-ba51cf1490fe tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1753328295/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013958 Oct 28 13:02:17.886680 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1203 bytes} [Fri Oct 28 13:02:17 2022] GET /compute/v2.1/flavors/1753328295/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:17.891509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82c32515-ea86-4243-a5b9-98e066071cb8 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-634276800"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:17.895469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-82c32515-ea86-4243-a5b9-98e066071cb8 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid 611c2a91-20a6-469c-a1c6-8a73de605a17 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:17.995667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-82c32515-ea86-4243-a5b9-98e066071cb8 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.107719 Oct 28 13:02:17.996280 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 17/30] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:17 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:18.003590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26498d40-dee1-4dc2-84db-c924e8bc7a48 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.087927 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e1445d4-8abc-4a28-ae44-dd80e498e689 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1355737965/action" status: 200 len: 21 microversion: 2.1 time: 1.087826 Oct 28 13:02:18.088525 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 14/31] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:16 2022] POST /compute/v2.1/flavors/1355737965/action => generated 21 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:18.129795 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26498d40-dee1-4dc2-84db-c924e8bc7a48 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1753328295/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.129837 Oct 28 13:02:18.130381 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 18/32] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:02:17 2022] DELETE /compute/v2.1/flavors/1753328295/os-extra_specs/hw:numa_nodes => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:18.136905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa56fe6f-e009-437a-b996-4d21adca8c33 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-565993926", "name": "tempest-test_aggregate-2022801033"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:18.157902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-fa56fe6f-e009-437a-b996-4d21adca8c33 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid dc6a4557-e1d6-43df-b8e2-7c8fa20d7f5d for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:18.164376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=74,nova_api:SAVEPOINT=7,nova_api:INSERT=6,nova_api:RELEASE=7,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:18.229472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-916421d9-8db2-4f3f-b9e5-e66890a16197 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-292354093", "id": 214447332, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:18.282027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa56fe6f-e009-437a-b996-4d21adca8c33 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.149349 Oct 28 13:02:18.282644 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 19/33] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Oct 28 13:02:18 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:18.323218 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-916421d9-8db2-4f3f-b9e5-e66890a16197 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.228710 Oct 28 13:02:18.323218 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 15/34] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:18 2022] POST /compute/v2.1/flavors => generated 426 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:18.324176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3a700de-4d2b-4d6a-9a96-620c0ab40033 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.478470 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3a700de-4d2b-4d6a-9a96-620c0ab40033 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1355737965" status: 202 len: 0 microversion: 2.1 time: 0.158039 Oct 28 13:02:18.479110 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 16/35] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:18 2022] DELETE /compute/v2.1/flavors/1355737965 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:18.484462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ecdc5fc6-0208-446f-968d-35ee689d50dd tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.643970 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ecdc5fc6-0208-446f-968d-35ee689d50dd tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1753328295/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.163573 Oct 28 13:02:18.644546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 17/36] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:02:18 2022] DELETE /compute/v2.1/flavors/1753328295/os-extra_specs/hw:cpu_policy => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:18.649800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a361a75f-8819-4718-bc73-fe1ece213bcd tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.664169 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a361a75f-8819-4718-bc73-fe1ece213bcd tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.018083 Oct 28 13:02:18.670681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a13cd9b4-1ee6-4311-834d-c7382b654798 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:18.673352 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 18/37] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:02:18 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:18.674338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a13cd9b4-1ee6-4311-834d-c7382b654798 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2235b4efc93d4c3097e8ca16f93c8583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91f1adb201f4632aedda480bfb74296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a13cd9b4-1ee6-4311-834d-c7382b654798 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Request method failure captured: Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 39 Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LRiW68wPiNfs_1PDJiJMNKsZ7xjKWmeDBCOYHcV3H1db0CQwSNlXe7T8UdUKM1Yt-_AVZzw5qu02dcaOVXWoJBrYEzHJSema2sQY85tEjnH-lqp9z8bpobuaprs72UUA6fucIen88e6nsJEdueC4S09i5QMxli1IB1h5NPLFioPv0 Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:18.676662 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e91f1adb201f4632aedda480bfb74296", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2235b4efc93d4c3097e8ca16f93c8583 Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: {"add_host": {"host": "n-h2-862876-2"}} Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:18.687951 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-862876-2'}}} Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:18.688587 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 13:02:18.690309 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:18.691224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a13cd9b4-1ee6-4311-834d-c7382b654798 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:18.691288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48ef06ea-799e-4420-b915-3e700820028e tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.691364 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a13cd9b4-1ee6-4311-834d-c7382b654798 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.394935 Oct 28 13:02:18.691364 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 20/38] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:18 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 396 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:18.691364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-19ddc708-7975-4e1c-9815-6931495b9a73 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.713664 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-19ddc708-7975-4e1c-9815-6931495b9a73 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.032992 Oct 28 13:02:18.714567 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 21/39] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:18 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:18.719901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49b5e6a4-0913-43ca-8133-ccb13443fc2d tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.728155 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49b5e6a4-0913-43ca-8133-ccb13443fc2d tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1753328295/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012138 Oct 28 13:02:18.735681 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 22/40] 10.222.0.25 () {58 vars in 1203 bytes} [Fri Oct 28 13:02:18 2022] GET /compute/v2.1/flavors/1753328295/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:18.741008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b897e0bb-9564-459e-9e6e-69e78546b90f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:18.753398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b897e0bb-9564-459e-9e6e-69e78546b90f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:18.753894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b897e0bb-9564-459e-9e6e-69e78546b90f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:18.754335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b897e0bb-9564-459e-9e6e-69e78546b90f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:18.821550 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48ef06ea-799e-4420-b915-3e700820028e tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/214447332" status: 202 len: 0 microversion: 2.1 time: 0.147000 Oct 28 13:02:18.822323 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 19/41] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:02:18 2022] DELETE /compute/v2.1/flavors/214447332 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:18.828171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bfc56c7-e049-4fa4-84fa-978796e9de4c tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:18.937797 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bfc56c7-e049-4fa4-84fa-978796e9de4c tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.114037 Oct 28 13:02:18.941996 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:18 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:18.948739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-478478cf-67d6-41dc-ad7c-3be678b5e7ce tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-948187823", "id": 1246763619, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:18.958938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=13 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:19.083325 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-478478cf-67d6-41dc-ad7c-3be678b5e7ce tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.140223 Oct 28 13:02:19.083925 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 21/43] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:18 2022] POST /compute/v2.1/flavors => generated 437 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:19.088397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35f86052-55b3-415e-9f59-1dd59b54ad43 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.139624 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b897e0bb-9564-459e-9e6e-69e78546b90f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.1 time: 0.402610 Oct 28 13:02:19.140205 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:19.157749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-890510d3-c5cb-41dc-b4c5-ce8fc4fc5c7d tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.180840 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-890510d3-c5cb-41dc-b4c5-ce8fc4fc5c7d tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5823 microversion: 2.1 time: 0.026552 Oct 28 13:02:19.181749 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 24/45] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:19 2022] GET /compute/v2.1/flavors/detail => generated 5823 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:19.194653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab0dbf8e-01e1-42c7-a228-797c7a76a0ba tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1105161501"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:19.198282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-ab0dbf8e-01e1-42c7-a228-797c7a76a0ba tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid ae1dcd2a-5b3b-41fa-aaff-24ced7803704 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:19.220417 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35f86052-55b3-415e-9f59-1dd59b54ad43 tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1753328295" status: 202 len: 0 microversion: 2.1 time: 0.135427 Oct 28 13:02:19.221229 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 22/46] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:19 2022] DELETE /compute/v2.1/flavors/1753328295 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:19.226010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c47e7874-2193-489a-8261-082326899993 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.236736 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-c47e7874-2193-489a-8261-082326899993 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c47e7874-2193-489a-8261-082326899993 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Request method failure captured: Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/flavors/1246763619/os-flavor-access HTTP/1.1 Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LV8-007Ak25SD_JBkfLk1fFIsIJWB0wD1GYmkgwR55i2soEBv0HCU-I-QEY1Bdq_K7YXzb91otmQz7M6etmEnVCdJQMZrAXq2Cjh2fHakhlzDeUGAxLFiPL572ZqIfa0lLq3P_yblBywsGTTYr8k82T7-33TASGQPRQ8qOxK6JxLE Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 4cb0552e34664b6e97ef105421fdb6b2 Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:19.238378 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cb0552e34664b6e97ef105421fdb6b2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 4cb0552e34664b6e97ef105421fdb6b2 Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4fc519e3a99a4f76843fa636436d6213 Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: exception: Access list not available for public flavors. Oct 28 13:02:19.239462 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'flavor_id': '1246763619'} Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 28 13:02:19.240131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.243413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c47e7874-2193-489a-8261-082326899993 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:19.244629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c47e7874-2193-489a-8261-082326899993 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1246763619/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022210 Oct 28 13:02:19.245727 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 23/47] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Oct 28 13:02:19 2022] GET /compute/v2.1/flavors/1246763619/os-flavor-access => generated 91 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:02:19.253568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c45ca948-d6dd-4797-af20-1f8c6a0f7535 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1179535640", "id": 1369003981, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:19.295580 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab0dbf8e-01e1-42c7-a228-797c7a76a0ba tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.112777 Oct 28 13:02:19.296617 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 25/48] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:19.301745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d67b20b3-9af0-46c5-8665-b02dd1739dac tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.323481 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d67b20b3-9af0-46c5-8665-b02dd1739dac tempest-FlavorsExtraSpecsTestJSON-575818840 tempest-FlavorsExtraSpecsTestJSON-575818840-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5418 microversion: 2.1 time: 0.025487 Oct 28 13:02:19.324099 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 26/49] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:19 2022] GET /compute/v2.1/flavors/detail => generated 5418 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:19.328468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-682eee92-0ef1-4c00-a8f3-38127112b876 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.359048 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c45ca948-d6dd-4797-af20-1f8c6a0f7535 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.111934 Oct 28 13:02:19.368519 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 24/50] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:19 2022] POST /compute/v2.1/flavors => generated 417 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:19.374890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1413544039"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:19.386677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:19.387349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:19.387888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:19.399996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:19.399996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:19.399996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:19.407941 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1413544039 could not be found. Oct 28 13:02:19.411095 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-682eee92-0ef1-4c00-a8f3-38127112b876 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1246763619" status: 202 len: 0 microversion: 2.1 time: 0.084861 Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 58 Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:19.411227 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: {"add_host": {"host": "tempest-nonexist_host-1413544039"}} Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:19.412249 n-d-862876-2 devstack@n-api.service[127793]: exception: Compute host tempest-nonexist_host-1413544039 could not be found. Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1413544039'}}} Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1413544039' is not mapped to any cell Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.412896 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 28 13:02:19.413860 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1413544039 could not be found. Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1413544039 could not be found. Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:19.414844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1413544039 could not be found. Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1413544039 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86dba8af-6db4-4923-9b43-84a8fafe0d9a tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.042783 Oct 28 13:02:19.415812 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:19 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:19.416307 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 27/52] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:19 2022] DELETE /compute/v2.1/flavors/1246763619 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:19.422347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad9d4461-7655-431e-913b-7e00b94c6b48 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.444077 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad9d4461-7655-431e-913b-7e00b94c6b48 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.026646 Oct 28 13:02:19.444819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 28/53] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:19 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:19.449466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c9d497a-8c48-46f7-b968-b1618696dcf8 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.470704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c9d497a-8c48-46f7-b968-b1618696dcf8 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.024739 Oct 28 13:02:19.471302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 29/54] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:19 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:19.478285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86771921-09cf-4132-90ad-4c7fb2708cde tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.561695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86771921-09cf-4132-90ad-4c7fb2708cde tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.089274 Oct 28 13:02:19.562283 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 30/55] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:19 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:19.567494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f2f6ce4d-6c95-4175-b03e-108218da963c tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.672051 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f2f6ce4d-6c95-4175-b03e-108218da963c tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1369003981" status: 202 len: 0 microversion: 2.1 time: 0.107933 Oct 28 13:02:19.676109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 31/56] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:19 2022] DELETE /compute/v2.1/flavors/1369003981 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:19.677537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-efd69511-4633-487a-9091-e6dca8ce7768 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1805833545", "id": 1422202486, "os-flavor-access:is_public": "False"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:19.797552 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-efd69511-4633-487a-9091-e6dca8ce7768 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.123545 Oct 28 13:02:19.798158 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 32/57] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:19 2022] POST /compute/v2.1/flavors => generated 439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:19.809919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3c780b6-4e95-470e-8f2f-a03c047ea518 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3c780b6-4e95-470e-8f2f-a03c047ea518 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 283 Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:02:19.814594 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:19.815762 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:02:19.816234 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:19.816715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:19.817501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:19.818355 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:02:19.818355 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:02:19.818355 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:02:19.818355 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:19.818355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3c780b6-4e95-470e-8f2f-a03c047ea518 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:19.818651 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e3c780b6-4e95-470e-8f2f-a03c047ea518 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016911 Oct 28 13:02:19.818651 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 33/58] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Oct 28 13:02:19 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:02:19.821659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f14010a9-032c-480b-a2f6-e1d550873161 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:19.841682 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f14010a9-032c-480b-a2f6-e1d550873161 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024186 Oct 28 13:02:19.842282 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 34/59] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:20.030555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-449631722", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "availability_zone": "tempest-test_az-565993926"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.042604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:20.043120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:20.043556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:20.044517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:20.044975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:20.045400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:20.126397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2748737f-50ea-4985-bc24-a9b4a2839c52 tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.129592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2748737f-50ea-4985-bc24-a9b4a2839c52 tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '34d499e2871b426a83fa0d43ce3053d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930429925cb43449ad9ffecf77878b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2748737f-50ea-4985-bc24-a9b4a2839c52 tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Request method failure captured: Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/flavors/1422202486/action HTTP/1.1 Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 67 Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LSm_URFDQR-XLwXFB1fo5OL6qeCcYQXK3F2T1spCXiGBfypQkc_2njB5lsieUepTBqoIXNDvzrQ2OcgDFyiwv9v5KZewrfpBXclqtp6QfCn3KPgKs3IUYdHZYv9NxkhgSa7xk7d-imUrlVflcIdg7P_7CvDuRfEH6lDmICZBywPkE Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 9930429925cb43449ad9ffecf77878b1 Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1681204515 Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:20.131394 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9930429925cb43449ad9ffecf77878b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9930429925cb43449ad9ffecf77878b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9930429925cb43449ad9ffecf77878b1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9930429925cb43449ad9ffecf77878b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1681204515 Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 9930429925cb43449ad9ffecf77878b1 Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1681204515 Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FlavorsAccessNegativeTestJSON-1681204515-project Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 34d499e2871b426a83fa0d43ce3053d3 Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1681204515-project Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: {"addTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} Oct 28 13:02:20.132726 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '1422202486', 'body': {'addTenantAccess': {'tenant': '9930429925cb43449ad9ffecf77878b1'}}} Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:20.133409 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 13:02:20.134303 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.135311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2748737f-50ea-4985-bc24-a9b4a2839c52 tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:20.135311 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2748737f-50ea-4985-bc24-a9b4a2839c52 tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] 10.222.0.25 "POST /compute/v2.1/flavors/1422202486/action" status: 403 len: 130 microversion: 2.1 time: 0.289491 Oct 28 13:02:20.135311 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 35/60] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:19 2022] POST /compute/v2.1/flavors/1422202486/action => generated 130 bytes in 290 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:20.140392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77fd6e31-cee5-4c36-b000-900d8953c293 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77fd6e31-cee5-4c36-b000-900d8953c293 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 27 Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:02:20.143850 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: {"aggregate": {"name": ""}} Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:20.145075 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '' Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:20.145691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:02:20.146739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.148295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77fd6e31-cee5-4c36-b000-900d8953c293 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:20.148295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77fd6e31-cee5-4c36-b000-900d8953c293 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011225 Oct 28 13:02:20.148295 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 36/61] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:20 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:02:20.151327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfe06edb-22ed-4632-a62e-fafe48af085b tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1020358721", "id": 587593680, "os-flavor-access:is_public": "True"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.243071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfe06edb-22ed-4632-a62e-fafe48af085b tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.095089 Oct 28 13:02:20.243696 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 37/62] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:20 2022] POST /compute/v2.1/flavors => generated 426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:20.247969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d80dae25-be3b-43ee-b107-208ef8ab4e82 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:20.340811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d80dae25-be3b-43ee-b107-208ef8ab4e82 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1422202486" status: 202 len: 0 microversion: 2.1 time: 0.096045 Oct 28 13:02:20.344482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 38/63] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:20 2022] DELETE /compute/v2.1/flavors/1422202486 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:20.346408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df56bd92-0ae3-41e1-825a-5fd186f17c93 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-916085161"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-df56bd92-0ae3-41e1-825a-5fd186f17c93 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2235b4efc93d4c3097e8ca16f93c8583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91f1adb201f4632aedda480bfb74296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df56bd92-0ae3-41e1-825a-5fd186f17c93 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Request method failure captured: Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 59 Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LRiW68wPiNfs_1PDJiJMNKsZ7xjKWmeDBCOYHcV3H1db0CQwSNlXe7T8UdUKM1Yt-_AVZzw5qu02dcaOVXWoJBrYEzHJSema2sQY85tEjnH-lqp9z8bpobuaprs72UUA6fucIen88e6nsJEdueC4S09i5QMxli1IB1h5NPLFioPv0 Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:20.351873 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e91f1adb201f4632aedda480bfb74296", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2235b4efc93d4c3097e8ca16f93c8583 Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: {"aggregate": {"name": "tempest-test_aggregate-916085161"}} Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:20.352957 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-916085161'}}} Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:20.358292 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:20.359447 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 13:02:20.360680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.360680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df56bd92-0ae3-41e1-825a-5fd186f17c93 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:20.360680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-df56bd92-0ae3-41e1-825a-5fd186f17c93 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010369 Oct 28 13:02:20.360680 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 39/64] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:20 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:20.360680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-098c4b0e-1e04-4048-b19e-77d270e4f2aa tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:20.489274 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-098c4b0e-1e04-4048-b19e-77d270e4f2aa tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/587593680" status: 202 len: 0 microversion: 2.1 time: 0.135091 Oct 28 13:02:20.489860 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 40/65] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:02:20 2022] DELETE /compute/v2.1/flavors/587593680 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:20.494337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b9bda89-9df7-4d22-896e-b816ceadcc27 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:20.514618 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b9bda89-9df7-4d22-896e-b816ceadcc27 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023732 Oct 28 13:02:20.515686 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 41/66] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:20.519704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dd13cf6c-2c0e-44ba-813d-e95033fae001 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1225491263"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.523008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-dd13cf6c-2c0e-44ba-813d-e95033fae001 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid 3b5d7f00-3733-410b-8b63-3f90c0166284 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:20.634402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dd13cf6c-2c0e-44ba-813d-e95033fae001 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.117829 Oct 28 13:02:20.635012 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 42/67] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:20.643783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7900bc54-163c-4b66-949a-787f5942a930 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:20.679862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7900bc54-163c-4b66-949a-787f5942a930 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043768 Oct 28 13:02:20.680772 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 43/68] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:20.685154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd3381a6-3530-4326-a18d-48b599a19447 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-906194684", "id": 1392466408, "os-flavor-access:is_public": "False"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.819462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd3381a6-3530-4326-a18d-48b599a19447 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.137604 Oct 28 13:02:20.820174 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 44/69] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:20 2022] POST /compute/v2.1/flavors => generated 438 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:20.838835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0bef384-6297-4059-8187-0bd8a25c6f7e tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1225491263"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:20.844049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-b0bef384-6297-4059-8187-0bd8a25c6f7e tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid 16808abd-7075-457c-baf3-a27657c9b2fb for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b0bef384-6297-4059-8187-0bd8a25c6f7e tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1225491263 already exists. Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0bef384-6297-4059-8187-0bd8a25c6f7e tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 60 Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:02:20.893391 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: {"aggregate": {"name": "tempest-test_aggregate-1225491263"}} Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:20.895169 n-d-862876-2 devstack@n-api.service[127794]: exception: Aggregate tempest-test_aggregate-1225491263 already exists. Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1225491263'}}} Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 28 13:02:20.895985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1225491263 already exists. Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:20.897169 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1225491263 already exists. Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1225491263 already exists. Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0bef384-6297-4059-8187-0bd8a25c6f7e tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1225491263 already exists. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:20.898424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0bef384-6297-4059-8187-0bd8a25c6f7e tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.045904 Oct 28 13:02:20.900572 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 45/70] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:20 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:02:20.900572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8429c945-22b1-4663-ba77-ab829bddf388 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1739209361", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:21.011668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:02:21.017532 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8429c945-22b1-4663-ba77-ab829bddf388 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.131681 Oct 28 13:02:21.017532 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 46/71] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:20 2022] POST /compute/v2.1/flavors => generated 507 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:21.021941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c496bcb3-23cb-4791-a6a2-554b9ce84c71 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:21.264413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:02:21.264841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:02:21.265349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:02:21.265760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:02:21.266213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:02:21.279257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:21.279741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:21.280180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:21.280963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:21.281431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:21.281892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:21.315097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Getting quotas for project 5554f4055a18401aa38b8cea29c1f75d. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:21.321772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Getting quotas for user 94e8ff8dcf344a169f57264a102f1afe and project 5554f4055a18401aa38b8cea29c1f75d. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:21.335296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:02:21.338523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:02:21.525757 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f99b1207-826b-47ea-85df-430e80f03d8a tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.108580 Oct 28 13:02:21.526409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 26/72] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:02:21.531369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3942dbcb-9494-4f80-b22c-04b29d2531ed tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:21.655589 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3942dbcb-9494-4f80-b22c-04b29d2531ed tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.127373 Oct 28 13:02:21.657264 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 27/73] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:21 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:21.662460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ddfbbefa-7301-418c-9bc4-2c46765d24e2 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:21.786848 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ddfbbefa-7301-418c-9bc4-2c46765d24e2 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/a6c9d8e0-8f09-4e7a-b9c6-f2deaf555e6d" status: 202 len: 0 microversion: 2.1 time: 0.128304 Oct 28 13:02:21.790604 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 28/74] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:02:21 2022] DELETE /compute/v2.1/flavors/a6c9d8e0-8f09-4e7a-b9c6-f2deaf555e6d => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:21.796013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f097ecde-83c0-4eac-b44d-dd2c8152cc90 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:21.797023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f097ecde-83c0-4eac-b44d-dd2c8152cc90 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:21.887373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f097ecde-83c0-4eac-b44d-dd2c8152cc90 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:21.904744 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f097ecde-83c0-4eac-b44d-dd2c8152cc90 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1241 microversion: 2.1 time: 0.112790 Oct 28 13:02:21.905325 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 29/75] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:21 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:21.910953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5688d7f-da56-48a9-bba4-00696ea84da4 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-514185392"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:21.914557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-e5688d7f-da56-48a9-bba4-00696ea84da4 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid c7c53b37-ddda-49e4-81b5-6b750edc07ef for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:22.008703 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5688d7f-da56-48a9-bba4-00696ea84da4 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.102338 Oct 28 13:02:22.010719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 30/76] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:22.017874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-720980ae-6209-4bf6-9a14-e983c0acb1dc tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.038587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=9,nova_api:DELETE=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:22.041305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c496bcb3-23cb-4791-a6a2-554b9ce84c71 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1392466408/action" status: 200 len: 97 microversion: 2.1 time: 1.023775 Oct 28 13:02:22.049562 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 47/77] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:21 2022] POST /compute/v2.1/flavors/1392466408/action => generated 97 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:22.054829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef3131ad-0bb7-4129-998e-5dce73383a68 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.057621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ef3131ad-0bb7-4129-998e-5dce73383a68 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2235b4efc93d4c3097e8ca16f93c8583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91f1adb201f4632aedda480bfb74296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef3131ad-0bb7-4129-998e-5dce73383a68 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Request method failure captured: Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LRiW68wPiNfs_1PDJiJMNKsZ7xjKWmeDBCOYHcV3H1db0CQwSNlXe7T8UdUKM1Yt-_AVZzw5qu02dcaOVXWoJBrYEzHJSema2sQY85tEjnH-lqp9z8bpobuaprs72UUA6fucIen88e6nsJEdueC4S09i5QMxli1IB1h5NPLFioPv0 Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:22.061007 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e91f1adb201f4632aedda480bfb74296", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2235b4efc93d4c3097e8ca16f93c8583 Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 13:02:22.062297 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6'} Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:22.063074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 13:02:22.064132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.066349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef3131ad-0bb7-4129-998e-5dce73383a68 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:22.067444 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef3131ad-0bb7-4129-998e-5dce73383a68 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.016604 Oct 28 13:02:22.068667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 48/78] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:22.087364 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-720980ae-6209-4bf6-9a14-e983c0acb1dc tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062808 Oct 28 13:02:22.087508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78aa332e-bccf-4766-896d-99657c2e29bc tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:22.087638 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 31/79] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:22.087723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-78aa332e-bccf-4766-896d-99657c2e29bc tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '34d499e2871b426a83fa0d43ce3053d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9930429925cb43449ad9ffecf77878b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:22.087801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7352ac3d-4ae3-4f37-848f-e3c726bf49d0 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78aa332e-bccf-4766-896d-99657c2e29bc tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Request method failure captured: Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/flavors/1392466408/action HTTP/1.1 Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 70 Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LSm_URFDQR-XLwXFB1fo5OL6qeCcYQXK3F2T1spCXiGBfypQkc_2njB5lsieUepTBqoIXNDvzrQ2OcgDFyiwv9v5KZewrfpBXclqtp6QfCn3KPgKs3IUYdHZYv9NxkhgSa7xk7d-imUrlVflcIdg7P_7CvDuRfEH6lDmICZBywPkE Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 9930429925cb43449ad9ffecf77878b1 Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1681204515 Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:22.087868 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9930429925cb43449ad9ffecf77878b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9930429925cb43449ad9ffecf77878b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9930429925cb43449ad9ffecf77878b1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9930429925cb43449ad9ffecf77878b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1681204515 Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 9930429925cb43449ad9ffecf77878b1 Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1681204515 Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FlavorsAccessNegativeTestJSON-1681204515-project Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 34d499e2871b426a83fa0d43ce3053d3 Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1681204515-project Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: {"removeTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} Oct 28 13:02:22.088898 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '1392466408', 'body': {'removeTenantAccess': {'tenant': '9930429925cb43449ad9ffecf77878b1'}}} Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can( Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:22.089561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 13:02:22.090520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.092001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78aa332e-bccf-4766-896d-99657c2e29bc tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:22.092001 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-78aa332e-bccf-4766-896d-99657c2e29bc tempest-FlavorsAccessNegativeTestJSON-1681204515 tempest-FlavorsAccessNegativeTestJSON-1681204515-project] 10.222.0.25 "POST /compute/v2.1/flavors/1392466408/action" status: 403 len: 133 microversion: 2.1 time: 0.014580 Oct 28 13:02:22.092001 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 49/80] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:22 2022] POST /compute/v2.1/flavors/1392466408/action => generated 133 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:22.101638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-818b0566-19ee-45d3-9461-38f30b4df51e tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9930429925cb43449ad9ffecf77878b1"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:22.261990 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7352ac3d-4ae3-4f37-848f-e3c726bf49d0 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.180043 Oct 28 13:02:22.261990 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 32/81] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:22.265706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed12eb2f-29f2-48e2-b7ea-f873a35076fe tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-997452767", "id": "542ad1a8-b2d7-4b33-9c87-072a98d73b16", "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:22.381265 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed12eb2f-29f2-48e2-b7ea-f873a35076fe tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.121075 Oct 28 13:02:22.382038 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 33/82] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:22 2022] POST /compute/v2.1/flavors => generated 506 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:22.386086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-441d6d45-1ce9-4607-b0f0-a13773ca09b3 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.397193 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-441d6d45-1ce9-4607-b0f0-a13773ca09b3 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-441d6d45-1ce9-4607-b0f0-a13773ca09b3 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:22.398970 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: exception: Aggregate -1 could not be found. Oct 28 13:02:22.400079 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '-1'} Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 13:02:22.400722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.401740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-441d6d45-1ce9-4607-b0f0-a13773ca09b3 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-441d6d45-1ce9-4607-b0f0-a13773ca09b3 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.017733 Oct 28 13:02:22.402734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 34/83] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:02:22 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:02:22.406576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09389188-7029-4158-af8b-7064ce7cf88d tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.518625 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09389188-7029-4158-af8b-7064ce7cf88d tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/542ad1a8-b2d7-4b33-9c87-072a98d73b16" status: 202 len: 0 microversion: 2.1 time: 0.115574 Oct 28 13:02:22.519248 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 35/84] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:02:22 2022] DELETE /compute/v2.1/flavors/542ad1a8-b2d7-4b33-9c87-072a98d73b16 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:22.527553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3843fd2f-6cbf-4589-8d1b-03b030797278 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-408607938"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:22.531699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-3843fd2f-6cbf-4589-8d1b-03b030797278 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid 3ff58c85-4852-4869-9345-8bfd0c6e76a0 for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:22.652848 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3843fd2f-6cbf-4589-8d1b-03b030797278 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.128948 Oct 28 13:02:22.660883 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 36/85] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:22.665963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-506371a3-1032-4726-99b8-c7d937aea0d3 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.687571 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-506371a3-1032-4726-99b8-c7d937aea0d3 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025168 Oct 28 13:02:22.706195 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 37/86] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:22.709824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d023192-3b39-45fb-b195-1d9e7c4a2270 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.711788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d023192-3b39-45fb-b195-1d9e7c4a2270 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2235b4efc93d4c3097e8ca16f93c8583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91f1adb201f4632aedda480bfb74296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d023192-3b39-45fb-b195-1d9e7c4a2270 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Request method failure captured: Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LRiW68wPiNfs_1PDJiJMNKsZ7xjKWmeDBCOYHcV3H1db0CQwSNlXe7T8UdUKM1Yt-_AVZzw5qu02dcaOVXWoJBrYEzHJSema2sQY85tEjnH-lqp9z8bpobuaprs72UUA6fucIen88e6nsJEdueC4S09i5QMxli1IB1h5NPLFioPv0 Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:22.714598 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e91f1adb201f4632aedda480bfb74296", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2235b4efc93d4c3097e8ca16f93c8583 Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 13:02:22.716234 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7'} Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:22.717063 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 13:02:22.718230 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:22.719363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d023192-3b39-45fb-b195-1d9e7c4a2270 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:22.720258 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d023192-3b39-45fb-b195-1d9e7c4a2270 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.029130 Oct 28 13:02:22.721213 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 38/87] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:02:22 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:22.726929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-74c7b3b5-251d-47df-8280-b4614a1f0e71 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-185562877", "id": 1097116535, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:22.880322 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-74c7b3b5-251d-47df-8280-b4614a1f0e71 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.157071 Oct 28 13:02:22.882658 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-818b0566-19ee-45d3-9461-38f30b4df51e tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1392466408/action" status: 200 len: 21 microversion: 2.1 time: 0.787026 Oct 28 13:02:22.884175 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 39/88] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:22 2022] POST /compute/v2.1/flavors => generated 413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:22.884462 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 50/89] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:22 2022] POST /compute/v2.1/flavors/1392466408/action => generated 21 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:22.889055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0d6200c9-f1fc-4799-91b7-9b4dbb8acbfa tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:22.897102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a695cfb-a869-453c-837e-f4d8cc7965b8 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.025245 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a695cfb-a869-453c-837e-f4d8cc7965b8 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1392466408" status: 202 len: 0 microversion: 2.1 time: 0.134128 Oct 28 13:02:23.025931 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 40/90] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:22 2022] DELETE /compute/v2.1/flavors/1392466408 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:23.035078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98901bc2-6b2b-414e-aedf-cf84678cb61c tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.036450 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0d6200c9-f1fc-4799-91b7-9b4dbb8acbfa tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.150780 Oct 28 13:02:23.037045 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 51/91] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:22 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:23.041533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b59b46c1-4401-4215-9b69-8f840c2d6562 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.042280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b59b46c1-4401-4215-9b69-8f840c2d6562 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:23.051616 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-98901bc2-6b2b-414e-aedf-cf84678cb61c tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1097116535" status: 200 len: 413 microversion: 2.1 time: 0.024725 Oct 28 13:02:23.052508 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 41/92] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/flavors/1097116535 => generated 413 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:23.338432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-927494dc-1202-4cca-a970-a7f76ad87aed tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Calling method '.version_select at 0x7f27ba327a60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.341079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-927494dc-1202-4cca-a970-a7f76ad87aed tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '590f5c14eb744e9aa9f619414136fe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2a1c754d84f4585c7c8d2eaf9cabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-927494dc-1202-4cca-a970-a7f76ad87aed tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Request method failure captured: Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LcpQBLoTUYwWZB2oHE8fux1iPLHV1BlBWHTU253YH1PgTPaQyzh-LynRfIAySbUFiF1I--bbfjkCNykQkIuJJeabhs_m5CFkzJ1hjwgUFcr0HS4nfLQTSvzmZ_qeMv_D9r1t3wWA1FqXCaiU7DfU3hnvenLD52dq-Atb8Uot3FMtU Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:23.344806 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73b2a1c754d84f4585c7c8d2eaf9cabe", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 590f5c14eb744e9aa9f619414136fe36 Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:02:23.347017 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:23.347764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 13:02:23.348910 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.351669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-927494dc-1202-4cca-a970-a7f76ad87aed tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:23.353661 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-927494dc-1202-4cca-a970-a7f76ad87aed tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.300060 Oct 28 13:02:23.360112 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 42/93] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 307 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:23.367131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f457061-5ea5-4961-9d3a-dc99cd1afc40 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.377599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=75,nova_api:DELETE=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:23.392728 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f457061-5ea5-4961-9d3a-dc99cd1afc40 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.030653 Oct 28 13:02:23.393412 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 43/94] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:23.401611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-944bf102-4c81-43ad-acfe-738763040a17 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.409408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-944bf102-4c81-43ad-acfe-738763040a17 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-944bf102-4c81-43ad-acfe-738763040a17 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:23.411383 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: exception: Aggregate -1 could not be found. Oct 28 13:02:23.412611 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '-1'} Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.413205 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 13:02:23.414458 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.415566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-944bf102-4c81-43ad-acfe-738763040a17 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:23.415566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-944bf102-4c81-43ad-acfe-738763040a17 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018516 Oct 28 13:02:23.415566 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 44/95] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:02:23.675780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-469e4bfc-b2fe-40cc-9ef6-e457cb717bcb tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.697419 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-469e4bfc-b2fe-40cc-9ef6-e457cb717bcb tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.281394 Oct 28 13:02:23.703693 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 45/96] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:23.709240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3397005b-0acf-43e7-9265-14a4eb109653 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Calling method '.version_select at 0x7f27ba327d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.711075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3397005b-0acf-43e7-9265-14a4eb109653 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '590f5c14eb744e9aa9f619414136fe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2a1c754d84f4585c7c8d2eaf9cabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3397005b-0acf-43e7-9265-14a4eb109653 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Request method failure captured: Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LcpQBLoTUYwWZB2oHE8fux1iPLHV1BlBWHTU253YH1PgTPaQyzh-LynRfIAySbUFiF1I--bbfjkCNykQkIuJJeabhs_m5CFkzJ1hjwgUFcr0HS4nfLQTSvzmZ_qeMv_D9r1t3wWA1FqXCaiU7DfU3hnvenLD52dq-Atb8Uot3FMtU Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:23.713120 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73b2a1c754d84f4585c7c8d2eaf9cabe", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 590f5c14eb744e9aa9f619414136fe36 Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:02:23.714374 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:23.715171 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 13:02:23.716735 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.717643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3397005b-0acf-43e7-9265-14a4eb109653 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:23.717643 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3397005b-0acf-43e7-9265-14a4eb109653 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.015449 Oct 28 13:02:23.717643 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 46/97] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:23.722228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e13336ab-3ef0-45a0-a20b-c69e38cbe7da tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-335720778", "id": 1674477846, "os-flavor-access:is_public": "False"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:23.835456 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e13336ab-3ef0-45a0-a20b-c69e38cbe7da tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.117862 Oct 28 13:02:23.844171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 47/98] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:23 2022] POST /compute/v2.1/flavors => generated 438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:23.849185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c325d49-74f6-4357-8806-7fb41ade1be3 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.850894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c325d49-74f6-4357-8806-7fb41ade1be3 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2235b4efc93d4c3097e8ca16f93c8583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91f1adb201f4632aedda480bfb74296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c325d49-74f6-4357-8806-7fb41ade1be3 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Request method failure captured: Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LRiW68wPiNfs_1PDJiJMNKsZ7xjKWmeDBCOYHcV3H1db0CQwSNlXe7T8UdUKM1Yt-_AVZzw5qu02dcaOVXWoJBrYEzHJSema2sQY85tEjnH-lqp9z8bpobuaprs72UUA6fucIen88e6nsJEdueC4S09i5QMxli1IB1h5NPLFioPv0 Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:23.852804 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e91f1adb201f4632aedda480bfb74296", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2235b4efc93d4c3097e8ca16f93c8583 Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 13:02:23.854069 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:23.854764 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 13:02:23.855755 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.857989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c325d49-74f6-4357-8806-7fb41ade1be3 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:23.859219 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c325d49-74f6-4357-8806-7fb41ade1be3 tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.013630 Oct 28 13:02:23.861603 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 48/99] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:23.869126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a0a3a339-803c-42cb-9e6c-06718564767f tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.952751 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a0a3a339-803c-42cb-9e6c-06718564767f tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1097116535" status: 202 len: 0 microversion: 2.1 time: 0.089923 Oct 28 13:02:23.954160 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 49/100] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:23 2022] DELETE /compute/v2.1/flavors/1097116535 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:23.959972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-80e8ffc9-44f4-4f54-93ae-69384236bac4 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Calling method '.version_select at 0x7f27ba32c040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:23.962002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-80e8ffc9-44f4-4f54-93ae-69384236bac4 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '590f5c14eb744e9aa9f619414136fe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2a1c754d84f4585c7c8d2eaf9cabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-80e8ffc9-44f4-4f54-93ae-69384236bac4 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Request method failure captured: Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LcpQBLoTUYwWZB2oHE8fux1iPLHV1BlBWHTU253YH1PgTPaQyzh-LynRfIAySbUFiF1I--bbfjkCNykQkIuJJeabhs_m5CFkzJ1hjwgUFcr0HS4nfLQTSvzmZ_qeMv_D9r1t3wWA1FqXCaiU7DfU3hnvenLD52dq-Atb8Uot3FMtU Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:23.964490 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73b2a1c754d84f4585c7c8d2eaf9cabe", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 590f5c14eb744e9aa9f619414136fe36 Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:02:23.965651 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:23.966301 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 13:02:23.967254 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:23.969758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-80e8ffc9-44f4-4f54-93ae-69384236bac4 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:23.970803 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-80e8ffc9-44f4-4f54-93ae-69384236bac4 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.014788 Oct 28 13:02:23.971873 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1179 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:23.977077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6dab8323-b716-4fad-b0ae-dd2affbbb80c tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8c2c91927e8743a98bc230018cb1c809"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:24.015970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b59b46c1-4401-4215-9b69-8f840c2d6562 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:24.030698 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b59b46c1-4401-4215-9b69-8f840c2d6562 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1241 microversion: 2.1 time: 0.992627 Oct 28 13:02:24.040120 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 52/102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:23 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1241 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:24.040120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b57a6293-c870-4f1d-9de3-07aa92ef62ed tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.065150 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b57a6293-c870-4f1d-9de3-07aa92ef62ed tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032073 Oct 28 13:02:24.067154 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 53/103] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:24.214941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:24.347411 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6dab8323-b716-4fad-b0ae-dd2affbbb80c tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] HTTP exception thrown: Flavor access not found for 27 / 8c2c91927e8743a98bc230018cb1c809 combination. Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6dab8323-b716-4fad-b0ae-dd2affbbb80c tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Request method failure captured: Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/flavors/1674477846/action HTTP/1.1 Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 70 Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LV8-007Ak25SD_JBkfLk1fFIsIJWB0wD1GYmkgwR55i2soEBv0HCU-I-QEY1Bdq_K7YXzb91otmQz7M6etmEnVCdJQMZrAXq2Cjh2fHakhlzDeUGAxLFiPL572ZqIfa0lLq3P_yblBywsGTTYr8k82T7-33TASGQPRQ8qOxK6JxLE Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 4cb0552e34664b6e97ef105421fdb6b2 Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:24.349265 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cb0552e34664b6e97ef105421fdb6b2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cb0552e34664b6e97ef105421fdb6b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 4cb0552e34664b6e97ef105421fdb6b2 Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-509086883 Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4fc519e3a99a4f76843fa636436d6213 Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: {"removeTenantAccess": {"tenant": "8c2c91927e8743a98bc230018cb1c809"}} Oct 28 13:02:24.350385 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor access not found for 27 / 8c2c91927e8743a98bc230018cb1c809 combination. Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1674477846', 'body': {'removeTenantAccess': {'tenant': '8c2c91927e8743a98bc230018cb1c809'}}} Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 28 13:02:24.351072 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 27 / 8c2c91927e8743a98bc230018cb1c809 combination. Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 27 / 8c2c91927e8743a98bc230018cb1c809 combination. Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.352194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 27 / 8c2c91927e8743a98bc230018cb1c809 combination. Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6dab8323-b716-4fad-b0ae-dd2affbbb80c tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Returning 404 to user: Flavor access not found for 27 / 8c2c91927e8743a98bc230018cb1c809 combination. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6dab8323-b716-4fad-b0ae-dd2affbbb80c tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1674477846/action" status: 404 len: 124 microversion: 2.1 time: 0.377852 Oct 28 13:02:24.354331 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 51/104] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:02:23 2022] POST /compute/v2.1/flavors/1674477846/action => generated 124 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:24.355979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d43dafa-07f8-463e-9158-cf705b646bff tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1598269973", "id": 1394068258, "os-flavor-access:is_public": "False"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:24.501988 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d43dafa-07f8-463e-9158-cf705b646bff tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.146326 Oct 28 13:02:24.503879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 52/105] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:24 2022] POST /compute/v2.1/flavors => generated 430 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:24.514949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c9d7d8c-e8e0-4ef8-88f5-343d973461c7 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.536094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Calling method '.version_select at 0x7f27ba52ea60>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.537928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:24.538594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:24.539210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:24.560953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:24.561441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:24.561887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:24.575788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:24.576517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:24.577066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:24.584293 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea060e6d-60f2-4c74-851d-0a65bfec4b2c tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.515319 Oct 28 13:02:24.591856 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 54/106] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:24.596865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c7bf5c8-246e-4c3e-b74e-75c05570f4cb tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "1394068258"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:24.610088 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4c7bf5c8-246e-4c3e-b74e-75c05570f4cb tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] HTTP exception thrown: Flavor 1394068258 could not be found. Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c7bf5c8-246e-4c3e-b74e-75c05570f4cb tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] Request method failure captured: Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 107 Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LXRTt9c_8DBBp_iCikDo2_wofuSoAeKtcG7sBR-EuwlW7DbzYPUTRvkD03GsUDa5kc14KjmtaEqd9bLkogpiTFOuZqy1I8gSWHYfwfLlZNwzsYtcVjFbV4dIRvUBApkOgDDp6TSgKXPrGOufd9s6Y8ODA38-tgAehCHGCEgXe0Jb0 Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 3b4e2e700f4746d4962670e651e4778d Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FlavorsAdminTestJSON-2107470663 Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:24.614419 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b4e2e700f4746d4962670e651e4778d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b4e2e700f4746d4962670e651e4778d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b4e2e700f4746d4962670e651e4778d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b4e2e700f4746d4962670e651e4778d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FlavorsAdminTestJSON-2107470663 Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 3b4e2e700f4746d4962670e651e4778d Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2107470663 Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FlavorsAdminTestJSON-2107470663-project Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a6cbbb36f5e74be5b99777319936020d Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FlavorsAdminTestJSON-2107470663-project Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "test", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "1394068258"}} Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:24.615533 n-d-862876-2 devstack@n-api.service[127794]: exception: Flavor 1394068258 could not be found. Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '1394068258'}}} Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1394068258 could not be found. Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.616191 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1394068258 could not be found. Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.617186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.618614 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.618614 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:24.618614 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:24.618614 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1394068258 could not be found. Oct 28 13:02:24.618614 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.619864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c7bf5c8-246e-4c3e-b74e-75c05570f4cb tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] Returning 400 to user: Flavor 1394068258 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:24.621466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c7bf5c8-246e-4c3e-b74e-75c05570f4cb tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.028071 Oct 28 13:02:24.623375 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 55/107] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:24 2022] POST /compute/v2.1/servers => generated 81 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:02:24.629693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1fbed02-78bb-4ad1-8ed2-9fa3f10e8ec6 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Calling method '.version_select at 0x7f27ba4bd8b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.632075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a1fbed02-78bb-4ad1-8ed2-9fa3f10e8ec6 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '590f5c14eb744e9aa9f619414136fe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2a1c754d84f4585c7c8d2eaf9cabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1fbed02-78bb-4ad1-8ed2-9fa3f10e8ec6 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Request method failure captured: Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LcpQBLoTUYwWZB2oHE8fux1iPLHV1BlBWHTU253YH1PgTPaQyzh-LynRfIAySbUFiF1I--bbfjkCNykQkIuJJeabhs_m5CFkzJ1hjwgUFcr0HS4nfLQTSvzmZ_qeMv_D9r1t3wWA1FqXCaiU7DfU3hnvenLD52dq-Atb8Uot3FMtU Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:24.634454 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73b2a1c754d84f4585c7c8d2eaf9cabe", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 590f5c14eb744e9aa9f619414136fe36 Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '1'} Oct 28 13:02:24.635675 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:24.636624 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 13:02:24.637691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.644841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1fbed02-78bb-4ad1-8ed2-9fa3f10e8ec6 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:24.644841 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1fbed02-78bb-4ad1-8ed2-9fa3f10e8ec6 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.014997 Oct 28 13:02:24.644841 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 56/108] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:24.646298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b329b45-e496-426b-98e3-5498001fdf2b tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.672623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c9d7d8c-e8e0-4ef8-88f5-343d973461c7 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1674477846" status: 202 len: 0 microversion: 2.1 time: 0.166208 Oct 28 13:02:24.675183 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 53/109] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:24 2022] DELETE /compute/v2.1/flavors/1674477846 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:24.680405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55a3d19e-d757-40f1-905c-c63e241d9ad9 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Calling method '.version_select at 0x7f27ba2ef8b0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.683787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-55a3d19e-d757-40f1-905c-c63e241d9ad9 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] HTTP exception thrown: Hypervisor with ID 'c510c790-81dd-4cdf-a98b-3b552d26ca9f' could not be found. Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55a3d19e-d757-40f1-905c-c63e241d9ad9 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Request method failure captured: Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/c510c790-81dd-4cdf-a98b-3b552d26ca9f/uptime HTTP/1.1 Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Lea-xeNJvh-KMmtZUUSRRZyDv2C14SLfNZIbL0MciHrpCKOS8ux99XeAEta4OPf2ycC9AkgLTjQhznucVovlqLCOnTGxnWcru_UNaSoYSSClxr3Ps0Rr026rmkn9_R6NUcOxm3m-VJSWS0ScCnHET8L6l0D3yyWOzlWYqI5nJLPuQ Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07f1e1a1a9bb45d49fa471882002dcbc Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2141810628 Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:24.686455 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07f1e1a1a9bb45d49fa471882002dcbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07f1e1a1a9bb45d49fa471882002dcbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07f1e1a1a9bb45d49fa471882002dcbc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07f1e1a1a9bb45d49fa471882002dcbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2141810628 Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07f1e1a1a9bb45d49fa471882002dcbc Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2141810628 Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 71e73c5d1e99484d9fa3fb9099a29d8d Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: exception: Hypervisor with ID 'c510c790-81dd-4cdf-a98b-3b552d26ca9f' could not be found. Oct 28 13:02:24.687863 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'c510c790-81dd-4cdf-a98b-3b552d26ca9f'} Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c510c790-81dd-4cdf-a98b-3b552d26ca9f' Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 13:02:24.688617 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c510c790-81dd-4cdf-a98b-3b552d26ca9f' could not be found. Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.689796 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c510c790-81dd-4cdf-a98b-3b552d26ca9f' could not be found. Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55a3d19e-d757-40f1-905c-c63e241d9ad9 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Returning 404 to user: Hypervisor with ID 'c510c790-81dd-4cdf-a98b-3b552d26ca9f' could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-55a3d19e-d757-40f1-905c-c63e241d9ad9 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/c510c790-81dd-4cdf-a98b-3b552d26ca9f/uptime" status: 404 len: 123 microversion: 2.1 time: 0.013129 Oct 28 13:02:24.690826 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/os-hypervisors/c510c790-81dd-4cdf-a98b-3b552d26ca9f/uptime => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:24.695959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ad4da3e-3a6a-4f13-bf0b-7b1d5eb5f6f4 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.739711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0ad4da3e-3a6a-4f13-bf0b-7b1d5eb5f6f4 tempest-FlavorsAccessNegativeTestJSON-509086883 tempest-FlavorsAccessNegativeTestJSON-509086883-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049270 Oct 28 13:02:24.751916 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 55/111] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:24.759571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Calling method '.version_select at 0x7f27ba2eda60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.761237 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b329b45-e496-426b-98e3-5498001fdf2b tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1394068258" status: 202 len: 0 microversion: 2.1 time: 0.119621 Oct 28 13:02:24.769000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:24.769554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 57/112] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:24 2022] DELETE /compute/v2.1/flavors/1394068258 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:24.770920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:24.771388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:24.780846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-183d3fd6-e671-44fd-af2d-6e793cc30b32 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.806948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:24.807440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:24.808431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:24.822360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:24.827322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:24.828557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:24.840035 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fa3bbace-99ea-4eca-bde8-cc6bde152a81 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086238 Oct 28 13:02:24.841544 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-183d3fd6-e671-44fd-af2d-6e793cc30b32 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056198 Oct 28 13:02:24.841868 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 56/113] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:24.842708 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 58/114] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:24.862599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2643a16b-99d7-4520-8175-ded482051dd9 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Calling method '.version_select at 0x7f27ba2edca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.863887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d20c4530-3cf8-4400-a367-4c61b5f955fb tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-292207369", "id": 674138129, "os-flavor-access:is_public": "False"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:24.864885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2643a16b-99d7-4520-8175-ded482051dd9 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '590f5c14eb744e9aa9f619414136fe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2a1c754d84f4585c7c8d2eaf9cabe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2643a16b-99d7-4520-8175-ded482051dd9 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Request method failure captured: Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LcpQBLoTUYwWZB2oHE8fux1iPLHV1BlBWHTU253YH1PgTPaQyzh-LynRfIAySbUFiF1I--bbfjkCNykQkIuJJeabhs_m5CFkzJ1hjwgUFcr0HS4nfLQTSvzmZ_qeMv_D9r1t3wWA1FqXCaiU7DfU3hnvenLD52dq-Atb8Uot3FMtU Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:24.866628 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73b2a1c754d84f4585c7c8d2eaf9cabe", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73b2a1c754d84f4585c7c8d2eaf9cabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 73b2a1c754d84f4585c7c8d2eaf9cabe Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423 Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 590f5c14eb744e9aa9f619414136fe36 Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1401727423-project Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1'} Oct 28 13:02:24.875793 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:24.876542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 13:02:24.877739 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.878946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2643a16b-99d7-4520-8175-ded482051dd9 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:24.878946 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2643a16b-99d7-4520-8175-ded482051dd9 tempest-HypervisorAdminNegativeTestJSON-1401727423 tempest-HypervisorAdminNegativeTestJSON-1401727423-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010255 Oct 28 13:02:24.878946 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 57/115] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:24.891462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b266b422-ec9e-4d60-aa58-572579f02f37 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Calling method '.version_select at 0x7f27ba2ef790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:24.899548 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-b266b422-ec9e-4d60-aa58-572579f02f37 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] HTTP exception thrown: Hypervisor with ID 'f7b2da49-8de6-40c2-8dd0-cbf3426f9047' could not be found. Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b266b422-ec9e-4d60-aa58-572579f02f37 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Request method failure captured: Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/f7b2da49-8de6-40c2-8dd0-cbf3426f9047 HTTP/1.1 Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Lea-xeNJvh-KMmtZUUSRRZyDv2C14SLfNZIbL0MciHrpCKOS8ux99XeAEta4OPf2ycC9AkgLTjQhznucVovlqLCOnTGxnWcru_UNaSoYSSClxr3Ps0Rr026rmkn9_R6NUcOxm3m-VJSWS0ScCnHET8L6l0D3yyWOzlWYqI5nJLPuQ Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07f1e1a1a9bb45d49fa471882002dcbc Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2141810628 Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:24.908312 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07f1e1a1a9bb45d49fa471882002dcbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07f1e1a1a9bb45d49fa471882002dcbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07f1e1a1a9bb45d49fa471882002dcbc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07f1e1a1a9bb45d49fa471882002dcbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2141810628 Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07f1e1a1a9bb45d49fa471882002dcbc Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2141810628 Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 71e73c5d1e99484d9fa3fb9099a29d8d Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: exception: Hypervisor with ID 'f7b2da49-8de6-40c2-8dd0-cbf3426f9047' could not be found. Oct 28 13:02:24.909703 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f7b2da49-8de6-40c2-8dd0-cbf3426f9047'} Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f7b2da49-8de6-40c2-8dd0-cbf3426f9047' Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 13:02:24.910443 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:02:24.911914 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f7b2da49-8de6-40c2-8dd0-cbf3426f9047' could not be found. Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f7b2da49-8de6-40c2-8dd0-cbf3426f9047' could not be found. Oct 28 13:02:24.913026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:24.915329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b266b422-ec9e-4d60-aa58-572579f02f37 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] Returning 404 to user: Hypervisor with ID 'f7b2da49-8de6-40c2-8dd0-cbf3426f9047' could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:24.916349 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b266b422-ec9e-4d60-aa58-572579f02f37 tempest-HypervisorAdminNegativeTestJSON-2141810628 tempest-HypervisorAdminNegativeTestJSON-2141810628-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/f7b2da49-8de6-40c2-8dd0-cbf3426f9047" status: 404 len: 123 microversion: 2.1 time: 0.036015 Oct 28 13:02:24.917038 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 58/116] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Oct 28 13:02:24 2022] GET /compute/v2.1/os-hypervisors/f7b2da49-8de6-40c2-8dd0-cbf3426f9047 => generated 123 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:25.057825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.061212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:25.061620 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d20c4530-3cf8-4400-a367-4c61b5f955fb tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.201175 Oct 28 13:02:25.069996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 59/117] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:24 2022] POST /compute/v2.1/flavors => generated 411 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:02:25.071928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:25.073047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:25.073826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:25.074685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-46449b7f-78f0-47b1-8f18-2765faa540ba tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-698404668", "id": 1437371042, "os-flavor-access:is_public": "True"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:25.075862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:25.076624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:25.077048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:25.203244 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-46449b7f-78f0-47b1-8f18-2765faa540ba tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.132081 Oct 28 13:02:25.203912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 60/118] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:25 2022] POST /compute/v2.1/flavors => generated 413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:25.219666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc299652-1966-40c7-81e3-3f062a6945ff tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.237484 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc299652-1966-40c7-81e3-3f062a6945ff tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.024928 Oct 28 13:02:25.238171 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 61/119] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:25.256713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ca88f0d-d8c8-4a4c-b4c5-7a8baadb9fe4 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.267733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ca88f0d-d8c8-4a4c-b4c5-7a8baadb9fe4 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.014477 Oct 28 13:02:25.276456 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 62/120] 10.222.0.25 () {58 vars in 1177 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:25.280285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:25.283441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57c507d5-4c73-4aab-81a8-4d5cd8f63bb4 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.294774 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78b9ae3e-b2b5-4bc9-8dde-aba7c72e555f tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1289 microversion: 2.1 time: 0.243989 Oct 28 13:02:25.295349 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 59/121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1289 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:25.296054 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57c507d5-4c73-4aab-81a8-4d5cd8f63bb4 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.017785 Oct 28 13:02:25.297647 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 63/122] 10.222.0.25 () {58 vars in 1171 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:02:25.322121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-891baab3-2af6-4664-b1e0-b97833cc9320 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.341403 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-891baab3-2af6-4664-b1e0-b97833cc9320 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.022760 Oct 28 13:02:25.342445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 60/123] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:25.358314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-24ad65c5-7fd9-4036-a4d0-a3cbf4ca2908 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.401224 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-24ad65c5-7fd9-4036-a4d0-a3cbf4ca2908 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.046863 Oct 28 13:02:25.404976 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 64/124] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:25.421738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f766e049-958d-42fe-9363-73d4c28cccf2 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.473052 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f766e049-958d-42fe-9363-73d4c28cccf2 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.056343 Oct 28 13:02:25.473602 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 61/125] 10.222.0.25 () {58 vars in 1175 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:25.493178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f041ee9-f98c-4f90-89da-0b0d7eb4abe9 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.514794 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4f041ee9-f98c-4f90-89da-0b0d7eb4abe9 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.026031 Oct 28 13:02:25.515391 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 65/126] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:25.533476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9fa4a1f-32ba-4768-8ebf-5593167b5c08 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.563294 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9fa4a1f-32ba-4768-8ebf-5593167b5c08 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.033114 Oct 28 13:02:25.571734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 62/127] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:25.581662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07be458c-6ac0-400d-ad6f-e4065b48b2ed tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.708078 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07be458c-6ac0-400d-ad6f-e4065b48b2ed tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1437371042" status: 202 len: 0 microversion: 2.1 time: 0.129528 Oct 28 13:02:25.708990 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 66/128] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:25 2022] DELETE /compute/v2.1/flavors/1437371042 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:25.719934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d00a2bb0-c2a1-4deb-81ce-ed1afd26cf53 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.749549 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d00a2bb0-c2a1-4deb-81ce-ed1afd26cf53 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034526 Oct 28 13:02:25.764446 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 63/129] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:25.769634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f732673-4537-4e70-bbd6-c6a9ac42cdd0 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.919300 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f732673-4537-4e70-bbd6-c6a9ac42cdd0 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/674138129" status: 202 len: 0 microversion: 2.1 time: 0.153044 Oct 28 13:02:25.920388 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:02:25 2022] DELETE /compute/v2.1/flavors/674138129 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:02:25.929051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cbd8dd3b-677e-48dd-ac72-50e7fb1b0b14 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:25.976141 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cbd8dd3b-677e-48dd-ac72-50e7fb1b0b14 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051100 Oct 28 13:02:25.990774 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 64/131] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:25.997522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-18b168ac-b77b-44dc-b6b9-87c20db11628 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1991819311", "id": 1263690910, "os-flavor-access:is_public": "False"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:26.118739 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-18b168ac-b77b-44dc-b6b9-87c20db11628 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.123089 Oct 28 13:02:26.131134 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 68/132] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:25 2022] POST /compute/v2.1/flavors => generated 415 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:26.143903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9ff67548-60a5-46ef-ac78-058e039cf1c0 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:26.165461 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9ff67548-60a5-46ef-ac78-058e039cf1c0 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026254 Oct 28 13:02:26.177752 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 69/133] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:26.189974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3558aadd-b987-4181-bfcc-280b8bd8074b tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:26.243990 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3558aadd-b987-4181-bfcc-280b8bd8074b tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062609 Oct 28 13:02:26.245493 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 70/134] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:26.268846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e87b6e95-b92d-4aec-acb2-59d6a1019da0 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:26.408942 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e87b6e95-b92d-4aec-acb2-59d6a1019da0 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1263690910" status: 202 len: 0 microversion: 2.1 time: 0.149126 Oct 28 13:02:26.410219 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 71/135] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:26 2022] DELETE /compute/v2.1/flavors/1263690910 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:26.417478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:26.418434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:26.441929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:26.443422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:26.443881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:26.448532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:26.449002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:26.453417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:26.570301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-75454b07-c425-4631-a799-0252db1e171d tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1434358107", "id": 29595743, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:26.679675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:26.707057 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c15832ca-3f84-46bb-903e-3daccc236d2c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1295 microversion: 2.1 time: 0.295382 Oct 28 13:02:26.709724 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 72/136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:26 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1295 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:26.720638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff07fc14-dc49-4cf7-8b4e-4a16faaac220 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:26.766047 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff07fc14-dc49-4cf7-8b4e-4a16faaac220 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055017 Oct 28 13:02:26.767319 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 73/137] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:26.789526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c729f4f3-71ec-418e-8503-5715ea32c660 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-11190319", "id": 47261322, "os-flavor-access:is_public": "True"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:26.797547 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-75454b07-c425-4631-a799-0252db1e171d tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 462 microversion: 2.61 time: 0.699416 Oct 28 13:02:26.798133 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 65/138] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:02:26 2022] POST /compute/v2.1/flavors => generated 462 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:26.986034 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c729f4f3-71ec-418e-8503-5715ea32c660 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.1 time: 0.199775 Oct 28 13:02:26.986034 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 74/139] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:27.010039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88383af3-e0eb-4245-9cb9-ba703fb74668 tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.091634 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88383af3-e0eb-4245-9cb9-ba703fb74668 tempest-FlavorsAdminTestJSON-2107470663 tempest-FlavorsAdminTestJSON-2107470663-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5799 microversion: 2.1 time: 0.095732 Oct 28 13:02:27.093447 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 75/140] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:26 2022] GET /compute/v2.1/flavors/detail => generated 5799 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:27.113495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2e20a947-1362-4630-96ef-bbced4cbe05a tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.173031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-571616ac-1233-4f3f-857b-5253390fb64a tempest-FlavorsV261TestJSON-1397958493 tempest-FlavorsV261TestJSON-1397958493-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.192357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-571616ac-1233-4f3f-857b-5253390fb64a tempest-FlavorsV261TestJSON-1397958493 tempest-FlavorsV261TestJSON-1397958493-project] 10.222.0.25 "GET /compute/v2.1/flavors/29595743" status: 200 len: 462 microversion: 2.61 time: 0.383803 Oct 28 13:02:27.201509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 66/141] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 13:02:26 2022] GET /compute/v2.1/flavors/29595743 => generated 462 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:27.243450 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2e20a947-1362-4630-96ef-bbced4cbe05a tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/47261322" status: 202 len: 0 microversion: 2.1 time: 0.134717 Oct 28 13:02:27.247875 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 76/142] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:02:27 2022] DELETE /compute/v2.1/flavors/47261322 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:02:27.255045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f05faf1b-e667-4dc1-950a-df11d90ca646 tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:27.283610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=18,nova_api:INSERT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:27.401938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2af882a8-037c-4ab3-80b6-4d6dc9d1fb04 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Action: 'create', calling method: .version_select at 0x7f27ba22d700>, body: {"keypair": {"name": "tempest-keypair-483803483", "type": "ssh", "user_id": "1fbfbdffe7b64eb6b351ddab6507ba21", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIV9oC7F9z1q9/wo0JSR9cAlkfckQF8luzgr9MAhAJw+RDRi0eOwItaFJ92Mlr+9DMM8M0a4fj4+fuKvmPz5oqMITIE/j1rovPDx3upXHNdGAqOdqARqPdewdV60HgATA=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:27.439163 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f05faf1b-e667-4dc1-950a-df11d90ca646 tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/29595743" status: 200 len: 463 microversion: 2.61 time: 0.190133 Oct 28 13:02:27.440602 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 77/143] 10.222.0.25 () {62 vars in 1213 bytes} [Fri Oct 28 13:02:27 2022] PUT /compute/v2.1/flavors/29595743 => generated 463 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:27.453068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2af882a8-037c-4ab3-80b6-4d6dc9d1fb04 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Getting quotas for project 3ce0a9dff02f41dc89e4cb47f363a2ec. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:27.457595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2af882a8-037c-4ab3-80b6-4d6dc9d1fb04 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Getting quotas for user 27cb660982c14a2089aaa5c47598902d and project 3ce0a9dff02f41dc89e4cb47f363a2ec. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:27.459587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1767ac11-0dde-4aed-9612-05b41d65c011 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.507569 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1767ac11-0dde-4aed-9612-05b41d65c011 tempest-FlavorsAdminTestJSON-1151224234 tempest-FlavorsAdminTestJSON-1151224234-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.065443 Oct 28 13:02:27.508580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 78/144] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:27 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:27.515712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a7ff3f8b-77b1-4be8-a5cf-2d0367feb393 tempest-FlavorsV261TestJSON-1397958493 tempest-FlavorsV261TestJSON-1397958493-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.571437 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a7ff3f8b-77b1-4be8-a5cf-2d0367feb393 tempest-FlavorsV261TestJSON-1397958493 tempest-FlavorsV261TestJSON-1397958493-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6244 microversion: 2.61 time: 0.061521 Oct 28 13:02:27.578147 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 79/145] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:02:27 2022] GET /compute/v2.1/flavors/detail => generated 6244 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:02:27.592973 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2af882a8-037c-4ab3-80b6-4d6dc9d1fb04 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.390048 Oct 28 13:02:27.593580 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 67/146] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:02:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 391 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 13:02:27.602034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2dbd3672-53e1-4e3c-842c-4065acbd2639 tempest-FlavorsV261TestJSON-1397958493 tempest-FlavorsV261TestJSON-1397958493-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.610572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c9f270d-4334-408d-a285-4d3e88d7d232 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Action: 'create', calling method: .version_select at 0x7f27ba206a60>, body: {"keypair": {"name": "tempest-keypair-839906015", "type": "ssh", "user_id": "1fbfbdffe7b64eb6b351ddab6507ba21", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ16aVflNpdNF+hZTQ7PNLH+et0aTP2bK0lqeWsQs5NXNNELqfQ2EMl/dNGfittIPbHEsMyLslNtWlab2ozX5yIpzZzDnT7ghsYZVGlhXntXbiHS/N75eCSbtQfJElpFA=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:27.652168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1c9f270d-4334-408d-a285-4d3e88d7d232 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Getting quotas for project 3ce0a9dff02f41dc89e4cb47f363a2ec. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:27.654100 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2dbd3672-53e1-4e3c-842c-4065acbd2639 tempest-FlavorsV261TestJSON-1397958493 tempest-FlavorsV261TestJSON-1397958493-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3151 microversion: 2.61 time: 0.058017 Oct 28 13:02:27.658583 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 80/147] 10.222.0.25 () {60 vars in 1166 bytes} [Fri Oct 28 13:02:27 2022] GET /compute/v2.1/flavors => generated 3151 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:02:27.679655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1c9f270d-4334-408d-a285-4d3e88d7d232 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Getting quotas for user 27cb660982c14a2089aaa5c47598902d and project 3ce0a9dff02f41dc89e4cb47f363a2ec. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:27.682397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef3563c6-e205-431a-a2ea-c08c7ea3554e tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.849741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef3563c6-e205-431a-a2ea-c08c7ea3554e tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/29595743" status: 202 len: 0 microversion: 2.61 time: 0.179292 Oct 28 13:02:27.851204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 81/148] 10.222.0.25 () {60 vars in 1196 bytes} [Fri Oct 28 13:02:27 2022] DELETE /compute/v2.1/flavors/29595743 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:02:27.854094 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c9f270d-4334-408d-a285-4d3e88d7d232 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.249264 Oct 28 13:02:27.855427 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 68/149] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:02:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 252 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 13:02:27.857364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.857969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:27.863830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-53c7fc97-4d84-4edd-8e64-f7642ed69add tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.876463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:27.878192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:27.878649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:27.879398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:27.879857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:27.880289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:27.896227 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-53c7fc97-4d84-4edd-8e64-f7642ed69add tempest-FlavorsV261TestJSON-1472784218 tempest-FlavorsV261TestJSON-1472784218-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.039579 Oct 28 13:02:27.911546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 69/150] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:02:27 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:02:27.934581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-898da5a9-e9d6-4dd7-a413-93f2f8fb55df tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Calling method '.version_select at 0x7f27ba2170d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:27.967477 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-898da5a9-e9d6-4dd7-a413-93f2f8fb55df tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-483803483?user_id=1fbfbdffe7b64eb6b351ddab6507ba21" status: 200 len: 511 microversion: 2.10 time: 0.041519 Oct 28 13:02:27.969863 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 70/151] 10.222.0.25 () {60 vars in 1337 bytes} [Fri Oct 28 13:02:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-483803483?user_id=1fbfbdffe7b64eb6b351ddab6507ba21 => generated 511 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:27.984812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d08a824-db6b-403f-aade-c971dbf5f64a tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Action: 'create', calling method: .version_select at 0x7f27ba2179d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1415020364", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEDHG7TV68l5a5A0YKEGLPw3xVXGlSd4OkTt6WW/THflWoVecRR8DnmQKJfXg9BFdIKjrSjW+8+7CYsyBLDti+h4feQWKok7RVFsoFeqbrtJtgz+pJDyLs6ZZ+3U0hqUw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:28.002234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9d08a824-db6b-403f-aade-c971dbf5f64a tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Getting quotas for project 3ce0a9dff02f41dc89e4cb47f363a2ec. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:28.010666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9d08a824-db6b-403f-aade-c971dbf5f64a tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Getting quotas for user 27cb660982c14a2089aaa5c47598902d and project 3ce0a9dff02f41dc89e4cb47f363a2ec. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:28.110931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:28.123701 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd33dd43-9532-475b-95eb-8ee3b8b178f0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1295 microversion: 2.1 time: 0.271079 Oct 28 13:02:28.124259 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 82/152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:27 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1295 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:28.173887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d08a824-db6b-403f-aade-c971dbf5f64a tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.193398 Oct 28 13:02:28.174505 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 71/153] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:02:27 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 13:02:28.190609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-58e6caf8-3447-4186-94b7-629ad20df6c6 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Calling method '.version_select at 0x7f27ba422dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:28.198627 n-d-862876-2 devstack@n-api.service[127794]: WARNING oslo_db.sqlalchemy.utils [None req-58e6caf8-3447-4186-94b7-629ad20df6c6 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 13:02:28.241501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-58e6caf8-3447-4186-94b7-629ad20df6c6 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=1fbfbdffe7b64eb6b351ddab6507ba21" status: 200 len: 724 microversion: 2.10 time: 0.055818 Oct 28 13:02:28.246064 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 83/154] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Oct 28 13:02:28 2022] GET /compute/v2.1/os-keypairs?user_id=1fbfbdffe7b64eb6b351ddab6507ba21 => generated 724 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:02:28.261860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bee3ad37-a829-4190-a332-5a303c346527 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Calling method '.version_select at 0x7f27ba2ef700>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:28.411096 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bee3ad37-a829-4190-a332-5a303c346527 tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1415020364" status: 204 len: 0 microversion: 2.10 time: 0.153343 Oct 28 13:02:28.412261 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 72/155] 10.222.0.25 () {60 vars in 1325 bytes} [Fri Oct 28 13:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1415020364 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:02:28.428800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd9ce794-0e67-4f44-9bfc-1aebb92227bc tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Calling method '.version_select at 0x7f27ba49b790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:28.555601 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd9ce794-0e67-4f44-9bfc-1aebb92227bc tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839906015?user_id=1fbfbdffe7b64eb6b351ddab6507ba21" status: 204 len: 0 microversion: 2.10 time: 0.132481 Oct 28 13:02:28.555783 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 84/156] 10.222.0.25 () {60 vars in 1340 bytes} [Fri Oct 28 13:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839906015?user_id=1fbfbdffe7b64eb6b351ddab6507ba21 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:02:28.566447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f2c0284-faba-4233-a7e4-60d2d9b0f9ce tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] Calling method '.version_select at 0x7f27ba217a60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:28.575837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:28.714095 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f2c0284-faba-4233-a7e4-60d2d9b0f9ce tempest-KeyPairsV210TestJSON-666713198 tempest-KeyPairsV210TestJSON-666713198-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483803483?user_id=1fbfbdffe7b64eb6b351ddab6507ba21" status: 204 len: 0 microversion: 2.10 time: 0.153153 Oct 28 13:02:28.716325 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 73/157] 10.222.0.25 () {60 vars in 1340 bytes} [Fri Oct 28 13:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483803483?user_id=1fbfbdffe7b64eb6b351ddab6507ba21 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:02:29.163869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:29.165037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:29.180425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:29.185230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:29.196864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:29.197815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:29.198382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:29.198983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:29.408095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:29.421362 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a951d9ac-f84d-4eeb-a90d-0d5f75496498 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.273393 Oct 28 13:02:29.422225 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 85/158] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:29 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:30.446686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:30.447433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:30.460120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:30.463776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:30.463776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:30.463776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:30.463776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:30.464211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:30.956941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:30.971211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be32d79d-5d1b-46f6-a7d9-a21bae0882cd tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.528974 Oct 28 13:02:30.973447 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 74/159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:30 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:32.007063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:32.010954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:32.062031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:32.062565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:32.063265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:32.064337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:32.064956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:32.067491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:33.173771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:33.189153 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8ec112c-a7ae-4538-ba03-5f72b8dad93d tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 1.195391 Oct 28 13:02:33.190866 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 86/160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:31 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:34.209694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:34.219371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:34.219371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:34.232334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:34.233103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:34.241698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:34.247312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:34.248010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:34.251902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:34.751096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:34.771409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-382d4947-2dac-44fa-9e58-f5e069943494 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.561915 Oct 28 13:02:34.780311 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 75/161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:34 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:35.638659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:35.810605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:35.811382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:35.826530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:35.827136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:35.827821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:35.828715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:35.829685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:35.830296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:36.004387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:36.017307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f7ceb94c-29cd-47e9-afb0-19a6f01ca77e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.211456 Oct 28 13:02:36.018005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 76/162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:35 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:02:36.894073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-014c280b-da36-4188-b212-18974705e5a0 req-57a54a4d-a1bd-4f5b-9863-3b2bd1d4dd44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90f3acc-bae4-469a-9b52-ebeb2e7e7e19", "tag": "2c2940ce-bc47-4d29-b36c-8bdf53dbd35d"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:36.938438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-014c280b-da36-4188-b212-18974705e5a0 req-57a54a4d-a1bd-4f5b-9863-3b2bd1d4dd44 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:36.940710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-014c280b-da36-4188-b212-18974705e5a0 req-57a54a4d-a1bd-4f5b-9863-3b2bd1d4dd44 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:36.942779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-014c280b-da36-4188-b212-18974705e5a0 req-57a54a4d-a1bd-4f5b-9863-3b2bd1d4dd44 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:37.020167 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-014c280b-da36-4188-b212-18974705e5a0 req-57a54a4d-a1bd-4f5b-9863-3b2bd1d4dd44 service nova] Creating event network-changed:2c2940ce-bc47-4d29-b36c-8bdf53dbd35d for instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 on n-h2-862876-2 Oct 28 13:02:37.020942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-014c280b-da36-4188-b212-18974705e5a0 req-57a54a4d-a1bd-4f5b-9863-3b2bd1d4dd44 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:02:37.021785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-014c280b-da36-4188-b212-18974705e5a0 req-57a54a4d-a1bd-4f5b-9863-3b2bd1d4dd44 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:02:37.028486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:37.030389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:37.031169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:37.032531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:37.033332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:37.034240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:37.042023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:37.043031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:37.047048 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.compute.rpcapi [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 13:02:37.048088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] Releasing lock "compute-rpcapi-router" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:02:37.052374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:37.052866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:37.053363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:37.054000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:37.054450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:37.059901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:37.094482 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-490edcef-8cb3-4ca9-99bd-0711c9eb8db4 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.463569 Oct 28 13:02:37.103340 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 87/163] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:37.313830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:37.322582 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9aaf77a-1b8f-454f-adea-cbdfd9c61bf6 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.285529 Oct 28 13:02:37.343119 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 77/164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:37 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:02:38.350814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:38.351525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:38.359815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:38.366082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:38.366899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:38.367855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:38.369023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:38.370961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:38.761666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:38.782614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f1579b5-ca32-4e85-8a60-50619868f09c tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.438282 Oct 28 13:02:38.783566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 88/165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:38 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:39.810344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:39.813388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:39.815334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=20 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:39.821748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:39.822257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:39.822892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:39.823629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:39.824343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:39.824813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:40.066933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:40.095981 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8489f8b5-a529-4437-80e4-bf22a2e32421 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.291198 Oct 28 13:02:40.109778 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 78/166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:39 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:40.223080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e4075e5a-8402-4fef-a67d-77c54cb2d1c6 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Calling method '.version_select at 0x7f27ba4221f0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:40.955198 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e4075e5a-8402-4fef-a67d-77c54cb2d1c6 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 371 microversion: 2.1 time: 0.928290 Oct 28 13:02:40.956244 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 89/167] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 13:02:40 2022] GET /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 371 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:40.971471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Action: 'update', calling method: .version_select at 0x7f27ba19b4c0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:41.121631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:41.122159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:41.128405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:41.128892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:41.129343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:41.130031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:41.130482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:41.130929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:41.281180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:41.297920 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f9e0160-3d52-4390-be6a-f9b0770261e0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.180328 Oct 28 13:02:41.298789 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 90/168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:41 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:02:41.745092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:41.746385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:41.747841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:41.748714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:41.749487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:41.751079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:41.934337 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f490325-09ab-43e2-9fb0-bf60d8c38aa4 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 328 microversion: 2.1 time: 0.968574 Oct 28 13:02:41.950441 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 79/169] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:02:40 2022] PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 328 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:42.320603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:42.321350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:42.330281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:42.336253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:42.336253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:42.336253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:42.336253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:42.336947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:42.621831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:42.637798 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47522e23-ab0c-4646-81dd-584e4831702e tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.317290 Oct 28 13:02:42.638625 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 91/170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:42 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:43.037999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1830294818", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:43.133175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:02:43.443234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:02:43.443818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:02:43.444509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:02:43.445022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:02:43.445558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:02:43.465891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:43.466986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:43.468134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:43.471025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:43.471745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:43.473447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:43.504413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=63 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:43.526600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Getting quotas for project 59c647315b8d40cb860a280f2481937b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:43.537387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Getting quotas for user f12d8d09d9854e56af516eb7c8bf8c32 and project 59c647315b8d40cb860a280f2481937b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:43.573912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.utils [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] cores quota exceeded for 59c647315b8d40cb860a280f2481937b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127793) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 13:02:43.576984 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Request method failure captured: Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 145 Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LrhZ1alDnT_R2OvMAcDpjlLl2pZYGGCcj4D5APPu5XGhy0b7p2O2WOUtVf_oHj7JQjwe1Jv2djBFLLCQRTSlGbbvSFvCl7zOW96nMEpuQmfbK7CThN-khBvPdhE9H6bOzhGE6Js0o1h4oRMp8lMOsXnk_oXeBkBBVsaqJF_-QMI5c Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:43.582179 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59c647315b8d40cb860a280f2481937b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59c647315b8d40cb860a280f2481937b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: f12d8d09d9854e56af516eb7c8bf8c32 Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1830294818", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} Oct 28 13:02:43.583655 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1830294818', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452'}}} Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 13:02:43.584786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:43.585949 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:43.587265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:43.588925 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.147859 Oct 28 13:02:43.591872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 80/171] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:42 2022] POST /compute/v2.1/servers => generated 111 bytes in 1155 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:02:43.592733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:43.593701 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c10a54a5-c559-42e5-aead-61dfa3a9ac3a tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001267 Oct 28 13:02:43.599424 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 81/172] 10.222.0.25 () {56 vars in 886 bytes} [Fri Oct 28 13:02:43 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 13:02:43.604260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Action: 'update', calling method: .version_select at 0x7f27ba0d4310>, body: {"quota_set": {"cores": 20}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:43.973501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba38a5e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:43.982306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:43.982306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:43.982306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:43.985784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=73 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:44.016162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:44.017030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:44.017620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:44.029596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:44.030401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:44.031054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:44.037877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4bb50094-e45f-495f-802d-b7b7d4451dac tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.774887 Oct 28 13:02:44.038960 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 92/173] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:02:44.051092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:44.051092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:44.056983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:44.057740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:44.058611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:44.062283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:44.063008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:44.063634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:44.318281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:44.318835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:44.322788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:44.323665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:44.324224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:44.326929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:44.356649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:44.368168 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd091b08-e675-46e3-ada0-5d1c56935920 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.327616 Oct 28 13:02:44.369428 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 93/174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:44 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:44.676000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5486e1fc-4901-4798-b955-ba141f693aa3 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1918966816", "ram": 512, "vcpus": 1, "disk": 10, "id": 1572403442, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:45.213993 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5486e1fc-4901-4798-b955-ba141f693aa3 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.840554 Oct 28 13:02:45.217640 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 94/175] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:44 2022] POST /compute/v2.1/flavors => generated 416 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:45.222107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba315e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:45.224327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.225004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.225801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.241742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.242221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.242659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.253471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.253947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.254536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.262958 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48ecfe3d-856e-4f3b-883a-7c34b03ca35e tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.043571 Oct 28 13:02:45.264474 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 95/176] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Oct 28 13:02:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:45.306546 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f847592-e57a-413a-88b2-ae032c0ab1ba tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 329 microversion: 2.1 time: 1.705118 Oct 28 13:02:45.307820 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 82/177] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:02:43 2022] PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 329 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:45.497602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-862899414", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:45.570114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d34c90b5-be96-4b78-b707-e2b0ad33fb2e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:45.582772 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d34c90b5-be96-4b78-b707-e2b0ad33fb2e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.273684 Oct 28 13:02:45.592147 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 83/178] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:02:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:45.606635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:02:45.721866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-adf42ac1-9c2a-4acc-a5c2-b1f0f757b57b tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:45.732207 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-adf42ac1-9c2a-4acc-a5c2-b1f0f757b57b tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] HTTP exception thrown: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-adf42ac1-9c2a-4acc-a5c2-b1f0f757b57b tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Request method failure captured: Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/flavors/1572403442/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Lw7ikWv1A4pYnhjssAhwb5u1rHAaRWb4yTK1GfiDwVh5Mi3s6rqW9DBT2p8q_ZJiXC5ecfHbd2NVFyqCKA2c34i1hrb-U7-sV-z2jj2c3s01Jzj9enlFiU7WjQ8ulH9x0tJgofVKOkR7femOs4pBlwQpeuSQ58t1zHn59r2Awv2pM Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:45.733766 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aaa26cdfda9b4ab0b46a1351666c3e66", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2414756e689e4e98ad40435e96014027 Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:45.734925 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'flavor_id': '1572403442', 'id': 'hw:cpu_thread_policy'} Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:45.735519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:45.736749 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:45.736749 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:45.736749 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:45.736749 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:45.736749 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:45.736749 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:45.736749 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:45.738853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-adf42ac1-9c2a-4acc-a5c2-b1f0f757b57b tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Returning 404 to user: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:45.740438 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-adf42ac1-9c2a-4acc-a5c2-b1f0f757b57b tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] 10.222.0.25 "GET /compute/v2.1/flavors/1572403442/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.146801 Oct 28 13:02:45.742050 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 84/179] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:02:45 2022] GET /compute/v2.1/flavors/1572403442/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:45.747278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba0d7940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:45.750685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.751580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.751824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.769332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.769951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.770468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.795844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.796543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.797041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.813478 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab99d428-0499-4649-9fd8-317b903e7667 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.069117 Oct 28 13:02:45.815080 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 85/180] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:45.826377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bb5a4986-5085-4b75-9b23-1746a25f1c36 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Calling method '.version_select at 0x7f27ba0d4670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:45.937919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:02:45.938407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:02:45.938987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:02:45.939805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:02:45.940317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:02:45.955311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.956331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.956965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.958404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:45.959907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:45.960608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:45.985960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Getting quotas for project a00fdcc92c02421f8d1bd03631662bd0. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:45.990535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Getting quotas for user 2123bea949fd47fe8d6574b6a26ab015 and project a00fdcc92c02421f8d1bd03631662bd0. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:46.003895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:02:46.006801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:02:46.006993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bb5a4986-5085-4b75-9b23-1746a25f1c36 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 371 microversion: 2.1 time: 0.190599 Oct 28 13:02:46.008085 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 86/181] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 13:02:45 2022] GET /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:46.013216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:46.013895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:46.020087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.020573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.021043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.021781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.022244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.022803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.124046 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7059b593-bbc1-458c-97c7-39eeacd18104 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858346 Oct 28 13:02:46.124857 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 96/182] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:02:46.181896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:46.190652 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b108a7fc-efb0-437b-99c6-624e5e92afc9 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.181416 Oct 28 13:02:46.194706 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 87/183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:46 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:46.288464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60bc1fac-0b38-47a6-9d1f-c92fcfe77235 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-722168786", "id": 1865344413, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:46.389181 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60bc1fac-0b38-47a6-9d1f-c92fcfe77235 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.245171 Oct 28 13:02:46.390530 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 97/184] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:46 2022] POST /compute/v2.1/flavors => generated 424 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:46.401466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c08894e-21e9-459b-976c-ccff4aae916f tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:46.405561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0c08894e-21e9-459b-976c-ccff4aae916f tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '2414756e689e4e98ad40435e96014027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa26cdfda9b4ab0b46a1351666c3e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c08894e-21e9-459b-976c-ccff4aae916f tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Request method failure captured: Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/flavors/1572403442/os-extra_specs HTTP/1.1 Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 66 Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Lw7ikWv1A4pYnhjssAhwb5u1rHAaRWb4yTK1GfiDwVh5Mi3s6rqW9DBT2p8q_ZJiXC5ecfHbd2NVFyqCKA2c34i1hrb-U7-sV-z2jj2c3s01Jzj9enlFiU7WjQ8ulH9x0tJgofVKOkR7femOs4pBlwQpeuSQ58t1zHn59r2Awv2pM Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:46.407716 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aaa26cdfda9b4ab0b46a1351666c3e66", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2414756e689e4e98ad40435e96014027 Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 28 13:02:46.408905 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'flavor_id': '1572403442', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:46.409583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 13:02:46.410696 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:46.413673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c08894e-21e9-459b-976c-ccff4aae916f tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:46.415111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c08894e-21e9-459b-976c-ccff4aae916f tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] 10.222.0.25 "POST /compute/v2.1/flavors/1572403442/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023001 Oct 28 13:02:46.416204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 98/185] 10.222.0.25 () {60 vars in 1224 bytes} [Fri Oct 28 13:02:46 2022] POST /compute/v2.1/flavors/1572403442/os-extra_specs => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:46.425865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba654790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:46.437713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.437713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.437713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.449341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.450275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.451027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.460502 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-602a7a89-b6b1-4f0b-b665-a47f5729622d tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.042407 Oct 28 13:02:46.463948 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 99/186] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:46.477736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Action: 'update', calling method: .version_select at 0x7f27ba2dc550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:46.503863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2ae2c24a-35dd-4722-a8b1-ee0141a8ff10 req-3579c319-5893-4920-a10b-60379bfbdb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90f3acc-bae4-469a-9b52-ebeb2e7e7e19", "name": "network-vif-plugged", "status": "completed", "tag": "2c2940ce-bc47-4d29-b36c-8bdf53dbd35d"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:46.529070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae2c24a-35dd-4722-a8b1-ee0141a8ff10 req-3579c319-5893-4920-a10b-60379bfbdb39 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.531800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae2c24a-35dd-4722-a8b1-ee0141a8ff10 req-3579c319-5893-4920-a10b-60379bfbdb39 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.531800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae2c24a-35dd-4722-a8b1-ee0141a8ff10 req-3579c319-5893-4920-a10b-60379bfbdb39 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.557030 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2ae2c24a-35dd-4722-a8b1-ee0141a8ff10 req-3579c319-5893-4920-a10b-60379bfbdb39 service nova] Creating event network-vif-plugged:2c2940ce-bc47-4d29-b36c-8bdf53dbd35d for instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 on n-h2-862876-2 Oct 28 13:02:46.557750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae2c24a-35dd-4722-a8b1-ee0141a8ff10 req-3579c319-5893-4920-a10b-60379bfbdb39 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:02:46.558767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae2c24a-35dd-4722-a8b1-ee0141a8ff10 req-3579c319-5893-4920-a10b-60379bfbdb39 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:02:46.560875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.561494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.562073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.562967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.563594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.564171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.574375 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.rpcapi [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 13:02:46.589283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] Releasing lock "compute-rpcapi-router" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:02:46.608008 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e523b4bc-3f2b-42dd-93be-765b5d9c308b None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415486 Oct 28 13:02:46.609616 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 88/187] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:46.620277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f8255da-656b-48b7-b41a-a74174dd1ef9 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:46.621046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f8255da-656b-48b7-b41a-a74174dd1ef9 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:46.701123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1f8255da-656b-48b7-b41a-a74174dd1ef9 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:46.710222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.710991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.712752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.713676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.714288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.714771 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f8255da-656b-48b7-b41a-a74174dd1ef9 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1218 microversion: 2.1 time: 0.103539 Oct 28 13:02:46.715040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.718957 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 89/188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:46 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:46.732955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de51e142-cf52-4be5-95dc-00e922acabdf tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:46.744982 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de51e142-cf52-4be5-95dc-00e922acabdf tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027758 Oct 28 13:02:46.746650 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 90/189] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Oct 28 13:02:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:46.752430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d85a855d-ca46-4979-bbfe-aa307bd75150 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:46.887497 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d85a855d-ca46-4979-bbfe-aa307bd75150 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1572403442/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.139569 Oct 28 13:02:46.893352 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 91/190] 10.222.0.25 () {60 vars in 1224 bytes} [Fri Oct 28 13:02:46 2022] POST /compute/v2.1/flavors/1572403442/os-extra_specs => generated 66 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:46.895060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5e779fb9-96b5-4402-88ae-ba73a53de181 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 328 microversion: 2.1 time: 0.429846 Oct 28 13:02:46.896168 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 100/191] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:02:46 2022] PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:46.898562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47dd807d-ab76-4512-8383-54373d655c4b tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba0d7940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:46.900305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47dd807d-ab76-4512-8383-54373d655c4b tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.900788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47dd807d-ab76-4512-8383-54373d655c4b tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.901222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47dd807d-ab76-4512-8383-54373d655c4b tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.901817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c4245619-81fa-4ad2-b525-b979a75998b6 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1202769402", "id": 785436589, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:46.921939 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47dd807d-ab76-4512-8383-54373d655c4b tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.026849 Oct 28 13:02:46.929862 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 92/192] 10.222.0.25 () {58 vars in 1179 bytes} [Fri Oct 28 13:02:46 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:46.936303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f86d3380-1881-494c-8b6a-09b2c057e243 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f86d3380-1881-494c-8b6a-09b2c057e243 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '2414756e689e4e98ad40435e96014027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa26cdfda9b4ab0b46a1351666c3e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f86d3380-1881-494c-8b6a-09b2c057e243 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Request method failure captured: Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Lw7ikWv1A4pYnhjssAhwb5u1rHAaRWb4yTK1GfiDwVh5Mi3s6rqW9DBT2p8q_ZJiXC5ecfHbd2NVFyqCKA2c34i1hrb-U7-sV-z2jj2c3s01Jzj9enlFiU7WjQ8ulH9x0tJgofVKOkR7femOs4pBlwQpeuSQ58t1zHn59r2Awv2pM Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:46.941167 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aaa26cdfda9b4ab0b46a1351666c3e66", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2414756e689e4e98ad40435e96014027 Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:46.942616 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'flavor_id': '1572403442', 'id': 'hw:numa_nodes'} Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:46.943288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:46.944452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f86d3380-1881-494c-8b6a-09b2c057e243 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:46.946331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f86d3380-1881-494c-8b6a-09b2c057e243 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011150 Oct 28 13:02:46.946331 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 93/193] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:02:46 2022] DELETE /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:46.948177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba0eab80>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:46.950664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.951129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.951566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.969028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.969512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.970193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.981858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:46.982346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:46.982853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:46.989140 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7395b343-c2c6-4ac0-a53d-c0a29f8c3c57 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044943 Oct 28 13:02:46.990136 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 94/194] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:46.995346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9129b2c-e91c-44d0-a55b-3fd04bc696da tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:47.020597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:47.038895 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9129b2c-e91c-44d0-a55b-3fd04bc696da tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1572403442/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047279 Oct 28 13:02:47.041024 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 95/195] 10.222.0.25 () {60 vars in 1224 bytes} [Fri Oct 28 13:02:46 2022] POST /compute/v2.1/flavors/1572403442/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:47.046403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba0d7dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:47.047459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c4245619-81fa-4ad2-b525-b979a75998b6 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.150007 Oct 28 13:02:47.048593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.049125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.049918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.051451 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 101/196] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:46 2022] POST /compute/v2.1/flavors => generated 422 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:47.059528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1976184423", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:47.066447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.066996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.067476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.074777 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e8fd2bb-db57-4d9a-ad81-9be0319dd33a tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.032391 Oct 28 13:02:47.075368 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 96/197] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:47.080906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f22226f6-da0a-4b8e-b98e-dbbd5b933b19 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:47.084106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f22226f6-da0a-4b8e-b98e-dbbd5b933b19 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '2414756e689e4e98ad40435e96014027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa26cdfda9b4ab0b46a1351666c3e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f22226f6-da0a-4b8e-b98e-dbbd5b933b19 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Request method failure captured: Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 22 Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Lw7ikWv1A4pYnhjssAhwb5u1rHAaRWb4yTK1GfiDwVh5Mi3s6rqW9DBT2p8q_ZJiXC5ecfHbd2NVFyqCKA2c34i1hrb-U7-sV-z2jj2c3s01Jzj9enlFiU7WjQ8ulH9x0tJgofVKOkR7femOs4pBlwQpeuSQ58t1zHn59r2Awv2pM Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:47.085862 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aaa26cdfda9b4ab0b46a1351666c3e66", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aaa26cdfda9b4ab0b46a1351666c3e66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: aaa26cdfda9b4ab0b46a1351666c3e66 Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2414756e689e4e98ad40435e96014027 Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: {"hw:numa_nodes": "1"} Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:47.087265 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'flavor_id': '1572403442', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:47.088737 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 13:02:47.091717 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.092978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f22226f6-da0a-4b8e-b98e-dbbd5b933b19 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:47.092978 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f22226f6-da0a-4b8e-b98e-dbbd5b933b19 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960 tempest-FlavorsExtraSpecsNegativeTestJSON-333105960-project] 10.222.0.25 "PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012037 Oct 28 13:02:47.092978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 97/198] 10.222.0.25 () {60 vars in 1265 bytes} [Fri Oct 28 13:02:47 2022] PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:47.096432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-036fa560-c9be-4fca-b689-c28b45858e5c tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:47.107834 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-036fa560-c9be-4fca-b689-c28b45858e5c tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015640 Oct 28 13:02:47.123089 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 98/199] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Oct 28 13:02:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:02:47.126234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:02:47.130677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba0d4d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:47.141819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.142319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.142817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.162610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.163492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.163573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.171337 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52944f36-d532-4af0-bccf-35510ce9c9d3 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.046567 Oct 28 13:02:47.182448 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 99/200] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:47 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:47.188464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e63481e6-6a47-497a-b495-ea9aebc2fae3 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:47.196734 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-e63481e6-6a47-497a-b495-ea9aebc2fae3 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] HTTP exception thrown: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e63481e6-6a47-497a-b495-ea9aebc2fae3 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Request method failure captured: Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/flavors/1572403442/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Lziyr7aBO-lPUm4aFnPoNl3gYgoLsOFiaVerKIf6Dpevjq9UC_ZRakqjNjo7kA8MN-lerNVmDuNmTkqSF200_r4LrCbWV_wbCKCOzooZ2GlP1VIEfcUnJbCrpkj5lVRN4TrfxXVsO7vF3EMEe6oQ8ICkNVaBdUZbBzhbQaERMgJNA Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 70961e025ff5402890021f53279fe307 Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:47.198394 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70961e025ff5402890021f53279fe307"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70961e025ff5402890021f53279fe307"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70961e025ff5402890021f53279fe307", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70961e025ff5402890021f53279fe307"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 70961e025ff5402890021f53279fe307 Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 49e3cbad240b4518b3723c53a01a28ea Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:47.200303 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'flavor_id': '1572403442', 'id': 'hw:cpu_thread_policy'} Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.201042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.202555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.202555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.202555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.202555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:47.202555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:47.202555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. Oct 28 13:02:47.202555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.203982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e63481e6-6a47-497a-b495-ea9aebc2fae3 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Returning 404 to user: Flavor 1572403442 has no extra specs with key hw:cpu_thread_policy. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:47.204991 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e63481e6-6a47-497a-b495-ea9aebc2fae3 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1572403442/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.021108 Oct 28 13:02:47.205900 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 100/201] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:02:47 2022] DELETE /compute/v2.1/flavors/1572403442/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:47.211092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ffb5aa76-608e-49a1-b81e-c79566847644 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Action: 'create', calling method: .version_select at 0x7f27ba0ea160>, body: {"keypair": {"name": "tempest-keypair-1932122644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfTx411E0CBXaALi4y90ns5qMmzTPU4g0MWSBRAXXLgi1Tw0e0ZWMcux6/BgxlFJybxSUrpv7ovkr7noxy3atbcT9SOAPQNZPXFllOf15zH5T6lWM7p0F2LOEmxpQICAA=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:47.234675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ffb5aa76-608e-49a1-b81e-c79566847644 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Getting quotas for project 23e3532105a140fdbaf84b5b2ffad712. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:47.241235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ffb5aa76-608e-49a1-b81e-c79566847644 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Getting quotas for user 148f8a3614e048a1b858f2c9744d0a6e and project 23e3532105a140fdbaf84b5b2ffad712. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:47.349692 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ffb5aa76-608e-49a1-b81e-c79566847644 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142611 Oct 28 13:02:47.350707 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 101/202] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:02:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:47.366167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Calling method '.version_select at 0x7f27ba0d7820>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:47.368144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.375193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.376040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.394900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.394900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.394900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.406131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.406959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.407534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.434332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:02:47.435584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:02:47.436230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:02:47.436802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:02:47.442516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:02:47.448061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.448916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.449363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.450850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.451306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.451904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.471972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:47.478400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Getting quotas for project 59c647315b8d40cb860a280f2481937b. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:47.483070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Getting quotas for user f12d8d09d9854e56af516eb7c8bf8c32 and project 59c647315b8d40cb860a280f2481937b. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:47.495293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.utils [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] instances quota exceeded for 59c647315b8d40cb860a280f2481937b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127794) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 13:02:47.496201 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Request method failure captured: Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 145 Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LrhZ1alDnT_R2OvMAcDpjlLl2pZYGGCcj4D5APPu5XGhy0b7p2O2WOUtVf_oHj7JQjwe1Jv2djBFLLCQRTSlGbbvSFvCl7zOW96nMEpuQmfbK7CThN-khBvPdhE9H6bOzhGE6Js0o1h4oRMp8lMOsXnk_oXeBkBBVsaqJF_-QMI5c Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:02:47.500621 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59c647315b8d40cb860a280f2481937b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59c647315b8d40cb860a280f2481937b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: f12d8d09d9854e56af516eb7c8bf8c32 Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1976184423", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} Oct 28 13:02:47.501799 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1976184423', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452'}}} Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 13:02:47.502485 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.504432 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.505533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b892b5d2-37f4-49f4-b4cd-7db95f912d24 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.449581 Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 102/203] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:47 2022] POST /compute/v2.1/servers => generated 119 bytes in 451 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:47.507994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:47.509414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:47.512463 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2caa9602-a962-45ce-bb44-65a937d59e45 tempest-HypervisorAdminTestJSON-1104705172 tempest-HypervisorAdminTestJSON-1104705172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.159668 Oct 28 13:02:47.513879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 102/204] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Oct 28 13:02:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:47.524909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35fc8bd4-c719-4c02-96ac-be676870be1e tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:47.530924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-35fc8bd4-c719-4c02-96ac-be676870be1e tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35fc8bd4-c719-4c02-96ac-be676870be1e tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Request method failure captured: Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 27 Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Lziyr7aBO-lPUm4aFnPoNl3gYgoLsOFiaVerKIf6Dpevjq9UC_ZRakqjNjo7kA8MN-lerNVmDuNmTkqSF200_r4LrCbWV_wbCKCOzooZ2GlP1VIEfcUnJbCrpkj5lVRN4TrfxXVsO7vF3EMEe6oQ8ICkNVaBdUZbBzhbQaERMgJNA Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 70961e025ff5402890021f53279fe307 Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:02:47.532861 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70961e025ff5402890021f53279fe307"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70961e025ff5402890021f53279fe307"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70961e025ff5402890021f53279fe307", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70961e025ff5402890021f53279fe307"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 70961e025ff5402890021f53279fe307 Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 49e3cbad240b4518b3723c53a01a28ea Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: {"hw:cpu_policy": "shared"} Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:47.534091 n-d-862876-2 devstack@n-api.service[127793]: exception: Request body and URI mismatch Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'flavor_id': '1572403442', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.534968 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.536052 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:47.536052 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:47.536052 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 28 13:02:47.536052 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.539982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35fc8bd4-c719-4c02-96ac-be676870be1e tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:47.541377 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35fc8bd4-c719-4c02-96ac-be676870be1e tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.026300 Oct 28 13:02:47.542149 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 103/205] 10.222.0.25 () {60 vars in 1265 bytes} [Fri Oct 28 13:02:47 2022] PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:02:47.552503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Action: 'update', calling method: .version_select at 0x7f27ba05b4c0>, body: {"quota_set": {"instances": 10}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:47.670973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.671164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.671453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.672182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.672753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.673049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.867610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:47.879531 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce34490a-cb0a-4773-9b46-4651a0927927 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1337 microversion: 2.1 time: 0.375667 Oct 28 13:02:47.880331 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 103/206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:47 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1337 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:47.885193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1ed2a93-b4e4-47a1-bf9c-655310f272e0 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1ed2a93-b4e4-47a1-bf9c-655310f272e0 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Request method failure captured: Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 49 Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Lziyr7aBO-lPUm4aFnPoNl3gYgoLsOFiaVerKIf6Dpevjq9UC_ZRakqjNjo7kA8MN-lerNVmDuNmTkqSF200_r4LrCbWV_wbCKCOzooZ2GlP1VIEfcUnJbCrpkj5lVRN4TrfxXVsO7vF3EMEe6oQ8ICkNVaBdUZbBzhbQaERMgJNA Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 70961e025ff5402890021f53279fe307 Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:02:47.891069 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70961e025ff5402890021f53279fe307"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70961e025ff5402890021f53279fe307"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70961e025ff5402890021f53279fe307", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70961e025ff5402890021f53279fe307"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 70961e025ff5402890021f53279fe307 Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 49e3cbad240b4518b3723c53a01a28ea Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 28 13:02:47.899007 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'flavor_id': '1572403442', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance: Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 28 13:02:47.899740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.900949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1ed2a93-b4e4-47a1-bf9c-655310f272e0 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:47.902033 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b1ed2a93-b4e4-47a1-bf9c-655310f272e0 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.011321 Oct 28 13:02:47.903446 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 104/207] 10.222.0.25 () {60 vars in 1265 bytes} [Fri Oct 28 13:02:47 2022] PUT /compute/v2.1/flavors/1572403442/os-extra_specs/hw:numa_nodes => generated 117 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:02:47.908372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0586983-fae4-45ab-8e56-3b2189140fda tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:47.909030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e0586983-fae4-45ab-8e56-3b2189140fda tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:47.953592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.954951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.956016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:47.957498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:47.958119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:47.959130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:48.019008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0586983-fae4-45ab-8e56-3b2189140fda tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:48.027093 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0586983-fae4-45ab-8e56-3b2189140fda tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1218 microversion: 2.1 time: 0.122303 Oct 28 13:02:48.028563 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 105/208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:47 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:48.033152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8989545-e9d6-44fb-a390-e70ef58b1114 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:48.212627 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8989545-e9d6-44fb-a390-e70ef58b1114 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1572403442" status: 202 len: 0 microversion: 2.1 time: 0.178651 Oct 28 13:02:48.212627 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 106/209] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:02:48 2022] DELETE /compute/v2.1/flavors/1572403442 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:02:48.217279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc086a31-5957-4b81-a113-82ce14ea7166 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:48.223722 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c6279e64-9c26-49ab-babc-8ab2f8ebce76 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 329 microversion: 2.1 time: 0.679967 Oct 28 13:02:48.228692 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 104/210] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:02:47 2022] PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 329 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:48.241355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0b434d48-fc90-4040-a83a-ae98ae3db944 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Calling method '.version_select at 0x7f27ba06b9d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:48.250855 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc086a31-5957-4b81-a113-82ce14ea7166 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876 tempest-FlavorsExtraSpecsNegativeTestJSON-1573400876-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030686 Oct 28 13:02:48.250855 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 107/211] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:02:48 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:02:48.592814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0b434d48-fc90-4040-a83a-ae98ae3db944 tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 371 microversion: 2.1 time: 0.356409 Oct 28 13:02:48.593599 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 105/212] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 13:02:48 2022] GET /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:02:48.606168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Action: 'update', calling method: .version_select at 0x7f27ba315160>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:48.902869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:48.912386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:48.912386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:48.912386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:48.912386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:48.912711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:48.913308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:48.913802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:49.294422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:49.295186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:49.296655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:49.297834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:49.299874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:49.301240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:49.390353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:49.400028 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c53c0f81-af0a-4f74-bd2f-6a746158d997 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1487 microversion: 2.1 time: 0.501723 Oct 28 13:02:49.404406 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 106/213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:48 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1487 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:49.422063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:49.423093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:49.438366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:49.439314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:49.444621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:49.444621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:49.444621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:49.444621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:49.482478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-51ea067f-b25d-4774-b203-6d5850930e1a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 325 microversion: 2.1 time: 0.880327 Oct 28 13:02:49.486844 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 108/214] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:02:48 2022] PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 325 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:49.498262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:49.499908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:49.555093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:49.555866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:49.557399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:49.558437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:49.559187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:49.559936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:49.580693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:49.592590 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-211c4d3c-83a5-4440-ba07-b73c461169ff tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1270 microversion: 2.1 time: 0.186939 Oct 28 13:02:49.605487 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 107/215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:49 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:49.816747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-332327461", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:49.901212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:02:50.279429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:02:50.284646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:02:50.284646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:02:50.284646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:02:50.284646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:02:50.302367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:50.304402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:50.308727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:50.309366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b363fa7-ab93-49ce-ace6-67dedf88c14a tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1638 microversion: 2.1 time: 0.819803 Oct 28 13:02:50.309966 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 109/216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:49 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1638 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:50.311601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:50.312192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:50.312853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:50.340781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:50.341472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:50.350837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:50.354701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:50.355394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:50.356322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:50.359407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:50.360075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:50.425283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Getting quotas for project 59c647315b8d40cb860a280f2481937b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:50.426394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:02:50.449156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Getting quotas for user f12d8d09d9854e56af516eb7c8bf8c32 and project 59c647315b8d40cb860a280f2481937b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:50.485348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.utils [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] ram quota exceeded for 59c647315b8d40cb860a280f2481937b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127793) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 13:02:50.491639 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Request method failure captured: Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 144 Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LrhZ1alDnT_R2OvMAcDpjlLl2pZYGGCcj4D5APPu5XGhy0b7p2O2WOUtVf_oHj7JQjwe1Jv2djBFLLCQRTSlGbbvSFvCl7zOW96nMEpuQmfbK7CThN-khBvPdhE9H6bOzhGE6Js0o1h4oRMp8lMOsXnk_oXeBkBBVsaqJF_-QMI5c Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:50.498678 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59c647315b8d40cb860a280f2481937b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59c647315b8d40cb860a280f2481937b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: f12d8d09d9854e56af516eb7c8bf8c32 Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-332327461", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} Oct 28 13:02:50.501219 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-332327461', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452'}}} Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 13:02:50.501976 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:50.503315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:50.504394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:50.506166 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07923711-617b-49b8-a1f3-4e437388381d tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.689780 Oct 28 13:02:50.508387 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 108/217] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 697 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:50.526246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Action: 'update', calling method: .version_select at 0x7f27ba0ea160>, body: {"quota_set": {"ram": 51200}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:51.112564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2dd34abb-7823-4b6d-aa97-0129f4a7f760 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 204 len: 0 microversion: 2.1 time: 0.779795 Oct 28 13:02:51.112564 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 110/218] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:02:50 2022] DELETE /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:02:51.123662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:51.124835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:51.134097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:51.135127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:51.136123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:51.137151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:51.137698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:51.138411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:51.221324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:51.232279 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-02f4396b-fe4c-4fff-b351-abd9a0f5f4a4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1276 microversion: 2.1 time: 0.114638 Oct 28 13:02:51.232910 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 111/219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:51 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:51.240093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:51.241052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:51.248733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:51.249483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:51.250891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:51.252162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:51.253262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:51.253914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:51.426022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:51.429308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:51.431326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:51.435218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:51.436001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:51.436794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:51.493268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:51.505100 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fdbc7b1a-ac0b-44a6-b9e2-30bb74eeb822 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1493 microversion: 2.1 time: 0.270959 Oct 28 13:02:51.506409 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 112/220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:51 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1493 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:51.560883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1555541913", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "785436589", "adminPass": "***", "networks": [{"uuid": "498fe085-27a0-47ba-8ff5-00f62dd39d69"}], "security_groups": [{"name": "tempest-securitygroup--1750132622"}], "key_name": "tempest-keypair-1932122644", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:51.717926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8fb51a0c-05f5-49fa-b1fb-0e2ad6c7742a tempest-QuotasAdminNegativeTest-779904849 tempest-QuotasAdminNegativeTest-779904849-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 200 len: 329 microversion: 2.1 time: 1.194425 Oct 28 13:02:51.718315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] validate_networks() for [('498fe085-27a0-47ba-8ff5-00f62dd39d69', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:02:51.719022 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 109/221] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:02:50 2022] PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 329 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:51.736418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29d82577-5967-4c16-8bc4-6c97123f30d9 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Action: 'update', calling method: .version_select at 0x7f27ba05bd30>, body: {"quota_set": {"ram": 0}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:51.742716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-29d82577-5967-4c16-8bc4-6c97123f30d9 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f12d8d09d9854e56af516eb7c8bf8c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c647315b8d40cb860a280f2481937b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29d82577-5967-4c16-8bc4-6c97123f30d9 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Request method failure captured: Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b HTTP/1.1 Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 25 Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LrhZ1alDnT_R2OvMAcDpjlLl2pZYGGCcj4D5APPu5XGhy0b7p2O2WOUtVf_oHj7JQjwe1Jv2djBFLLCQRTSlGbbvSFvCl7zOW96nMEpuQmfbK7CThN-khBvPdhE9H6bOzhGE6Js0o1h4oRMp8lMOsXnk_oXeBkBBVsaqJF_-QMI5c Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:51.744914 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59c647315b8d40cb860a280f2481937b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59c647315b8d40cb860a280f2481937b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59c647315b8d40cb860a280f2481937b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 59c647315b8d40cb860a280f2481937b Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-187268828 Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: f12d8d09d9854e56af516eb7c8bf8c32 Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-QuotasAdminNegativeTest-187268828-project Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: {"quota_set": {"ram": 0}} Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 13:02:51.746129 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '59c647315b8d40cb860a280f2481937b', 'body': {'quota_set': {'ram': 0}}} Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:02:51.747475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:51.748722 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:51.752130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:51.752130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:51.752130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:02:51.752130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:02:51.752130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 13:02:51.752130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:51.754439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29d82577-5967-4c16-8bc4-6c97123f30d9 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:51.755708 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-29d82577-5967-4c16-8bc4-6c97123f30d9 tempest-QuotasAdminNegativeTest-187268828 tempest-QuotasAdminNegativeTest-187268828-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b" status: 403 len: 116 microversion: 2.1 time: 0.023315 Oct 28 13:02:51.756370 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 110/222] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:02:51 2022] PUT /compute/v2.1/os-quota-sets/59c647315b8d40cb860a280f2481937b => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:52.260155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:52.260870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:52.267969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:52.268519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:52.268969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:52.269644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:52.271337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:52.271337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:52.603417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:52.611983 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-207c22a8-ea18-4f04-bc1b-138c51eddf41 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.356102 Oct 28 13:02:52.612857 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 111/223] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:52 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:02:52.617738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:52.626030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:52.634231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:52.639585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:52.641492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:52.643683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:52.644347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:52.644924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:53.005892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:53.025665 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94a48b9f-647e-461d-bed0-a633fa04d827 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1493 microversion: 2.1 time: 0.411563 Oct 28 13:02:53.026294 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 112/224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:52 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1493 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:53.565748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:02:53.566367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:02:53.566635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:02:53.567076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:02:53.567571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:02:53.576471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:53.576988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:53.577427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:53.578387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:53.579110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:53.579550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:53.598914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Getting quotas for project 23e3532105a140fdbaf84b5b2ffad712. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:53.606792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Getting quotas for user 148f8a3614e048a1b858f2c9744d0a6e and project 23e3532105a140fdbaf84b5b2ffad712. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:53.623158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:02:53.626966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:02:53.653522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:53.653522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:53.673954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:53.674522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:53.676617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:53.678873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:53.680750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:53.682191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:53.951084 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be37e4c9-4611-4355-a4f7-43ba26dbcea5 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.396210 Oct 28 13:02:53.952378 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 113/225] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:02:53.958223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-32e59b95-18d4-4e05-b918-880725624387 req-f99a03e4-2187-48ab-ae0c-25c7bd0d7281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90f3acc-bae4-469a-9b52-ebeb2e7e7e19", "name": "network-vif-deleted", "tag": "2c2940ce-bc47-4d29-b36c-8bdf53dbd35d"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:53.975942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-32e59b95-18d4-4e05-b918-880725624387 req-f99a03e4-2187-48ab-ae0c-25c7bd0d7281 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:53.976634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-32e59b95-18d4-4e05-b918-880725624387 req-f99a03e4-2187-48ab-ae0c-25c7bd0d7281 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:53.977311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-32e59b95-18d4-4e05-b918-880725624387 req-f99a03e4-2187-48ab-ae0c-25c7bd0d7281 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:54.004263 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-32e59b95-18d4-4e05-b918-880725624387 req-f99a03e4-2187-48ab-ae0c-25c7bd0d7281 service nova] Creating event network-vif-deleted:2c2940ce-bc47-4d29-b36c-8bdf53dbd35d for instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 on n-h2-862876-2 Oct 28 13:02:54.015694 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-32e59b95-18d4-4e05-b918-880725624387 req-f99a03e4-2187-48ab-ae0c-25c7bd0d7281 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061527 Oct 28 13:02:54.023250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:54.023554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 114/226] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:54.029739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95644d55-57ce-4097-941c-f49b22956deb tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:54.030727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95644d55-57ce-4097-941c-f49b22956deb tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:54.072537 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eab37af9-8f6d-4bbf-89d2-a50d3b789d05 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.438239 Oct 28 13:02:54.075483 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 113/227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:53 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:02:54.087441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:54.088282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:54.106160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:54.106665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:54.111447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:54.112164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:54.112651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:54.113189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:54.233879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:54.245957 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa3fec21-9691-41d1-bb37-d1f034ce37e2 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1322 microversion: 2.1 time: 0.169240 Oct 28 13:02:54.251708 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 114/228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:54 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:54.329978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95644d55-57ce-4097-941c-f49b22956deb tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:54.342615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95644d55-57ce-4097-941c-f49b22956deb tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1263 microversion: 2.1 time: 0.319138 Oct 28 13:02:54.349129 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 115/229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:54 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1263 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:55.097466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:55.098071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:55.113744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:55.115021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:55.115736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:55.117321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:55.118109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:55.118602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:55.291153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:55.292417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:55.304253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:55.306271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:55.309608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:55.310565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:55.311361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:55.312629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:55.357797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:55.365278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:55.365362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:55.365775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:55.366257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lazy-loading 'fault' on Instance uuid b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:02:55.368161 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-313b66f2-9f79-4cd6-8c19-12abe16ee345 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.274389 Oct 28 13:02:55.386138 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 115/230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:55 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:55.392636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3596036e-cda9-4a05-b821-569c658d324d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:55.393953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3596036e-cda9-4a05-b821-569c658d324d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:55.476312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3596036e-cda9-4a05-b821-569c658d324d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:55.483838 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3596036e-cda9-4a05-b821-569c658d324d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1263 microversion: 2.1 time: 0.095703 Oct 28 13:02:55.485624 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 116/231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:55 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:55.534986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e8ff8dcf344a169f57264a102f1afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554f4055a18401aa38b8cea29c1f75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:55.545251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9698316a-7a35-4aec-860c-da1f9f5682bc tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 200 len: 1327 microversion: 2.1 time: 0.257891 Oct 28 13:02:55.554900 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 116/232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:55 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 1327 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:02:56.399446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:56.400647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:56.423257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:56.424499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:56.424499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:56.429511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:56.430106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:56.431558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:56.656493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c66c8096-11db-47e9-9c26-28529380d8dc tempest-InstanceUsageAuditLogTestJSON-1093024847 tempest-InstanceUsageAuditLogTestJSON-1093024847-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:56.700786 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c66c8096-11db-47e9-9c26-28529380d8dc tempest-InstanceUsageAuditLogTestJSON-1093024847 tempest-InstanceUsageAuditLogTestJSON-1093024847-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 13:02:55" status: 200 len: 318 microversion: 2.1 time: 0.720119 Oct 28 13:02:56.701571 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 117/233] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:02:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2013%3A02%3A55 => generated 318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:56.714521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:56.716004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:56.728539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:56.729030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:56.739138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:56.740357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:56.741071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:56.741956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:56.828174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:56.840765 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2fe15218-d744-48c4-a824-fb4a70f7d1c8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1336 microversion: 2.1 time: 0.129494 Oct 28 13:02:56.850183 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 118/234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:56 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1336 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:56.872615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:56.873739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:56.880132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:56.880943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:56.881387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:56.882184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:56.883060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:56.883632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:56.901082 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] HTTP exception thrown: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Request method failure captured: Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 HTTP/1.1 Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LS7cjZQyYsBnqVC9O48V5QtSfTnonbQ2ZboXoUqrocjea0PqqvKuBXfIQ98C_fSthfESL0tk6yb1AP5w2lMF9FcZGpyvPhTRqYIOHAH4N3Vy3pAm4OZLHmn41eIVpEunOAghTyZOycvcF5KY3Cnaxu7O5uRBdblPA5kdZntT1C-Ws Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5554f4055a18401aa38b8cea29c1f75d Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:02:56.903865 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5554f4055a18401aa38b8cea29c1f75d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5554f4055a18401aa38b8cea29c1f75d Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminTestJSON-1942659910-project Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 94e8ff8dcf344a169f57264a102f1afe Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminTestJSON-1942659910-project Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:02:56.905060 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b90f3acc-bae4-469a-9b52-ebeb2e7e7e19'} Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:02:56.906215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:02:56.907379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:02:56.925177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Returning 404 to user: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:02:56.926559 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ffab64c-ad03-4188-9f12-7c3e437b71a0 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 404 len: 111 microversion: 2.1 time: 0.075047 Oct 28 13:02:56.927744 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 119/235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:56 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:02:56.998285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:57.009698 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d5d5fb4-8e5c-4cbb-a7c5-86fb3031d14a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.619158 Oct 28 13:02:57.017657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 117/236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:56 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:57.018812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1a1aaf1-d0b4-4d83-92c0-5ab3a09dd8d1 tempest-InstanceUsageAuditLogTestJSON-1093024847 tempest-InstanceUsageAuditLogTestJSON-1093024847-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:57.060446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1a1aaf1-d0b4-4d83-92c0-5ab3a09dd8d1 tempest-InstanceUsageAuditLogTestJSON-1093024847 tempest-InstanceUsageAuditLogTestJSON-1093024847-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.045924 Oct 28 13:02:57.061068 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 118/237] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Oct 28 13:02:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:57.078011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4318d737-9f79-4992-b274-0641daf85e4d tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:57.091940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-273339416", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:57.108643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4318d737-9f79-4992-b274-0641daf85e4d tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:57.111471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4318d737-9f79-4992-b274-0641daf85e4d tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:57.112187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4318d737-9f79-4992-b274-0641daf85e4d tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:57.242243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:02:57.537469 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4318d737-9f79-4992-b274-0641daf85e4d tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.1 time: 0.472008 Oct 28 13:02:57.552725 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 119/238] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:57.557445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8aaf8f1e-2ac0-4693-ad47-19353f8d0c39 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:57.716475 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8aaf8f1e-2ac0-4693-ad47-19353f8d0c39 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.162577 Oct 28 13:02:57.719745 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 120/239] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:57 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:57.736374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-744ec287-e306-4d02-948b-c5acaa4c0f3f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-26773889"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:57.741758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-744ec287-e306-4d02-948b-c5acaa4c0f3f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid 9d65af3f-4beb-4787-9202-8ace442613a8 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:57.765839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:02:57.765839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:02:57.766574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:02:57.767164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:02:57.767720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:02:57.774517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:RELEASE=1,nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:57.791630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:57.792476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:57.793620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:57.794574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:57.795212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:57.796021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:57.816118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Getting quotas for project cc5b202053784198b6b227ca75f193e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:02:57.820459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Getting quotas for user 7fb9bade40944010b614a5e6be68fe16 and project cc5b202053784198b6b227ca75f193e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:02:57.833973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:02:57.840767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:02:57.889952 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-744ec287-e306-4d02-948b-c5acaa4c0f3f tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.157174 Oct 28 13:02:57.897756 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 121/240] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:57 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:57.905088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:57.905980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:57.908951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:57.914838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:57.915587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:57.916217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:57.917108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:57.917739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:57.919052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:57.995235 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d37cef54-0c2e-4613-b1bc-455eda342c66 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066125 Oct 28 13:02:57.995863 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 120/241] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:02:58.005093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-998fdd5e-e661-4dd7-b03d-d379df242436 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:58.054579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998fdd5e-e661-4dd7-b03d-d379df242436 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:58.058509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998fdd5e-e661-4dd7-b03d-d379df242436 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:58.059881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998fdd5e-e661-4dd7-b03d-d379df242436 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:58.076112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:58.155313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:58.174175 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e733d326-080d-4d5a-9505-e1951f81e1e2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1321 microversion: 2.1 time: 0.273845 Oct 28 13:02:58.174789 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 122/242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:57 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:58.190649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f140b419-5b33-43c8-a17f-f58260503aab tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:58.194360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f140b419-5b33-43c8-a17f-f58260503aab tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:58.397456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f140b419-5b33-43c8-a17f-f58260503aab tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:58.414686 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f140b419-5b33-43c8-a17f-f58260503aab tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1213 microversion: 2.1 time: 0.235527 Oct 28 13:02:58.430680 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:58 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1213 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:58.439515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:58.439515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:58.448279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:58.448994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:58.451020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:58.452937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:58.453574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:58.457985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:58.548623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:02:58.568506 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-998fdd5e-e661-4dd7-b03d-d379df242436 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 240 microversion: 2.1 time: 0.571172 Oct 28 13:02:58.569342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 121/244] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:57 2022] POST /compute/v2.1/os-aggregates/8/action => generated 240 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:58.586843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7eeb49ae-e78a-4424-b469-50fab86dee1b tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:58.606794 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7eeb49ae-e78a-4424-b469-50fab86dee1b tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.023196 Oct 28 13:02:58.609164 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 122/245] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:02:58 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:58.624664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3510c22b-4f15-4d8b-b2e2-5379702ce362 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:58.646256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3510c22b-4f15-4d8b-b2e2-5379702ce362 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:58.647318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3510c22b-4f15-4d8b-b2e2-5379702ce362 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:58.648069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3510c22b-4f15-4d8b-b2e2-5379702ce362 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:59.006237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:59.019019 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-53ea3f7e-f4ac-4a79-888f-7ef1c96096e7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.596347 Oct 28 13:02:59.038650 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 124/246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:58 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:59.140703 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3510c22b-4f15-4d8b-b2e2-5379702ce362 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 225 microversion: 2.1 time: 0.524698 Oct 28 13:02:59.141480 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 123/247] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:58 2022] POST /compute/v2.1/os-aggregates/8/action => generated 225 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:59.153964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-734ba4bc-d687-470c-aad6-5e0f2b6041f9 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:59.235852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6951a667-20ef-4af3-8ba9-82183d54f84b req-ee3ba400-91ba-48d3-aa76-97e7ad238bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bdfcdd-1fcf-489a-bfe0-d842d4a75b89", "tag": "05d151cf-cbd4-4456-b3ac-4f97871022dd"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:59.250025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6951a667-20ef-4af3-8ba9-82183d54f84b req-ee3ba400-91ba-48d3-aa76-97e7ad238bf1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:59.251252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6951a667-20ef-4af3-8ba9-82183d54f84b req-ee3ba400-91ba-48d3-aa76-97e7ad238bf1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:59.251840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6951a667-20ef-4af3-8ba9-82183d54f84b req-ee3ba400-91ba-48d3-aa76-97e7ad238bf1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:59.267905 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6951a667-20ef-4af3-8ba9-82183d54f84b req-ee3ba400-91ba-48d3-aa76-97e7ad238bf1 service nova] Creating event network-changed:05d151cf-cbd4-4456-b3ac-4f97871022dd for instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 on n-h1-862876-2 Oct 28 13:02:59.275641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6951a667-20ef-4af3-8ba9-82183d54f84b req-ee3ba400-91ba-48d3-aa76-97e7ad238bf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235013 Oct 28 13:02:59.276918 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 125/248] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:59.283161 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-734ba4bc-d687-470c-aad6-5e0f2b6041f9 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.133418 Oct 28 13:02:59.283983 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 124/249] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:02:59 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:02:59.291266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:59.292930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:59.298281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d328752-8804-453a-b22c-ac154cf13eb0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-572507383"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:59.302836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:59.303658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:59.304323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:59.305122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-0d328752-8804-453a-b22c-ac154cf13eb0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid 777cb6d5-d597-4379-a8cd-d22e01a0ef08 for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:02:59.305547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:59.307023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:59.307940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:59.414948 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d328752-8804-453a-b22c-ac154cf13eb0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.122678 Oct 28 13:02:59.416633 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 125/250] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:02:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:59.431211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:59.431720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-42472bc5-c968-4f36-9191-e08fa5805f48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:59.443010 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3f31d3c-02ca-4211-934c-e2f728734484 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1321 microversion: 2.1 time: 0.164523 Oct 28 13:02:59.443787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42472bc5-c968-4f36-9191-e08fa5805f48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:59.444274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42472bc5-c968-4f36-9191-e08fa5805f48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:59.444707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42472bc5-c968-4f36-9191-e08fa5805f48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:02:59.457213 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 126/251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:59 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:59.464963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad3bc89d-741f-4f9f-ba16-e7a0ee8224b9 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:59.465595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ad3bc89d-741f-4f9f-ba16-e7a0ee8224b9 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:02:59.557372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad3bc89d-741f-4f9f-ba16-e7a0ee8224b9 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:02:59.567223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad3bc89d-741f-4f9f-ba16-e7a0ee8224b9 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1213 microversion: 2.1 time: 0.107041 Oct 28 13:02:59.568364 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 127/252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:02:59 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:02:59.886003 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-42472bc5-c968-4f36-9191-e08fa5805f48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.460124 Oct 28 13:02:59.888456 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 126/253] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:59 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:59.899578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8a6c0e5d-14f0-43d6-8ddb-ad1b6ecf6271 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:02:59.930063 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8a6c0e5d-14f0-43d6-8ddb-ad1b6ecf6271 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.026982 Oct 28 13:02:59.930933 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 128/254] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:02:59 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:02:59.943090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-534847bf-f61d-4821-85b5-8c34e0e79659 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:02:59.970890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-534847bf-f61d-4821-85b5-8c34e0e79659 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:02:59.971369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-534847bf-f61d-4821-85b5-8c34e0e79659 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:02:59.971808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-534847bf-f61d-4821-85b5-8c34e0e79659 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:00.052225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:00.055366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:00.082483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:00.091072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:00.095136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:00.097860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:00.098532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:00.099146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:00.410184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:00.427282 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdd0d25f-7c74-449f-9d7f-6d2bbdc11c1a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.385039 Oct 28 13:03:00.427909 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 129/255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:00 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:00.440785 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-534847bf-f61d-4821-85b5-8c34e0e79659 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.501458 Oct 28 13:03:00.448587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 127/256] 10.222.0.25 () {60 vars in 1191 bytes} [Fri Oct 28 13:02:59 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:00.461106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8a2d3f87-07fe-426c-b61d-753b1c7c1e43 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:00.468467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:00.469371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:00.487699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:00.490916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:00.490916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:00.490916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:00.490916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:00.491316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:00.606379 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8a2d3f87-07fe-426c-b61d-753b1c7c1e43 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.151200 Oct 28 13:03:00.607500 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 130/257] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:03:00 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:03:00.617111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:00.617340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:00.633346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:00.633953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:00.634954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:00.637073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:00.637759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:00.639883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:00.831961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:00.856260 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b80ee7df-4795-44db-a486-66f9104b2b53 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1209 microversion: 2.1 time: 0.244867 Oct 28 13:03:00.859150 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 131/258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:00 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1209 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:00.891968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e495f281-d867-480d-8bea-c7a6a89da818 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1931948624"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:00.898867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-e495f281-d867-480d-8bea-c7a6a89da818 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid c37fa5c1-ef09-4c4d-abf4-5921f0ecedc8 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:01.086240 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e495f281-d867-480d-8bea-c7a6a89da818 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.220813 Oct 28 13:03:01.092603 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 132/259] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:03:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:01.103226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-299b2a32-0290-4e75-99a7-fb5eadb23c00 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:01.130593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:01.132224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-299b2a32-0290-4e75-99a7-fb5eadb23c00 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:01.133640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-299b2a32-0290-4e75-99a7-fb5eadb23c00 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:01.136708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-299b2a32-0290-4e75-99a7-fb5eadb23c00 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:01.142094 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a37e6e9f-a1f5-49b5-8ba8-dfc073182039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.677509 Oct 28 13:03:01.155892 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 128/260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:00 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:01.255890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6367babf-3831-41f1-b935-9447acac0587 req-053941c3-4ee4-4026-943b-2842de7dc927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69e5a01-bef1-4cb9-91d4-63e5124edbb3", "tag": "0f7c5045-27c5-4a52-9053-48527718260e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:01.281844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6367babf-3831-41f1-b935-9447acac0587 req-053941c3-4ee4-4026-943b-2842de7dc927 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:01.286955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6367babf-3831-41f1-b935-9447acac0587 req-053941c3-4ee4-4026-943b-2842de7dc927 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:01.287431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6367babf-3831-41f1-b935-9447acac0587 req-053941c3-4ee4-4026-943b-2842de7dc927 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:01.310230 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6367babf-3831-41f1-b935-9447acac0587 req-053941c3-4ee4-4026-943b-2842de7dc927 service nova] Creating event network-changed:0f7c5045-27c5-4a52-9053-48527718260e for instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 on n-h2-862876-2 Oct 28 13:03:01.324444 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6367babf-3831-41f1-b935-9447acac0587 req-053941c3-4ee4-4026-943b-2842de7dc927 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076250 Oct 28 13:03:01.325157 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 129/261] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:01.461871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:01.461871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:01.465878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-299b2a32-0290-4e75-99a7-fb5eadb23c00 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.366415 Oct 28 13:03:01.466506 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 133/262] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:03:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:01.473809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:01.478204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:01.481633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d77088d2-9e79-497d-bb6e-cf35ef664a56 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:01.482914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:01.483671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:01.484148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:01.484581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:01.499849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d77088d2-9e79-497d-bb6e-cf35ef664a56 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:01.500963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d77088d2-9e79-497d-bb6e-cf35ef664a56 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:01.501544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d77088d2-9e79-497d-bb6e-cf35ef664a56 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:01.838096 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d77088d2-9e79-497d-bb6e-cf35ef664a56 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.361151 Oct 28 13:03:01.838096 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 134/263] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:03:01 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:01.850859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60e47ec2-a98c-4fa9-9f7c-c1ff27f484ac tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:01.972930 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60e47ec2-a98c-4fa9-9f7c-c1ff27f484ac tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.126475 Oct 28 13:03:01.973628 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 135/264] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:01 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 13:03:01.991495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:01.992375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:02.005233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:02.006319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:02.006763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:02.007625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:02.008156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:02.008872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:02.212843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:02.240407 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36dc027d-cf34-46fb-a627-983714ed925e tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.785612 Oct 28 13:03:02.253510 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 130/265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:01 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:02.279273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bcf89f94-9cf0-4342-8cb7-d09c47c2b1b7 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1672583250"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:02.292781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-bcf89f94-9cf0-4342-8cb7-d09c47c2b1b7 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid 4e28ec55-5ba3-48c4-9e10-b8853abc16ed for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:02.306426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:02.318852 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5bbc9ef4-50d2-4492-8a7d-5728199f3c18 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1273 microversion: 2.1 time: 0.339671 Oct 28 13:03:02.318852 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 136/266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:01 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:02.336147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2977be64-dc0e-4bd0-8ec9-ba8f109e0576 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-908265396"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:02.338989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-2977be64-dc0e-4bd0-8ec9-ba8f109e0576 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid bfb00192-a0bb-4839-a99d-fdf6d31da5bb for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:02.424518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bcf89f94-9cf0-4342-8cb7-d09c47c2b1b7 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.163549 Oct 28 13:03:02.430146 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 131/267] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:03:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:02.430262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:02.434879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:02.455090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:02.455746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:02.456490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:02.457466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:02.458332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:02.462858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:02.470939 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2977be64-dc0e-4bd0-8ec9-ba8f109e0576 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.148385 Oct 28 13:03:02.473108 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 137/268] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:03:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:02.512557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-592395f6-56ac-496d-8a19-310c32fda70d tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:02.655858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-592395f6-56ac-496d-8a19-310c32fda70d tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.180083 Oct 28 13:03:02.656461 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 138/269] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:02 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:03:02.667045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5aa15198-bbf4-45fa-bd3a-4768480a1963 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:02.695035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5aa15198-bbf4-45fa-bd3a-4768480a1963 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:02.695529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5aa15198-bbf4-45fa-bd3a-4768480a1963 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:02.695962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5aa15198-bbf4-45fa-bd3a-4768480a1963 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:02.963479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:02.972896 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06422e3a-8e7c-49b0-866e-6d6174b009b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.546106 Oct 28 13:03:02.981231 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 132/270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:02 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:02.983796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-39d982ac-a37d-49fb-8fad-771108217650 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.001335 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-39d982ac-a37d-49fb-8fad-771108217650 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-39d982ac-a37d-49fb-8fad-771108217650 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Request method failure captured: Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LVFr8rub86fZAbI5QTll7OzWsv-FWtCL9qMonJqgUjucCFFFYoa44wN4dx8B0cCSl6KRQnndov3KYEqTASDbqRmd08Kq7o3IIrFZNd_5PVlb_LWqNOiJrWJ2qEX0FlUDw23dRxSEe7O1_7y2UGnhLwPMKks_rPdnLTGEURN1TzCmk Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:03:03.004062 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aef5651d099479baeb1ad3aa0da5d4a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6153664a73194854a091bb83a9539b73 Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: exception: Aggregate 11 could not be found. Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '11'} Oct 28 13:03:03.005263 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.006001 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 28 13:03:03.014805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.022972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-39d982ac-a37d-49fb-8fad-771108217650 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:03.022972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-39d982ac-a37d-49fb-8fad-771108217650 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.032734 Oct 28 13:03:03.022972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 133/271] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:03:02 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:03.023189 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5aa15198-bbf4-45fa-bd3a-4768480a1963 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.356993 Oct 28 13:03:03.023189 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 139/272] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:03:02 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:03.023647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1983a334-91c2-428b-94eb-1da6f03322e2 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.030981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ca76080-ae59-4b4a-8d8d-bf548579b85c tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:03.034637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ca76080-ae59-4b4a-8d8d-bf548579b85c tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2235b4efc93d4c3097e8ca16f93c8583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91f1adb201f4632aedda480bfb74296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ca76080-ae59-4b4a-8d8d-bf548579b85c tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Request method failure captured: Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 42 Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LRiW68wPiNfs_1PDJiJMNKsZ7xjKWmeDBCOYHcV3H1db0CQwSNlXe7T8UdUKM1Yt-_AVZzw5qu02dcaOVXWoJBrYEzHJSema2sQY85tEjnH-lqp9z8bpobuaprs72UUA6fucIen88e6nsJEdueC4S09i5QMxli1IB1h5NPLFioPv0 Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:03.045630 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e91f1adb201f4632aedda480bfb74296", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e91f1adb201f4632aedda480bfb74296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e91f1adb201f4632aedda480bfb74296 Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-886021404 Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2235b4efc93d4c3097e8ca16f93c8583 Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-886021404-project Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: {"remove_host": {"host": "n-h2-862876-2"}} Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:03.047306 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-862876-2'}}} Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:03.048026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 13:03:03.049585 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.050783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ca76080-ae59-4b4a-8d8d-bf548579b85c tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:03.050783 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ca76080-ae59-4b4a-8d8d-bf548579b85c tempest-AggregatesAdminNegativeTestJSON-886021404 tempest-AggregatesAdminNegativeTestJSON-886021404-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.020605 Oct 28 13:03:03.050783 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 140/273] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:03:03 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:03.061671 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1983a334-91c2-428b-94eb-1da6f03322e2 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 28 13:03:03.061873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6fa10d06-caa7-4bcd-a341-52cdf2c5af34 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1983a334-91c2-428b-94eb-1da6f03322e2 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Request method failure captured: Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LVFr8rub86fZAbI5QTll7OzWsv-FWtCL9qMonJqgUjucCFFFYoa44wN4dx8B0cCSl6KRQnndov3KYEqTASDbqRmd08Kq7o3IIrFZNd_5PVlb_LWqNOiJrWJ2qEX0FlUDw23dRxSEe7O1_7y2UGnhLwPMKks_rPdnLTGEURN1TzCmk Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:03:03.066443 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aef5651d099479baeb1ad3aa0da5d4a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6153664a73194854a091bb83a9539b73 Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: exception: Aggregate 11 could not be found. Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '11'} Oct 28 13:03:03.067648 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:03.068586 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.069584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.072583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.072583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:03.072583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:03.072583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 28 13:03:03.072583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.076117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1983a334-91c2-428b-94eb-1da6f03322e2 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:03.077317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1983a334-91c2-428b-94eb-1da6f03322e2 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.059767 Oct 28 13:03:03.078395 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 134/274] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:03 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:03.084124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fa10d06-caa7-4bcd-a341-52cdf2c5af34 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:03.084622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fa10d06-caa7-4bcd-a341-52cdf2c5af34 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:03.085066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fa10d06-caa7-4bcd-a341-52cdf2c5af34 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:03.092290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cd9f9345-f4cf-41b6-9931-89b555f6bb37 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1807987256", "name": "tempest-test_aggregate-189927060"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:03.147332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-cd9f9345-f4cf-41b6-9931-89b555f6bb37 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid c059aee7-56ea-4719-8225-97b8cf2fa212 for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:03.247887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cd9f9345-f4cf-41b6-9931-89b555f6bb37 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.163570 Oct 28 13:03:03.251157 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 135/275] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Oct 28 13:03:03 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:03.261509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9cc70f2-92da-486b-9b54-0287b48d9359 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.412043 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9cc70f2-92da-486b-9b54-0287b48d9359 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.155093 Oct 28 13:03:03.413082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 136/276] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:03 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 13:03:03.420892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.421687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:03.440866 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6fa10d06-caa7-4bcd-a341-52cdf2c5af34 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.388594 Oct 28 13:03:03.441949 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 141/277] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:03:03 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:03.447108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.447651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:03.448382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:03.449223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:03.450310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:03.454243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:03.454987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:03.455620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:03.474862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:03.475370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:03.475813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:03.476529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:03.476990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:03.477426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:03.593256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:03.598018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=12 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:03.612387 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a307bb0d-83d0-45cb-a82b-85ea9937d07a tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1271 microversion: 2.1 time: 0.169146 Oct 28 13:03:03.628649 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 142/278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:03 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:03.644236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d61082dc-8edf-4f21-a204-7d048b2588ae tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.649880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:03.661768 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d61082dc-8edf-4f21-a204-7d048b2588ae tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 28 13:03:03.662944 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-777d87fe-f48a-4c27-87b7-4a3db62f847f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.246404 Oct 28 13:03:03.663555 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 137/279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:03 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d61082dc-8edf-4f21-a204-7d048b2588ae tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Request method failure captured: Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LVFr8rub86fZAbI5QTll7OzWsv-FWtCL9qMonJqgUjucCFFFYoa44wN4dx8B0cCSl6KRQnndov3KYEqTASDbqRmd08Kq7o3IIrFZNd_5PVlb_LWqNOiJrWJ2qEX0FlUDw23dRxSEe7O1_7y2UGnhLwPMKks_rPdnLTGEURN1TzCmk Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:03.665513 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aef5651d099479baeb1ad3aa0da5d4a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6153664a73194854a091bb83a9539b73 Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: exception: Aggregate 13 could not be found. Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '13'} Oct 28 13:03:03.666972 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.667871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 28 13:03:03.669288 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.670471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d61082dc-8edf-4f21-a204-7d048b2588ae tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:03.670471 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d61082dc-8edf-4f21-a204-7d048b2588ae tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.037235 Oct 28 13:03:03.671108 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 143/280] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:03:03 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:03.679743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd4d2a94-eb0d-4808-96b1-24b1f7215585 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.684363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d23b8b48-3724-4f03-a7e2-419371d62bbf tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.713103 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d23b8b48-3724-4f03-a7e2-419371d62bbf tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d23b8b48-3724-4f03-a7e2-419371d62bbf tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Request method failure captured: Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LVFr8rub86fZAbI5QTll7OzWsv-FWtCL9qMonJqgUjucCFFFYoa44wN4dx8B0cCSl6KRQnndov3KYEqTASDbqRmd08Kq7o3IIrFZNd_5PVlb_LWqNOiJrWJ2qEX0FlUDw23dRxSEe7O1_7y2UGnhLwPMKks_rPdnLTGEURN1TzCmk Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:03.723105 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1aef5651d099479baeb1ad3aa0da5d4a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1aef5651d099479baeb1ad3aa0da5d4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 1aef5651d099479baeb1ad3aa0da5d4a Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1779417046 Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6153664a73194854a091bb83a9539b73 Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminTestJSON-1779417046-project-admin Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: exception: Aggregate 13 could not be found. Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '13'} Oct 28 13:03:03.724553 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:03.725299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:03.726263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d23b8b48-3724-4f03-a7e2-419371d62bbf tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d23b8b48-3724-4f03-a7e2-419371d62bbf tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.047489 Oct 28 13:03:03.727338 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 144/281] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:03 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:03.746442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0a7de7d3-57c3-4f66-a204-262f1fb77e31 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214423137"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:03.758123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-0a7de7d3-57c3-4f66-a204-262f1fb77e31 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid 1c629722-ed18-453b-b60b-210cd611b9e6 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:03.813662 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd4d2a94-eb0d-4808-96b1-24b1f7215585 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.140809 Oct 28 13:03:03.814405 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 138/282] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:03 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:03:03.824829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55e17d9a-7fa0-4571-a6ba-a9fca116b642 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-797860413"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:03.828277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-55e17d9a-7fa0-4571-a6ba-a9fca116b642 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Generated uuid 0c4df8c2-e32c-4f88-85bd-a4e6a96138ee for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:03.851502 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0a7de7d3-57c3-4f66-a204-262f1fb77e31 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.118370 Oct 28 13:03:03.861901 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 145/283] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:03:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:03.875378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c132ab38-7b12-47ec-8b5c-66f822c38d63 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:03.890789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c132ab38-7b12-47ec-8b5c-66f822c38d63 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.027746 Oct 28 13:03:03.894386 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 146/284] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:03:03 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:03.912143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8254f732-b071-4d4d-8777-f557627d616e tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:03.989916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-55e17d9a-7fa0-4571-a6ba-a9fca116b642 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.169356 Oct 28 13:03:03.997504 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 139/285] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:03:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:04.004419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:04.005197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:04.013423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:DELETE=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:04.020008 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8254f732-b071-4d4d-8777-f557627d616e tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.115592 Oct 28 13:03:04.023471 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 147/286] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:03:03 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:04.025870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.026838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.027530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.028396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.029060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.029667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.032143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:04.048715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=8,nova_api:INSERT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:04.057277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.057763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.062245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.097077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.099783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.100290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.134370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.compute.aggregates [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 13:03:04.135595 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Request method failure captured: Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 42 Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LU4ZdLTj6GOh-OlPyWppKoP9VnLzfwn1ybeJGvdDklnhRZQ9Dz3_cuvH-Om_jVH3SOMvW_MA5wCa9CHsfoiF2BLDTiKSXjcKALbm4LmAgK8VIOg3SoBdkpCmGCaun4YnEslgYbhkeYOWzcIFesCLf1WfRvB9qNwFhcIu2PUMmN-LQ Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:04.141371 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08e86af29616439b997831ee3bc370cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08e86af29616439b997831ee3bc370cc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08e86af29616439b997831ee3bc370cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 08e86af29616439b997831ee3bc370cc Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-768479512 Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e7ad18d568284dd999aaaba623f811d4 Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: {"remove_host": {"host": "nonexist_host"}} Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:04.142900 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 13:03:04.143667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 28 13:03:04.144701 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.145743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:04.148095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:04.148095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:04.148095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:04.148095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:04.148095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 28 13:03:04.148095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:04.151510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:04.153295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dca2ff59-3a1c-43f2-8029-4dc58e80ae05 tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.127406 Oct 28 13:03:04.154048 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 148/287] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:03:04 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:04.161947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f3132280-499d-468f-8aa1-4428c9b1a4b0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:04.173788 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f3132280-499d-468f-8aa1-4428c9b1a4b0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.018695 Oct 28 13:03:04.174982 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 149/288] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:03:04 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:04.185084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e08617fc-2577-4f82-8fa8-86685a5604fb tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:04.247042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:04.257184 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1555c1f3-4001-4b55-a167-5ed1e3db522a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.258138 Oct 28 13:03:04.258259 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 140/289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:03 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:04.264670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da7ab99b-0af4-4ea2-ba59-4e1a894fbacf tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:04.284068 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e08617fc-2577-4f82-8fa8-86685a5604fb tempest-AggregatesAdminNegativeTestJSON-768479512 tempest-AggregatesAdminNegativeTestJSON-768479512-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.107672 Oct 28 13:03:04.285981 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 150/290] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:04 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:03:04.431104 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da7ab99b-0af4-4ea2-ba59-4e1a894fbacf tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.170869 Oct 28 13:03:04.431734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 141/291] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:04 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:03:04.442527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ae1a224-1800-401d-856c-45c0cd99be48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-300892348", "availability_zone": "tempest-test_az-779586886"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:04.448587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-2ae1a224-1800-401d-856c-45c0cd99be48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid 0259ce96-94f2-412d-84bf-1002ae2de783 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:04.586807 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ae1a224-1800-401d-856c-45c0cd99be48 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.147811 Oct 28 13:03:04.588133 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 151/292] 10.222.0.25 () {60 vars in 1165 bytes} [Fri Oct 28 13:03:04 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:04.599396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a10d8348-0bcd-4fa6-bc35-5e57e0c0a9c0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-300892348_new", "availability_zone": "tempest-test_az-779586886_new"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:04.638156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:04.639136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:04.646565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.647301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.647896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.651315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.652056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.653899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.843537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a10d8348-0bcd-4fa6-bc35-5e57e0c0a9c0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.844851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a10d8348-0bcd-4fa6-bc35-5e57e0c0a9c0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.845540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a10d8348-0bcd-4fa6-bc35-5e57e0c0a9c0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.884195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:04.893587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-24fcbdfb-748e-48d9-92d0-51863816babe tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.259906 Oct 28 13:03:04.902806 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 152/293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:04 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:04.902806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:04.902806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:04.909747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.910306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.910880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:04.911742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:04.913391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:04.913505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.009793 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a10d8348-0bcd-4fa6-bc35-5e57e0c0a9c0 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 334 microversion: 2.1 time: 0.414278 Oct 28 13:03:05.011171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 142/294] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Oct 28 13:03:04 2022] PUT /compute/v2.1/os-aggregates/16 => generated 334 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:05.023054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13a88f6a-e8a4-44c7-82ae-4ee57ad68f87 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.038475 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13a88f6a-e8a4-44c7-82ae-4ee57ad68f87 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.019318 Oct 28 13:03:05.039773 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 143/295] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:03:05 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:05.060806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6bed4329-9a4f-42ba-9726-65d99f52dfca tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.181987 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6bed4329-9a4f-42ba-9726-65d99f52dfca tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.132719 Oct 28 13:03:05.182992 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 144/296] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:05 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:03:05.195192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-509396d9-a5c3-4c4c-872c-521ff610fe21 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1061243926"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:05.203350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.aggregate [None req-509396d9-a5c3-4c4c-872c-521ff610fe21 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Generated uuid 34789aee-2238-44d7-af6e-3376e7845bfd for aggregate {{(pid=127793) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:05.240732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:05.255939 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-61587c7a-87c4-4d40-ac6c-f04642416fa7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.358683 Oct 28 13:03:05.257925 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 153/297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:04 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:05.288293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.289379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:05.307815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.309234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.309711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.312593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.314577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.316478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.402958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-509396d9-a5c3-4c4c-872c-521ff610fe21 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.212098 Oct 28 13:03:05.403810 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 145/298] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:03:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:05.416623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87b8153d-be59-4f72-9124-6c0d879bbbfc tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.438266 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87b8153d-be59-4f72-9124-6c0d879bbbfc tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.026387 Oct 28 13:03:05.440149 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 146/299] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:03:05 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:05.458538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5b4af35b-da0c-427c-8f70-b217a5ef9b68 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.639998 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5b4af35b-da0c-427c-8f70-b217a5ef9b68 tempest-AggregatesAdminTestJSON-1779417046 tempest-AggregatesAdminTestJSON-1779417046-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.191418 Oct 28 13:03:05.640794 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 147/300] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:03:05 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:03:05.652311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.654416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:05.655295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:05.665795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.666024 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27da332a-2f6e-4094-982f-93d9907dea90 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.386251 Oct 28 13:03:05.666785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.666987 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 154/301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:05 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:05.668841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.669878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.670412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.670932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.694262 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] HTTP exception thrown: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Request method failure captured: Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 HTTP/1.1 Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LS7cjZQyYsBnqVC9O48V5QtSfTnonbQ2ZboXoUqrocjea0PqqvKuBXfIQ98C_fSthfESL0tk6yb1AP5w2lMF9FcZGpyvPhTRqYIOHAH4N3Vy3pAm4OZLHmn41eIVpEunOAghTyZOycvcF5KY3Cnaxu7O5uRBdblPA5kdZntT1C-Ws Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5554f4055a18401aa38b8cea29c1f75d Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:03:05.697080 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5554f4055a18401aa38b8cea29c1f75d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5554f4055a18401aa38b8cea29c1f75d Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AggregatesAdminTestJSON-1942659910-project Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 94e8ff8dcf344a169f57264a102f1afe Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AggregatesAdminTestJSON-1942659910-project Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.698661 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b90f3acc-bae4-469a-9b52-ebeb2e7e7e19'} Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:05.700095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.703131 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.706822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Returning 404 to user: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:05.708776 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c85c5c4-511d-4f02-b1c6-a3600fc26681 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 404 len: 111 microversion: 2.1 time: 0.062270 Oct 28 13:03:05.713124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 148/302] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:03:05 2022] DELETE /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:03:05.718116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.719077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] [instance: b90f3acc-bae4-469a-9b52-ebeb2e7e7e19] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:05.725720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.726484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.727168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.728074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.728722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.729424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.775292 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] HTTP exception thrown: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Request method failure captured: Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 HTTP/1.1 Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LS7cjZQyYsBnqVC9O48V5QtSfTnonbQ2ZboXoUqrocjea0PqqvKuBXfIQ98C_fSthfESL0tk6yb1AP5w2lMF9FcZGpyvPhTRqYIOHAH4N3Vy3pAm4OZLHmn41eIVpEunOAghTyZOycvcF5KY3Cnaxu7O5uRBdblPA5kdZntT1C-Ws Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 5554f4055a18401aa38b8cea29c1f75d Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:05.777838 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5554f4055a18401aa38b8cea29c1f75d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5554f4055a18401aa38b8cea29c1f75d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 5554f4055a18401aa38b8cea29c1f75d Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1942659910 Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AggregatesAdminTestJSON-1942659910-project Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 94e8ff8dcf344a169f57264a102f1afe Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AggregatesAdminTestJSON-1942659910-project Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.779117 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b90f3acc-bae4-469a-9b52-ebeb2e7e7e19'} Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:05.779821 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. Oct 28 13:03:05.780937 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:05.784083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] Returning 404 to user: Instance b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:05.785371 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ebf2a90c-eb79-4024-8365-808be1ec6030 tempest-AggregatesAdminTestJSON-1942659910 tempest-AggregatesAdminTestJSON-1942659910-project] 10.222.0.25 "GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19" status: 404 len: 111 microversion: 2.1 time: 0.071032 Oct 28 13:03:05.786433 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 155/303] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:05 2022] GET /compute/v2.1/servers/b90f3acc-bae4-469a-9b52-ebeb2e7e7e19 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:05.925869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:05.927061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:05.937856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.938686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.939605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:05.940712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:05.941247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:05.942012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:06.195731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-fb70124c-d941-4333-9239-9b0ba9210984 req-f1dc141e-0d9b-4ec7-8ca5-bbd0f83996b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bdfcdd-1fcf-489a-bfe0-d842d4a75b89", "name": "network-vif-plugged", "status": "completed", "tag": "05d151cf-cbd4-4456-b3ac-4f97871022dd"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:06.215267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fb70124c-d941-4333-9239-9b0ba9210984 req-f1dc141e-0d9b-4ec7-8ca5-bbd0f83996b1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:06.216337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fb70124c-d941-4333-9239-9b0ba9210984 req-f1dc141e-0d9b-4ec7-8ca5-bbd0f83996b1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:06.216997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fb70124c-d941-4333-9239-9b0ba9210984 req-f1dc141e-0d9b-4ec7-8ca5-bbd0f83996b1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:06.263021 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fb70124c-d941-4333-9239-9b0ba9210984 req-f1dc141e-0d9b-4ec7-8ca5-bbd0f83996b1 service nova] Creating event network-vif-plugged:05d151cf-cbd4-4456-b3ac-4f97871022dd for instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 on n-h1-862876-2 Oct 28 13:03:06.274606 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-fb70124c-d941-4333-9239-9b0ba9210984 req-f1dc141e-0d9b-4ec7-8ca5-bbd0f83996b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082650 Oct 28 13:03:06.287290 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 156/304] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:06.304405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5a784cd4-7f28-43a8-816b-305d1b4c9f3c req-69455660-6f93-4dbc-beb5-a16a996aa6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dbf208-5db0-4ab9-bd51-1001525886c7", "tag": "6249444d-1dcf-4b7a-bf89-9aa92a0a24a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:06.325275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5a784cd4-7f28-43a8-816b-305d1b4c9f3c req-69455660-6f93-4dbc-beb5-a16a996aa6cd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:06.325977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5a784cd4-7f28-43a8-816b-305d1b4c9f3c req-69455660-6f93-4dbc-beb5-a16a996aa6cd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:06.326248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5a784cd4-7f28-43a8-816b-305d1b4c9f3c req-69455660-6f93-4dbc-beb5-a16a996aa6cd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:06.368695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5a784cd4-7f28-43a8-816b-305d1b4c9f3c req-69455660-6f93-4dbc-beb5-a16a996aa6cd service nova] Creating event network-changed:6249444d-1dcf-4b7a-bf89-9aa92a0a24a2 for instance 70dbf208-5db0-4ab9-bd51-1001525886c7 on n-h2-862876-2 Oct 28 13:03:06.376427 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5a784cd4-7f28-43a8-816b-305d1b4c9f3c req-69455660-6f93-4dbc-beb5-a16a996aa6cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086426 Oct 28 13:03:06.377554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 157/305] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:06.388793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:06.395005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:06.412759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:06.414754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:06.417108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:06.421470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:06.422213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:06.423605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:06.592554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:06.607159 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5032afa6-e4aa-4a4d-afad-87d5a9d08396 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.692987 Oct 28 13:03:06.608281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 149/306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:05 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:06.690977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:06.696321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:06.708666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:06.714254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:06.715245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:06.716833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:06.717564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:06.719102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:06.929964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:06.942690 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f3b9793-fed0-405d-8817-74a22d566c72 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.563467 Oct 28 13:03:06.947127 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 158/307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:06 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:07.180361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:07.196312 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b92546c6-12b3-4c0b-8465-f9e0ce3b302e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.510031 Oct 28 13:03:07.202434 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 150/308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:06 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:07.629834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:07.630528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:07.637400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:07.637894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:07.638329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:07.639078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:07.639537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:07.639959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:07.869894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:07.905827 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-711c0fed-5d1a-4d8b-bec1-186de936fae4 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.280099 Oct 28 13:03:07.906423 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 159/309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:07 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:07.969552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:07.970204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:07.972669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:07.973338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=66 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:07.995697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:07.996960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:07.997563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:07.998466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:07.998963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:07.999452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:08.218534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:08.221683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:08.222546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:08.227211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-893d590b-7c4e-41a1-8cd5-db308e8bc2e4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1318 microversion: 2.1 time: 0.262121 Oct 28 13:03:08.228741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:08.229224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:08.229647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:08.230379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:08.230862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:08.231282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:08.242829 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 151/310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:07 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:08.404926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:08.418986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e464da0-5dcb-4836-a154-fa2302144532 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.201484 Oct 28 13:03:08.420705 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 160/311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:08 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:08.933907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:08.935221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:08.944937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:08.950874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:08.951374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:08.952139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:08.952612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:08.953043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:09.250012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:09.250981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:09.267017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:09.275179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:09.276930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:09.283756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:09.286793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:09.287464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:09.536398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:09.546918 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2de5864a-c5ab-4698-8784-4242080debb6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.618279 Oct 28 13:03:09.550910 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 152/312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:08 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:09.560319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:09.562731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:09.566387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=48 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:09.579381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:09.582351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:09.585251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:09.586161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:09.587377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:09.589448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:09.617010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:09.620033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:09.639985 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c638cf7-7904-4a1d-9b3d-1a8da6df0a00 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1468 microversion: 2.1 time: 0.393738 Oct 28 13:03:09.650773 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 161/313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:09 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1468 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:10.084043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-691793946", "block_migration": true, "disk_over_commit": false}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:10.088202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:10.100011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.101104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.101568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.102308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.102861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.104214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.214872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lazy-loading 'flavor' on Instance uuid 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:10.265061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Going to try to live migrate instance to tempest-host-691793946 {{(pid=127794) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:03:10.273764 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] HTTP exception thrown: Compute host tempest-host-691793946 could not be found. Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Request method failure captured: Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89/action HTTP/1.1 Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 106 Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9L0SLiHx5vbe6gNzQxk2lrsb-h2y8M5Gfi_Pzoh86IYQFdJd6zZ4XKgsAG5eSx6DYP7ETOOuEj_2_zr4U6rmFUUOZQH12_sv2gQu_6SP_GDY9gb9t4eTTKZPxiUqxKauyQT4hOiDv-S0i2cV0vQ7xDXIBOhv3NwgqhyNKAST_Xhz6Y Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c75bd3440a5840bfaf42216a2bfdc18f Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveMigrationNegativeTest-1753165619 Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:10.283789 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c75bd3440a5840bfaf42216a2bfdc18f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c75bd3440a5840bfaf42216a2bfdc18f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c75bd3440a5840bfaf42216a2bfdc18f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c75bd3440a5840bfaf42216a2bfdc18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveMigrationNegativeTest-1753165619 Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c75bd3440a5840bfaf42216a2bfdc18f Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1753165619 Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveMigrationNegativeTest-1753165619-project-admin Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 40cba68e3e0d45c9b137bc622f22faa8 Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveMigrationNegativeTest-1753165619-project-admin Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: {"os-migrateLive": {"host": "tempest-host-691793946", "block_migration": true, "disk_over_commit": false}} Oct 28 13:03:10.285244 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: exception: Compute host tempest-host-691793946 could not be found. Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '71bdfcdd-1fcf-489a-bfe0-d842d4a75b89', 'body': {'os-migrateLive': {'host': 'tempest-host-691793946', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:03:10.286058 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-691793946 could not be found. Oct 28 13:03:10.287673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-691793946 could not be found. Oct 28 13:03:10.289000 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-691793946 could not be found. Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Returning 400 to user: Compute host tempest-host-691793946 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f2a427cd-e589-43e2-ae18-2dbf148f9779 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89/action" status: 400 len: 99 microversion: 2.1 time: 0.616135 Oct 28 13:03:10.290341 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 162/314] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Oct 28 13:03:09 2022] POST /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89/action => generated 99 bytes in 622 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 28 13:03:10.466652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:10.466652 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea076f7d-493c-4a13-8872-6166f9e97d3a tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.828799 Oct 28 13:03:10.466652 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 153/315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:09 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:10.468424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b99d5921-3c8b-4d2f-9e34-6a30f2855234 req-986f0ad9-0067-4aea-bdeb-6c903b8baeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a69e5a01-bef1-4cb9-91d4-63e5124edbb3", "name": "network-vif-plugged", "status": "completed", "tag": "0f7c5045-27c5-4a52-9053-48527718260e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:10.468424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b99d5921-3c8b-4d2f-9e34-6a30f2855234 req-986f0ad9-0067-4aea-bdeb-6c903b8baeb9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.468424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b99d5921-3c8b-4d2f-9e34-6a30f2855234 req-986f0ad9-0067-4aea-bdeb-6c903b8baeb9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.468424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b99d5921-3c8b-4d2f-9e34-6a30f2855234 req-986f0ad9-0067-4aea-bdeb-6c903b8baeb9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.469445 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b99d5921-3c8b-4d2f-9e34-6a30f2855234 req-986f0ad9-0067-4aea-bdeb-6c903b8baeb9 service nova] Creating event network-vif-plugged:0f7c5045-27c5-4a52-9053-48527718260e for instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 on n-h2-862876-2 Oct 28 13:03:10.469445 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b99d5921-3c8b-4d2f-9e34-6a30f2855234 req-986f0ad9-0067-4aea-bdeb-6c903b8baeb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051605 Oct 28 13:03:10.469445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 154/316] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:10.469445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:10.469445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:10.470988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.470988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.470988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.473128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.473833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.475428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.617766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-250972023", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": "none"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:10.678638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:10.679159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:10.679850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:10.680268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:10.681373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:10.691625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.692107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.692542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.693270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.693733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.694160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.706239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:10.712166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Getting quotas for project 1e16a79f715647e7b21ca21bc516abec. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:10.714299 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9bc854a5-69fa-4c3a-adc9-fb8f83b596a3 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1468 microversion: 2.1 time: 0.262995 Oct 28 13:03:10.715780 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 155/317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:10 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1468 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:10.716731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Getting quotas for user 5a8cd48d3f224ef1ba336772eaa4bf49 and project 1e16a79f715647e7b21ca21bc516abec. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:10.720390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:10.721002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:10.727306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.727802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.727896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:10.728244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.728940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:10.729403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:10.729825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:10.730254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:10.863945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:10.872161 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe26532e-c063-45a8-8643-c73f12155e99 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.155656 Oct 28 13:03:10.872727 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 156/318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:10 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:11.082715 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-292e7eb4-4b76-4712-81a8-111ab72a4a01 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.794155 Oct 28 13:03:11.100320 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 163/319] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:03:11.106809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d29cb5c2-df6c-4071-a8bf-9cd8544a6e61 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:11.122463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d29cb5c2-df6c-4071-a8bf-9cd8544a6e61 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:11.294379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-715129327", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:11.455173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:03:11.571572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d29cb5c2-df6c-4071-a8bf-9cd8544a6e61 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:11.586782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d29cb5c2-df6c-4071-a8bf-9cd8544a6e61 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:11.597831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d29cb5c2-df6c-4071-a8bf-9cd8544a6e61 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:11.653496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d29cb5c2-df6c-4071-a8bf-9cd8544a6e61 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "PUT /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1358 microversion: 2.75 time: 0.552662 Oct 28 13:03:11.670834 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 157/320] 10.222.0.25 () {62 vars in 1297 bytes} [Fri Oct 28 13:03:11 2022] PUT /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1358 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:11.678444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:11.680260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:11.691925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:11.693036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:11.693663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:11.695360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:11.696090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:11.696662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:12.020001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:12.024505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:12.037501 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b65ed89a-f516-4492-9624-f50b129c323b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1389 microversion: 2.1 time: 0.374325 Oct 28 13:03:12.053196 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 158/321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:11 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1389 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:12.053196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fdacda3-1a8e-4208-8886-6335f91b36f5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:12.053196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5fdacda3-1a8e-4208-8886-6335f91b36f5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:12.139514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:12.140166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:12.140640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:12.141720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:12.142143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:12.150848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:12.151536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:12.152193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:12.153580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:12.154204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:12.154816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:12.172709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Getting quotas for project a00fdcc92c02421f8d1bd03631662bd0. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:12.176827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Getting quotas for user 2123bea949fd47fe8d6574b6a26ab015 and project a00fdcc92c02421f8d1bd03631662bd0. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:12.180879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fdacda3-1a8e-4208-8886-6335f91b36f5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:12.189424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fdacda3-1a8e-4208-8886-6335f91b36f5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:12.193822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fdacda3-1a8e-4208-8886-6335f91b36f5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:12.206949 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fdacda3-1a8e-4208-8886-6335f91b36f5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1358 microversion: 2.75 time: 0.166669 Oct 28 13:03:12.212338 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 159/322] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:12 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:12.213545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:12.216604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:12.233141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:12.234591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:12.256178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:12.257674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:12.258317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:12.259392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:12.260303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:12.261159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:12.391225 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0adbc4e-6b5d-4458-9dca-07c481baa082 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100257 Oct 28 13:03:12.395059 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 164/323] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:03:12.425350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4bb42882-bd49-4aec-8786-6007fb04a38a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:12.426846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4bb42882-bd49-4aec-8786-6007fb04a38a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:12.700712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4bb42882-bd49-4aec-8786-6007fb04a38a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:12.708203 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4bb42882-bd49-4aec-8786-6007fb04a38a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1218 microversion: 2.1 time: 0.305653 Oct 28 13:03:12.711213 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 165/324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:12 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:12.942562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:12.951056 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5b200286-ddad-43f8-b587-f508401ad8cf tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.739666 Oct 28 13:03:12.955352 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 160/325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:12 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:13.063241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:13.064197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:13.078384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.082599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.082599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.082599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.085357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.085997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.252532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:13.254834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.255494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.256166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.257809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.258981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.259595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.299644 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3db29dea-0c70-4b2f-ba71-9bbd5bae95bb tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.225220 Oct 28 13:03:13.300802 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 161/326] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Oct 28 13:03:13 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:03:13.305829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:13.306641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:13.313832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.324930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.324930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.324930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.324930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.325320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.472777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:13.483598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:13.492200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:13.498334 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1816e090-bb8b-4b08-9922-ba351673c0bf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1362 microversion: 2.75 time: 0.196308 Oct 28 13:03:13.512138 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 162/327] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:13 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:13.526320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:13.528439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.531203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.531203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.531203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.531203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.531834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.582879 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e1fd31c3-cc0d-44a5-b83b-96144a592b4b tempest-AZAdminV2TestJSON-1029313887 tempest-AZAdminV2TestJSON-1029313887-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.068960 Oct 28 13:03:13.585670 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 163/328] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Oct 28 13:03:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:13.587034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:13.599685 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0cc08c87-01bd-460a-80ff-ccbb3b1d2336 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1588 microversion: 2.1 time: 0.540962 Oct 28 13:03:13.601565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 166/329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:13 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1588 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:13.633803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:13.633803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:13.641191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.641683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.642121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.642847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.643307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.659217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:13.735673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4e99aa6c-b396-4626-ad31-8b81774e8bc7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:13.736897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4e99aa6c-b396-4626-ad31-8b81774e8bc7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:13.917746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4e99aa6c-b396-4626-ad31-8b81774e8bc7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:13.929591 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4e99aa6c-b396-4626-ad31-8b81774e8bc7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1218 microversion: 2.1 time: 0.199825 Oct 28 13:03:13.933123 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 167/330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:13 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:13.958014 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f30a21b-ce84-441a-9e84-46fdd98c4f41 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332970 Oct 28 13:03:13.969439 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 164/331] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:03:13 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:13.980886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:13.981734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:13.998077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:13.999336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:13.999938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:14.004036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:14.004537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:14.004979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:14.473861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:14.487850 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-126ffc87-82de-4a3a-961e-f555efb87f2b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.511029 Oct 28 13:03:14.499129 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 168/332] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:13 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:14.532736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:14.533431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:14.548678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:14.549172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:14.549610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:14.550406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:14.555828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:14.557905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:14.779152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Calling method '.version_select at 0x7f27b9f9b670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:14.785217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:14.785874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:14.789931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:14.812614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:14.826470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:14.828176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:14.833426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:14.834215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:14.834988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:14.845794 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-744a3572-998b-470b-a219-e96e4a71174c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1410 microversion: 2.75 time: 0.319060 Oct 28 13:03:14.847615 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 169/333] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:14 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1410 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:14.868120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:14.869973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:14.870349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:14.870691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:14.886083 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab1b2dbf-7422-4e58-aab9-c410ca02088b tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.399306 Oct 28 13:03:14.892664 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 165/334] 10.222.0.25 () {60 vars in 1208 bytes} [Fri Oct 28 13:03:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:14.908892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8acf50d9-8c9a-4798-99aa-6783a489f3be tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-553747269"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:14.913675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-8acf50d9-8c9a-4798-99aa-6783a489f3be tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Generated uuid f9e5b915-0077-4ba6-afdb-99c0be3096d4 for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:03:14.955899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:14.956926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:14.986904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:14.997315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.003505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.005607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.009082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.009738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.057060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8acf50d9-8c9a-4798-99aa-6783a489f3be tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.151691 Oct 28 13:03:15.057700 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 170/335] 10.222.0.25 () {62 vars in 1205 bytes} [Fri Oct 28 13:03:14 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:15.070108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-804d3ecf-c446-415d-8317-f96ff65882f7 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-922398059"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:15.266433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=9 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:15.366112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:15.390445 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-804d3ecf-c446-415d-8317-f96ff65882f7 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.324600 Oct 28 13:03:15.391794 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 171/336] 10.222.0.25 () {62 vars in 1213 bytes} [Fri Oct 28 13:03:15 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:15.401593 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b6d11b8-55d6-49d7-9028-34843ae6bcbe tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1214 microversion: 2.1 time: 0.450115 Oct 28 13:03:15.403206 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 166/337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:14 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1214 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:15.404293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9352ccb2-a63f-47f2-8ec3-674346d04398 req-fa3fa682-048c-4d16-942b-36ce9416474c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dbf208-5db0-4ab9-bd51-1001525886c7", "name": "network-vif-plugged", "status": "completed", "tag": "6249444d-1dcf-4b7a-bf89-9aa92a0a24a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:15.415983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b3544e7-ca43-4163-a094-19fd76d095fa tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:15.430831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9352ccb2-a63f-47f2-8ec3-674346d04398 req-fa3fa682-048c-4d16-942b-36ce9416474c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.431582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9352ccb2-a63f-47f2-8ec3-674346d04398 req-fa3fa682-048c-4d16-942b-36ce9416474c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.432154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9352ccb2-a63f-47f2-8ec3-674346d04398 req-fa3fa682-048c-4d16-942b-36ce9416474c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.435585 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b3544e7-ca43-4163-a094-19fd76d095fa tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.029353 Oct 28 13:03:15.441510 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 167/338] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 13:03:15 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:15.469391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86075a97-fcb8-4885-a426-85dfcca88272 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:15.486173 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9352ccb2-a63f-47f2-8ec3-674346d04398 req-fa3fa682-048c-4d16-942b-36ce9416474c service nova] Creating event network-vif-plugged:6249444d-1dcf-4b7a-bf89-9aa92a0a24a2 for instance 70dbf208-5db0-4ab9-bd51-1001525886c7 on n-h2-862876-2 Oct 28 13:03:15.497562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86075a97-fcb8-4885-a426-85dfcca88272 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.498336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86075a97-fcb8-4885-a426-85dfcca88272 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.499422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86075a97-fcb8-4885-a426-85dfcca88272 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.499541 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9352ccb2-a63f-47f2-8ec3-674346d04398 req-fa3fa682-048c-4d16-942b-36ce9416474c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105452 Oct 28 13:03:15.500373 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 172/339] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:15.513991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:15.515874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:15.531533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.531533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.531533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.532237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.535885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.536515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.933966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:15.944472 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86075a97-fcb8-4885-a426-85dfcca88272 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 314 microversion: 2.41 time: 0.490883 Oct 28 13:03:15.944472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 168/340] 10.222.0.25 () {62 vars in 1235 bytes} [Fri Oct 28 13:03:15 2022] POST /compute/v2.1/os-aggregates/18/action => generated 314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:15.945773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:15.946383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:15.954053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c059ddfb-0b49-458c-b8c9-d5470481a3c6 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.444085 Oct 28 13:03:15.954992 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 173/341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:15 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:15.961390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f0cd23c-b262-424a-a322-f678c878ccd6 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:15.975578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.976078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.976514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.977219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.977684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.978113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:15.989682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f0cd23c-b262-424a-a322-f678c878ccd6 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:15.990737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f0cd23c-b262-424a-a322-f678c878ccd6 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:15.991384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f0cd23c-b262-424a-a322-f678c878ccd6 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:16.313222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:16.322649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:16.324726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:16.342563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f9c8955-636f-4014-b2e1-91a94c13435c tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1428 microversion: 2.75 time: 0.400336 Oct 28 13:03:16.343371 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 169/342] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:15 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1428 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:16.430116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:16.430943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:16.441062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:16.442854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:16.443872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:16.446949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:16.449377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:16.450963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:16.504413 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f0cd23c-b262-424a-a322-f678c878ccd6 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.548007 Oct 28 13:03:16.508406 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 174/343] 10.222.0.25 () {62 vars in 1235 bytes} [Fri Oct 28 13:03:15 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:16.527434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a05936a-a6bc-4c2c-896b-afbb60741b20 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:16.738495 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a05936a-a6bc-4c2c-896b-afbb60741b20 tempest-AggregatesAdminTestV241-1762127165 tempest-AggregatesAdminTestV241-1762127165-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.221274 Oct 28 13:03:16.739517 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 175/344] 10.222.0.25 () {60 vars in 1196 bytes} [Fri Oct 28 13:03:16 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:16.759445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:16.794168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6efe44d2-a1c4-427d-86ac-6d893c423bf5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1278 microversion: 2.1 time: 0.368659 Oct 28 13:03:16.799403 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 170/345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:16 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1278 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:16.979802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:16.981468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:16.992087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:16.992865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:16.993384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:16.994156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:16.994851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:16.995503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:17.163874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:17.175533 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dca88dcf-21be-43c2-84c9-a45e7c8385d8 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1313 microversion: 2.1 time: 0.199960 Oct 28 13:03:17.176657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 176/346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:16 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:17.381931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:17.389441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:17.391636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:17.392372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:17.393421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:17.394560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:17.395871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:17.396528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:17.560382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:17.580613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:17.580613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:17.584930 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d9d10b9-cb1d-4812-af14-18daf93bd7a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1416 microversion: 2.75 time: 0.209116 Oct 28 13:03:17.589223 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 171/347] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:17 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1416 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:17.831460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:17.832080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:17.842243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:17.844692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:17.845784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:17.846728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:17.854624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:17.854624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:18.203199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:18.204038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:18.244144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:18.251617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:18.251617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:18.251617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:18.251617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:18.252423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:18.286077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:18.303253 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49fe4a93-58b6-4d43-9eaa-c390486cf2ca tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1276 microversion: 2.1 time: 0.476056 Oct 28 13:03:18.304434 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 177/348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:17 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1276 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:18.621353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:18.621954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:18.636153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:18.636153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:18.636625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:18.637141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:18.641096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:18.642559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:18.816768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:18.826128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:18.839110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:18.848935 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f45dd995-7852-424d-8955-7fa7617be5a1 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1437 microversion: 2.75 time: 0.231859 Oct 28 13:03:18.862784 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 178/349] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:18 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1437 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:18.882942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:18.885798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:18.901632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:18.902065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:18.902504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:18.903443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:18.904013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:18.904441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:19.032715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:19.034852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:19.035420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:19.037173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:19.038213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:19.219961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:19.233782 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a9aedee-8ef5-4517-8772-726aa0920a61 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1463 microversion: 2.1 time: 1.032584 Oct 28 13:03:19.235515 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 172/350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:18 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1463 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:19.245763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:19.247504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:19.260956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:19.264775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:19.266173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:19.276280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:19.279126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:19.279856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:19.354330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:19.368101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:19.368696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:19.369141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:19.385986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:19.389267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:19.391614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:19.504019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:19.513614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:19.515613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:19.538865 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2a1ddda-a658-4a96-b5b1-0190cd6938f6 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "POST /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec/action" status: 202 len: 1494 microversion: 2.75 time: 0.660119 Oct 28 13:03:19.547164 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 179/351] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:03:18 2022] POST /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec/action => generated 1494 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 28 13:03:19.553148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f0280200-08b7-41f3-8f7c-64700af5cfb2 req-86cdd356-c34c-4cae-a21d-4a947f2ed61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69e5a01-bef1-4cb9-91d4-63e5124edbb3", "tag": "0f7c5045-27c5-4a52-9053-48527718260e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:19.568823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f0280200-08b7-41f3-8f7c-64700af5cfb2 req-86cdd356-c34c-4cae-a21d-4a947f2ed61b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:19.569601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f0280200-08b7-41f3-8f7c-64700af5cfb2 req-86cdd356-c34c-4cae-a21d-4a947f2ed61b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:19.570258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f0280200-08b7-41f3-8f7c-64700af5cfb2 req-86cdd356-c34c-4cae-a21d-4a947f2ed61b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:19.591906 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f0280200-08b7-41f3-8f7c-64700af5cfb2 req-86cdd356-c34c-4cae-a21d-4a947f2ed61b service nova] Creating event network-changed:0f7c5045-27c5-4a52-9053-48527718260e for instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 on n-h2-862876-2 Oct 28 13:03:19.597858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f0280200-08b7-41f3-8f7c-64700af5cfb2 req-86cdd356-c34c-4cae-a21d-4a947f2ed61b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049227 Oct 28 13:03:19.599566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 180/352] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:19.864535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:19.889411 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b500c971-2db4-42ec-81f2-d35875ed6e11 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 200 len: 1588 microversion: 2.1 time: 0.651100 Oct 28 13:03:19.890472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 173/353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:19 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 1588 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:19.903879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:19.904850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:19.920151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:19.920675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:19.921129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:19.921890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:19.944917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:19.944917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.184321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:20.198545 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f726963-f8de-4c83-9af0-9a786b2cb5a2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1276 microversion: 2.1 time: 0.304228 Oct 28 13:03:20.218798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 174/354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:19 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1276 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:20.223719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:20.225334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:20.245233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.245813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.246264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.247019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.247474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.247899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.267923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Calling method '.version_select at 0x7f27b9ef9e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:20.295371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.296548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.296548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.350128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.353126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.359531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.396071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5bb25632-8061-40fe-be38-cf609cfeda76 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/cc5b202053784198b6b227ca75f193e8?start=2022-10-27T13%3A03%3A19.257685&end=2022-10-29T13%3A03%3A19.257685" status: 200 len: 646 microversion: 2.1 time: 0.795037 Oct 28 13:03:20.398898 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 181/355] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Oct 28 13:03:19 2022] GET /compute/v2.1/os-simple-tenant-usage/cc5b202053784198b6b227ca75f193e8?start=2022-10-27T13%3A03%3A19.257685&end=2022-10-29T13%3A03%3A19.257685 => generated 646 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:20.420971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '.version_select at 0x7f27ba12fee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:20.450688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.451463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.452067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.471984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.479294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.480611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.511587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee4fd1a1-9acb-4b55-999d-a590496661ac tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/cc5b202053784198b6b227ca75f193e8?start=2022-10-27T13%3A03%3A19.257685&end=2022-10-29T13%3A03%3A19.257685" status: 200 len: 694 microversion: 2.1 time: 0.094147 Oct 28 13:03:20.516491 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 182/356] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Oct 28 13:03:20 2022] GET /compute/v2.1/os-simple-tenant-usage/cc5b202053784198b6b227ca75f193e8?start=2022-10-27T13%3A03%3A19.257685&end=2022-10-29T13%3A03%3A19.257685 => generated 694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:20.549708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Calling method '.version_select at 0x7f27ba13e700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:20.560001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.560553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.560992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.590463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.590980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.591417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.624159 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-09dec142-592a-49c1-91b1-5ebdc9bc5b37 tempest-TenantUsagesTestJSON-2020531124 tempest-TenantUsagesTestJSON-2020531124-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T13%3A03%3A19.257685&end=2022-10-29T13%3A03%3A19.257685&detailed=1" status: 200 len: 3488 microversion: 2.1 time: 0.094894 Oct 28 13:03:20.625059 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 183/357] 10.222.0.25 () {58 vars in 1335 bytes} [Fri Oct 28 13:03:20 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T13%3A03%3A19.257685&end=2022-10-29T13%3A03%3A19.257685&detailed=1 => generated 3488 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:20.648571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:20.649217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:20.659964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.660953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.661394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.663349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:20.664659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:20.665276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:20.667089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:20.679985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:20.681825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:20.699199 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fb18a2d-615a-4d47-88f0-9232011c0139 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.477794 Oct 28 13:03:20.699199 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 175/358] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:20 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:20.706267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:03:20.761107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:21.212716 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfda71de-90ed-4bed-ba23-c763e68e589b tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "DELETE /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 204 len: 0 microversion: 2.1 time: 0.566005 Oct 28 13:03:21.219157 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 184/359] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:03:20 2022] DELETE /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:03:21.223619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:21.224226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:21.238823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:21.239530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:21.244813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:21.245570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:21.246229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:21.246965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:21.247105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:21.247451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:21.247598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:21.247973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:21.248164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:21.249010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:21.249464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:21.249885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:21.433737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:21.445821 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4b691175-6440-4d93-883a-32778bd279b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 0.212660 Oct 28 13:03:21.450877 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 185/360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:21 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:21.729484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:21.729972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:21.740026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:21.740809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:21.741399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:21.742594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:21.743297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:21.743961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:21.860775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:21.879925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:21.884020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:21.896361 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-acaacbe2-7a06-45d2-95b8-8366a2bc52e4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.172913 Oct 28 13:03:21.902705 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 186/361] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:21 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:21.971257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:21.988032 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0f87814-6099-4cb5-94d6-4ad899fca361 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1469 microversion: 2.1 time: 0.762908 Oct 28 13:03:21.989221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 176/362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:21 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1469 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:22.473612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:22.474248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:22.498151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:22.504666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:22.506429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:22.507643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:22.509016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:22.510490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:22.512715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:22.800257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-347794462", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:22.821347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:22.832688 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6d9eb5fe-0542-4a49-8c96-2c36b7809206 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 0.363764 Oct 28 13:03:22.838492 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 177/363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:22 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:22.879627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:03:23.015891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1606505852", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "1217f953-ad0c-48ca-a39a-bfdf8506b13b"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:23.083682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] validate_networks() for [('1217f953-ad0c-48ca-a39a-bfdf8506b13b', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:03:23.200194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:23.200622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:23.201079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:23.201676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:23.202227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:23.216865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:23.219415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:23.220023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:23.222428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:23.223078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:23.233286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:23.270578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Getting quotas for project f1a957c0dec14fbb92fc1a4b7b17efa8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:23.278470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Getting quotas for user a715e794315e44369c51eed6d09c710e and project f1a957c0dec14fbb92fc1a4b7b17efa8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:23.301013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:23.308781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:23.549803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:23.568276 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-772d4068-05d2-460b-a019-f8edc33b706d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.374540 Oct 28 13:03:23.570402 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 187/364] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:03:23.602923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:23.602923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:23.608304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:23.609060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:23.609715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:23.610641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:23.611879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:23.612518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:23.830476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:23.843004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:23.843004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:23.865665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3aa65037-5438-49bd-b28a-4c98ab2dfdce tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.293934 Oct 28 13:03:23.887355 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 188/365] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:23 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:23.887355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:23.887355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:23.895139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:23.895786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:23.896330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:23.897147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:23.899016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:23.899559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.112865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:24.123109 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b9b9fdbe-7bd1-4c41-b2d3-1aa1145ba49e tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1427 microversion: 2.1 time: 0.248808 Oct 28 13:03:24.132075 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 189/366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:23 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1427 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:24.147030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-44715ca3-7075-4871-ba5e-559a9a9395e0 req-6732255f-54e5-4271-9106-ba89dd57a34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38f3657-1be2-4469-a4a2-952cd16c0e65", "tag": "a74251be-e377-4d89-b9b5-fc29db4dc13a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:24.168747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-44715ca3-7075-4871-ba5e-559a9a9395e0 req-6732255f-54e5-4271-9106-ba89dd57a34b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.169700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-44715ca3-7075-4871-ba5e-559a9a9395e0 req-6732255f-54e5-4271-9106-ba89dd57a34b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.170460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-44715ca3-7075-4871-ba5e-559a9a9395e0 req-6732255f-54e5-4271-9106-ba89dd57a34b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.187402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-44715ca3-7075-4871-ba5e-559a9a9395e0 req-6732255f-54e5-4271-9106-ba89dd57a34b service nova] Creating event network-changed:a74251be-e377-4d89-b9b5-fc29db4dc13a for instance b38f3657-1be2-4469-a4a2-952cd16c0e65 on n-h1-862876-2 Oct 28 13:03:24.201536 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-44715ca3-7075-4871-ba5e-559a9a9395e0 req-6732255f-54e5-4271-9106-ba89dd57a34b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060929 Oct 28 13:03:24.201536 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 190/367] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:24.201536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8fcad7c9-a267-4fdb-b6f8-86b1259a6745 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:24.201536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8fcad7c9-a267-4fdb-b6f8-86b1259a6745 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:24.335545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8fcad7c9-a267-4fdb-b6f8-86b1259a6745 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:24.362893 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8fcad7c9-a267-4fdb-b6f8-86b1259a6745 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1219 microversion: 2.1 time: 0.149879 Oct 28 13:03:24.365512 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 191/368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:24 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:24.377480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bbb3a5a6-9f69-4483-9b56-b3d3d018701f req-eed5987f-d2aa-4336-9d30-5c7e6d05c0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dbf208-5db0-4ab9-bd51-1001525886c7", "name": "network-vif-deleted", "tag": "6249444d-1dcf-4b7a-bf89-9aa92a0a24a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:24.401547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbb3a5a6-9f69-4483-9b56-b3d3d018701f req-eed5987f-d2aa-4336-9d30-5c7e6d05c0a5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.402070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbb3a5a6-9f69-4483-9b56-b3d3d018701f req-eed5987f-d2aa-4336-9d30-5c7e6d05c0a5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.402506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbb3a5a6-9f69-4483-9b56-b3d3d018701f req-eed5987f-d2aa-4336-9d30-5c7e6d05c0a5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.429847 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bbb3a5a6-9f69-4483-9b56-b3d3d018701f req-eed5987f-d2aa-4336-9d30-5c7e6d05c0a5 service nova] Creating event network-vif-deleted:6249444d-1dcf-4b7a-bf89-9aa92a0a24a2 for instance 70dbf208-5db0-4ab9-bd51-1001525886c7 on n-h2-862876-2 Oct 28 13:03:24.444570 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bbb3a5a6-9f69-4483-9b56-b3d3d018701f req-eed5987f-d2aa-4336-9d30-5c7e6d05c0a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079243 Oct 28 13:03:24.445184 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 192/369] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:24.469312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:24.470035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:24.484127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.487561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.488020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.488752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.489219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.489647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.764266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:24.774768 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5127d277-44de-45ce-9fda-3699bbf8f814 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 0.328271 Oct 28 13:03:24.775700 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 193/370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:24 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:24.789914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:24.790688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:24.791610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:24.793429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:24.793861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:24.812335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.812833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.813271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.813997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.814460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.814916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.860809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:24.867153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for user 17a50d2f7a154acbbf6bc218efb8b67d and project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:24.888606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:24.891755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:24.905216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:24.906530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:24.916855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.918245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.918973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:24.922149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:24.923726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:24.924391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:25.004505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.023882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.023882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.023882 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26c875da-055f-41e0-8e92-361b38bb5c9b tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.121677 Oct 28 13:03:25.024207 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 194/371] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:24 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:25.154145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:25.154464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:25.182028 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f05f9413-19d7-457e-a694-409e0d4dec35 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.283249 Oct 28 13:03:25.182883 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 178/372] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 13:03:25.206672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:25.207247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:25.207705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:25.208438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:25.209039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4d8c9482-7ed3-43c3-9078-42516bc3b4f4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:25.210042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4d8c9482-7ed3-43c3-9078-42516bc3b4f4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:25.217500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:25.217967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:25.341293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:25.342978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:25.343431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:25.344015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lazy-loading 'fault' on Instance uuid 70dbf208-5db0-4ab9-bd51-1001525886c7 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:25.369655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4d8c9482-7ed3-43c3-9078-42516bc3b4f4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.393991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4d8c9482-7ed3-43c3-9078-42516bc3b4f4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.396035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4d8c9482-7ed3-43c3-9078-42516bc3b4f4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.398590 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4d8c9482-7ed3-43c3-9078-42516bc3b4f4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1262 microversion: 2.25 time: 0.195061 Oct 28 13:03:25.410520 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 179/373] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:25 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1262 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:25.423696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48835a71-101a-46c2-88a2-07d7de03c9db tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:25.424705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48835a71-101a-46c2-88a2-07d7de03c9db tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:25.445761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb9bade40944010b614a5e6be68fe16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5b202053784198b6b227ca75f193e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.455963 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a773e3c8-69b3-4876-a3f5-0d1201abb653 tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 200 len: 1303 microversion: 2.1 time: 0.306136 Oct 28 13:03:25.458212 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 195/374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:25 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 1303 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:25.503286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48835a71-101a-46c2-88a2-07d7de03c9db tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:25.514271 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48835a71-101a-46c2-88a2-07d7de03c9db tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1219 microversion: 2.1 time: 0.105224 Oct 28 13:03:25.517825 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 180/375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:25 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:25.809157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:25.809157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:25.818405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:25.820226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:25.822469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:25.825200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:25.826608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:25.827263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:26.069258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.088751 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-632d380a-e561-4f58-ba06-1cc787bbe718 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 0.289526 Oct 28 13:03:26.091541 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 196/376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:25 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:26.096508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49bec2a6-8aa3-47de-8e28-9684df0eff58 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-124454287", "id": 1414817556, "os-flavor-access:is_public": "False"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:26.117421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:26.118200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:26.124118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:26.127606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:26.128288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:26.128837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:26.129620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:26.130232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:26.131044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:26.214906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.227803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.229412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.238615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49bec2a6-8aa3-47de-8e28-9684df0eff58 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.338262 Oct 28 13:03:26.239821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 181/377] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:25 2022] POST /compute/v2.1/flavors => generated 430 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:26.252374 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a177a0e-a8b0-4f50-b85e-75d8447cf206 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.159695 Oct 28 13:03:26.256730 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 197/378] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:26 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:26.271931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25e9a347-52e6-4f3f-be46-b72d0b3d4e1f tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3471e72b7e5640d7bbfcb3dd1edec0df"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:26.428135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e939c184-68a4-43a1-84c8-b313f8ee5d77 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:26.428842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e939c184-68a4-43a1-84c8-b313f8ee5d77 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:26.468109 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25e9a347-52e6-4f3f-be46-b72d0b3d4e1f tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1414817556/action" status: 200 len: 97 microversion: 2.1 time: 0.207103 Oct 28 13:03:26.469038 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 182/379] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:03:26 2022] POST /compute/v2.1/flavors/1414817556/action => generated 97 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:03:26.548155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e939c184-68a4-43a1-84c8-b313f8ee5d77 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.555844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e939c184-68a4-43a1-84c8-b313f8ee5d77 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.557305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e939c184-68a4-43a1-84c8-b313f8ee5d77 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.567917 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e939c184-68a4-43a1-84c8-b313f8ee5d77 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1262 microversion: 2.25 time: 0.135740 Oct 28 13:03:26.571109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 198/380] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:26 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1262 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:26.585788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:26.585788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] [instance: 70dbf208-5db0-4ab9-bd51-1001525886c7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:26.630908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:26.631769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:26.632712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:26.634308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:26.635773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:26.636285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:26.658503 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] HTTP exception thrown: Instance 70dbf208-5db0-4ab9-bd51-1001525886c7 could not be found. Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Request method failure captured: Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 HTTP/1.1 Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9L-84XL_vPB-UHmHdUwhOuy0n9FlP63QFdjDWIzZomkBKBeXwwe6T9VCqzVDzEGcSva7ClnnkI4fPJ5DG_xgshxfr-HKlnRLfepz8wUGFC0rxT2KKzeHlMBM8yzP0Ur2laj2xhu2La4jflDFbcE05pe0k2dcTHpUMD5IYcI4xIBt3w Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: cc5b202053784198b6b227ca75f193e8 Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TenantUsagesTestJSON-1063149044 Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:26.662651 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc5b202053784198b6b227ca75f193e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cc5b202053784198b6b227ca75f193e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cc5b202053784198b6b227ca75f193e8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cc5b202053784198b6b227ca75f193e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TenantUsagesTestJSON-1063149044 Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: cc5b202053784198b6b227ca75f193e8 Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1063149044 Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TenantUsagesTestJSON-1063149044-project Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7fb9bade40944010b614a5e6be68fe16 Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TenantUsagesTestJSON-1063149044-project Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 70dbf208-5db0-4ab9-bd51-1001525886c7 could not be found. Oct 28 13:03:26.663945 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '70dbf208-5db0-4ab9-bd51-1001525886c7'} Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70dbf208-5db0-4ab9-bd51-1001525886c7 could not be found. Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:26.664760 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70dbf208-5db0-4ab9-bd51-1001525886c7 could not be found. Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70dbf208-5db0-4ab9-bd51-1001525886c7 could not be found. Oct 28 13:03:26.665889 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:26.668537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] Returning 404 to user: Instance 70dbf208-5db0-4ab9-bd51-1001525886c7 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:26.668537 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4621fb75-17a4-4b7c-b7bd-60f4c4e4269c tempest-TenantUsagesTestJSON-1063149044 tempest-TenantUsagesTestJSON-1063149044-project] 10.222.0.25 "GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7" status: 404 len: 111 microversion: 2.1 time: 0.091202 Oct 28 13:03:26.668537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 199/381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:26 2022] GET /compute/v2.1/servers/70dbf208-5db0-4ab9-bd51-1001525886c7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:26.671732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:26.672346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:26.680538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:26.686490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:26.686490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:26.686490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:26.687255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:26.689460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:26.699761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85a93d1f-7dfd-4a05-a408-829040c77cea tempest-FlavorsAccessTestJSON-675620693 tempest-FlavorsAccessTestJSON-675620693-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:26.753143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85a93d1f-7dfd-4a05-a408-829040c77cea tempest-FlavorsAccessTestJSON-675620693 tempest-FlavorsAccessTestJSON-675620693-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6237 microversion: 2.1 time: 0.276877 Oct 28 13:03:26.756260 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 183/382] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:03:26 2022] GET /compute/v2.1/flavors/detail => generated 6237 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:26.787228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9318c34d-bf39-4237-8d61-baa5af26a2d2 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3471e72b7e5640d7bbfcb3dd1edec0df"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:26.828875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:26.839074 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-338e499b-912d-48b3-8cf3-40723375b807 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1271 microversion: 2.1 time: 0.172423 Oct 28 13:03:26.839923 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 200/383] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:26 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:27.026701 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9318c34d-bf39-4237-8d61-baa5af26a2d2 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1414817556/action" status: 200 len: 21 microversion: 2.1 time: 0.247911 Oct 28 13:03:27.033281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 184/384] 10.222.0.25 () {60 vars in 1200 bytes} [Fri Oct 28 13:03:26 2022] POST /compute/v2.1/flavors/1414817556/action => generated 21 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:03:27.038391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62712d5e-ab5a-405e-8d40-ed36a95eb08c tempest-FlavorsAccessTestJSON-675620693 tempest-FlavorsAccessTestJSON-675620693-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.069912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62712d5e-ab5a-405e-8d40-ed36a95eb08c tempest-FlavorsAccessTestJSON-675620693 tempest-FlavorsAccessTestJSON-675620693-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.035437 Oct 28 13:03:27.083242 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 201/385] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:27.091403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bbbef01-4985-4084-96ef-5d59abfea144 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.117395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.118144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:27.124132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.126624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.136865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.136865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.136865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.136865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.264568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:27.273032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e51fa191-b412-4446-9804-03703de402bb tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 0.160768 Oct 28 13:03:27.273608 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 202/386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:27.282194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.283182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:27.298733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bbbef01-4985-4084-96ef-5d59abfea144 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1414817556" status: 202 len: 0 microversion: 2.1 time: 0.209657 Oct 28 13:03:27.306916 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 185/387] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:03:27 2022] DELETE /compute/v2.1/flavors/1414817556 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:03:27.309980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.310728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.311429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.312351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.313008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.314265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.323450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04c79ec0-b9d0-4210-b19c-26e166cbda84 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.390810 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-04c79ec0-b9d0-4210-b19c-26e166cbda84 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.082707 Oct 28 13:03:27.392845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 186/388] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:27.419142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9eaf12ba-3bb4-4b1c-89b4-d2d8c99a3c5e tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1679254362", "id": 721788697, "os-flavor-access:is_public": "False"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:27.420920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:27.433794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:27.435427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:27.444027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87190c39-5e58-48ca-9de1-4bbb7da0f028 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.165782 Oct 28 13:03:27.459026 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 203/389] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:27.564525 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9eaf12ba-3bb4-4b1c-89b4-d2d8c99a3c5e tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.152673 Oct 28 13:03:27.564717 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 187/390] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:27 2022] POST /compute/v2.1/flavors => generated 428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:27.580549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5697932-c792-4bbc-afb5-97d8d799aa1e tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.597954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.598578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:27.604702 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5697932-c792-4bbc-afb5-97d8d799aa1e tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/721788697/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.031445 Oct 28 13:03:27.606473 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 204/391] 10.222.0.25 () {58 vars in 1206 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/flavors/721788697/os-flavor-access => generated 21 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:03:27.617119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.624604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.625499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.630036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.630713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-38505493-6ee6-45fb-a0d3-0b2dd4f34c49 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.635294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.637837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.766914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:27.776005 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-38505493-6ee6-45fb-a0d3-0b2dd4f34c49 tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/721788697" status: 202 len: 0 microversion: 2.1 time: 0.153141 Oct 28 13:03:27.777394 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 205/392] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:03:27 2022] DELETE /compute/v2.1/flavors/721788697 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:03:27.782597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:27.786012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f446f8fb-eafc-405d-ac21-2f309635079d tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.787031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:27.790585 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-288a5073-ad34-4427-a0d5-1b0bd64f7589 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1258 microversion: 2.25 time: 0.196691 Oct 28 13:03:27.793478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 188/393] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:27.831552 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f446f8fb-eafc-405d-ac21-2f309635079d tempest-FlavorsAccessTestJSON-306025351 tempest-FlavorsAccessTestJSON-306025351-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.049506 Oct 28 13:03:27.835074 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 206/394] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:27.866720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:27.868327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:27.877554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.878138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.878792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.879709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:27.880344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:27.880834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:27.889535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:28.110476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:28.118790 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78c74417-9b41-4957-87a8-78349cfd609c tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1279 microversion: 2.1 time: 0.256837 Oct 28 13:03:28.119389 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 189/395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:27 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:28.301286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:28.302988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:28.312464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:28.315578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:28.315578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:28.315578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:28.316193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:28.316821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:28.482888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:28.483647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:28.492269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:28.492868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:28.495478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:28.495478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:28.495478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:28.495478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:28.757095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:28.786937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:28.794221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:28.807826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:28.816847 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d6f0f7c-1ceb-4eca-afa7-a24d7a6c8d9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.337824 Oct 28 13:03:28.843679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:28.854622 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 190/396] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:28 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:28.859002 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-38d9939c-9522-41da-ab47-24ffdcc14a31 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 0.557358 Oct 28 13:03:28.860461 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 207/397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:28 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:28.862765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:28.863785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:28.891083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:28.892997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:28.896476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:28.899652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:28.902917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:28.917097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:29.086667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:29.106615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:29.115557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:29.116734 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c38d3496-5648-4b42-a243-0d30d414cd54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1322 microversion: 2.25 time: 0.260696 Oct 28 13:03:29.127475 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 191/398] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:28 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:29.143278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:29.145496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:29.166624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:29.167490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:29.168114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:29.172081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:29.172081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:29.172081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:29.333319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:29.345627 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-495150b5-ef50-449a-ab24-182a837e44f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1277 microversion: 2.1 time: 0.206193 Oct 28 13:03:29.358769 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 208/399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:29 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:29.851675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:29.852291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:29.863177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:29.866507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:29.869200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:29.870063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:29.871309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:29.879513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:29.882612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:29.883502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:29.898534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:29.899378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:29.900344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:29.917177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:29.917879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:29.918335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:30.039296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:30.097619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.116100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.117614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.131474 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-737338e9-c515-4096-a1f9-7b9747dd60c0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.283777 Oct 28 13:03:30.132584 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 192/400] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:29 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:30.153045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:30.153900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:30.162712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:30.163665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:30.165241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:30.166124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:30.169938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:30.170380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:30.428957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.441033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.443497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.444909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5b145cbf-d4be-4627-b615-b181ba6680bf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1320 microversion: 2.25 time: 0.295864 Oct 28 13:03:30.469515 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 193/401] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:30 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:30.475408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d86750b4-92f2-40bc-9100-4121c4e47234 req-97477fe9-99d6-4216-a228-7cecee0cf6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38f3657-1be2-4469-a4a2-952cd16c0e65", "name": "network-vif-plugged", "status": "completed", "tag": "a74251be-e377-4d89-b9b5-fc29db4dc13a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:30.502410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d86750b4-92f2-40bc-9100-4121c4e47234 req-97477fe9-99d6-4216-a228-7cecee0cf6d4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:30.503252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d86750b4-92f2-40bc-9100-4121c4e47234 req-97477fe9-99d6-4216-a228-7cecee0cf6d4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:30.503819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d86750b4-92f2-40bc-9100-4121c4e47234 req-97477fe9-99d6-4216-a228-7cecee0cf6d4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:30.529350 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d86750b4-92f2-40bc-9100-4121c4e47234 req-97477fe9-99d6-4216-a228-7cecee0cf6d4 service nova] Creating event network-vif-plugged:a74251be-e377-4d89-b9b5-fc29db4dc13a for instance b38f3657-1be2-4469-a4a2-952cd16c0e65 on n-h1-862876-2 Oct 28 13:03:30.540578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d86750b4-92f2-40bc-9100-4121c4e47234 req-97477fe9-99d6-4216-a228-7cecee0cf6d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067986 Oct 28 13:03:30.543221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 194/402] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:30.550420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:30.551369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:30.561610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:30.566276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:30.566276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:30.566276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:30.566276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:30.566646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:30.789533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.799961 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-efda7242-ea6a-4f38-9ad2-4d34c9f8679e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.255877 Oct 28 13:03:30.803050 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 195/403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:30 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:30.906681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:30.914511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8a90c9e5-b922-4c52-984d-92d8cc142f08 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 1.036477 Oct 28 13:03:30.915122 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 209/404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:29 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:31.165705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:31.166473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:31.180291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:31.185802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:31.187473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:31.190732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:31.192001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:31.194422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:31.356567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:31.373633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:31.379307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:31.391277 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb4c2caf-5204-4a1b-b95a-a4c0a4345e60 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.231142 Oct 28 13:03:31.392229 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 196/405] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:31 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:31.474127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:31.474816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:31.482172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:31.483264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:31.483917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:31.485354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:31.486137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:31.486809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:31.822807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:31.823771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:31.832910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:31.833939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:31.834370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:31.836477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:31.838470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:31.839088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:31.974080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:31.984461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:31.991812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:32.007717 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-548588f0-e137-495f-8363-22d16274f309 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.523315 Oct 28 13:03:32.007717 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 210/406] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:31 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:32.015171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:32.021201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:32.042009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:32.042997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:32.044926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:32.047713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:32.048308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:32.051261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:32.256305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:32.271133 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5512791-d15c-470d-a9f3-490daed7fb80 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.449724 Oct 28 13:03:32.273402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 197/407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:31 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:32.422936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:32.423587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:32.434489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:32.435261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:32.435850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:32.436740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:32.437343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:32.437922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:32.546698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:32.579332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:32.593590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:32.615704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9b593fc-756a-4309-ac66-ef57ab011a31 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.198489 Oct 28 13:03:32.621322 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 198/408] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:32 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:32.792225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:32.792225 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b6ce378-40f9-4e07-8ab9-3b862f3b1090 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1318 microversion: 2.1 time: 0.794064 Oct 28 13:03:32.799675 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 211/409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:31 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1318 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:33.025529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:33.030645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:33.037708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.038206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.038640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.039398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.039841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.040317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.204495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:33.215113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:33.216774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:33.218516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a53a292-1224-464c-ace9-9800c1f08ed8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.197001 Oct 28 13:03:33.227250 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 199/410] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:33 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:33.296919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:33.297565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:33.307293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:33.310008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.310516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.310984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.311698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.312166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.312856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.424999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2c1b61b5-8082-4721-b09b-b29576e3b05f req-28d3a967-80e7-4a41-bcd7-0df53d709d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e0baaa-3d64-45b4-8b42-a235d4550f04", "tag": "a61e79cd-1906-4295-a654-ea1881270697"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:33.439231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2c1b61b5-8082-4721-b09b-b29576e3b05f req-28d3a967-80e7-4a41-bcd7-0df53d709d3c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.439826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2c1b61b5-8082-4721-b09b-b29576e3b05f req-28d3a967-80e7-4a41-bcd7-0df53d709d3c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.440481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2c1b61b5-8082-4721-b09b-b29576e3b05f req-28d3a967-80e7-4a41-bcd7-0df53d709d3c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.452606 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2c1b61b5-8082-4721-b09b-b29576e3b05f req-28d3a967-80e7-4a41-bcd7-0df53d709d3c service nova] Creating event network-changed:a61e79cd-1906-4295-a654-ea1881270697 for instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 on n-h2-862876-2 Oct 28 13:03:33.457806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2c1b61b5-8082-4721-b09b-b29576e3b05f req-28d3a967-80e7-4a41-bcd7-0df53d709d3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039369 Oct 28 13:03:33.458406 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 200/411] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:33.653671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:33.654633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:33.661966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.662470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.662950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.663692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.664151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.664578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.743287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:33.744860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:33.750595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:33.752788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:33.758840 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2cadb0d-d4b4-4ae6-b417-94b46f45afc3 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.110199 Oct 28 13:03:33.760053 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 201/412] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:33 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:33.761775 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48561e05-da37-441c-a03b-f8e295dbf204 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.468801 Oct 28 13:03:33.763962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 212/413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:33 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:33.826572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:33.827243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:33.837200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.847584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.847584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:33.847584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:33.847584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:33.847976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.006274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.042648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f044a1d-8626-442c-b52b-14e0623f8202 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1467 microversion: 2.1 time: 0.219352 Oct 28 13:03:34.042648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 202/414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:33 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1467 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:34.072171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:34.073512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:34.087597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.088176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.088530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.090373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.090875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.091312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.173891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lazy-loading 'flavor' on Instance uuid b38f3657-1be2-4469-a4a2-952cd16c0e65 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:34.247971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:34.248582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:34.273930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.274547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.275632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.275752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.280356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.280807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.495465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.505780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.507413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.508633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc5177f8-eb6d-4c7d-81fe-b52eff43712c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.265618 Oct 28 13:03:34.509092 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 203/415] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:34 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:34.539748 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4388926-3fe6-45d6-9d57-414a7298bb2d tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65/action" status: 202 len: 0 microversion: 2.1 time: 0.476390 Oct 28 13:03:34.540504 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 213/416] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:03:34 2022] POST /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:03:34.571077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:34.572955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:34.588078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.589432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.589901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.593818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.594348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.595402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.790902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:34.791802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:34.809027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.810008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.810793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.811342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.812651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.813852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.814768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.823748 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3cdc680-d809-445a-8c8e-8e0c211581b2 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1475 microversion: 2.1 time: 0.260725 Oct 28 13:03:34.823748 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 204/417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:34 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:34.828538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:34.833485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:34.847914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.848415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.848932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.849637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:34.854525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:34.855628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:34.962493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.981233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.981233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:34.983754 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-73c900fd-9d65-4511-bef7-a2b8b511b936 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.197463 Oct 28 13:03:34.993828 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 214/418] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:34 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:35.018249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.030357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6d2600a6-a414-40c6-8753-efdcde28c90e tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.207794 Oct 28 13:03:35.031156 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 205/419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:34 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:35.277439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85c47092-aa77-4a13-995d-d51f90f4f8d9 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9eb2d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.284902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:35.326795 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85c47092-aa77-4a13-995d-d51f90f4f8d9 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/eceddf71-03bd-4fb1-a048-916e4470701d" status: 200 len: 662 microversion: 2.1 time: 0.053197 Oct 28 13:03:35.327612 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 206/420] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/images/eceddf71-03bd-4fb1-a048-916e4470701d => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:35.342609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2295756-3a83-463b-8bdf-4868f3c76688 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9e833a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.400232 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2295756-3a83-463b-8bdf-4868f3c76688 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/eceddf71-03bd-4fb1-a048-916e4470701d" status: 200 len: 662 microversion: 2.1 time: 0.061936 Oct 28 13:03:35.401126 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 207/421] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/images/eceddf71-03bd-4fb1-a048-916e4470701d => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:03:35.418639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Calling method '.version_select at 0x7f27ba0c5310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.422196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:35.422690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:35.423164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:35.423896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:35.424352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:35.424781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:35.472793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4ef6a7d-ba3c-4dc7-972a-2a214098be42 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.235437 Oct 28 13:03:35.474201 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 215/422] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:35.484152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-15124ece-ef3e-44a0-b05b-c8bda6df7109 req-1a0975bd-c684-4f0a-993b-91934e9eaef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33f2331-58e4-4f5a-b517-56192307a84b", "tag": "f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:35.499507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-15124ece-ef3e-44a0-b05b-c8bda6df7109 req-1a0975bd-c684-4f0a-993b-91934e9eaef5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:35.499507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-15124ece-ef3e-44a0-b05b-c8bda6df7109 req-1a0975bd-c684-4f0a-993b-91934e9eaef5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:35.499507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-15124ece-ef3e-44a0-b05b-c8bda6df7109 req-1a0975bd-c684-4f0a-993b-91934e9eaef5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:35.507143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-15124ece-ef3e-44a0-b05b-c8bda6df7109 req-1a0975bd-c684-4f0a-993b-91934e9eaef5 service nova] Creating event network-changed:f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3 for instance f33f2331-58e4-4f5a-b517-56192307a84b on n-h2-862876-2 Oct 28 13:03:35.513489 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-15124ece-ef3e-44a0-b05b-c8bda6df7109 req-1a0975bd-c684-4f0a-993b-91934e9eaef5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032821 Oct 28 13:03:35.514363 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 208/423] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:35.539050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:35.546472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.551927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:35.553559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:35.554106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:35.554737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:35.555638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:35.556095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:35.556520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:35.606335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7858f127-4fc0-41ec-b1c1-6403299cfa06 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Calling method '.version_select at 0x7f27b9f16700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.611301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7858f127-4fc0-41ec-b1c1-6403299cfa06 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a898314470254320890be631b6b84444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db658d438d64b52a5b4c45476e01e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7858f127-4fc0-41ec-b1c1-6403299cfa06 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Request method failure captured: Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Mm3UtcTG4HhFMI5BPpR63IO4bsKDeYZOMHLlCyPh4ZbcwlQ8AoZxUv8nuIKpG5_c5AF4AKaJO3j9grwUERaLwVSUvfh2_Vcm9kqn0HZVvvNFCAMt6RGmSRTIDlK89HFLnPFhQqYOPCNuuiiGW4T6eK2s3Qf4hzX0UY39CPLf-__CQ Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:35.613313 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7db658d438d64b52a5b4c45476e01e8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a898314470254320890be631b6b84444 Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: action_args: {} Oct 28 13:03:35.614892 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.615891 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 13:03:35.617218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.618528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7858f127-4fc0-41ec-b1c1-6403299cfa06 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.618528 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7858f127-4fc0-41ec-b1c1-6403299cfa06 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.132993 Oct 28 13:03:35.618528 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 216/424] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 134 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:03:35.627955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1326778e-a0de-446a-9d8d-d9b7e8e74a23 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Calling method '.version_select at 0x7f27b9f57ee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.630070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1326778e-a0de-446a-9d8d-d9b7e8e74a23 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a898314470254320890be631b6b84444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db658d438d64b52a5b4c45476e01e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1326778e-a0de-446a-9d8d-d9b7e8e74a23 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Request method failure captured: Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts/n-d-862876-2/reboot HTTP/1.1 Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Mm3UtcTG4HhFMI5BPpR63IO4bsKDeYZOMHLlCyPh4ZbcwlQ8AoZxUv8nuIKpG5_c5AF4AKaJO3j9grwUERaLwVSUvfh2_Vcm9kqn0HZVvvNFCAMt6RGmSRTIDlK89HFLnPFhQqYOPCNuuiiGW4T6eK2s3Qf4hzX0UY39CPLf-__CQ Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:35.632376 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7db658d438d64b52a5b4c45476e01e8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a898314470254320890be631b6b84444 Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'n-d-862876-2'} Oct 28 13:03:35.633835 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.634720 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 13:03:35.636043 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.638255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1326778e-a0de-446a-9d8d-d9b7e8e74a23 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.639270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1326778e-a0de-446a-9d8d-d9b7e8e74a23 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862876-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017330 Oct 28 13:03:35.640312 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 217/425] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/n-d-862876-2/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:35.655162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a06c3fdd-0091-469d-8cef-82998e29be3e tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Calling method '.version_select at 0x7f27ba38a280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.666254 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a06c3fdd-0091-469d-8cef-82998e29be3e tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a06c3fdd-0091-469d-8cef-82998e29be3e tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:35.668383 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'nonexistent_hostname'} Oct 28 13:03:35.669909 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:35.670877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 13:03:35.672253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a06c3fdd-0091-469d-8cef-82998e29be3e tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a06c3fdd-0091-469d-8cef-82998e29be3e tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.023840 Oct 28 13:03:35.673305 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 218/426] 10.222.0.25 () {58 vars in 1212 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:35.685907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81bef099-f9c0-4a0e-885b-6579f9d7f6fe tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Calling method '.version_select at 0x7f27b9ef95e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.687744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81bef099-f9c0-4a0e-885b-6579f9d7f6fe tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a898314470254320890be631b6b84444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db658d438d64b52a5b4c45476e01e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81bef099-f9c0-4a0e-885b-6579f9d7f6fe tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Request method failure captured: Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts/n-d-862876-2 HTTP/1.1 Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Mm3UtcTG4HhFMI5BPpR63IO4bsKDeYZOMHLlCyPh4ZbcwlQ8AoZxUv8nuIKpG5_c5AF4AKaJO3j9grwUERaLwVSUvfh2_Vcm9kqn0HZVvvNFCAMt6RGmSRTIDlK89HFLnPFhQqYOPCNuuiiGW4T6eK2s3Qf4hzX0UY39CPLf-__CQ Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:35.689286 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7db658d438d64b52a5b4c45476e01e8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a898314470254320890be631b6b84444 Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'n-d-862876-2'} Oct 28 13:03:35.690734 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.691749 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 13:03:35.692864 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.694778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81bef099-f9c0-4a0e-885b-6579f9d7f6fe tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.696174 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81bef099-f9c0-4a0e-885b-6579f9d7f6fe tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862876-2" status: 403 len: 109 microversion: 2.1 time: 0.016237 Oct 28 13:03:35.697035 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 219/427] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/n-d-862876-2 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:35.706312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06bd06ff-8152-4173-a065-4ec1432e7f32 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Calling method '.version_select at 0x7f27b9f16dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.715478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-06bd06ff-8152-4173-a065-4ec1432e7f32 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06bd06ff-8152-4173-a065-4ec1432e7f32 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:35.717122 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'nonexistent_hostname'} Oct 28 13:03:35.718611 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.719527 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.720794 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.721986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06bd06ff-8152-4173-a065-4ec1432e7f32 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.721986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06bd06ff-8152-4173-a065-4ec1432e7f32 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017642 Oct 28 13:03:35.722453 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 220/428] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:03:35.732022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7605ba54-73e3-4d5e-bc09-9eca5d036c51 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Calling method '.version_select at 0x7f27b9ef9550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7605ba54-73e3-4d5e-bc09-9eca5d036c51 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a898314470254320890be631b6b84444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db658d438d64b52a5b4c45476e01e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7605ba54-73e3-4d5e-bc09-9eca5d036c51 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Request method failure captured: Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts/n-d-862876-2/shutdown HTTP/1.1 Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Mm3UtcTG4HhFMI5BPpR63IO4bsKDeYZOMHLlCyPh4ZbcwlQ8AoZxUv8nuIKpG5_c5AF4AKaJO3j9grwUERaLwVSUvfh2_Vcm9kqn0HZVvvNFCAMt6RGmSRTIDlK89HFLnPFhQqYOPCNuuiiGW4T6eK2s3Qf4hzX0UY39CPLf-__CQ Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:35.740321 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7db658d438d64b52a5b4c45476e01e8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a898314470254320890be631b6b84444 Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'n-d-862876-2'} Oct 28 13:03:35.741834 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.742552 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 13:03:35.743807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.744919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7605ba54-73e3-4d5e-bc09-9eca5d036c51 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.744919 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7605ba54-73e3-4d5e-bc09-9eca5d036c51 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862876-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009513 Oct 28 13:03:35.744919 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 221/429] 10.222.0.25 () {58 vars in 1194 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/n-d-862876-2/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:35.750566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.750844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32dc236f-525a-40da-adea-31375a6898ea tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Calling method '.version_select at 0x7f27b9f57e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.759050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:35.761994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.766878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.768236 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-849570ee-447c-4768-a19b-f944b65ba6e2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.230331 Oct 28 13:03:35.772045 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 209/430] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:35.772346 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-32dc236f-525a-40da-adea-31375a6898ea tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32dc236f-525a-40da-adea-31375a6898ea tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:35.775179 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'nonexistent_hostname'} Oct 28 13:03:35.777252 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:35.778162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 13:03:35.779414 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.780636 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.781715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32dc236f-525a-40da-adea-31375a6898ea tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.782898 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32dc236f-525a-40da-adea-31375a6898ea tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.035786 Oct 28 13:03:35.787807 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 222/431] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:03:35.794654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23d522c2-dd33-4782-b94a-1dc47c9a89de tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Calling method '.version_select at 0x7f27b9ea4af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.794852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23d522c2-dd33-4782-b94a-1dc47c9a89de tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a898314470254320890be631b6b84444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db658d438d64b52a5b4c45476e01e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23d522c2-dd33-4782-b94a-1dc47c9a89de tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Request method failure captured: Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hosts/n-d-862876-2/startup HTTP/1.1 Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Mm3UtcTG4HhFMI5BPpR63IO4bsKDeYZOMHLlCyPh4ZbcwlQ8AoZxUv8nuIKpG5_c5AF4AKaJO3j9grwUERaLwVSUvfh2_Vcm9kqn0HZVvvNFCAMt6RGmSRTIDlK89HFLnPFhQqYOPCNuuiiGW4T6eK2s3Qf4hzX0UY39CPLf-__CQ Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:03:35.796741 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7db658d438d64b52a5b4c45476e01e8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a898314470254320890be631b6b84444 Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'n-d-862876-2'} Oct 28 13:03:35.797949 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.798881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 13:03:35.800074 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.800972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23d522c2-dd33-4782-b94a-1dc47c9a89de tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.800972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23d522c2-dd33-4782-b94a-1dc47c9a89de tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-862876-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.009565 Oct 28 13:03:35.800972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 210/432] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/n-d-862876-2/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:03:35.809306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb2565aa-cf55-4603-a821-7ddd8f597954 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Calling method '.version_select at 0x7f27b9ef94c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.818211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-cb2565aa-cf55-4603-a821-7ddd8f597954 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb2565aa-cf55-4603-a821-7ddd8f597954 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:35.820311 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'nonexistent_hostname'} Oct 28 13:03:35.821523 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:35.822256 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 13:03:35.828626 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb2565aa-cf55-4603-a821-7ddd8f597954 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb2565aa-cf55-4603-a821-7ddd8f597954 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.016874 Oct 28 13:03:35.829815 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 223/433] 10.222.0.25 () {58 vars in 1215 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:35.832725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b68fadf2-cda8-4903-a11a-6a7240b9fe63 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9f9b820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b68fadf2-cda8-4903-a11a-6a7240b9fe63 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/os-hosts/n-d-862876-2 HTTP/1.1 Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 51 Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:03:35.845584 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: {"status": "enable", "maintenance_mode": "invalid"} Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:03:35.847119 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'n-d-862876-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance: Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.847978 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.849688 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.850952 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.850952 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:03:35.850952 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:03:35.850952 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.850952 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.858446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b68fadf2-cda8-4903-a11a-6a7240b9fe63 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.859738 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b68fadf2-cda8-4903-a11a-6a7240b9fe63 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862876-2" status: 400 len: 199 microversion: 2.1 time: 0.031657 Oct 28 13:03:35.861360 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 211/434] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:03:35 2022] PUT /compute/v2.1/os-hosts/n-d-862876-2 => generated 199 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:03:35.873402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:35.873966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ce71287-f72d-46f5-ae80-92ad4591ae5c tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9eee700>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:35.874112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ce71287-f72d-46f5-ae80-92ad4591ae5c tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/os-hosts/n-d-862876-2 HTTP/1.1 Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 51 Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:03:35.878696 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: {"status": "invalid", "maintenance_mode": "enable"} Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:03:35.880081 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'n-d-862876-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance: Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.881000 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.882595 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.883626 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.883626 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:03:35.883626 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:03:35.883626 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 13:03:35.883626 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.883917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:35.883917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:35.883917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:35.884118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:35.884525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:35.884953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:35.885280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ce71287-f72d-46f5-ae80-92ad4591ae5c tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.886850 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ce71287-f72d-46f5-ae80-92ad4591ae5c tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862876-2" status: 400 len: 189 microversion: 2.1 time: 0.017775 Oct 28 13:03:35.892966 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 212/435] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:03:35 2022] PUT /compute/v2.1/os-hosts/n-d-862876-2 => generated 189 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:03:35.903394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9f63af4-290d-4fdf-8347-0387409a8b92 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Action: 'update', calling method: .version_select at 0x7f27b9ea4700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:35.904220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9f63af4-290d-4fdf-8347-0387409a8b92 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a898314470254320890be631b6b84444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db658d438d64b52a5b4c45476e01e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9f63af4-290d-4fdf-8347-0387409a8b92 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Request method failure captured: Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/os-hosts/n-d-862876-2 HTTP/1.1 Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 50 Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Mm3UtcTG4HhFMI5BPpR63IO4bsKDeYZOMHLlCyPh4ZbcwlQ8AoZxUv8nuIKpG5_c5AF4AKaJO3j9grwUERaLwVSUvfh2_Vcm9kqn0HZVvvNFCAMt6RGmSRTIDlK89HFLnPFhQqYOPCNuuiiGW4T6eK2s3Qf4hzX0UY39CPLf-__CQ Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:03:35.906155 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7db658d438d64b52a5b4c45476e01e8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7db658d438d64b52a5b4c45476e01e8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7db658d438d64b52a5b4c45476e01e8e Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1515301233 Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a898314470254320890be631b6b84444 Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1515301233-project Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 13:03:35.907679 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'n-d-862876-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.908536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 13:03:35.909666 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.910672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9f63af4-290d-4fdf-8347-0387409a8b92 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.910672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9f63af4-290d-4fdf-8347-0387409a8b92 tempest-HostsAdminNegativeTestJSON-1515301233 tempest-HostsAdminNegativeTestJSON-1515301233-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862876-2" status: 403 len: 111 microversion: 2.1 time: 0.013544 Oct 28 13:03:35.910672 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 213/436] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:03:35 2022] PUT /compute/v2.1/os-hosts/n-d-862876-2 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:35.919294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11f41596-4c36-458e-8b8a-fd5e3a8157d3 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9f6a3a0>, body: {"status": null, "maintenance_mode": null} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11f41596-4c36-458e-8b8a-fd5e3a8157d3 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/os-hosts/n-d-862876-2 HTTP/1.1 Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 42 Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:03:35.929945 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: {"status": null, "maintenance_mode": null} Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 13:03:35.931130 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'n-d-862876-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance: Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi None Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.931908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.933444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.934705 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:03:35.934705 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:03:35.934705 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 13:03:35.934705 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.934705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11f41596-4c36-458e-8b8a-fd5e3a8157d3 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.934705 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11f41596-4c36-458e-8b8a-fd5e3a8157d3 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-862876-2" status: 400 len: 127 microversion: 2.1 time: 0.012492 Oct 28 13:03:35.934705 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 214/437] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:03:35 2022] PUT /compute/v2.1/os-hosts/n-d-862876-2 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:03:35.940769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8a75fcfb-8bef-4e47-8d9e-d13faffd25b6 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9ea4790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:35.944491 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.hosts [None req-8a75fcfb-8bef-4e47-8d9e-d13faffd25b6 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Enabling host nonexistent_hostname. Oct 28 13:03:35.955672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-8a75fcfb-8bef-4e47-8d9e-d13faffd25b6 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8a75fcfb-8bef-4e47-8d9e-d13faffd25b6 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Request method failure captured: Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 50 Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MnDQSpP7ppShuhjB6bPFdTi7rKy_6KNgneLMgxnZqAJqvI0ZHFkN6w3RmhE-8d-SWizCbnhTYkU31RQ9LC8-LmIXIqImIAI7IpzMFMiimKBD-HvbuaxcHLtbisZTkOLGMRryz2BGi198MFGAvm6ajjzdMTI10UgwcqzlfZHEbZ1SA Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:03:35.957695 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6dfa3885beb14c908636d53e016a53e6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6dfa3885beb14c908636d53e016a53e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6dfa3885beb14c908636d53e016a53e6 Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-687106655 Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3d7c47f5555242cc8a816fc86420e8be Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HostsAdminNegativeTestJSON-687106655-project-admin Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.959226 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 13:03:35.960241 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:35.961584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:03:35.962677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8a75fcfb-8bef-4e47-8d9e-d13faffd25b6 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:35.963713 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8a75fcfb-8bef-4e47-8d9e-d13faffd25b6 tempest-HostsAdminNegativeTestJSON-687106655 tempest-HostsAdminNegativeTestJSON-687106655-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024240 Oct 28 13:03:35.963713 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 215/438] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Oct 28 13:03:35 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:36.019091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:36.021492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:36.027959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.028968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.029865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.030813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.031441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.032979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.065030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:36.076740 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ae8baaf-1792-43f7-80b8-f74a5814745a tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1458 microversion: 2.1 time: 0.231781 Oct 28 13:03:36.077515 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 224/439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:35 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1458 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:36.083754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:36.084785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:36.098449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.099561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.100001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.100753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.101236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.101661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.131258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:36.147965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:36.152707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:36.162185 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ce69450-16df-4507-9849-f2738040f317 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.150871 Oct 28 13:03:36.170795 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 216/440] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:36 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:36.170795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:36.170795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:36.176739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.177370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.177877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.178825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.179433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.180009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.358580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:36.370066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8aa26e05-c2af-4d93-ae10-6281eaa416e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.291295 Oct 28 13:03:36.371486 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 225/441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:36 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:36.797931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:36.800276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:36.806770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=26 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:36.809491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.810787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.811871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.813252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:36.813943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:36.814550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:36.997829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:37.011721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:37.013428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:37.016735 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-99c06282-0f56-4b0d-ac3b-16e9e3ed25b9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.224478 Oct 28 13:03:37.019669 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 226/442] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:36 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:37.121485 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-392996f3-c768-467d-95ab-54c78893fb35 tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1609 microversion: 2.1 time: 0.951333 Oct 28 13:03:37.121485 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 217/443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:36 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1609 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:37.155331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:37.155331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.155331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.155331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.155935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.155935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.155935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.185854 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63ef5755-61c8-460b-b954-0b2af0c4983f tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045939 Oct 28 13:03:37.196457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:37.197441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:37.203461 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 227/444] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:03:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:37.207370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.209916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.211038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.212069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.213547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862876-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:37.214797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.217502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:37.218141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.236315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.240763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.241314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.242317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.242931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.243434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.270042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Lazy-loading 'flavor' on Instance uuid b38f3657-1be2-4469-a4a2-952cd16c0e65 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:37.285697 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance b38f3657-1be2-4469-a4a2-952cd16c0e65 while it is in vm_state suspended Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Request method failure captured: Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65/action HTTP/1.1 Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 97 Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9L0SLiHx5vbe6gNzQxk2lrsb-h2y8M5Gfi_Pzoh86IYQFdJd6zZ4XKgsAG5eSx6DYP7ETOOuEj_2_zr4U6rmFUUOZQH12_sv2gQu_6SP_GDY9gb9t4eTTKZPxiUqxKauyQT4hOiDv-S0i2cV0vQ7xDXIBOhv3NwgqhyNKAST_Xhz6Y Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c75bd3440a5840bfaf42216a2bfdc18f Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveMigrationNegativeTest-1753165619 Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:03:37.287601 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c75bd3440a5840bfaf42216a2bfdc18f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c75bd3440a5840bfaf42216a2bfdc18f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c75bd3440a5840bfaf42216a2bfdc18f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c75bd3440a5840bfaf42216a2bfdc18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveMigrationNegativeTest-1753165619 Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c75bd3440a5840bfaf42216a2bfdc18f Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1753165619 Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveMigrationNegativeTest-1753165619-project-admin Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 40cba68e3e0d45c9b137bc622f22faa8 Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveMigrationNegativeTest-1753165619-project-admin Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: {"os-migrateLive": {"host": "n-h2-862876-2", "block_migration": true, "disk_over_commit": false}} Oct 28 13:03:37.288855 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'os-migrateLive' instance b38f3657-1be2-4469-a4a2-952cd16c0e65 while it is in vm_state suspended Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b38f3657-1be2-4469-a4a2-952cd16c0e65', 'body': {'os-migrateLive': {'host': 'n-h2-862876-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 13:03:37.289544 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b38f3657-1be2-4469-a4a2-952cd16c0e65 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:37.290524 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance b38f3657-1be2-4469-a4a2-952cd16c0e65 while it is in vm_state suspended Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance b38f3657-1be2-4469-a4a2-952cd16c0e65 while it is in vm_state suspended Oct 28 13:03:37.291616 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:37.293710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance b38f3657-1be2-4469-a4a2-952cd16c0e65 while it is in vm_state suspended {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:37.293710 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a93eed51-6561-45c1-9d38-a4dd311cb12e tempest-LiveMigrationNegativeTest-1753165619 tempest-LiveMigrationNegativeTest-1753165619-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65/action" status: 409 len: 155 microversion: 2.1 time: 0.084242 Oct 28 13:03:37.293710 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 228/445] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:03:37 2022] POST /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65/action => generated 155 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:03:37.304310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:37.304859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:37.309569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:37.317220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:37.319239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:37.322180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.323043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.332443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.332443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.332443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.332443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.333066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ccfcaa8-3b7d-472a-8f94-3594d9c10dd9 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.134340 Oct 28 13:03:37.333066 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 218/446] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:37 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:37.369311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:03:37.402235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:37.406948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:37.414277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.416419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.417198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.418580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.419406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.420606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.687653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:37.703627 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-31380cde-603a-4624-a96f-47d0540d1d84 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.311199 Oct 28 13:03:37.705500 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 219/447] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:37 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:37.732057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-045c5d19-44a4-41ca-8ece-74c1874a5fca tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9e77430>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:37.789136 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-045c5d19-44a4-41ca-8ece-74c1874a5fca tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/ada6ac05-4e26-4ba7-83dc-e8007ef14fbd" status: 200 len: 662 microversion: 2.1 time: 0.069180 Oct 28 13:03:37.790763 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 220/448] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:03:37 2022] GET /compute/v2.1/images/ada6ac05-4e26-4ba7-83dc-e8007ef14fbd => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:37.807332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-550dfb7c-b6ed-42f0-9fe8-a81172d4ef89 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9eee940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:37.849087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23a8ce60-e36f-4338-895e-51c9fc47d73b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 204 len: 0 microversion: 2.1 time: 0.548840 Oct 28 13:03:37.850594 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 229/449] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:03:37 2022] DELETE /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:03:37.858561 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-550dfb7c-b6ed-42f0-9fe8-a81172d4ef89 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/ada6ac05-4e26-4ba7-83dc-e8007ef14fbd" status: 200 len: 662 microversion: 2.1 time: 0.056869 Oct 28 13:03:37.862930 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 221/450] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:03:37 2022] GET /compute/v2.1/images/ada6ac05-4e26-4ba7-83dc-e8007ef14fbd => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:37.863066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:37.863066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:37.871364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.872750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.872750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:37.873397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:37.874040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:37.874476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:38.048402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:38.049676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:38.071314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:38.074180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:38.075169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:38.076149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:38.077313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:38.078953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:38.170256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:38.179761 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3e604a8-5a08-4e28-8998-d740e800ce4b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1464 microversion: 2.1 time: 0.323850 Oct 28 13:03:38.194830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 230/451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:37 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:38.361353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:38.361975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:38.380968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:38.381810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:38.382451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:38.383554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:38.384250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:38.384886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:38.401242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:38.417458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:38.420372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:38.424549 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-811ff76a-0a3f-4c95-9e20-1be94f7e864c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.380180 Oct 28 13:03:38.427992 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 222/452] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:38 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:38.501968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:38.515111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:38.524535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:38.533291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:38.539500 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86c97b1e-1d1f-4f17-b5a6-2a798c140d72 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.181946 Oct 28 13:03:38.540763 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 231/453] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:38 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:38.728071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:38.729199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:38.737198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:38.738818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:38.739469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:38.740207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:38.740672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:38.741158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:39.192077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:39.202413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4882012c-171c-419e-949c-ec01b5daa2ba tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.478279 Oct 28 13:03:39.203231 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 223/454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:38 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:39.208529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:39.216860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:39.264992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:39.268479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:39.268923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:39.278475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:39.280690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:39.287066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:39.453798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:39.454501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:39.480634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:39.489840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:39.490624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:39.493270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:39.495944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:39.500326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:39.739213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:39.748132 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-46994968-b488-49ec-af28-5ec86cef06e6 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1464 microversion: 2.1 time: 0.547503 Oct 28 13:03:39.751293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 232/455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:39 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1464 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:39.773239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:39.773239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:39.800116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:39.802056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:39.802056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:39.811234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:39.812493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:39.813436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:39.844082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:39.861446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:39.863227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:39.864379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-086d9012-8ca1-443a-b655-eca7d70feb10 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.414998 Oct 28 13:03:39.864948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 224/456] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:39 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:40.226602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:40.227243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:40.250320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:40.250950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:40.252515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:40.256642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:40.256642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:40.259682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:40.301559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:40.337887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:40.341507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:40.351863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6fcb6e80-aa2e-4124-922e-28f24e5bf4cd tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.595074 Oct 28 13:03:40.354464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 233/457] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:39 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:40.490979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:40.502190 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a844f031-7412-4832-9211-04a28e3d23a7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.279488 Oct 28 13:03:40.503543 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 225/458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:40 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:40.754517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-51cda3d2-00f0-4a3c-8384-353c17706ff3 req-0598df9f-c0e7-4501-a683-aab73d2d6869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38f3657-1be2-4469-a4a2-952cd16c0e65", "name": "network-vif-deleted", "tag": "a74251be-e377-4d89-b9b5-fc29db4dc13a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:40.767496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51cda3d2-00f0-4a3c-8384-353c17706ff3 req-0598df9f-c0e7-4501-a683-aab73d2d6869 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:40.768236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51cda3d2-00f0-4a3c-8384-353c17706ff3 req-0598df9f-c0e7-4501-a683-aab73d2d6869 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:40.768868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51cda3d2-00f0-4a3c-8384-353c17706ff3 req-0598df9f-c0e7-4501-a683-aab73d2d6869 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:40.773557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:40.774254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:40.786574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:40.787163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:40.787609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:40.788324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:40.788784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:40.789212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:40.791234 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-51cda3d2-00f0-4a3c-8384-353c17706ff3 req-0598df9f-c0e7-4501-a683-aab73d2d6869 service nova] Creating event network-vif-deleted:a74251be-e377-4d89-b9b5-fc29db4dc13a for instance b38f3657-1be2-4469-a4a2-952cd16c0e65 on n-h1-862876-2 Oct 28 13:03:40.798175 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-51cda3d2-00f0-4a3c-8384-353c17706ff3 req-0598df9f-c0e7-4501-a683-aab73d2d6869 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054525 Oct 28 13:03:40.801321 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 234/459] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:40.895686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:40.896989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:40.910995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:40.911730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:40.913049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:40.913967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:40.914587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:40.915310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:40.942118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:40.958070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48e1081f-63f7-4478-999d-6a23116f57b7 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1422 microversion: 2.1 time: 0.188491 Oct 28 13:03:40.965254 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 226/460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:40 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1422 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:41.003960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8926a40e-4b26-4f76-98c4-f248d63c434b tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9eb2790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:41.056592 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8926a40e-4b26-4f76-98c4-f248d63c434b tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c99302d8-d9be-4eb7-ba8b-04bd21646bef" status: 200 len: 662 microversion: 2.1 time: 0.056569 Oct 28 13:03:41.057579 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 227/461] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:03:40 2022] GET /compute/v2.1/images/c99302d8-d9be-4eb7-ba8b-04bd21646bef => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:41.076790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-308b2122-abaf-45cd-818c-0e926de472f0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9eee790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:41.127130 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-308b2122-abaf-45cd-818c-0e926de472f0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c99302d8-d9be-4eb7-ba8b-04bd21646bef" status: 200 len: 662 microversion: 2.1 time: 0.055163 Oct 28 13:03:41.127710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 228/462] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:03:41 2022] GET /compute/v2.1/images/c99302d8-d9be-4eb7-ba8b-04bd21646bef => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:41.244327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:41.256282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:41.258157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:41.260167 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9c5dd919-7057-4bf5-acd5-749d7989bfe7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.373977 Oct 28 13:03:41.261826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 235/463] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:40 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:41.366152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-543954659", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:41.385394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:41.387342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:41.409616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.410126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.410572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:41.411323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.411840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.412267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:41.446980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:03:41.557311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:41.573790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:41.576714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:41.584856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:41.586614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-634c9b4a-fcc6-4794-b95a-9dc5f0ab65d0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.205101 Oct 28 13:03:41.603725 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 236/464] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:41 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:41.613739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:41.614520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:41.622350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.623187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.624008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:41.624935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.626609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.627283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:41.787754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:41.789050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:41.789567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:41.790133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:41.790714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:41.791366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:41.795566 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b16d0ee5-35d8-4c9d-8ce6-537848a8de62 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.190683 Oct 28 13:03:41.796138 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 237/465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:41 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:41.801402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.801887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.803116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:41.803962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.804336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.804789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:41.823455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Getting quotas for project 4f51dc9ea4fd4a00b97d3a43d851acbd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:41.828034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Getting quotas for user 419066f907e545a39fd554ca1fc680a4 and project 4f51dc9ea4fd4a00b97d3a43d851acbd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:41.839760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:41.842179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:41.987797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:41.988402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:41.996128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.996852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.997495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:41.998354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:41.999064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:41.999709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.036026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.036510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.037128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.037580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lazy-loading 'fault' on Instance uuid b38f3657-1be2-4469-a4a2-952cd16c0e65 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:42.059453 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dca9ebc1-da80-4fa6-8cb4-c3cfa1563915 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698818 Oct 28 13:03:42.060737 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 229/466] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:03:42.116434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:42.129990 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a26273c-3dd9-4ee0-9c8a-340312b9852b tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 200 len: 1308 microversion: 2.1 time: 0.145894 Oct 28 13:03:42.130596 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 238/467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:41 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:42.261673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1345289095", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:42.288666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:42.289330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:42.301911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.304220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.309711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.310578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.311288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.313354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.368829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:03:42.631542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:42.642485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:42.644085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:42.646983 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a817a6ae-8c1c-4a71-b69e-4f15d735b24c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.362307 Oct 28 13:03:42.648105 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 239/468] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:42 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:42.666645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:42.668302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:42.670407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:42.671524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:42.672081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:42.672537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:42.672947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:42.674974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.675705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.676203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.677444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.678511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.679402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.683563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.684211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.684851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.685741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.686193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.686611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.704835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Getting quotas for project 4f51dc9ea4fd4a00b97d3a43d851acbd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:42.709262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Getting quotas for user 419066f907e545a39fd554ca1fc680a4 and project 4f51dc9ea4fd4a00b97d3a43d851acbd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:42.722049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:42.724483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:42.832818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:42.842256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:42.843829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:42.849533 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-382dc4f5-ed48-4d91-a443-dcbc0f805a77 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.199549 Oct 28 13:03:42.858885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 240/469] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:42 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:42.930000 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-90861781-7b19-4226-9eff-39cfbdca957e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672646 Oct 28 13:03:42.938730 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 230/470] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:03:42.945270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:42.945891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:42.960464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:42.960464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.960464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.960464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:42.961348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:42.961832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:42.962619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.116433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Calling method '.version_select at 0x7f27ba13e700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.123864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.128115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.128824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.163920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.168363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.168363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.190225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:43.198041 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49ae9de8-4523-4409-a7e5-827078cea3a6 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.257809 Oct 28 13:03:43.200742 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 231/471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:42 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:43.218694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ab30c7d-fb1c-45bc-9567-b69ffebecd32 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.219336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0ab30c7d-fb1c-45bc-9567-b69ffebecd32 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:43.231675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.232479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.233350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.247762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.248526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.249165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.274142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.274700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.275126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.283527 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-19703142-c5f3-4697-8c0d-45f37abf638d tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.431763 Oct 28 13:03:43.284095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 241/472] 10.222.0.25 () {60 vars in 1243 bytes} [Fri Oct 28 13:03:42 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:43.288764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.299635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: b38f3657-1be2-4469-a4a2-952cd16c0e65] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:43.299635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.299635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.299635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.300109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.300109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.300109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.303344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0ab30c7d-fb1c-45bc-9567-b69ffebecd32 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:43.311344 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0ab30c7d-fb1c-45bc-9567-b69ffebecd32 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1218 microversion: 2.1 time: 0.108589 Oct 28 13:03:43.312194 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 232/473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:43 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:43.312416 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] HTTP exception thrown: Instance b38f3657-1be2-4469-a4a2-952cd16c0e65 could not be found. Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Request method failure captured: Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 HTTP/1.1 Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LxNKdb-XPuQIuZ9fMd7ooQoBbmkcguKdPeewRxewL9BGPRMsHeCIuMHUMaukGhUV1g4ZIybOxndnxgWvMAUVBDr5dk8ZSAndLyc_qLXVOXIEtaMiVOkv6x2EulzJyAT1QoW9No-xdiWJk4V7SzZc7Taft1Mc4DtZ2OJPVAyJogA4I Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a00fdcc92c02421f8d1bd03631662bd0 Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveMigrationNegativeTest-881574808 Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:43.314149 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00fdcc92c02421f8d1bd03631662bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00fdcc92c02421f8d1bd03631662bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a00fdcc92c02421f8d1bd03631662bd0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a00fdcc92c02421f8d1bd03631662bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveMigrationNegativeTest-881574808 Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a00fdcc92c02421f8d1bd03631662bd0 Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-881574808 Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveMigrationNegativeTest-881574808-project Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2123bea949fd47fe8d6574b6a26ab015 Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveMigrationNegativeTest-881574808-project Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b38f3657-1be2-4469-a4a2-952cd16c0e65 could not be found. Oct 28 13:03:43.315641 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b38f3657-1be2-4469-a4a2-952cd16c0e65'} Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38f3657-1be2-4469-a4a2-952cd16c0e65 could not be found. Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:43.316360 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38f3657-1be2-4469-a4a2-952cd16c0e65 could not be found. Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38f3657-1be2-4469-a4a2-952cd16c0e65 could not be found. Oct 28 13:03:43.317478 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:43.318491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Returning 404 to user: Instance b38f3657-1be2-4469-a4a2-952cd16c0e65 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:43.318491 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f7d9abb-89ea-4cd4-ac09-05ea17f65a70 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65" status: 404 len: 111 microversion: 2.1 time: 0.030590 Oct 28 13:03:43.318491 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 242/474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:43 2022] GET /compute/v2.1/servers/b38f3657-1be2-4469-a4a2-952cd16c0e65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:43.322331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Calling method '.version_select at 0x7f27b9f9bd30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.326909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.327466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.328104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.335638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.339620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:43.342054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.342544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.343054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.343739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.344193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.344611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.356642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.357231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.357844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.379424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:03:43.407638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.410541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.411228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.424444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.424929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.425363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.447132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.447742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.448990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.456864 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ff715bb-ccf6-4d42-9010-8e6007b9240f tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.143183 Oct 28 13:03:43.457693 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 233/475] 10.222.0.25 () {60 vars in 1222 bytes} [Fri Oct 28 13:03:43 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:43.470006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Calling method '.version_select at 0x7f27b9eb23a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.473589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.474081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.474509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.499113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.499602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.505667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.506706 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bc4dc7dc-c5ee-46e0-b2cf-d1435f689eec tempest-HypervisorAdminV253TestBase-1010914436 tempest-HypervisorAdminV253TestBase-1010914436-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/c5e6cd5f-0bf8-4890-afaa-12d2f87379b7" status: 200 len: 792 microversion: 2.53 time: 0.040212 Oct 28 13:03:43.507334 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 234/476] 10.222.0.25 () {60 vars in 1298 bytes} [Fri Oct 28 13:03:43 2022] GET /compute/v2.1/os-hypervisors/c5e6cd5f-0bf8-4890-afaa-12d2f87379b7 => generated 792 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:43.676773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.677843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:43.689204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.689698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.691161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.694704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.695240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.695676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.809584 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ba4ed70-e368-4ab4-ae27-0f1292bbc3d1 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 204 len: 0 microversion: 2.1 time: 0.477905 Oct 28 13:03:43.814828 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 243/477] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:03:43 2022] DELETE /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:03:43.819916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f54b5b68-ac38-41fe-a9bb-889ee6adb3cd req-56789b74-728e-42a5-9901-af2dca867ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33f2331-58e4-4f5a-b517-56192307a84b", "name": "network-vif-plugged", "status": "completed", "tag": "f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:43.829296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f54b5b68-ac38-41fe-a9bb-889ee6adb3cd req-56789b74-728e-42a5-9901-af2dca867ee0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.829783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f54b5b68-ac38-41fe-a9bb-889ee6adb3cd req-56789b74-728e-42a5-9901-af2dca867ee0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.830204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f54b5b68-ac38-41fe-a9bb-889ee6adb3cd req-56789b74-728e-42a5-9901-af2dca867ee0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.841948 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f54b5b68-ac38-41fe-a9bb-889ee6adb3cd req-56789b74-728e-42a5-9901-af2dca867ee0 service nova] Creating event network-vif-plugged:f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3 for instance f33f2331-58e4-4f5a-b517-56192307a84b on n-h2-862876-2 Oct 28 13:03:43.856247 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f54b5b68-ac38-41fe-a9bb-889ee6adb3cd req-56789b74-728e-42a5-9901-af2dca867ee0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039966 Oct 28 13:03:43.861609 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 244/478] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:43.872160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.879525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:43.890469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.892564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.893892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.899216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.899714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:43.900298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:43.943171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:43.958705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:43.960301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:43.966629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd509126-9b04-41d8-8e4a-0dfb60f8b72b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.291218 Oct 28 13:03:43.967545 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 235/479] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:43 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:43.982732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:43.983719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:43.992984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:43.994453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:44.002931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:44.003856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:44.004535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:44.005315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:44.109220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:44.125649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:44.128883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:44.135188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-57267bb6-f24e-48a1-b9cb-5a7ec2e1dcae tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.166121 Oct 28 13:03:44.135818 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 236/480] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:43 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:44.169574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:44.180549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47a32f56-34b3-4fc0-85d1-1eaf20a609b5 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1474 microversion: 2.1 time: 0.317376 Oct 28 13:03:44.181964 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 245/481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:43 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1474 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:44.228165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:44.229669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:44.238925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:44.239553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:44.240140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:44.241241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:44.241834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:44.242679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:44.337351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f69de42-5341-4f3d-92de-a7258bacc1d2 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:44.338068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f69de42-5341-4f3d-92de-a7258bacc1d2 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:44.432123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f69de42-5341-4f3d-92de-a7258bacc1d2 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:44.438875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:44.439726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:44.444196 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f69de42-5341-4f3d-92de-a7258bacc1d2 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1218 microversion: 2.1 time: 0.110163 Oct 28 13:03:44.445610 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 246/482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:44 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:44.452175 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-56af0beb-4c61-45db-8aec-e5633ce1c87b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.229372 Oct 28 13:03:44.467573 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 237/483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:44 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:44.999335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:45.001461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:45.009631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.011437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.011437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.012862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.013572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.014364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.165403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:45.166495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:45.174774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.175497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.176078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.179353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.179353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.179353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.304492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.306541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.321683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.324087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.327521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.329395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.330828 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5801ed32-fd00-4579-b4e5-192e056f01e9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1362 microversion: 2.25 time: 0.339633 Oct 28 13:03:45.343249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 247/484] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:44 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:45.343368 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09b82df4-87fe-440c-93ee-48ba9cbbd008 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.174013 Oct 28 13:03:45.343368 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 238/485] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:45 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:45.343541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:45.343541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:45.363824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.365010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.365879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.366772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.367410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.368006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.380491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:45.473835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:45.474756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:45.486452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.487918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.488445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.489241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.490455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.491095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.597553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.609678 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6decc1ae-3ce6-494b-bd49-e5a31fdef0a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1214 microversion: 2.1 time: 0.142208 Oct 28 13:03:45.610733 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 239/486] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:45 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1214 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:45.629018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:45.629926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:45.643606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.644096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.644717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.645645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.646257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.646679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.746123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.763450 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-43bc8b52-21e0-412c-acde-67b7f6fae881 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1474 microversion: 2.1 time: 0.425519 Oct 28 13:03:45.764255 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 248/487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:45 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1474 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:45.899435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:45.903936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-35f185a4-6e03-4cda-891c-c42273333d61 req-6b20ba2b-1879-48b3-b851-a0bfc2f6e6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e0baaa-3d64-45b4-8b42-a235d4550f04", "name": "network-vif-plugged", "status": "completed", "tag": "a61e79cd-1906-4295-a654-ea1881270697"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:45.907290 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0321084e-32e7-441d-be12-cf9a77f289fc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1319 microversion: 2.1 time: 0.294814 Oct 28 13:03:45.915224 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 240/488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:45 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:45.949593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-35f185a4-6e03-4cda-891c-c42273333d61 req-6b20ba2b-1879-48b3-b851-a0bfc2f6e6c1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:45.950074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-35f185a4-6e03-4cda-891c-c42273333d61 req-6b20ba2b-1879-48b3-b851-a0bfc2f6e6c1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:45.950494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-35f185a4-6e03-4cda-891c-c42273333d61 req-6b20ba2b-1879-48b3-b851-a0bfc2f6e6c1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:45.974551 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-35f185a4-6e03-4cda-891c-c42273333d61 req-6b20ba2b-1879-48b3-b851-a0bfc2f6e6c1 service nova] Creating event network-vif-plugged:a61e79cd-1906-4295-a654-ea1881270697 for instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 on n-h2-862876-2 Oct 28 13:03:45.982302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-35f185a4-6e03-4cda-891c-c42273333d61 req-6b20ba2b-1879-48b3-b851-a0bfc2f6e6c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086911 Oct 28 13:03:45.983967 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 249/489] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:46.262599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fb9b0982-c942-4abb-82e6-aace76801ada req-26db87fb-6010-4dfb-9ff6-dbe8317bd627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bdfcdd-1fcf-489a-bfe0-d842d4a75b89", "name": "network-vif-deleted", "tag": "05d151cf-cbd4-4456-b3ac-4f97871022dd"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:46.273933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb9b0982-c942-4abb-82e6-aace76801ada req-26db87fb-6010-4dfb-9ff6-dbe8317bd627 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.274415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb9b0982-c942-4abb-82e6-aace76801ada req-26db87fb-6010-4dfb-9ff6-dbe8317bd627 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.275085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb9b0982-c942-4abb-82e6-aace76801ada req-26db87fb-6010-4dfb-9ff6-dbe8317bd627 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.288833 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fb9b0982-c942-4abb-82e6-aace76801ada req-26db87fb-6010-4dfb-9ff6-dbe8317bd627 service nova] Creating event network-vif-deleted:05d151cf-cbd4-4456-b3ac-4f97871022dd for instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 on n-h1-862876-2 Oct 28 13:03:46.294865 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fb9b0982-c942-4abb-82e6-aace76801ada req-26db87fb-6010-4dfb-9ff6-dbe8317bd627 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035978 Oct 28 13:03:46.295719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 241/490] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:46.358187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:46.360728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:46.367551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:46.369099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:46.369272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.369934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.374621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.374621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.374621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.374621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.377440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.378167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.378849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.380275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.380745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.381224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.461537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:46.472352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:46.474557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:46.481934 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48d1928a-19fe-4843-88ab-7b5865318988 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.119722 Oct 28 13:03:46.482928 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 242/491] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:46 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:46.604078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:46.623432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:46.640359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:46.641726 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9fb9b023-0fa6-4546-baf2-16517d7a59c6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1559 microversion: 2.25 time: 0.288789 Oct 28 13:03:46.648412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:46.648688 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 250/492] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:46 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1559 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:46.648802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:46.689663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.692281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.692844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.693959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.695654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.700327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.835916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:46.864074 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60dd96af-ea6a-41a5-a8e6-b1a7f5f9ae31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1270 microversion: 2.1 time: 0.228837 Oct 28 13:03:46.875232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 243/493] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:46 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:46.893715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:46.896672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:46.906831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.907683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.908406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:46.909427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:46.910102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:46.910664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.019465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:47.029192 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19c89ad7-6f33-4548-88fe-f8273d38e8c4 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1303 microversion: 2.1 time: 0.152730 Oct 28 13:03:47.031588 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 244/494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:46 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:47.036823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:47.037553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:47.055406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.056207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.056802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.058736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.059406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.060181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.127722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:03:47.160904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:47.232482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:47.233264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:47.259535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.260626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.265940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.299239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.299239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.299239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.589747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid f33f2331-58e4-4f5a-b517-56192307a84b {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:47.751618 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4040a45a-1c73-4134-adea-5c774a654607 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 204 len: 0 microversion: 2.1 time: 0.718187 Oct 28 13:03:47.752154 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 245/495] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:03:47 2022] DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:03:47.752562 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6ceae79-4423-4f05-8e78-bc74d03d58db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 2052 microversion: 2.25 time: 1.083950 Oct 28 13:03:47.753600 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 251/496] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:46 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 2052 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:47.759016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:47.760656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:47.768676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.770551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.771404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.772494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.773443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.774192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.782716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:47.785812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:47.798087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.798890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.802561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:47.803513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:47.804131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:47.804855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.108438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:48.137063 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a710ac7a-935f-4b2a-9fcf-662fb7ca2a37 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1468 microversion: 2.1 time: 0.379099 Oct 28 13:03:48.141288 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 246/497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:47 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:48.156015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:48.156720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:48.178309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:48.178901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:48.179378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.180716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:48.181306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:48.181738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.403590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:48.414156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:48.415684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:48.429314 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ede1079f-b34e-435f-a6ef-c9dc679f2fe5 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.672730 Oct 28 13:03:48.433167 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 252/498] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:47 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:48.434122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid f33f2331-58e4-4f5a-b517-56192307a84b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:48.450629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:48.451786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:48.461523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:48.462231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:48.462912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.464443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:48.467337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:48.469143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.566211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73f17a0c-6d1b-4ac3-acfd-940487069f07 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 2052 microversion: 2.25 time: 0.423670 Oct 28 13:03:48.566839 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 247/499] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:48 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 2052 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:48.578238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-89660090", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "1865344413", "adminPass": "***", "networks": [{"uuid": "498fe085-27a0-47ba-8ff5-00f62dd39d69"}], "security_groups": [{"name": "tempest-securitygroup--1750132622"}], "key_name": "tempest-keypair-1932122644", "user_data": "}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:48.655899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:48.665175 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8582e511-6b5c-4450-8b8a-5850361969ac tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1276 microversion: 2.1 time: 0.230682 Oct 28 13:03:48.678457 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 253/500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:48 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:48.691470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:48.693530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:48.704044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:48.704529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:48.707552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.708292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:48.708832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:48.711673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.773197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:48.773949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:48.774881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:48.775524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lazy-loading 'fault' on Instance uuid 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:48.838560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] validate_networks() for [('498fe085-27a0-47ba-8ff5-00f62dd39d69', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:03:48.865187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2123bea949fd47fe8d6574b6a26ab015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00fdcc92c02421f8d1bd03631662bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:48.877704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c0186db4-8912-4694-abbd-9674bdab2391 tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 200 len: 1308 microversion: 2.1 time: 0.190307 Oct 28 13:03:48.879128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 254/501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:48 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:49.157757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:49.158340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:49.164702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.165285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.165807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.166655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.167219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.167886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.210367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:03:49.513622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:49.514357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:49.514869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:49.515386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:49.515801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:49.526881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.527618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.528056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.528875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.529340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.529798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.549478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Getting quotas for project 23e3532105a140fdbaf84b5b2ffad712. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:49.553757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Getting quotas for user 148f8a3614e048a1b858f2c9744d0a6e and project 23e3532105a140fdbaf84b5b2ffad712. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:49.565894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:49.568741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:49.756941 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-64f4218b-0153-4e36-9a68-19129df61f79 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 204 len: 0 microversion: 2.1 time: 0.876378 Oct 28 13:03:49.759795 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 255/502] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:03:48 2022] DELETE /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:03:49.763281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:49.767240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.772669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.774403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.775481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.777350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.783587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.785382 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ebf2bee1-4773-46a2-905c-d2f36d0d85a0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.214424 Oct 28 13:03:49.796968 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 248/503] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:03:49.821715 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d804ab9-86c1-4a78-951e-d32f90780801 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062832 Oct 28 13:03:49.831148 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 256/504] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Oct 28 13:03:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:49.835214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:49.836107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:49.836623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:49.836813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:49.843820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.848201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.848201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.848201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.848201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.848513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.859787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.866449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.867173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.868074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.868754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.869335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.956227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:49.968867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:49.976056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:49.982534 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e0dc368-c3be-4148-b2a5-26d61a5e9acf tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.184171 Oct 28 13:03:49.984378 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 249/505] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:49 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:49.989222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:49.989817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:49.997719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:49.998278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:49.999013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:49.999917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:50.000585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:50.001571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:50.169766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:50.178361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-919eba01-098b-4d4d-877a-a6711baafa27 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1474 microversion: 2.1 time: 0.192818 Oct 28 13:03:50.191307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 250/506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:49 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1474 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:50.200810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b19237b1-38c6-458a-a350-ce73632e66fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:50.201899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b19237b1-38c6-458a-a350-ce73632e66fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:50.269408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b19237b1-38c6-458a-a350-ce73632e66fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:50.279928 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b19237b1-38c6-458a-a350-ce73632e66fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1263 microversion: 2.1 time: 0.087493 Oct 28 13:03:50.281063 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 251/507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:50 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:50.287907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862876-2", "block_migration": "auto"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:50.293023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:50.306549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:50.307423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:50.307919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:50.312841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:50.312841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:50.312841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:50.329991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:50.339302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0fd8de7-0d83-4bbd-bce1-e8a7232170c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1318 microversion: 2.1 time: 0.514266 Oct 28 13:03:50.341470 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 257/508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:49 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:50.344754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:50.345577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] [instance: 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:50.352697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:50.353507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:50.353937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:50.355370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:50.355809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:50.356233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:50.391268 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] HTTP exception thrown: Instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 could not be found. Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Request method failure captured: Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 HTTP/1.1 Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LxNKdb-XPuQIuZ9fMd7ooQoBbmkcguKdPeewRxewL9BGPRMsHeCIuMHUMaukGhUV1g4ZIybOxndnxgWvMAUVBDr5dk8ZSAndLyc_qLXVOXIEtaMiVOkv6x2EulzJyAT1QoW9No-xdiWJk4V7SzZc7Taft1Mc4DtZ2OJPVAyJogA4I Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a00fdcc92c02421f8d1bd03631662bd0 Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveMigrationNegativeTest-881574808 Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:50.392943 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00fdcc92c02421f8d1bd03631662bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a00fdcc92c02421f8d1bd03631662bd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a00fdcc92c02421f8d1bd03631662bd0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a00fdcc92c02421f8d1bd03631662bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveMigrationNegativeTest-881574808 Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a00fdcc92c02421f8d1bd03631662bd0 Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-881574808 Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveMigrationNegativeTest-881574808-project Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2123bea949fd47fe8d6574b6a26ab015 Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveMigrationNegativeTest-881574808-project Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 could not be found. Oct 28 13:03:50.394503 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '71bdfcdd-1fcf-489a-bfe0-d842d4a75b89'} Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 could not be found. Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:50.395368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 could not be found. Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 could not be found. Oct 28 13:03:50.396500 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:50.404327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] Returning 404 to user: Instance 71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:50.404327 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c57afa41-a88a-4186-a10b-e3e1cbee911f tempest-LiveMigrationNegativeTest-881574808 tempest-LiveMigrationNegativeTest-881574808-project] 10.222.0.25 "GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89" status: 404 len: 111 microversion: 2.1 time: 0.053390 Oct 28 13:03:50.404327 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 258/509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:50 2022] GET /compute/v2.1/servers/71bdfcdd-1fcf-489a-bfe0-d842d4a75b89 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:03:50.450550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'flavor' on Instance uuid f33f2331-58e4-4f5a-b517-56192307a84b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:50.525885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Going to try to live migrate instance to n-h1-862876-2 {{(pid=127793) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:03:50.800382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:51.177529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-732cb996-5a52-4f82-9d19-ead496fe2042 tempest-NetworksTest-513260600 tempest-NetworksTest-513260600-project-admin] Calling method '.version_select at 0x7f27b9ef93a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:51.908918 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-732cb996-5a52-4f82-9d19-ead496fe2042 tempest-NetworksTest-513260600 tempest-NetworksTest-513260600-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 4711 microversion: 2.1 time: 1.423472 Oct 28 13:03:51.908918 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 259/510] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:03:50 2022] GET /compute/v2.1/os-networks => generated 4711 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:03:51.913929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:51.914810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:51.943900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:51.944531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:51.944936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:51.948786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:51.949476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:51.950048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:52.126643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:52.138597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:52.142667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:52.153822 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c70df22-cee1-4b29-aee4-f4758c052fb2 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1446 microversion: 2.75 time: 0.245974 Oct 28 13:03:52.156900 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 260/511] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:51 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1446 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:52.173497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:52.175488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:52.182933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:52.183586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:52.183845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:52.184539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:52.185433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:52.186028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:52.693004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:52.711958 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4b73e9e2-3e8b-4dc2-ab66-3dcf24ffc3ef tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1474 microversion: 2.1 time: 0.551648 Oct 28 13:03:52.714914 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 261/512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:52 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1474 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:52.724581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:52.725206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:52.733726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:52.736380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:52.736380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:52.736380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:52.736885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:52.737235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:52.813097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:52.822798 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-58c878d2-60e5-4447-861b-8d79a8a356b0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1315 microversion: 2.1 time: 0.104913 Oct 28 13:03:52.823451 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 262/513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:52 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1315 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:52.832498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:52.833837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:52.843118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:52.843676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:52.844859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:52.851827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:52.852607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:52.853235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:53.232985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:53.245559 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c7b8f91-006b-412f-a439-3b5e420fee60 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1318 microversion: 2.1 time: 0.420459 Oct 28 13:03:53.248166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 263/514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:52 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:53.262276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2aa237fd-5094-4399-9f05-3af6eba69758 req-3fa9bdbc-39c4-45e7-86e3-aa7a7c73173d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f24c67-2a68-4503-b970-023af509105c", "tag": "c1cc3ab6-4dba-4722-ab4c-0acee2b8276e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:53.297389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2aa237fd-5094-4399-9f05-3af6eba69758 req-3fa9bdbc-39c4-45e7-86e3-aa7a7c73173d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:53.298413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2aa237fd-5094-4399-9f05-3af6eba69758 req-3fa9bdbc-39c4-45e7-86e3-aa7a7c73173d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:53.299702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2aa237fd-5094-4399-9f05-3af6eba69758 req-3fa9bdbc-39c4-45e7-86e3-aa7a7c73173d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:53.313499 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2aa237fd-5094-4399-9f05-3af6eba69758 req-3fa9bdbc-39c4-45e7-86e3-aa7a7c73173d service nova] Creating event network-changed:c1cc3ab6-4dba-4722-ab4c-0acee2b8276e for instance 50f24c67-2a68-4503-b970-023af509105c on n-h1-862876-2 Oct 28 13:03:53.320392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2aa237fd-5094-4399-9f05-3af6eba69758 req-3fa9bdbc-39c4-45e7-86e3-aa7a7c73173d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067144 Oct 28 13:03:53.321012 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 264/515] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:53.326990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11cb7419-f77a-43a7-b9b3-541e9b16b3f1 tempest-NetworksTest-513260600 tempest-NetworksTest-513260600-project-admin] Calling method '.version_select at 0x7f27b9fb53a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:53.592771 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11cb7419-f77a-43a7-b9b3-541e9b16b3f1 tempest-NetworksTest-513260600 tempest-NetworksTest-513260600-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/1be8f2a9-1883-44e8-a6c6-76b51d50fa9f" status: 200 len: 652 microversion: 2.1 time: 0.269732 Oct 28 13:03:53.598386 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 265/516] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:03:53 2022] GET /compute/v2.1/os-networks/1be8f2a9-1883-44e8-a6c6-76b51d50fa9f => generated 652 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:53.603637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-593529da-a08b-441e-a2ba-432e4070510e req-85e844c0-d7c1-4d9b-a773-f10a5faedda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a69e5a01-bef1-4cb9-91d4-63e5124edbb3", "name": "network-vif-deleted", "tag": "0f7c5045-27c5-4a52-9053-48527718260e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:53.636242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-593529da-a08b-441e-a2ba-432e4070510e req-85e844c0-d7c1-4d9b-a773-f10a5faedda0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:53.636242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-593529da-a08b-441e-a2ba-432e4070510e req-85e844c0-d7c1-4d9b-a773-f10a5faedda0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:53.636242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-593529da-a08b-441e-a2ba-432e4070510e req-85e844c0-d7c1-4d9b-a773-f10a5faedda0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:53.644255 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-593529da-a08b-441e-a2ba-432e4070510e req-85e844c0-d7c1-4d9b-a773-f10a5faedda0 service nova] Creating event network-vif-deleted:0f7c5045-27c5-4a52-9053-48527718260e for instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 on n-h2-862876-2 Oct 28 13:03:53.652843 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-593529da-a08b-441e-a2ba-432e4070510e req-85e844c0-d7c1-4d9b-a773-f10a5faedda0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050865 Oct 28 13:03:53.654097 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 266/517] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:53.671013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:53.671013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:53.680548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:53.681157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:53.683055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:53.684095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:53.684833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:53.686346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:53.817117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:53.823554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:53.828376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:53.833128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:53.850828 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27d98773-2fe6-4b47-a5aa-5036bfb6b174 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1452 microversion: 2.75 time: 0.193136 Oct 28 13:03:53.851576 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 267/518] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:53 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:53.856928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12377c47-78df-4895-9ca2-ce9fb3a92dbe tempest-NetworksTest-513260600 tempest-NetworksTest-513260600-project-admin] Calling method '.version_select at 0x7f27b9e16dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:54.216388 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12377c47-78df-4895-9ca2-ce9fb3a92dbe tempest-NetworksTest-513260600 tempest-NetworksTest-513260600-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 4711 microversion: 2.1 time: 0.363654 Oct 28 13:03:54.216993 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 268/519] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:03:53 2022] GET /compute/v2.1/os-networks => generated 4711 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:54.232786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:54.233406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:54.240037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.240535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.240971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.241676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.242127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.242732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.282114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.282603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.283061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.283551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lazy-loading 'fault' on Instance uuid 27e0baaa-3d64-45b4-8b42-a235d4550f04 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:54.361944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:54.371340 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2824d392-aa4c-4703-a57d-fac69a5773ce tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 200 len: 1309 microversion: 2.1 time: 0.148520 Oct 28 13:03:54.384657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 269/520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:54 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:54.384657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:54.384657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:54.385026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.385663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.386903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.388513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.408138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.408138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.444076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:54.501983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:54.508191 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-082ff562-1fa2-4f36-972e-877b7542dd2c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1321 microversion: 2.1 time: 0.134507 Oct 28 13:03:54.519117 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 270/521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:54 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1321 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:54.523964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:54.524608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:54.527015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:54.531800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.532288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.532894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.533591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.534048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.534471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.812439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:54.827680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bda0ac78-19e8-4daa-b5b8-eb7b70200ecb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1318 microversion: 2.1 time: 0.317769 Oct 28 13:03:54.829315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 271/522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:54 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:54.885748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:54.887024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:54.893121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.893611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.894033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:54.895286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:54.896073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:54.896762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:55.047391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:55.056077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:55.058047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:55.063431 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6146a67a-bea3-4f8d-b332-8f20f25a77a0 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1452 microversion: 2.75 time: 0.182612 Oct 28 13:03:55.076315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 272/523] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:54 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:03:55.397891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:55.399315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:55.415872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:55.416615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:55.417301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:55.423455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:55.425859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:55.427409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:55.461028 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] HTTP exception thrown: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Request method failure captured: Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 HTTP/1.1 Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MYkJbM70pQF2hmTHcoWGxqJtwOTj7vPWrOMWK-rIymf6dZ15uq-RFfBGo6UXrcWDv2EKfDn7kLE8YnPgdo6Kzy3or_NkraIRBDO2DKXW9HTozCAdaEkKUfnAXw62a_2BeBZVY1XM75TVJzcckirvSBEw75VBvMf141g5HV8eABsno Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:03:55.462687 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a957c0dec14fbb92fc1a4b7b17efa8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a715e794315e44369c51eed6d09c710e Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:03:55.464236 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '27e0baaa-3d64-45b4-8b42-a235d4550f04'} Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:03:55.465073 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:03:55.466336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:03:55.467442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Returning 404 to user: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:03:55.467442 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-194c040b-4bec-4326-8203-fb391bdae0e7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 404 len: 111 microversion: 2.1 time: 0.070436 Oct 28 13:03:55.467442 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 273/524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:55 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:03:55.531629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:55.533089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:55.539257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:55.540055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:55.540765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:55.541540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:55.542609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:55.543312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:56.081628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:56.099988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f88029a-7190-41ce-adc9-7a5107d254b8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.572044 Oct 28 13:03:56.108107 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 274/525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:55 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:56.122986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1914279987", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:56.245157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:03:56.571514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:56.572152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:56.572463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:56.572879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:56.573356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:56.592217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:56.593346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:56.593961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:56.594917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:56.595539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:56.596117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:56.641223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Getting quotas for project f1a957c0dec14fbb92fc1a4b7b17efa8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:03:56.653269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Getting quotas for user a715e794315e44369c51eed6d09c710e and project f1a957c0dec14fbb92fc1a4b7b17efa8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:03:56.679659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:03:56.687736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:03:56.920352 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a0e1783e-d338-4270-960d-09be90600b6d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810608 Oct 28 13:03:56.926469 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 275/526] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:03:56.933297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:56.933914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:56.962229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:56.962733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:56.963193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:56.964024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:56.964481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:56.964912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:57.296745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:57.307223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-65cb0544-7173-4f9b-9b89-85d8018310f7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1318 microversion: 2.1 time: 0.377613 Oct 28 13:03:57.308280 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 276/527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:56 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:57.318326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3331020b-f786-49a3-9d64-a62a73294cb7 req-a7a06b33-b26d-4b59-abdf-b2473e5d828f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e0baaa-3d64-45b4-8b42-a235d4550f04", "name": "network-vif-deleted", "tag": "a61e79cd-1906-4295-a654-ea1881270697"}, {"name": "network-changed", "server_uuid": "aa7b3df7-aba2-4aa3-b02a-525e788cf294", "tag": "5bf284c1-9f73-4970-ad51-e0c6eeaf0d88"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:57.340724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3331020b-f786-49a3-9d64-a62a73294cb7 req-a7a06b33-b26d-4b59-abdf-b2473e5d828f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:57.341223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3331020b-f786-49a3-9d64-a62a73294cb7 req-a7a06b33-b26d-4b59-abdf-b2473e5d828f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:57.341645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3331020b-f786-49a3-9d64-a62a73294cb7 req-a7a06b33-b26d-4b59-abdf-b2473e5d828f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:57.356807 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3331020b-f786-49a3-9d64-a62a73294cb7 req-a7a06b33-b26d-4b59-abdf-b2473e5d828f service nova] Creating event network-vif-deleted:a61e79cd-1906-4295-a654-ea1881270697 for instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 on n-h2-862876-2 Oct 28 13:03:57.357468 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3331020b-f786-49a3-9d64-a62a73294cb7 req-a7a06b33-b26d-4b59-abdf-b2473e5d828f service nova] Creating event network-changed:5bf284c1-9f73-4970-ad51-e0c6eeaf0d88 for instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 on n-h1-862876-2 Oct 28 13:03:57.365969 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3331020b-f786-49a3-9d64-a62a73294cb7 req-a7a06b33-b26d-4b59-abdf-b2473e5d828f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055202 Oct 28 13:03:57.367075 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 277/528] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:57.376502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:57.377602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:57.384416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:57.384901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:57.386028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:57.386727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:57.387371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:57.387801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:57.511801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:57.530320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:57.533260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:57.545878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76550bac-b977-46b3-8247-c5203fed9c9e tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1437 microversion: 2.75 time: 0.177030 Oct 28 13:03:57.549148 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 278/529] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:57 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1437 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:57.570689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52e7f19e-6b69-4bdc-9713-212fd9a760f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:57.572143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52e7f19e-6b69-4bdc-9713-212fd9a760f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:57.654700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52e7f19e-6b69-4bdc-9713-212fd9a760f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:57.664226 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52e7f19e-6b69-4bdc-9713-212fd9a760f9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1220 microversion: 2.1 time: 0.113796 Oct 28 13:03:57.679614 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 279/530] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:57 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:57.679614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:57.679614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:57.687840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:57.687840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:57.688287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:57.693762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:57.694252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:57.696323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:57.767729 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76a64c59-3a48-4ec4-a851-465d45cd9939 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b/action" status: 202 len: 0 microversion: 2.25 time: 7.485292 Oct 28 13:03:57.771443 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 252/531] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:03:50 2022] POST /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b/action => generated 0 bytes in 7489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:03:58.028066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:58.037128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a6dd9b8-32f9-4cec-86cc-a975335a5c5c tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.370975 Oct 28 13:03:58.038308 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 280/532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:57 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:58.044054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:58.044970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:58.051104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.051861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.052686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.053663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.054269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.054789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.407175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:58.410346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:58.417707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.418448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.419106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.420606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.421223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.421842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.467531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:58.477922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:58.477922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:58.478465 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3220440e-340d-4311-85a6-1fee044675bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.438816 Oct 28 13:03:58.479058 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 281/533] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:58 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:58.502532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3d3fc6e2-6fe7-475b-9eed-7e648751bc87 req-c2673698-51a7-41df-ae69-5ca3b854cce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f24c67-2a68-4503-b970-023af509105c", "name": "network-vif-plugged", "status": "completed", "tag": "c1cc3ab6-4dba-4722-ab4c-0acee2b8276e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:58.512023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:03:58.512710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3d3fc6e2-6fe7-475b-9eed-7e648751bc87 req-c2673698-51a7-41df-ae69-5ca3b854cce1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.512863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:03:58.513449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:03:58.513617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3d3fc6e2-6fe7-475b-9eed-7e648751bc87 req-c2673698-51a7-41df-ae69-5ca3b854cce1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.514048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:03:58.514419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3d3fc6e2-6fe7-475b-9eed-7e648751bc87 req-c2673698-51a7-41df-ae69-5ca3b854cce1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.514650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:03:58.526403 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3d3fc6e2-6fe7-475b-9eed-7e648751bc87 req-c2673698-51a7-41df-ae69-5ca3b854cce1 service nova] Creating event network-vif-plugged:c1cc3ab6-4dba-4722-ab4c-0acee2b8276e for instance 50f24c67-2a68-4503-b970-023af509105c on n-h1-862876-2 Oct 28 13:03:58.537494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3d3fc6e2-6fe7-475b-9eed-7e648751bc87 req-c2673698-51a7-41df-ae69-5ca3b854cce1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045577 Oct 28 13:03:58.549472 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 282/534] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:58.620344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9f57dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:58.695613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.695613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.695613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.695613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.696197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.696197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.808895 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea84fecd-14c2-4a1e-aade-341c09b204b0 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81" status: 200 len: 240 microversion: 2.36 time: 0.257780 Oct 28 13:03:58.809462 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 283/535] 10.222.0.25 () {62 vars in 1303 bytes} [Fri Oct 28 13:03:58 2022] PUT /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81 => generated 240 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:58.814664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:58.816026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:58.822090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.822574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.823110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.824313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.824766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.825186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.935260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:58.949852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.955784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.956365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.967157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:58.967157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:58.967157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:58.991109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:58.999435 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7ed98d08-f705-4743-a209-5c15dcddaf11 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1318 microversion: 2.1 time: 0.189006 Oct 28 13:03:59.000091 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 284/536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:58 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:59.004857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:59.005560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:59.011417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.011978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.013232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.014005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.014541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.015064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.075936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:59.080356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:59.083615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9a482ed-4a5e-4beb-8a03-e08c7bc297c5 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1224 microversion: 2.1 time: 0.082472 Oct 28 13:03:59.084199 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 285/537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:59 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:59.088541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Calling method '.version_select at 0x7f27b9fb5160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:59.095891 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e1d1ca6-f483-4512-9569-c18001911153 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec/action" status: 202 len: 1940 microversion: 2.75 time: 1.324199 Oct 28 13:03:59.096808 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 253/538] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:03:57 2022] POST /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec/action => generated 1940 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 13:03:59.107431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:59.108051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:59.114029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.126628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.126628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.126628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.126628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.127247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.152363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.152945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.153468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.154393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.154941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.162123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.173246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fae497b6-b2ce-4674-9699-7390b22b382c tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81/detail" status: 200 len: 672 microversion: 2.36 time: 0.088017 Oct 28 13:03:59.173869 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 286/539] 10.222.0.25 () {60 vars in 1304 bytes} [Fri Oct 28 13:03:59 2022] GET /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81/detail => generated 672 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:03:59.178209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:59.179067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:59.187568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.188143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.188754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.189528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.190062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.190560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.268658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:59.286702 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7572dc22-ea4e-4055-93e6-8dbfdc8ffc10 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.188694 Oct 28 13:03:59.296903 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 254/540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:03:59 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:03:59.316847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:03:59.333072 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-98b40a45-1d4d-4f04-87b7-49dd63fbfc70 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.158102 Oct 28 13:03:59.333616 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 287/541] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:59 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:59.390493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2089fa01-dea8-46c8-b6f3-ea597a508d81 req-ae010e7a-3f0a-4ae5-ac0b-b95b94fe22bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cda74e-b1b2-45c9-b774-721ee27c2187", "tag": "e28a0faa-c9a2-4eb6-8405-1897598332db"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:59.399751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2089fa01-dea8-46c8-b6f3-ea597a508d81 req-ae010e7a-3f0a-4ae5-ac0b-b95b94fe22bc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.400315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2089fa01-dea8-46c8-b6f3-ea597a508d81 req-ae010e7a-3f0a-4ae5-ac0b-b95b94fe22bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.400727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2089fa01-dea8-46c8-b6f3-ea597a508d81 req-ae010e7a-3f0a-4ae5-ac0b-b95b94fe22bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.412447 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2089fa01-dea8-46c8-b6f3-ea597a508d81 req-ae010e7a-3f0a-4ae5-ac0b-b95b94fe22bc service nova] Creating event network-changed:e28a0faa-c9a2-4eb6-8405-1897598332db for instance 26cda74e-b1b2-45c9-b774-721ee27c2187 on n-h2-862876-2 Oct 28 13:03:59.417579 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2089fa01-dea8-46c8-b6f3-ea597a508d81 req-ae010e7a-3f0a-4ae5-ac0b-b95b94fe22bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030586 Oct 28 13:03:59.418484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 255/542] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:59.508165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:03:59.508997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:03:59.518120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.519101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.519880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.520888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.521522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.522127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.524086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9bbc040>, body: {"quota_set": {"ram": "2048"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:59.543680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:59.716778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.717274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.717923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.718864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.719331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.719764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.735812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:03:59.759966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.760614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.761115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.762048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.762513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.763654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.853336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:59.868652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:59.874948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:03:59.880501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28006893-62dd-4a7b-86b9-fe011752c4b8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.378296 Oct 28 13:03:59.881450 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 288/543] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:03:59 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:03:59.927798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-61cf6bb5-a1ed-4252-93dc-e8c1baa6408c req-945624b4-bdb6-4bae-aee7-3202391a8f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33f2331-58e4-4f5a-b517-56192307a84b", "name": "network-vif-unplugged", "status": "completed", "tag": "f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:03:59.941615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-61cf6bb5-a1ed-4252-93dc-e8c1baa6408c req-945624b4-bdb6-4bae-aee7-3202391a8f53 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:03:59.942148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-61cf6bb5-a1ed-4252-93dc-e8c1baa6408c req-945624b4-bdb6-4bae-aee7-3202391a8f53 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:03:59.951265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-61cf6bb5-a1ed-4252-93dc-e8c1baa6408c req-945624b4-bdb6-4bae-aee7-3202391a8f53 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:03:59.955670 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c61b297-e853-42c2-aa3f-59ded44f017e tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81?user_id=921e3371cfb644da97ffb6d3032612c6" status: 200 len: 240 microversion: 2.36 time: 0.436051 Oct 28 13:03:59.960616 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-61cf6bb5-a1ed-4252-93dc-e8c1baa6408c req-945624b4-bdb6-4bae-aee7-3202391a8f53 service nova] Creating event network-vif-unplugged:f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3 for instance f33f2331-58e4-4f5a-b517-56192307a84b on n-h2-862876-2 Oct 28 13:03:59.963887 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 256/544] 10.222.0.25 () {62 vars in 1384 bytes} [Fri Oct 28 13:03:59 2022] PUT /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81?user_id=921e3371cfb644da97ffb6d3032612c6 => generated 240 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:03:59.967954 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-61cf6bb5-a1ed-4252-93dc-e8c1baa6408c req-945624b4-bdb6-4bae-aee7-3202391a8f53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044886 Oct 28 13:03:59.969445 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 289/545] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:03:59.970035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c51e9f1-8d7b-4530-92aa-1a0170140d38 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] Calling method '.version_select at 0x7f27b9d961f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:00.029034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:00.029755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:00.045244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.047177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.047798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.048797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.051618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.052731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.090810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:00.363188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c51e9f1-8d7b-4530-92aa-1a0170140d38 tempest-QuotasAdminTestV236-1539216728 tempest-QuotasAdminTestV236-1539216728-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81?user_id=921e3371cfb644da97ffb6d3032612c6" status: 200 len: 282 microversion: 2.36 time: 0.397660 Oct 28 13:04:00.364487 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 257/546] 10.222.0.25 () {60 vars in 1364 bytes} [Fri Oct 28 13:03:59 2022] GET /compute/v2.1/os-quota-sets/124e681203394ef6891a12fb0f0b0d81?user_id=921e3371cfb644da97ffb6d3032612c6 => generated 282 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:04:00.369880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:00.370975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:00.385790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.386480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.387252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.388150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.388790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.389838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.475047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:00.476836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:00.485150 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5efccbb6-c7cd-4521-8e4e-e74be128843d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1318 microversion: 2.1 time: 0.465453 Oct 28 13:04:00.487084 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e867afa-892d-4679-9417-5af3b3e536b9 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1272 microversion: 2.1 time: 0.120010 Oct 28 13:04:00.487619 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 290/547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:00 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:00.490900 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 258/548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:00 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:00.493528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:00.494151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:00.502522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.503071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.503593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.504264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.505100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.505548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.508490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:00.510132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:00.518213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.518720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.519352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.520183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.520807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.521420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.610578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:00.655908 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-824260a1-6ddd-4f8f-a70c-cae8abe6f43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.163160 Oct 28 13:04:00.671552 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 259/549] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:00 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:00.818628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:00.831464 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e979640-634f-4a44-95c2-20a9bffda83b tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.342731 Oct 28 13:04:00.833315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 291/550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:00 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:00.910339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:00.911358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:00.921336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.922407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.923161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:00.924210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:00.924762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:00.925412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.068864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:01.077093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:01.078530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:01.079700 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-67dedc5a-ab20-49f9-8877-ebb6e067acbf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.175615 Oct 28 13:04:01.080260 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 260/551] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:00 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:01.509754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:01.510497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:01.517438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.518644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.519968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.521279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.521897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.522623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.683596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:01.692874 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-65733878-e675-4e2c-baf4-4f560d58477a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1468 microversion: 2.1 time: 0.187008 Oct 28 13:04:01.693572 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 261/552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:01 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1468 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:01.704811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-273c101c-6081-40fc-9eee-640edba0ea64 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] Calling method '.version_select at 0x7f27b9e168b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:01.717723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:01.718581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:01.725575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.726442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.727346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.728394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.729075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.729776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.737518 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-273c101c-6081-40fc-9eee-640edba0ea64 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.342874 Oct 28 13:04:01.738321 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 292/553] 10.222.0.25 () {60 vars in 1226 bytes} [Fri Oct 28 13:04:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:04:01.750462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:01.751522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:01.763142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.765235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.765863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.766765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.767378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.767956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.828609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:01.836686 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3516c7bd-6c04-4eff-805f-17575cebbca7 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1290 microversion: 2.1 time: 0.141766 Oct 28 13:04:01.837583 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 262/554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:01 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1290 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:01.842692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:01.843365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:01.851373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.851991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.852600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.853485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:01.853979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:01.854616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:01.897311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:01.916919 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0be8dc26-00ac-4a7f-b34c-3adf30cfb729 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.170715 Oct 28 13:04:01.917546 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 293/555] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:01 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:01.940452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b90e1d4d-ee9c-459f-a856-dc912df5dc99 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9f3c280>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:02.084008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:02.092487 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-18d00728-a718-44fc-a1b0-5958b0a0aa31 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1317 microversion: 2.1 time: 0.253887 Oct 28 13:04:02.103477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 263/556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:01 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:02.113913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:02.115247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:02.122154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:02.122878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:02.123465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:02.124738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:02.125195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:02.125616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:02.251033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:02.332293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:02.340984 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ee5be3f4-1edb-46f6-90d7-f2f3817a0d18 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.236187 Oct 28 13:04:02.341643 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 264/557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:02 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:02.573249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c509788-70c8-4554-b299-87b0bf60c79e tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] Action: 'create', calling method: .version_select at 0x7f27b9b20700>, body: {"security_group": {"name": "tempest-securitygroup-2127489155", "description": "tempest-description-69078894"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:02.861994 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b90e1d4d-ee9c-459f-a856-dc912df5dc99 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.942528 Oct 28 13:04:02.862827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 294/558] 10.222.0.25 () {62 vars in 1247 bytes} [Fri Oct 28 13:04:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:04:02.867322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8ed9315b-0d4e-4143-a45f-1183b0fcac50 req-419ccce3-b69f-4960-a696-9284f3415e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33f2331-58e4-4f5a-b517-56192307a84b", "tag": "f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:02.877782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8ed9315b-0d4e-4143-a45f-1183b0fcac50 req-419ccce3-b69f-4960-a696-9284f3415e6c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:02.878292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8ed9315b-0d4e-4143-a45f-1183b0fcac50 req-419ccce3-b69f-4960-a696-9284f3415e6c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:02.878766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8ed9315b-0d4e-4143-a45f-1183b0fcac50 req-419ccce3-b69f-4960-a696-9284f3415e6c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:02.890278 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8ed9315b-0d4e-4143-a45f-1183b0fcac50 req-419ccce3-b69f-4960-a696-9284f3415e6c service nova] Creating event network-changed:f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3 for instance f33f2331-58e4-4f5a-b517-56192307a84b on n-h2-862876-2 Oct 28 13:04:02.895612 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8ed9315b-0d4e-4143-a45f-1183b0fcac50 req-419ccce3-b69f-4960-a696-9284f3415e6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031263 Oct 28 13:04:02.896372 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 295/559] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:02.901779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:02.902407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:02.912258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:02.926255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:02.927813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:02.928707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:02.929916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:02.931183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.169756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:03.180710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:03.187601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:03.187601 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4c51a48-e86c-4b6a-9733-4aca276f5fa4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.286138 Oct 28 13:04:03.187601 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 296/560] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:02 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:03.199315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-87317af6-fd2d-4888-9cab-8871cb26d877 req-7c99cfca-e37d-4215-93cd-1e6ca72a9d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b3df7-aba2-4aa3-b02a-525e788cf294", "name": "network-vif-plugged", "status": "completed", "tag": "5bf284c1-9f73-4970-ad51-e0c6eeaf0d88"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:03.208944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-87317af6-fd2d-4888-9cab-8871cb26d877 req-7c99cfca-e37d-4215-93cd-1e6ca72a9d10 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.209605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-87317af6-fd2d-4888-9cab-8871cb26d877 req-7c99cfca-e37d-4215-93cd-1e6ca72a9d10 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.210168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-87317af6-fd2d-4888-9cab-8871cb26d877 req-7c99cfca-e37d-4215-93cd-1e6ca72a9d10 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.221908 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-87317af6-fd2d-4888-9cab-8871cb26d877 req-7c99cfca-e37d-4215-93cd-1e6ca72a9d10 service nova] Creating event network-vif-plugged:5bf284c1-9f73-4970-ad51-e0c6eeaf0d88 for instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 on n-h1-862876-2 Oct 28 13:04:03.227126 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-87317af6-fd2d-4888-9cab-8871cb26d877 req-7c99cfca-e37d-4215-93cd-1e6ca72a9d10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041036 Oct 28 13:04:03.228043 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 297/561] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:03.233078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:03.233789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:03.239957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.240654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.241243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.241935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.242385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.242823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.504424 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c509788-70c8-4554-b299-87b0bf60c79e tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.161516 Oct 28 13:04:03.505127 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 265/562] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:04:02 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:03.509865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2b989c2-4b0e-47fa-8f1c-68db41de72f9 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] Calling method '.version_select at 0x7f27b9b20af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:03.527866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2b989c2-4b0e-47fa-8f1c-68db41de72f9 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021454 Oct 28 13:04:03.528767 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 266/563] 10.222.0.25 () {60 vars in 1226 bytes} [Fri Oct 28 13:04:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:04:03.540724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:03.541606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:03.550877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.551540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.552069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.552868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.553476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.553998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.629925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:03.647043 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e8785769-5dca-45b9-af4d-973f64dc1a69 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.117117 Oct 28 13:04:03.647626 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 267/564] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:03 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:03.652664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:03.653262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:03.659075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.659569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.659995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.660666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.661119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.661532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.825272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:03.834007 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3719356d-542f-4846-b56f-81a1db633256 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.604598 Oct 28 13:04:03.834602 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 298/565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:03 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:03.842531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:03.845040 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0394031-b4a8-4f2e-94f0-b59d90e9b406 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1317 microversion: 2.1 time: 0.196401 Oct 28 13:04:03.845911 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 268/566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:03 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:03.848915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:03.849825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:03.850918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6b6843b9-2f54-49c6-8229-125553dca49f tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] Action: 'create', calling method: .version_select at 0x7f27b9bc8820>, body: {"security_group": {"name": "tempest-securitygroup-540636505", "description": "tempest-description-586858261"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:03.862182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.862182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.862182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:03.862182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:03.862891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:03.862891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:04.230230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:04.246256 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6b6843b9-2f54-49c6-8229-125553dca49f tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.399232 Oct 28 13:04:04.246887 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 269/567] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:04:03 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:04.258488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d3270f74-0fcb-4b90-940a-910f995dac08 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9b62280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:04.264669 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-732b9dc6-8830-4e52-9b38-d4e14e88faf2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.420637 Oct 28 13:04:04.265317 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 299/568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:03 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:04.274950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:04.275496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:04.282529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:04.283049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:04.283485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:04.284388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:04.284896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:04.285384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:04.508923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:04.511698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:04.513144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:04.514314 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e3a988cf-92a7-439f-bcc0-27bbc4c4a448 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.246663 Oct 28 13:04:04.515133 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 300/569] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:04 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:04.826109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3536a652-936a-4e68-bcd9-456b57b0fd0f tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] Action: 'create', calling method: .version_select at 0x7f27b9d9c5e0>, body: {"security_group": {"name": "tempest-securitygroup-1896775388", "description": "tempest-description-571005153"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:05.196696 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d3270f74-0fcb-4b90-940a-910f995dac08 tempest-QuotaClassesAdmin257Test-1426393897 tempest-QuotaClassesAdmin257Test-1426393897-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.944034 Oct 28 13:04:05.197363 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 270/570] 10.222.0.25 () {62 vars in 1247 bytes} [Fri Oct 28 13:04:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:04:05.204386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-01955d3c-5cfa-4cd0-a940-1d56ebf049be req-a197be1a-ac26-4231-9460-7eec1670dc29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "febb8e78-4b94-45f6-8deb-87f4ce076224", "tag": "4cb1ceb2-87f3-407b-ba06-c650f7abf3f6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:05.215518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-01955d3c-5cfa-4cd0-a940-1d56ebf049be req-a197be1a-ac26-4231-9460-7eec1670dc29 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.216006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-01955d3c-5cfa-4cd0-a940-1d56ebf049be req-a197be1a-ac26-4231-9460-7eec1670dc29 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.216432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-01955d3c-5cfa-4cd0-a940-1d56ebf049be req-a197be1a-ac26-4231-9460-7eec1670dc29 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.228334 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-01955d3c-5cfa-4cd0-a940-1d56ebf049be req-a197be1a-ac26-4231-9460-7eec1670dc29 service nova] Creating event network-changed:4cb1ceb2-87f3-407b-ba06-c650f7abf3f6 for instance febb8e78-4b94-45f6-8deb-87f4ce076224 on n-h2-862876-2 Oct 28 13:04:05.234736 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-01955d3c-5cfa-4cd0-a940-1d56ebf049be req-a197be1a-ac26-4231-9460-7eec1670dc29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035539 Oct 28 13:04:05.235717 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 271/571] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:05.241133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:05.242361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:05.250046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.250977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.252188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.253112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.254137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.254913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.281830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:05.368907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:05.395925 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-426532ca-c552-4ee3-a226-9f5c515b77e9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.158757 Oct 28 13:04:05.397252 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 272/572] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:05 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:05.402129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:05.402917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:05.409065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.409589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.410004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.410696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.411312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.411912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.548255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:05.557870 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f70f1bd0-8b23-4d9e-ba4e-cb79379bc864 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.158749 Oct 28 13:04:05.558872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 273/573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:05 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:05.564201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:05.564814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:05.571360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.572172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.572444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.573266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.573758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.574237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.706612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:05.714253 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5da1806-eb99-431b-ac80-1172c249edd5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1467 microversion: 2.1 time: 0.154245 Oct 28 13:04:05.714838 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 274/574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:05 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1467 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:05.722593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-94a928ed-aee4-4f08-af7e-3a62d7d7585f req-434132e9-ad12-4454-b5e5-0e12870730c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cda74e-b1b2-45c9-b774-721ee27c2187", "name": "network-vif-plugged", "status": "completed", "tag": "e28a0faa-c9a2-4eb6-8405-1897598332db"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:05.727976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-94a928ed-aee4-4f08-af7e-3a62d7d7585f req-434132e9-ad12-4454-b5e5-0e12870730c6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.728449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-94a928ed-aee4-4f08-af7e-3a62d7d7585f req-434132e9-ad12-4454-b5e5-0e12870730c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.728872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-94a928ed-aee4-4f08-af7e-3a62d7d7585f req-434132e9-ad12-4454-b5e5-0e12870730c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.740200 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-94a928ed-aee4-4f08-af7e-3a62d7d7585f req-434132e9-ad12-4454-b5e5-0e12870730c6 service nova] Creating event network-vif-plugged:e28a0faa-c9a2-4eb6-8405-1897598332db for instance 26cda74e-b1b2-45c9-b774-721ee27c2187 on n-h2-862876-2 Oct 28 13:04:05.745543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-94a928ed-aee4-4f08-af7e-3a62d7d7585f req-434132e9-ad12-4454-b5e5-0e12870730c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029070 Oct 28 13:04:05.746167 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 275/575] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:05.751090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:05.752039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:05.757920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.758409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.758870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.759555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.760008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.760493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.870177 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3536a652-936a-4e68-bcd9-456b57b0fd0f tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.343011 Oct 28 13:04:05.871413 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 301/576] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:04:04 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:05.877954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:05.880607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:05.898142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.898646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.899157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.902714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.903313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.903786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.943834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:05.957203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-776c0996-4b91-4cde-be87-3fb9508efa5e tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.208123 Oct 28 13:04:05.959075 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 276/577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:05 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:05.971882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1501626316"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:05.974908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:05.983151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.983791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.984374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:05.985418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:05.986209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:05.986817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:06.103476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:06.112695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:06.115750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:06.116932 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41201cc2-25c9-4a8a-876c-514d2dfa639b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.244334 Oct 28 13:04:06.117494 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 302/578] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:05 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:06.123758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-336aae09-602f-46c3-953d-e0fdd4aa4c7e tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] Action: 'create', calling method: .version_select at 0x7f27b9c805e0>, body: {"security_group": {"name": "tempest-securitygroup-755068035", "description": "tempest-description-737605808"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:06.504032 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8871491f-20c8-41e4-aa30-164a2ce63df7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "POST /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294/action" status: 202 len: 0 microversion: 2.1 time: 0.542309 Oct 28 13:04:06.512014 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 277/579] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:04:05 2022] POST /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:04:06.518676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:06.519566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:06.535002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:06.535002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:06.535002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:06.535506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:06.535965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:06.536429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:06.623124 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-336aae09-602f-46c3-953d-e0fdd4aa4c7e tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.504117 Oct 28 13:04:06.624015 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 303/580] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:04:06 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:06.629257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff75a403-6f68-4927-bf3b-1b25c4e601a4 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9f57ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:06.676235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:06.700307 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff75a403-6f68-4927-bf3b-1b25c4e601a4 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.074803 Oct 28 13:04:06.701047 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 304/581] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:06 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:06.714553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:06.715452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:06.728042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dae31a7a-7e2a-40f0-97d4-276e02ff681a tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.214395 Oct 28 13:04:06.730888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:06.731152 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 278/582] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:06 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:06.737488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:06.738050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:06.738925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:06.739637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:06.740279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:06.749379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c0f3e65-db6c-487d-9a59-648311a0ec66 tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] Calling method '.version_select at 0x7f27b9bc9310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:07.041817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:07.049883 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00120ec2-ca8b-464e-b4d8-8e39771f0b10 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.346209 Oct 28 13:04:07.050452 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 305/583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:06 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:07.060256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:07.060918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:07.066992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:07.067482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:07.067953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:07.068650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:07.069109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:07.069528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:07.242011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:07.254216 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17bdf973-0241-40bf-bd2f-f75728f44ec8 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1389 microversion: 2.1 time: 0.201666 Oct 28 13:04:07.255077 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 306/584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:07 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1389 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:07.260306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:07.261117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:07.268028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:07.269001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:07.269606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:07.270469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:07.271138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:07.271720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:07.532253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:07.553916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:07.557583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:07.559051 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-706938b1-c6dc-43d0-9fc6-864b95f03588 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.302819 Oct 28 13:04:07.580894 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 307/585] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:07 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:07.756268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1509311374", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:07.819181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:04:08.215395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:04:08.219301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:04:08.220232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:04:08.221936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:04:08.225657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:04:08.245881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.247268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.247718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.248649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.249144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.249578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.267926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:08.272910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:08.286283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:04:08.288690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:04:08.366195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c0f3e65-db6c-487d-9a59-648311a0ec66 tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8993 microversion: 2.1 time: 1.633789 Oct 28 13:04:08.370802 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 279/586] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Oct 28 13:04:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8993 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:08.371886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36ae0327-bc3c-4712-9b60-e2b05fabbf43 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9bbc040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:08.419296 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36ae0327-bc3c-4712-9b60-e2b05fabbf43 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.051052 Oct 28 13:04:08.419866 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 280/587] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:08 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:08.424381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:08.424986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:08.431441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.431929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.432936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.433651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.434109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.434534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.450699 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6cd0690-311a-4dcb-80f5-47e8180611ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834764 Oct 28 13:04:08.451549 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 308/588] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:04:08.463391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:08.464220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:08.471040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.471457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.472528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.473504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.474098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.474639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.521880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:08.568721 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9cd57f7d-10b7-4d3b-ac2a-eff8a177ca05 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.147695 Oct 28 13:04:08.571342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 281/589] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:08 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:08.582949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:08.584750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:08.594878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.595639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.596271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.602710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:08.606284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:08.608637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:08.654512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:08.664639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35cf8539-2fd9-4110-9ce5-398bc8a31e7f tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.205743 Oct 28 13:04:08.665216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 309/590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:08 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:08.690090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26870b23-fa30-4c58-8db5-0a7f2bee81a0 tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] Calling method '.version_select at 0x7f27b9ea8dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:08.914366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:08.937852 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3a53b1f-2860-409e-9769-3fcd989792f2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1589 microversion: 2.1 time: 0.359864 Oct 28 13:04:08.937852 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 282/591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:08 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1589 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:08.946427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf037fb8-1289-479e-a636-d7ad56b9b6a0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:08.947086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf037fb8-1289-479e-a636-d7ad56b9b6a0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:09.009996 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26870b23-fa30-4c58-8db5-0a7f2bee81a0 tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.333379 Oct 28 13:04:09.011165 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 310/592] 10.222.0.25 () {58 vars in 1191 bytes} [Fri Oct 28 13:04:08 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:09.031348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:09.031348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:09.031507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf037fb8-1289-479e-a636-d7ad56b9b6a0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:09.032874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=43 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:09.038168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf037fb8-1289-479e-a636-d7ad56b9b6a0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1217 microversion: 2.1 time: 0.098871 Oct 28 13:04:09.038972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 283/593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:08 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:09.040121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.040869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.041451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.043033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.044243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.044768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.059094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:09.059868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:09.067916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.068713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.069320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.070239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.070915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.071491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.205767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:09.214495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:09.220008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:09.237987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47fe49fb-5111-4b50-b13c-3e8ca4f05c01 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.209307 Oct 28 13:04:09.237987 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 311/594] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:09 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:09.241857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c870b679-e864-4fc8-9957-c0be7a3f9d59 tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] Calling method '.version_select at 0x7f27b9c80040>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:09.382939 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2f9a659-2422-4fd8-95a6-bd1b2d5c1236 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.342574 Oct 28 13:04:09.384066 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 284/595] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:04:09 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187/os-interface => generated 285 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:09.435353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37543c83-f0f8-4fc0-8bda-ecd03ee81ae7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9b609d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:09.484716 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37543c83-f0f8-4fc0-8bda-ecd03ee81ae7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.053681 Oct 28 13:04:09.486099 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 285/596] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:09 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:09.501916 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c870b679-e864-4fc8-9957-c0be7a3f9d59 tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/1ba53cd1-12be-471d-85b9-e01953ce8ddd" status: 202 len: 0 microversion: 2.1 time: 0.272051 Oct 28 13:04:09.501916 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 312/597] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:04:09 2022] DELETE /compute/v2.1/os-security-groups/1ba53cd1-12be-471d-85b9-e01953ce8ddd => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:04:09.509763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b020c25-6036-49b2-9d95-a6cf8d41f4d6 tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] Calling method '.version_select at 0x7f27b9b20670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:09.605032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:09.605681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:09.612130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.613379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.613834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.614536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.618099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.619073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.712892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:09.731904 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-870c16c9-0214-4b43-8fcd-add99dd9e99d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.132126 Oct 28 13:04:09.732576 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 313/598] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:09 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:09.754964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:09.755666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:09.766238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.766951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.767438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.768273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:09.769695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:09.770156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:09.970529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:09.984207 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b31b228e-79c7-4df8-9284-9f2a21ff4ff3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.250321 Oct 28 13:04:09.995140 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 314/599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:09 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:10.067216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:10.067839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:10.083758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:10.085506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:10.086605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:10.091244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:10.093512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:10.094263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:10.119062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:10.192578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:10.201360 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c4c83f6e-6b5d-4627-9dcd-a04c82e31113 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1221 microversion: 2.1 time: 0.138401 Oct 28 13:04:10.202280 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 315/600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:10 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:10.224031 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b020c25-6036-49b2-9d95-a6cf8d41f4d6 tempest-SecurityGroupsTestAdminJSON-1558847172 tempest-SecurityGroupsTestAdminJSON-1558847172-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/80b123f6-8052-465f-a717-9b878877a89b" status: 202 len: 0 microversion: 2.1 time: 0.718337 Oct 28 13:04:10.224031 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 286/601] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:04:09 2022] DELETE /compute/v2.1/os-security-groups/80b123f6-8052-465f-a717-9b878877a89b => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:04:10.230680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59ec0747-5910-4791-aa1e-a515d5348491 tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] Calling method '.version_select at 0x7f27b9f57ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:10.251283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:10.252213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:10.265830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:10.268455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:10.270038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:10.271641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:10.272465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:10.273381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:10.582711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=5 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:10.670220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:10.684609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:10.687250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:10.692769 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b158d01e-3325-480f-a9e0-4a2bc8f2edb0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1569 microversion: 2.25 time: 0.445783 Oct 28 13:04:10.693934 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 287/602] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:10 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1569 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:10.699010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e183420-3e44-483f-97a5-9c662581270e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9bbc5e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:10.788835 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e183420-3e44-483f-97a5-9c662581270e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.093400 Oct 28 13:04:10.801050 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 288/603] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:10 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:10.806422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:10.812080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:10.814254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=7 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:10.820245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:10.820828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:10.821305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:10.822138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:10.822591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:10.824327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:10.983927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:11.029139 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59ec0747-5910-4791-aa1e-a515d5348491 tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ed07f639-0cb6-44e3-a9bd-353801c0917f" status: 202 len: 0 microversion: 2.1 time: 0.802798 Oct 28 13:04:11.029924 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 316/604] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:04:10 2022] DELETE /compute/v2.1/os-security-groups/ed07f639-0cb6-44e3-a9bd-353801c0917f => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:04:11.035789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:11.036729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:11.063776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.063776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.063776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:11.063776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.065425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.065425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:11.067706 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f34353a0-8b7c-4b2b-854e-c21bc0e7cda9 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.264741 Oct 28 13:04:11.078774 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 289/605] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:10 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:11.078774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d6404a10-7608-47d8-8d92-de4248c5473c tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] Calling method '.version_select at 0x7f27b9af8ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:11.287592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:11.296511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49e31a0c-8c4d-4cf3-b3fb-c9a6cf623a2d tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.265326 Oct 28 13:04:11.299250 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 317/606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:11 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:11.318529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:11.319488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:11.326422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.327148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.327816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:11.328796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.329260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.329685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:11.480874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:11.491846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8757d1b0-8ae9-4426-9669-3f23279956a7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1269 microversion: 2.1 time: 0.189945 Oct 28 13:04:11.506994 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 318/607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:11 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:11.728980 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-435ddd76-2643-4414-b310-ba02c22839a0 tempest-TenantUsagesNegativeTestJSON-2080844947 tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T13%3A04%3A11.309251&end=2022-10-29T13%3A04%3A11.309251" status: 404 len: 112 microversion: - time: 0.181055 Oct 28 13:04:11.728980 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 319/608] 10.222.0.25 () {58 vars in 1316 bytes} [Fri Oct 28 13:04:11 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T13%3A04%3A11.309251&end=2022-10-29T13%3A04%3A11.309251 => generated 112 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 13:04:11.735677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:11.736510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:11.750318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.750807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.751312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:11.753726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.753726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.753726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:11.921171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:11.929717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:11.932426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:11.934185 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf899c25-1602-4954-9591-e026ab01b222 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1559 microversion: 2.25 time: 0.219161 Oct 28 13:04:11.935274 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 320/609] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:11 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:11.941304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-597ae553-011c-4c95-b9c9-20d99c357c43 tempest-TenantUsagesNegativeTestJSON-2080844947 tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin] Calling method '.version_select at 0x7f27b9fb5310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:11.946087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-597ae553-011c-4c95-b9c9-20d99c357c43 tempest-TenantUsagesNegativeTestJSON-2080844947 tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-597ae553-011c-4c95-b9c9-20d99c357c43 tempest-TenantUsagesNegativeTestJSON-2080844947 tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin] Request method failure captured: Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-simple-tenant-usage/00493589dcf04d11b6c4b7bd305aa18e?start=2022-10-29T13%3A04%3A11.309251&end=2022-10-27T13%3A04%3A11.309251 HTTP/1.1 Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9NLQWXANMpsHkyfBnTv-H__FU3-I2_OF_Kt5dWbi7xMKNGa1ZO3JpfNNhMXXSnMR2vgqyA1lQJXnJ9z-Nuy-pygHOBBadDeyz3U4tlnDpU2DJn5ezhVkKSrQYgEQ45a9ownme6t-s0SoKnM_Z6LexUm8Dv-5u0n1VhHuNUfKI0LW8s Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0567cf4bdeba4ad6a65fea7b7ca96db4 Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2080844947 Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:04:11.948422 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0567cf4bdeba4ad6a65fea7b7ca96db4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0567cf4bdeba4ad6a65fea7b7ca96db4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0567cf4bdeba4ad6a65fea7b7ca96db4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0567cf4bdeba4ad6a65fea7b7ca96db4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2080844947 Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0567cf4bdeba4ad6a65fea7b7ca96db4 Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2080844947 Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d93aafcfa0d8417d8e8f433d37e89b70 Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid start time. The start time cannot occur after the end time. Oct 28 13:04:11.949840 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '00493589dcf04d11b6c4b7bd305aa18e'} Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 13:04:11.950620 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-597ae553-011c-4c95-b9c9-20d99c357c43 tempest-TenantUsagesNegativeTestJSON-2080844947 tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:11.951869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-597ae553-011c-4c95-b9c9-20d99c357c43 tempest-TenantUsagesNegativeTestJSON-2080844947 tempest-TenantUsagesNegativeTestJSON-2080844947-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/00493589dcf04d11b6c4b7bd305aa18e?start=2022-10-29T13%3A04%3A11.309251&end=2022-10-27T13%3A04%3A11.309251" status: 400 len: 111 microversion: 2.1 time: 0.013568 Oct 28 13:04:11.954165 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 321/610] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Oct 28 13:04:11 2022] GET /compute/v2.1/os-simple-tenant-usage/00493589dcf04d11b6c4b7bd305aa18e?start=2022-10-29T13%3A04%3A11.309251&end=2022-10-27T13%3A04%3A11.309251 => generated 111 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:04:11.957769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:11.959024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:11.969053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.969286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.969699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:11.970428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:11.971038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:11.971531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.149145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:12.159051 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-127766da-ced0-45b6-901e-ef4dc6193039 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1589 microversion: 2.1 time: 0.207065 Oct 28 13:04:12.160182 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 322/611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:11 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1589 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:12.180094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c04f0523-a637-475e-a005-9e3625777948 req-fbee1348-5107-4ca1-a3d0-8118a5addb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cda74e-b1b2-45c9-b774-721ee27c2187", "tag": "e28a0faa-c9a2-4eb6-8405-1897598332db"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:12.194511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c04f0523-a637-475e-a005-9e3625777948 req-fbee1348-5107-4ca1-a3d0-8118a5addb01 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:12.195427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c04f0523-a637-475e-a005-9e3625777948 req-fbee1348-5107-4ca1-a3d0-8118a5addb01 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:12.196098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c04f0523-a637-475e-a005-9e3625777948 req-fbee1348-5107-4ca1-a3d0-8118a5addb01 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.209252 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d6404a10-7608-47d8-8d92-de4248c5473c tempest-SecurityGroupsTestAdminJSON-838040384 tempest-SecurityGroupsTestAdminJSON-838040384-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f9614340-b1f9-41cd-897a-f1519cbd974d" status: 202 len: 0 microversion: 2.1 time: 1.139365 Oct 28 13:04:12.210543 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 290/612] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:04:11 2022] DELETE /compute/v2.1/os-security-groups/f9614340-b1f9-41cd-897a-f1519cbd974d => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:04:12.217627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d80d39d2-6e53-46d9-b623-eb69ce1ca68e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9bc91f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:12.238181 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c04f0523-a637-475e-a005-9e3625777948 req-fbee1348-5107-4ca1-a3d0-8118a5addb01 service nova] Creating event network-changed:e28a0faa-c9a2-4eb6-8405-1897598332db for instance 26cda74e-b1b2-45c9-b774-721ee27c2187 on n-h2-862876-2 Oct 28 13:04:12.255170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c04f0523-a637-475e-a005-9e3625777948 req-fbee1348-5107-4ca1-a3d0-8118a5addb01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092877 Oct 28 13:04:12.257855 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 323/613] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:12.282640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6b8f647-150c-4a32-bd04-cd8ffbe12aec tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '.version_select at 0x7f27b9d0e670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:12.298392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b8f647-150c-4a32-bd04-cd8ffbe12aec tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:12.311112 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d80d39d2-6e53-46d9-b623-eb69ce1ca68e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.098694 Oct 28 13:04:12.311594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b8f647-150c-4a32-bd04-cd8ffbe12aec tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:12.312288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b8f647-150c-4a32-bd04-cd8ffbe12aec tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.324167 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 291/614] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:12 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:12.418487 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6b8f647-150c-4a32-bd04-cd8ffbe12aec tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.158295 Oct 28 13:04:12.430079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 324/615] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Oct 28 13:04:12 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:04:12.433617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:12.433617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:12.449036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:12.451774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:12.455025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.457851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:12.458001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:12.460658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.684064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:12.732510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ccf506cc-7d1c-4c7c-9b08-6678c4f17317 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.302455 Oct 28 13:04:12.733408 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 325/616] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:12 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:12.738651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:12.739307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:12.754419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:12.756271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:12.757149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.766781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:12.767645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:12.779068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50cff626-6be0-4d58-a925-4f14b3a1de77 tempest-TenantUsagesNegativeTestJSON-1930077732 tempest-TenantUsagesNegativeTestJSON-1930077732-project] Calling method '.version_select at 0x7f27b9bc9310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:12.799779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.833852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50cff626-6be0-4d58-a925-4f14b3a1de77 tempest-TenantUsagesNegativeTestJSON-1930077732 tempest-TenantUsagesNegativeTestJSON-1930077732-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b50235f8225e48ecb0ef0c3d943be771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00493589dcf04d11b6c4b7bd305aa18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50cff626-6be0-4d58-a925-4f14b3a1de77 tempest-TenantUsagesNegativeTestJSON-1930077732 tempest-TenantUsagesNegativeTestJSON-1930077732-project] Request method failure captured: Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T13%3A04%3A11.309251&end=2022-10-29T13%3A04%3A11.309251&detailed=1 HTTP/1.1 Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NJPrb46IAXQtgToBn0WcN18Y3UrsT_-c0rzQXFnXrqopfH8OaFKoFbqMk3c9ReZ6GuNvp_dR1mY2_fs7RRR_m6LIF9QFLqfMTV0zVrjxVKuV_7bKXeh2JmBzGhUXM-KPBtv0ASBMexa-v9idRXIPXgKYvCtNoNYaceXl2nkaEiWbU Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 00493589dcf04d11b6c4b7bd305aa18e Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1930077732 Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:12.843739 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00493589dcf04d11b6c4b7bd305aa18e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/00493589dcf04d11b6c4b7bd305aa18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_00493589dcf04d11b6c4b7bd305aa18e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/00493589dcf04d11b6c4b7bd305aa18e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1930077732 Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 00493589dcf04d11b6c4b7bd305aa18e Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1930077732 Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TenantUsagesNegativeTestJSON-1930077732-project Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: b50235f8225e48ecb0ef0c3d943be771 Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1930077732-project Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:04:12.845110 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:04:12.845939 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:04:12.847206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:04:12.848348 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 13:04:12.848348 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:12.852782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50cff626-6be0-4d58-a925-4f14b3a1de77 tempest-TenantUsagesNegativeTestJSON-1930077732 tempest-TenantUsagesNegativeTestJSON-1930077732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:12.861076 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50cff626-6be0-4d58-a925-4f14b3a1de77 tempest-TenantUsagesNegativeTestJSON-1930077732 tempest-TenantUsagesNegativeTestJSON-1930077732-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T13%3A04%3A11.309251&end=2022-10-29T13%3A04%3A11.309251&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.516359 Oct 28 13:04:12.868243 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 292/617] 10.222.0.25 () {58 vars in 1335 bytes} [Fri Oct 28 13:04:12 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T13%3A04%3A11.309251&end=2022-10-29T13%3A04%3A11.309251&detailed=1 => generated 123 bytes in 543 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:12.929353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ed2a9547-c29a-41bb-a738-6ac1dcc460d0 req-a49a3e06-006e-48ca-9586-21b886e38835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b3df7-aba2-4aa3-b02a-525e788cf294", "name": "network-vif-plugged", "status": "completed", "tag": "5bf284c1-9f73-4970-ad51-e0c6eeaf0d88"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:12.944390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ed2a9547-c29a-41bb-a738-6ac1dcc460d0 req-a49a3e06-006e-48ca-9586-21b886e38835 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:12.945320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ed2a9547-c29a-41bb-a738-6ac1dcc460d0 req-a49a3e06-006e-48ca-9586-21b886e38835 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:12.946129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ed2a9547-c29a-41bb-a738-6ac1dcc460d0 req-a49a3e06-006e-48ca-9586-21b886e38835 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:12.962456 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ed2a9547-c29a-41bb-a738-6ac1dcc460d0 req-a49a3e06-006e-48ca-9586-21b886e38835 service nova] Creating event network-vif-plugged:5bf284c1-9f73-4970-ad51-e0c6eeaf0d88 for instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 on n-h1-862876-2 Oct 28 13:04:12.970375 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ed2a9547-c29a-41bb-a738-6ac1dcc460d0 req-a49a3e06-006e-48ca-9586-21b886e38835 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094232 Oct 28 13:04:12.971367 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 293/618] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:12.983227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:12.984506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:12.993625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:13.002277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:13.003867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:13.004808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:13.005428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:13.006433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:13.159256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:13.171786 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bcedbe5-ea62-41e3-8085-023953142758 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.437404 Oct 28 13:04:13.175411 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 326/619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:12 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:13.192964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:13.195233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:13.202950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:13.203714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:13.204315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:13.205234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:13.205994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:13.206570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:13.494440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid f33f2331-58e4-4f5a-b517-56192307a84b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:13.505688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:13.519216 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f21d660-0ebe-4903-9846-2bb0f6cefb18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1287 microversion: 2.1 time: 0.341844 Oct 28 13:04:13.521843 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2009d8e-5794-4012-a1b8-080a3ecb2909 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 2052 microversion: 2.25 time: 0.544889 Oct 28 13:04:13.522879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 294/620] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:12 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 2052 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:13.535655 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 327/621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:13 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1287 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:13.540205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e8c5820-ead9-4261-ab2f-efb14ff4f716 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c364c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:13.639866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e8c5820-ead9-4261-ab2f-efb14ff4f716 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.115723 Oct 28 13:04:13.645473 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 295/622] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:13 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:13.769983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:13.770730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:13.783777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:13.785774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:13.787046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:13.790331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:13.790850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:13.792345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:13.910664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-406157657", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "1217f953-ad0c-48ca-a39a-bfdf8506b13b"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:14.055317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] validate_networks() for [('1217f953-ad0c-48ca-a39a-bfdf8506b13b', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:04:14.055476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:14.099701 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75ad1c69-6782-4cbd-bdd6-af4d7cb0e03d tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.333278 Oct 28 13:04:14.102663 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 328/623] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:13 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:14.196583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:14.197195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:14.209739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:14.210975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:14.211809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:14.212705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:14.213374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:14.217857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:14.427956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:14.444434 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-198e24f6-0925-4e57-a627-0f91363fddaf tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.252282 Oct 28 13:04:14.445629 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 329/624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:14 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:14.548313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:14.548947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:14.556196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:14.559933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:14.560531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:14.561280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:14.562724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:14.562724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:14.645904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:14.656609 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-842d8651-f5c7-41d0-9697-c17ace4e9dbb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1275 microversion: 2.1 time: 0.113729 Oct 28 13:04:14.657193 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 330/625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:14 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:14.670410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-169b06d7-967a-4b74-810d-7cce173e04eb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9dc8ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:14.727114 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-169b06d7-967a-4b74-810d-7cce173e04eb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.068803 Oct 28 13:04:14.735393 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 331/626] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:14 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:14.993853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-522e669c-11ea-4f97-9026-a158285700c0 req-810b4774-c772-48e6-867c-6851f8b14838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "febb8e78-4b94-45f6-8deb-87f4ce076224", "name": "network-vif-plugged", "status": "completed", "tag": "4cb1ceb2-87f3-407b-ba06-c650f7abf3f6"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:15.004826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-522e669c-11ea-4f97-9026-a158285700c0 req-810b4774-c772-48e6-867c-6851f8b14838 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.005597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-522e669c-11ea-4f97-9026-a158285700c0 req-810b4774-c772-48e6-867c-6851f8b14838 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.006183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-522e669c-11ea-4f97-9026-a158285700c0 req-810b4774-c772-48e6-867c-6851f8b14838 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.019605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-522e669c-11ea-4f97-9026-a158285700c0 req-810b4774-c772-48e6-867c-6851f8b14838 service nova] Creating event network-vif-plugged:4cb1ceb2-87f3-407b-ba06-c650f7abf3f6 for instance febb8e78-4b94-45f6-8deb-87f4ce076224 on n-h2-862876-2 Oct 28 13:04:15.026301 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-522e669c-11ea-4f97-9026-a158285700c0 req-810b4774-c772-48e6-867c-6851f8b14838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040381 Oct 28 13:04:15.028260 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 332/627] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:15.147043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:15.148109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:15.153894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:INSERT=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:15.159533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.169616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.175761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.175761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.175761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.175761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.187762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:04:15.188914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:04:15.189487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:04:15.191025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:04:15.191608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:04:15.214019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.217114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.218625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.220056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.220881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.222996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.298831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:15.328259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:15.334449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for user 17a50d2f7a154acbbf6bc218efb8b67d and project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:15.347721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a956413-452b-4f74-a6bc-e5d58975fd02 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.208419 Oct 28 13:04:15.351996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 333/628] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:15 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:15.360689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:04:15.363583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:04:15.476972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:15.476972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:15.484187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.484959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.488150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.489318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.490005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.490642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.541959 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25a134a5-d157-4c22-9d78-1ad888829d68 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.635435 Oct 28 13:04:15.545587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 296/629] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:04:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:04:15.564058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b1feb28-1b4e-4a20-a52d-40bb089d0c60 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:15.568841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b1feb28-1b4e-4a20-a52d-40bb089d0c60 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:15.744756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b1feb28-1b4e-4a20-a52d-40bb089d0c60 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:15.757223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b1feb28-1b4e-4a20-a52d-40bb089d0c60 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:15.766812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b1feb28-1b4e-4a20-a52d-40bb089d0c60 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:15.775042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b1feb28-1b4e-4a20-a52d-40bb089d0c60 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1261 microversion: 2.25 time: 0.219422 Oct 28 13:04:15.778665 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 297/630] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:15 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:15.797909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:15.797909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:15.825508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.827822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.831846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.834291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:15.835601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:15.836631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:15.863706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:15.883704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5bc11c6d-42fb-4e50-85a3-b69281636ea0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1320 microversion: 2.1 time: 0.417482 Oct 28 13:04:15.884482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 334/631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:15 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1320 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:15.899932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d90cb8ab-4cbb-48c3-b53d-2379fc37b658 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c6ca60>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:15.983588 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d90cb8ab-4cbb-48c3-b53d-2379fc37b658 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.097630 Oct 28 13:04:15.994288 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 335/632] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:15 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:16.144801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:16.153041 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd79d41e-2848-485f-94fd-84e13a7f29d9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.372996 Oct 28 13:04:16.153627 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 298/633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:15 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:16.383893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:16.384583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:16.391314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:16.395265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:16.397379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:16.405393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:16.405393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:16.405393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:16.534008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:16.565344 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c5ee5e9-9f17-42b2-b21d-d513b3165696 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.179819 Oct 28 13:04:16.565344 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 336/634] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:16 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:16.810459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1fe808cd-a737-4a63-95ce-0a7c485dafa1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:16.811924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1fe808cd-a737-4a63-95ce-0a7c485dafa1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:16.906405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1fe808cd-a737-4a63-95ce-0a7c485dafa1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:16.907429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:16.908041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:16.913656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:16.914131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:16.914582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1fe808cd-a737-4a63-95ce-0a7c485dafa1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:16.914738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:16.917351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1fe808cd-a737-4a63-95ce-0a7c485dafa1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:16.917700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:16.918163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:16.918560 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1fe808cd-a737-4a63-95ce-0a7c485dafa1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1261 microversion: 2.25 time: 0.112884 Oct 28 13:04:16.918669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:16.919348 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 299/635] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:16 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:17.002967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c13d1a05-1089-40f0-a902-8c66f8f73ceb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a924c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:17.051151 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c13d1a05-1089-40f0-a902-8c66f8f73ceb tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.055239 Oct 28 13:04:17.051762 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 300/636] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:16 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:17.061077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:17.069632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:17.069632 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-287109f8-563f-4f06-8eb6-96d8666b16c8 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1469 microversion: 2.1 time: 0.166168 Oct 28 13:04:17.070005 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 337/637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:16 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:17.113536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:17.115799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:17.121897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.122387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.122851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.123541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.123999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.124423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.142998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:17.177946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:17.178580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:17.184834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.185316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.185747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.186426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.186908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.187346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.399933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:17.410119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4d6fa4c1-638e-4803-9740-8ba93ce57fa8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.235881 Oct 28 13:04:17.423323 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 338/638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:17 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:17.432558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6ffd9765-610d-41e5-9651-d344db16bd8f req-7ee16406-03c0-49a8-abc4-69297b744821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9de8fb-d31e-4f62-b8cb-cafb20df5769", "tag": "a98862dc-d21d-470a-88e8-e37c85cda8ca"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:17.443754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ffd9765-610d-41e5-9651-d344db16bd8f req-7ee16406-03c0-49a8-abc4-69297b744821 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.444408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ffd9765-610d-41e5-9651-d344db16bd8f req-7ee16406-03c0-49a8-abc4-69297b744821 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.445007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ffd9765-610d-41e5-9651-d344db16bd8f req-7ee16406-03c0-49a8-abc4-69297b744821 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.460203 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6ffd9765-610d-41e5-9651-d344db16bd8f req-7ee16406-03c0-49a8-abc4-69297b744821 service nova] Creating event network-changed:a98862dc-d21d-470a-88e8-e37c85cda8ca for instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 on n-h1-862876-2 Oct 28 13:04:17.467457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6ffd9765-610d-41e5-9651-d344db16bd8f req-7ee16406-03c0-49a8-abc4-69297b744821 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042329 Oct 28 13:04:17.468773 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 339/639] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:17.526397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e393ee1-c776-45cf-989d-d0ca9bd8e9d9 tempest-DeleteServersAdminTestJSON-668000923 tempest-DeleteServersAdminTestJSON-668000923-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224/action" status: 202 len: 0 microversion: 2.1 time: 0.416001 Oct 28 13:04:17.527418 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 301/640] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:04:17 2022] POST /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:04:17.536404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:17.537343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:17.548066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.548971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.549731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.553290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.556224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.556687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.593967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:17.597089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:17.607061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.607912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.609102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.610660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.611973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.612581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.661354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.661354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.661630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.662023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lazy-loading 'fault' on Instance uuid febb8e78-4b94-45f6-8deb-87f4ce076224 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:17.757304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:17.792586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:17.807020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8f5250e-7806-4ef8-b224-d12576a79fd2 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1452 microversion: 2.1 time: 0.272394 Oct 28 13:04:17.807020 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 340/641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:17 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1452 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:17.833115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:17.834203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a64fd1b4-0191-4549-9cfa-45f862a21dfd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.245275 Oct 28 13:04:17.834774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:17.844748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.845149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.845823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.847078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.847163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.847552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.857110 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 302/642] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:17 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:17.887366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:04:17.952562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:17.953476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:17.963020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.965721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.976497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:17.983906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:17.984635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:17.985178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.175767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:18.194338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:18.196497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:18.198687 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c564640-b7cb-47f2-893f-fce76d496fb8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1257 microversion: 2.25 time: 0.250859 Oct 28 13:04:18.207758 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 303/643] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:17 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1257 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:18.214992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-92997951-ab06-453b-9ed4-40216d80c4ec tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a7b0d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:18.260922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:18.280529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=49,nova_cell0:UPDATE=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:18.289287 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-92997951-ab06-453b-9ed4-40216d80c4ec tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.079420 Oct 28 13:04:18.289972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 304/644] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:18 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:18.391676 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-55151a2f-261d-4a0d-a465-14e6ffaf4c6a tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 204 len: 0 microversion: 2.1 time: 0.562921 Oct 28 13:04:18.392314 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 341/645] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:04:17 2022] DELETE /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:04:18.402171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:18.403141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:18.410228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:18.411063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:18.411684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.412562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:18.413174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:18.413752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.456851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:18.456851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:18.456851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.456851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lazy-loading 'fault' on Instance uuid febb8e78-4b94-45f6-8deb-87f4ce076224 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:18.473546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c0c0845-1e63-40c1-9412-68e5dc8ada8f tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:18.485888 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c0c0845-1e63-40c1-9412-68e5dc8ada8f tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.194105 Oct 28 13:04:18.501221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 305/646] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:04:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:18.519416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:18.520053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:18.555283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:18.555916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:18.556765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.557937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:18.558231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:18.558662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.662260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:18.672998 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-afb2dad2-d5c6-45aa-b82f-0fac4ec43f39 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1458 microversion: 2.1 time: 0.275828 Oct 28 13:04:18.674821 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 342/647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:18 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1458 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:18.722538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:18.733324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c26366db-1e29-47db-8006-bee1164aae1c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.229280 Oct 28 13:04:18.733972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 306/648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:18 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:18.871697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:18.873057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:18.881743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:18.882526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:18.884682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.884682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:18.885902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:18.886569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:18.989333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:19.014566 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ac26f681-c6b3-40c4-bd4b-db68f28eccd7 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.149273 Oct 28 13:04:19.015560 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 343/649] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:18 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:19.236490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:19.236490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:19.245065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:19.245725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:19.246508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:19.247506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:19.248256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:19.248831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:19.308767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53e3be8a-2269-446b-acee-0538138d04be tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9d0ec10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:19.345451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:19.355721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:19.357284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:19.358448 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-65aade4c-207d-40e3-87f6-e8a82f7ee299 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1313 microversion: 2.25 time: 0.135750 Oct 28 13:04:19.359893 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 307/650] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:19 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:19.699283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:19.700777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:19.712927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:19.714043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:19.714693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:19.715916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:19.716584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:19.717226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:19.784457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:19.786248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:19.795922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:19.795922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lazy-loading 'fault' on Instance uuid febb8e78-4b94-45f6-8deb-87f4ce076224 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:19.882818 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-53e3be8a-2269-446b-acee-0538138d04be tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.580557 Oct 28 13:04:19.883854 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 344/651] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:19 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:19.888898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:19.889810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:19.897359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:19.898458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:19.899196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:19.900167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:19.901650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:19.902289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:20.065271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:20.079069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0ded09fe-479e-41c9-a58d-4d756ee5eeb0 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1458 microversion: 2.1 time: 0.383838 Oct 28 13:04:20.079869 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 308/652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:19 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1458 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:20.088178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a1c615d-12e8-43fa-8b28-d368397b8e7e tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-60290847", "imageRef": "cde01fcc-f2a1-476a-9ada-1bf1a8670ed9", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:20.211440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-9a1c615d-12e8-43fa-8b28-d368397b8e7e tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:04:20.304470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:20.312863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11aee363-d7d4-402f-a2dd-f8c7f5ae8af2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.427701 Oct 28 13:04:20.321722 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 345/653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:19 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:20.327192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:20.331326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:20.347255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:20.350222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:20.350222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:20.350222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:20.350222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:20.351080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:20.540233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:20.549629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-9a1c615d-12e8-43fa-8b28-d368397b8e7e tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a1c615d-12e8-43fa-8b28-d368397b8e7e tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] Request method failure captured: Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 141 Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NSKmFB0r0izJMFipl32v026RR6xfmrS5DQ9_8y_cOJgPB9d8bqFLVxzEv5lu8Epjgs9p9v-pcCEs0jOTU4LzGgqd0BHd3nsj2bglWIpe6jPX9uKl7U0hSJ0bgznC_WvIHzsPhx0KPrm45hOns8CVgoxu259a5OPtloOE65f62dkqg Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a078bf08dc1f4f118c60072573085730 Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FlavorsV2NegativeTest-683944393 Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:20.551732 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078bf08dc1f4f118c60072573085730"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078bf08dc1f4f118c60072573085730"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a078bf08dc1f4f118c60072573085730", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a078bf08dc1f4f118c60072573085730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FlavorsV2NegativeTest-683944393 Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a078bf08dc1f4f118c60072573085730 Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-683944393 Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FlavorsV2NegativeTest-683944393-project Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 9f09a9cb2ea7438bbfd8ee819cc00d43 Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FlavorsV2NegativeTest-683944393-project Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-60290847", "imageRef": "cde01fcc-f2a1-476a-9ada-1bf1a8670ed9", "flavorRef": "452"}} Oct 28 13:04:20.553310 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor's memory is too small for requested image. Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-60290847', 'imageRef': 'cde01fcc-f2a1-476a-9ada-1bf1a8670ed9', 'flavorRef': '452'}}} Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:20.554215 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:20.555786 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:20.558324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:20.558324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:20.558324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:20.558324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:20.558324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 28 13:04:20.558324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:20.558324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a1c615d-12e8-43fa-8b28-d368397b8e7e tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:20.559138 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a1c615d-12e8-43fa-8b28-d368397b8e7e tempest-FlavorsV2NegativeTest-683944393 tempest-FlavorsV2NegativeTest-683944393-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.475809 Oct 28 13:04:20.560257 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 309/654] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:04:20 2022] POST /compute/v2.1/servers => generated 93 bytes in 478 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:04:20.567765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:20.568610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:20.572504 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8086d11-a9aa-47d1-a61e-ec9bdcf13eac tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.248822 Oct 28 13:04:20.573353 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 346/655] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:20 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:20.612133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:20.612639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:20.613077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:20.613788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:20.614238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:20.614657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:20.689085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:20.700392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:20.702087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:20.703680 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9727e73e-e7e1-4ef9-8007-bf0f4b016531 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1331 microversion: 2.25 time: 0.142023 Oct 28 13:04:20.704902 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 310/656] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:20 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:20.901274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a9ffd29-a43b-451d-b13d-cc39cd219243 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9cad790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:21.107858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:21.109327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:21.120388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.126041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.126420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.127426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.127882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.128339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.200471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.200978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.201418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.203297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lazy-loading 'fault' on Instance uuid febb8e78-4b94-45f6-8deb-87f4ce076224 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:21.475949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:21.517619 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8c85143-ff59-42ac-8c26-a706154838c3 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1416 microversion: 2.1 time: 0.410958 Oct 28 13:04:21.523170 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 311/657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:21 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1416 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:21.558253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-307f73e4-9bde-4903-8e63-ae00e43e334c req-be2f68f4-f1cd-4fd0-ad58-7ff3aca920d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "febb8e78-4b94-45f6-8deb-87f4ce076224", "name": "network-vif-deleted", "tag": "4cb1ceb2-87f3-407b-ba06-c650f7abf3f6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:21.583297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-307f73e4-9bde-4903-8e63-ae00e43e334c req-be2f68f4-f1cd-4fd0-ad58-7ff3aca920d6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.584028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-307f73e4-9bde-4903-8e63-ae00e43e334c req-be2f68f4-f1cd-4fd0-ad58-7ff3aca920d6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.584635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-307f73e4-9bde-4903-8e63-ae00e43e334c req-be2f68f4-f1cd-4fd0-ad58-7ff3aca920d6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.603668 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-307f73e4-9bde-4903-8e63-ae00e43e334c req-be2f68f4-f1cd-4fd0-ad58-7ff3aca920d6 service nova] Creating event network-vif-deleted:4cb1ceb2-87f3-407b-ba06-c650f7abf3f6 for instance febb8e78-4b94-45f6-8deb-87f4ce076224 on n-h2-862876-2 Oct 28 13:04:21.626373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-307f73e4-9bde-4903-8e63-ae00e43e334c req-be2f68f4-f1cd-4fd0-ad58-7ff3aca920d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101347 Oct 28 13:04:21.627731 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 312/658] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:21.631380 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a9ffd29-a43b-451d-b13d-cc39cd219243 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.736050 Oct 28 13:04:21.639388 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 347/659] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:20 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:21.639637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:21.639637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:21.652608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:21.655980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:21.661107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.661714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.662164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.663137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.664649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.665269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.678482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.691041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.691699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.692567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.694092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.694617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.834090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:21.866596 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-01e767f4-33cb-499d-915e-35fe9298e43b tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.233028 Oct 28 13:04:21.867687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 348/660] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:21 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:21.875885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:21.876782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:21.883057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.884128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.884839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.886393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:21.886882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:21.887312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:21.933069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:21.941337 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9ac983f-13d0-45a1-9707-7a07ff083f37 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.312155 Oct 28 13:04:21.942155 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 313/661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:21 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:22.006510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:22.006510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:22.006774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:22.006774 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-655a4917-ad3f-4a4f-a2ce-49aa39d902cf tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1319 microversion: 2.25 time: 0.105465 Oct 28 13:04:22.006774 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 349/662] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:21 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:22.548315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:22.548967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:22.578149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:22.578848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:22.579143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:22.588578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:22.589606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:22.591922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:22.648802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5dbe1c0-64f6-4e5e-ba58-e0eeed7c6d58 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9f57c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:22.658991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:22.659724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:22.660592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:22.661373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lazy-loading 'fault' on Instance uuid febb8e78-4b94-45f6-8deb-87f4ce076224 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:22.785751 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5dbe1c0-64f6-4e5e-ba58-e0eeed7c6d58 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.141694 Oct 28 13:04:22.787095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 350/663] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:22 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:22.800035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a715e794315e44369c51eed6d09c710e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a957c0dec14fbb92fc1a4b7b17efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:22.817236 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd4dd2b8-4166-48ab-8089-3bb4d188cafe tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 200 len: 1310 microversion: 2.1 time: 0.274577 Oct 28 13:04:22.839130 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 314/664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:22 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:22.896740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:22.898248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:22.911690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:22.912778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:22.913451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:22.914473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:22.918708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:22.919615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:22.965997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:22.967007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:22.980884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:22.982473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:22.984864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:22.985770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:22.987830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:22.989172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:23.306618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:23.333261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:23.337663 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-601eb482-162c-4540-801f-6d0cf70a85c1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.367807 Oct 28 13:04:23.338633 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 315/665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:22 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:23.360334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:23.361265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:23.381791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:23.383034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:23.391502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:23.396930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:23.397839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:23.400104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:23.403436 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bc10192c-e48b-45a4-9d0a-afef696c61b4 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.510787 Oct 28 13:04:23.411541 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 351/666] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:22 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:23.591309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:23.607412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:23.609368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:23.611256 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2dfda431-dc86-4305-8095-d8f115d53c6d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.270198 Oct 28 13:04:23.611962 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 316/667] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:23 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:23.844475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3ce5184-3818-4c4f-b073-289be3487abe tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9dc8ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:23.846837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:23.847453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:23.859047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:23.859709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:23.860281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:23.871196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:23.873198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:23.877770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:23.896352 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3ce5184-3818-4c4f-b073-289be3487abe tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.098656 Oct 28 13:04:23.901374 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 352/668] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:23 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:23.926516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] HTTP exception thrown: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Request method failure captured: Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 HTTP/1.1 Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MYkJbM70pQF2hmTHcoWGxqJtwOTj7vPWrOMWK-rIymf6dZ15uq-RFfBGo6UXrcWDv2EKfDn7kLE8YnPgdo6Kzy3or_NkraIRBDO2DKXW9HTozCAdaEkKUfnAXw62a_2BeBZVY1XM75TVJzcckirvSBEw75VBvMf141g5HV8eABsno Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:23.928252 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a957c0dec14fbb92fc1a4b7b17efa8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a715e794315e44369c51eed6d09c710e Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:23.929801 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'febb8e78-4b94-45f6-8deb-87f4ce076224'} Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:23.930684 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:23.932387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:23.933819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Returning 404 to user: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:23.933819 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f879f5f-a7bf-4f65-9536-47e7e7f32984 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 404 len: 111 microversion: 2.1 time: 0.087559 Oct 28 13:04:23.933819 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 317/669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:23 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:23.949898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:23.949898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:23.961258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:23.961771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:23.964576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:23.965370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:23.967439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:23.969588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:23.998265 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] HTTP exception thrown: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Request method failure captured: Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 HTTP/1.1 Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MYkJbM70pQF2hmTHcoWGxqJtwOTj7vPWrOMWK-rIymf6dZ15uq-RFfBGo6UXrcWDv2EKfDn7kLE8YnPgdo6Kzy3or_NkraIRBDO2DKXW9HTozCAdaEkKUfnAXw62a_2BeBZVY1XM75TVJzcckirvSBEw75VBvMf141g5HV8eABsno Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:04:24.001078 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a957c0dec14fbb92fc1a4b7b17efa8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a715e794315e44369c51eed6d09c710e Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.002728 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'febb8e78-4b94-45f6-8deb-87f4ce076224'} Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:24.003592 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.005433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.009261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Returning 404 to user: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:24.010789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba83644a-9858-42bb-809d-0946f345168b tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 404 len: 111 microversion: 2.1 time: 0.070256 Oct 28 13:04:24.023253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:24.023609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: febb8e78-4b94-45f6-8deb-87f4ce076224] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:24.028465 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 353/670] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:04:23 2022] DELETE /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:24.030566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.031286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.031764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.032684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.033138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.033551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.048870 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] HTTP exception thrown: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Request method failure captured: Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 HTTP/1.1 Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MYkJbM70pQF2hmTHcoWGxqJtwOTj7vPWrOMWK-rIymf6dZ15uq-RFfBGo6UXrcWDv2EKfDn7kLE8YnPgdo6Kzy3or_NkraIRBDO2DKXW9HTozCAdaEkKUfnAXw62a_2BeBZVY1XM75TVJzcckirvSBEw75VBvMf141g5HV8eABsno Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:24.050438 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a957c0dec14fbb92fc1a4b7b17efa8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a715e794315e44369c51eed6d09c710e Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.052010 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'febb8e78-4b94-45f6-8deb-87f4ce076224'} Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:24.052926 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. Oct 28 13:04:24.054206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.056119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Returning 404 to user: Instance febb8e78-4b94-45f6-8deb-87f4ce076224 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:24.057287 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5cf4876a-6eea-44b0-9562-cac075507bcc tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224" status: 404 len: 111 microversion: 2.1 time: 0.041281 Oct 28 13:04:24.058017 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 318/671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:24 2022] GET /compute/v2.1/servers/febb8e78-4b94-45f6-8deb-87f4ce076224 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:04:24.066476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:24.067272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:24.076340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.077075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.084503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.084503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.084503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.084503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.098981 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] HTTP exception thrown: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Request method failure captured: Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 HTTP/1.1 Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MYkJbM70pQF2hmTHcoWGxqJtwOTj7vPWrOMWK-rIymf6dZ15uq-RFfBGo6UXrcWDv2EKfDn7kLE8YnPgdo6Kzy3or_NkraIRBDO2DKXW9HTozCAdaEkKUfnAXw62a_2BeBZVY1XM75TVJzcckirvSBEw75VBvMf141g5HV8eABsno Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:04:24.101184 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a957c0dec14fbb92fc1a4b7b17efa8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a715e794315e44369c51eed6d09c710e Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.102725 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '27e0baaa-3d64-45b4-8b42-a235d4550f04'} Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:24.103582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.105619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.107678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Returning 404 to user: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:24.108781 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86c2ca59-8c9e-4092-b36b-52b1c788e324 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 404 len: 111 microversion: 2.1 time: 0.046495 Oct 28 13:04:24.113255 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 354/672] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:04:24 2022] DELETE /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:24.118987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:24.119861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] [instance: 27e0baaa-3d64-45b4-8b42-a235d4550f04] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:24.131499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.132820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.134190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.135729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.142258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.142258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.180795 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] HTTP exception thrown: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Request method failure captured: Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 HTTP/1.1 Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MYkJbM70pQF2hmTHcoWGxqJtwOTj7vPWrOMWK-rIymf6dZ15uq-RFfBGo6UXrcWDv2EKfDn7kLE8YnPgdo6Kzy3or_NkraIRBDO2DKXW9HTozCAdaEkKUfnAXw62a_2BeBZVY1XM75TVJzcckirvSBEw75VBvMf141g5HV8eABsno Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:24.184890 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1a957c0dec14fbb92fc1a4b7b17efa8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1a957c0dec14fbb92fc1a4b7b17efa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f1a957c0dec14fbb92fc1a4b7b17efa8 Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1389076097 Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a715e794315e44369c51eed6d09c710e Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersAdminTestJSON-1389076097-project Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.186176 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '27e0baaa-3d64-45b4-8b42-a235d4550f04'} Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:24.188028 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. Oct 28 13:04:24.189269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:24.191258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] Returning 404 to user: Instance 27e0baaa-3d64-45b4-8b42-a235d4550f04 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:24.193612 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-792ef0a9-592a-47c2-a4ee-bb523119a606 tempest-DeleteServersAdminTestJSON-1389076097 tempest-DeleteServersAdminTestJSON-1389076097-project] 10.222.0.25 "GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04" status: 404 len: 111 microversion: 2.1 time: 0.079463 Oct 28 13:04:24.198944 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 319/673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:24 2022] GET /compute/v2.1/servers/27e0baaa-3d64-45b4-8b42-a235d4550f04 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:24.367963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:24.369201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:24.379583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.381560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.384752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.386391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.387064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.389472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.445716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:24.446488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:24.457497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.460163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.460618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.461625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.496827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.500941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.695598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:24.774429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:24.787144 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-65005303-a1bf-4c5a-a095-9ac4ca79e9dd tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.350258 Oct 28 13:04:24.803470 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 320/674] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:24 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:24.828531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5e0f499f-3439-4753-aa84-88934f7c029c req-73b83d20-2c42-4bb5-a130-529fc03de443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9de8fb-d31e-4f62-b8cb-cafb20df5769", "name": "network-vif-plugged", "status": "completed", "tag": "a98862dc-d21d-470a-88e8-e37c85cda8ca"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:24.840246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5e0f499f-3439-4753-aa84-88934f7c029c req-73b83d20-2c42-4bb5-a130-529fc03de443 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.840946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5e0f499f-3439-4753-aa84-88934f7c029c req-73b83d20-2c42-4bb5-a130-529fc03de443 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.841510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5e0f499f-3439-4753-aa84-88934f7c029c req-73b83d20-2c42-4bb5-a130-529fc03de443 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.867796 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5e0f499f-3439-4753-aa84-88934f7c029c req-73b83d20-2c42-4bb5-a130-529fc03de443 service nova] Creating event network-vif-plugged:a98862dc-d21d-470a-88e8-e37c85cda8ca for instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 on n-h1-862876-2 Oct 28 13:04:24.875087 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5e0f499f-3439-4753-aa84-88934f7c029c req-73b83d20-2c42-4bb5-a130-529fc03de443 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069194 Oct 28 13:04:24.876837 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 321/675] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:24.883151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:24.884296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:24.891975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.892693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.893289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.893989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:24.894577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:24.898687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:24.920791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:24.934089 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8b983989-f513-4eb6-bb39-974edf1b2541 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.569791 Oct 28 13:04:24.939664 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 355/676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:24 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:24.944589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8658bec9-4ba9-4756-a6dc-b764d78c76c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9e16280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:25.045839 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8658bec9-4ba9-4756-a6dc-b764d78c76c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.104870 Oct 28 13:04:25.046654 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 356/677] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:24 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:25.209575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:25.220639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:25.230052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:25.231482 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-34b7dcb2-b3a4-4908-b462-453165b529cc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.353202 Oct 28 13:04:25.232093 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 322/678] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:24 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:25.585648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cbe90add-d1f0-479d-bbec-ee9562a82eac req-499f3037-cc2a-43c9-8578-682dcad42fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d226cb64-78cc-4727-a90c-024cb6e5e87d", "tag": "8ac23d6b-995f-4a03-8e2c-3436bb2388b1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:25.602521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cbe90add-d1f0-479d-bbec-ee9562a82eac req-499f3037-cc2a-43c9-8578-682dcad42fa1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:25.604372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cbe90add-d1f0-479d-bbec-ee9562a82eac req-499f3037-cc2a-43c9-8578-682dcad42fa1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:25.604996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cbe90add-d1f0-479d-bbec-ee9562a82eac req-499f3037-cc2a-43c9-8578-682dcad42fa1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:25.622235 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cbe90add-d1f0-479d-bbec-ee9562a82eac req-499f3037-cc2a-43c9-8578-682dcad42fa1 service nova] Creating event network-changed:8ac23d6b-995f-4a03-8e2c-3436bb2388b1 for instance d226cb64-78cc-4727-a90c-024cb6e5e87d on n-h2-862876-2 Oct 28 13:04:25.630907 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cbe90add-d1f0-479d-bbec-ee9562a82eac req-499f3037-cc2a-43c9-8578-682dcad42fa1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052095 Oct 28 13:04:25.637746 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 357/679] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:25.823061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:25.823625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:25.834490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:25.842914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:25.848314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:25.851438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:25.853961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:25.856999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:25.858589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:25.962771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:25.964008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:25.979673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:25.980442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:25.983760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:25.987252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:25.988809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:25.989631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:26.035013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:26.040061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:26.083110 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab56d216-1e31-49b2-802d-ca40cbaede16 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.265036 Oct 28 13:04:26.084952 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 323/680] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:25 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:26.090931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ba851d15-58b9-495c-ae92-def08f134f95 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a7b160>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:26.184068 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ba851d15-58b9-495c-ae92-def08f134f95 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.092849 Oct 28 13:04:26.185379 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 324/681] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:26 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:26.259923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:26.262024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:26.271225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:26.272050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:26.273051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:26.274487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:26.275186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:26.275891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:26.695368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:26.707218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:26.725251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:26.728989 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d11a61d3-ebb1-4a42-a3a4-51933cae360f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.472720 Oct 28 13:04:26.743926 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 325/682] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:26 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:26.835275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:26.847523 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4adbd443-cef9-4e5e-8566-8e9c5f5b55d3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1317 microversion: 2.1 time: 0.888736 Oct 28 13:04:26.848513 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 358/683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:25 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1317 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:27.127309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:27.131975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:27.138937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=11 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:27.140736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:27.141387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:27.141983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:27.142904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:27.143524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:27.144106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:27.201175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8d48cfe-923f-45e0-812c-3159efaf490e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9d9cd30>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:27.262824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:27.300564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19181051-594c-494d-bc2d-079297e08750 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.185820 Oct 28 13:04:27.301155 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 326/684] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:27 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:27.329495 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8d48cfe-923f-45e0-812c-3159efaf490e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.132654 Oct 28 13:04:27.334249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 359/685] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:27 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:27.758914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:27.760738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:27.769879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:27.770541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:27.770819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:27.772098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:27.772565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:27.772997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:27.872757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:27.873427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:27.887689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:27.888463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:27.889926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:27.898308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:27.900920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:27.904836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:27.931888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:27.944672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:27.952069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:27.952069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b85c0bd5-f564-4dd8-8f9e-410d2cc980c5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.194107 Oct 28 13:04:27.952069 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 327/686] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:27 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:28.188231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:28.206626 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-346459eb-36a6-443c-8dc8-04a12adbc9c6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1467 microversion: 2.1 time: 0.339032 Oct 28 13:04:28.209074 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 360/687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:27 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1467 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:28.334147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:28.334147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:28.358239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:28.361467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:28.363119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:28.365066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:28.366983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:28.367632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:28.715632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:28.757715 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48097f1c-9632-4b9f-8076-c142f17fc58c tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.431893 Oct 28 13:04:28.759763 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 361/688] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:28 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:28.768021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3e64289-3700-4e04-81c7-8d6afbb4baf8 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9d9cd30>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:28.837160 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e3e64289-3700-4e04-81c7-8d6afbb4baf8 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.074944 Oct 28 13:04:28.838524 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 362/689] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:28 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:28.955018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:28.955645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:28.967027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:28.967772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:28.968373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:28.969904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:28.970372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:28.970849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:28.981947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:28.982870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:28.996412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:28.997456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:28.998099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:28.999020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:28.999928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:29.001246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:29.184592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:29.193238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:29.195210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:29.196578 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-22a73a5b-2682-484a-9cef-3d131e4c87ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.221845 Oct 28 13:04:29.197434 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 363/690] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:28 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:29.588551 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-38d58feb-d556-40a2-bbfa-b7b496ff4d19 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1618 microversion: 2.1 time: 1.357758 Oct 28 13:04:29.594073 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 328/691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:28 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1618 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:29.623300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3b8b01d-a254-4bf4-acb0-4d6b78da35de tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: .version_select at 0x7f27b9c7c550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-647319786", "policies": ["affinity"]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:29.658894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b3b8b01d-a254-4bf4-acb0-4d6b78da35de tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:29.674078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b3b8b01d-a254-4bf4-acb0-4d6b78da35de tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:29.798826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:29.799706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:29.802221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:29.817873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:29.821670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:29.822431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:29.823417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:29.829963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:29.831089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:29.852889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b3b8b01d-a254-4bf4-acb0-4d6b78da35de tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:29.859095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b3b8b01d-a254-4bf4-acb0-4d6b78da35de tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:29.896577 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3b8b01d-a254-4bf4-acb0-4d6b78da35de tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.273899 Oct 28 13:04:29.913134 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 364/692] 10.222.0.25 () {60 vars in 1174 bytes} [Fri Oct 28 13:04:29 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:29.921250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1072fda1-92e2-4bb7-8ded-130aaef7d868 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c6ce50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:30.030866 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1072fda1-92e2-4bb7-8ded-130aaef7d868 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.116385 Oct 28 13:04:30.031676 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 365/693] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:29 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:30.120232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:30.163397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1fb4dab-ccd1-4bf4-a2d7-96aefef25074 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.368878 Oct 28 13:04:30.171168 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 329/694] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:29 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:30.200581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1596338387", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "233b0b5f-bf34-4784-bf4b-e2f2fdd54262"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:30.221993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:30.222609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:30.251831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:30.252335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:30.252770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:30.264157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:30.264820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:30.265275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:30.394069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:04:30.787584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:30.799564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:30.805740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:30.807282 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5cb54e78-4a7f-4a6e-a128-084f17b6e88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.589305 Oct 28 13:04:30.813775 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 330/695] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:30 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:31.047520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7262abb1-ee41-4a33-8fe0-9fbb96742782 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a53dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:31.107089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:04:31.107561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:04:31.108925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:04:31.110120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:04:31.112010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:04:31.112213 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7262abb1-ee41-4a33-8fe0-9fbb96742782 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1455 microversion: 2.1 time: 0.068897 Oct 28 13:04:31.121458 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 331/696] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:31 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:31.158843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:31.166583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:31.167393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:31.167837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:31.168546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:31.168996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:31.169415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:31.187290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:31.191981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:31.196201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:31.196812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:31.203979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:31.204394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Going to run 2 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:04:31.204841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:31.206037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:31.206783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:31.207243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:31.207673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:31.208494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:04:31.300909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:31.319387 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82a4df24-5856-42f2-a557-ccc41b4076f8 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1927 microversion: 2.75 time: 0.126899 Oct 28 13:04:31.319978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 332/697] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:31 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1927 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:31.493530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127794) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 13:04:31.549347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:31.564745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:31.745857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:31.770517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:31.813648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=9256c7bc-6b0f-4ee2-8b7f-49e469b5127a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:04:31.842974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:31.843656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:31.857693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:31.860382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:31.870369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:31.871722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:31.872377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:31.878977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:32.088890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:32.111288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:32.275529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:32.288008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:32.292925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:32.294153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b460f68-649e-437b-97eb-c6f777320f5a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.458553 Oct 28 13:04:32.295622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:32.309993 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 333/698] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:31 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:32.317099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:32.323022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9190f4bc-f2ef-406b-bdea-175d04591cbf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a53e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:32.403356 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9190f4bc-f2ef-406b-bdea-175d04591cbf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1464 microversion: 2.1 time: 0.091998 Oct 28 13:04:32.404298 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 334/699] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:32 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1464 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:32.405616 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35bafbd8-4108-4069-8e16-c10113562d33 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.209510 Oct 28 13:04:32.408274 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 366/700] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:04:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 2213 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:04:32.415041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:32.416837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:32.430251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:32.435919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:32.436802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:32.437790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:32.438481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:32.439142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:32.665825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27b9bc99d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:32.671211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:32.672286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:32.672998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:32.674157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:32.674881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:32.675572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:32.718059 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-949ca4a2-0d5c-40e5-9c67-88a2567b802c tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.309812 Oct 28 13:04:32.719727 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 335/701] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Oct 28 13:04:32 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:32.725497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06a05e64-08b6-4bd5-8003-b8a2675b1893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a53f70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:32.789206 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06a05e64-08b6-4bd5-8003-b8a2675b1893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 200 len: 1464 microversion: 2.1 time: 0.067930 Oct 28 13:04:32.790213 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 336/702] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:32 2022] GET /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 1464 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:32.803066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:32.817552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:32.818497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Searching by: {'deleted': False, 'project_id': '83f9bc35587c481ba2be5676f43c0672'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:04:32.854468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:32.855217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:32.855732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:32.856685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:32.857558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:32.859193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:32.958680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:32.997607 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f6d51a5-88f3-46c3-a085-605275a97221 tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1933 microversion: 2.75 time: 0.587860 Oct 28 13:04:32.998209 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 367/703] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:32 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1933 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:33.024310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27b9c6ce50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:33.028421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.029262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.029858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.030782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.031392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.031992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.063941 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5299d35b-82b4-4c66-96e6-421a1e932b45 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.052022 Oct 28 13:04:33.072200 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 368/704] 10.222.0.25 () {58 vars in 1139 bytes} [Fri Oct 28 13:04:32 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:33.082720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:33.083600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:33.095640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.096382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.096974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.097864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.098695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.099444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.190148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:04:33.576495 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14f00e33-58e5-47c3-af7b-1e09fc31d17c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.783520 Oct 28 13:04:33.577545 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 337/705] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:04:32 2022] GET /compute/v2.1/servers => generated 1004 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:33.595575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27b9a92550>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:33.600720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.600831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.601225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.601954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.602413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.602865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.633425 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef10386c-5099-470e-b421-f17ae51d6494 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.054477 Oct 28 13:04:33.634044 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 338/706] 10.222.0.25 () {58 vars in 1145 bytes} [Fri Oct 28 13:04:33 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:04:33.647410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:33.648028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:33.654774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.655301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.655797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.656586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.657098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.657533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.858983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:33.869191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:33.874326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:33.875527 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ec094316-acbd-4015-b255-c8c2c3a79e98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.232185 Oct 28 13:04:33.882128 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 339/707] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:33 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:33.887630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc14d4b4-3922-4261-9148-be2b7ae764ac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:33.888244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc14d4b4-3922-4261-9148-be2b7ae764ac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:33.893374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:33.910280 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-018e3722-aa45-4668-9784-4429480b3893 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1467 microversion: 2.1 time: 0.835344 Oct 28 13:04:33.911111 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 369/708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:33 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1467 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:33.921088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27b9be8820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:33.927244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.927727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.928215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.929060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:33.929517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:33.929935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:33.975253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc14d4b4-3922-4261-9148-be2b7ae764ac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:33.985473 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc14d4b4-3922-4261-9148-be2b7ae764ac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1219 microversion: 2.1 time: 0.102191 Oct 28 13:04:33.986063 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 340/709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:33 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:34.005911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2037152550"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:34.009461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:34.018843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.021195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.021195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.021195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.022134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.022665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.026185 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-66aabc53-32a2-4f34-a078-d604f5cbe8d0 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.114016 Oct 28 13:04:34.026827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 370/710] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Oct 28 13:04:33 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:34.051251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:34.052642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:34.072650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.073162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.073607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.074327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.074839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.075435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.252682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:34.318338 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e0fe498-1a6e-49ed-bea9-e17777b1d7bf tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1933 microversion: 2.75 time: 0.280455 Oct 28 13:04:34.320136 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 371/711] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:34 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1933 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:34.331587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27ba1a0820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:34.342385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.343450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.344941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.346707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.347507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.348150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.379421 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1de6de1e-4923-4e00-b433-b7a0039ae515 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.058004 Oct 28 13:04:34.380640 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 372/712] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:04:34 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:34.405145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27b9c7c550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:34.421932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.423571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.424018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.424760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.427356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.427852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.461796 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a7468d1-a18b-4864-a8d1-1a3304aa4db5 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.073639 Oct 28 13:04:34.463566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 373/713] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Oct 28 13:04:34 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:34.474471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27ba2ea1f0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:34.481903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.482641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.483287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.499506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.500207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.500822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.526521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:34.534679 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91e097ed-d07d-46e0-b70d-2fe71f2384a8 tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-862876-2" status: 200 len: 598 microversion: 2.1 time: 0.064542 Oct 28 13:04:34.536897 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 374/714] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Oct 28 13:04:34 2022] GET /compute/v2.1/os-hosts/n-h2-862876-2 => generated 598 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:34.549018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Calling method '.version_select at 0x7f27b9dc8550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:34.568546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.569330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.571090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.584101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:34.589627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.590390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.591120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.621079 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6d2b112-c73a-4a87-ad5b-a0de1a6bd20e tempest-HostsAdminTestJSON-234809818 tempest-HostsAdminTestJSON-234809818-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-862876-2" status: 200 len: 860 microversion: 2.1 time: 0.077273 Oct 28 13:04:34.622429 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 375/715] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Oct 28 13:04:34 2022] GET /compute/v2.1/os-hosts/n-h1-862876-2 => generated 860 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:34.805086 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51a2c81d-d664-4d2d-b1d9-5f73682317cf tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "POST /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c/action" status: 202 len: 0 microversion: 2.1 time: 0.817214 Oct 28 13:04:34.811557 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 341/716] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:04:33 2022] POST /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:04:34.817499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-017e3e6e-d8d6-4a41-b133-982a51705df6 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9d0ee50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:34.888946 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-017e3e6e-d8d6-4a41-b133-982a51705df6 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.076227 Oct 28 13:04:34.896295 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 376/717] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:34 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:34.906326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:34.907438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:34.920086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.927131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.927968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:34.928937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:34.929717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:34.930208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:35.009079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1170ff79-5869-4d18-a545-1590b2727496 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:35.009826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1170ff79-5869-4d18-a545-1590b2727496 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:35.079489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1170ff79-5869-4d18-a545-1590b2727496 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:35.110652 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1170ff79-5869-4d18-a545-1590b2727496 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1219 microversion: 2.1 time: 0.102835 Oct 28 13:04:35.114409 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 377/718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:35 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:35.219654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:35.226321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:35.227811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:35.229507 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6bec8c95-7355-42d7-ad32-6f1faf479021 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.328125 Oct 28 13:04:35.234805 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 342/719] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:34 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:35.352786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:35.353408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:35.387712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:35.388129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:35.392435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:35.393465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:35.396713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:35.398360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:35.594638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] Lazy-loading 'services' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:35.628913 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a697ad6-0094-49a6-86c8-317244fb8a6e tempest-ServersAdmin275Test-1967919758 tempest-ServersAdmin275Test-1967919758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1918 microversion: 2.75 time: 0.283573 Oct 28 13:04:35.629847 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 378/720] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:35 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1918 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:35.674758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:35.678058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:35.685629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:35.686403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:35.687060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:35.699008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:35.702096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:35.702667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:35.761575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:04:35.912461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ff1ac44-d975-43b4-97f4-56d7244fc4f6 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c7cf70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:36.017510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ff1ac44-d975-43b4-97f4-56d7244fc4f6 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.109902 Oct 28 13:04:36.020353 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 379/721] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:35 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:36.157429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:36.159529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:36.178517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:36.180451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:36.181124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:36.182170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:36.183133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:36.183784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:36.329927 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-93f463e9-5b7f-4f12-9cd1-dcd78b8d0303 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 204 len: 0 microversion: 2.75 time: 0.662967 Oct 28 13:04:36.331302 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 343/722] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:04:35 2022] DELETE /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:04:36.351039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:36.357073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:36.358096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:36.363446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0e01784-2e51-40fc-9708-dfb75e31daad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1215 microversion: 2.1 time: 0.225180 Oct 28 13:04:36.376562 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 380/723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:36 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:36.378701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:36.381783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:36.383384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:36.385325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:36.387054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:36.388853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:36.392071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:36.394696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:36.420872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:36.420872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:36.423443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:36.425558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:36.426244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:36.428524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:36.673270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:36.708559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:36.719410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:36.746367 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-438ca22c-36f3-4702-b1cf-aeafabb08b75 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1443 microversion: 2.75 time: 0.368054 Oct 28 13:04:36.753566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 381/724] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:36 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1443 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:36.977715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:36.992278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:36.994551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:36.996553 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fcaa9f64-bdd4-4166-9bff-9db01e40e5b3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.662579 Oct 28 13:04:36.999500 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 344/725] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:36 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:37.033892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f1016109-1861-418b-bb63-9f40766161b7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c80790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:37.095878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f1016109-1861-418b-bb63-9f40766161b7 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.066814 Oct 28 13:04:37.097024 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 382/726] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:37 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:37.344130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3d94c7f3-5403-4030-9f7c-251dc8bb3022 req-4152191d-9b41-4896-a984-db7c17a9a99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b3df7-aba2-4aa3-b02a-525e788cf294", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf284c1-9f73-4970-ad51-e0c6eeaf0d88"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:37.378181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3d94c7f3-5403-4030-9f7c-251dc8bb3022 req-4152191d-9b41-4896-a984-db7c17a9a99d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:37.379713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3d94c7f3-5403-4030-9f7c-251dc8bb3022 req-4152191d-9b41-4896-a984-db7c17a9a99d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:37.381084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3d94c7f3-5403-4030-9f7c-251dc8bb3022 req-4152191d-9b41-4896-a984-db7c17a9a99d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:37.389854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:37.390939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:37.406436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:37.407581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:37.409259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:37.411862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:37.412717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:37.415636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:37.431825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3d94c7f3-5403-4030-9f7c-251dc8bb3022 req-4152191d-9b41-4896-a984-db7c17a9a99d service nova] Creating event network-vif-unplugged:5bf284c1-9f73-4970-ad51-e0c6eeaf0d88 for instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 on n-h1-862876-2 Oct 28 13:04:37.445328 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3d94c7f3-5403-4030-9f7c-251dc8bb3022 req-4152191d-9b41-4896-a984-db7c17a9a99d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104966 Oct 28 13:04:37.448063 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 345/727] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:37.572639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:37.580956 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f0096a7-feff-4ea2-af1d-db4761c8bb82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1271 microversion: 2.1 time: 0.195819 Oct 28 13:04:37.591466 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 383/728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:37 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:37.788199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:37.789161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:37.802596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:37.803400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:37.804045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:37.804988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:37.805662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:37.806286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:37.918009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:37.928217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:37.929948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:37.939347 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-704daf81-2a39-4cba-8b3d-1d1d68702b63 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1443 microversion: 2.75 time: 0.154114 Oct 28 13:04:37.940574 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 346/729] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:37 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:38.024905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:38.026358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:38.032870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:38.033454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:38.033979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:38.034779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:38.035244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:38.035664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:38.113525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01d0c319-c311-42e4-9da2-e15e67961d29 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c87430>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:38.171051 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01d0c319-c311-42e4-9da2-e15e67961d29 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.061626 Oct 28 13:04:38.172372 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 347/730] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:38 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:38.607454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:38.610336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:38.629260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:38.634223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:38.634223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:38.635306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:38.640084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:38.640555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:38.848886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:38.862532 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ac45395-904c-46bf-913e-e768a3757f62 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1277 microversion: 2.1 time: 0.258471 Oct 28 13:04:38.866919 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 348/731] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:38 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:39.162262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:39.168374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:39.179216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:39.183058 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6a07922-09cc-4f24-a2b6-cbad50aebf25 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 1.162950 Oct 28 13:04:39.184130 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 384/732] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:38 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:39.188992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:39.193172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:39.206401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:39.207237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:39.211046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:39.211697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:39.212167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:39.212594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:39.251431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:39.274609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1191483722", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a791660c-7eb7-446a-a3be-2b028b5235c0"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:39.328856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:39.329562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:39.330163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:39.330866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lazy-loading 'fault' on Instance uuid 7eec00cd-2700-47be-b870-c01c578074ec {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:39.373470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] validate_networks() for [('a791660c-7eb7-446a-a3be-2b028b5235c0', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:04:39.469635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:39.482002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:39.483988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8cd48d3f224ef1ba336772eaa4bf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16a79f715647e7b21ca21bc516abec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:39.495682 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0faa8e46-28a7-4bd6-b4e1-442d6bf59813 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 200 len: 1448 microversion: 2.75 time: 0.310084 Oct 28 13:04:39.496627 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 385/733] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:39 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 1448 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:39.502457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88399739-767e-47d8-bd0c-0889a3b233ef tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9fb50d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:39.606155 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88399739-767e-47d8-bd0c-0889a3b233ef tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.108373 Oct 28 13:04:39.615602 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 386/734] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:39 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:39.693073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-aecc0168-1c2b-4ed6-889b-a3d20d4810b5 req-58a63378-cae3-4eae-a1a4-6988c3ecb596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d226cb64-78cc-4727-a90c-024cb6e5e87d", "name": "network-vif-plugged", "status": "completed", "tag": "8ac23d6b-995f-4a03-8e2c-3436bb2388b1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:39.703969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aecc0168-1c2b-4ed6-889b-a3d20d4810b5 req-58a63378-cae3-4eae-a1a4-6988c3ecb596 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:39.704640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aecc0168-1c2b-4ed6-889b-a3d20d4810b5 req-58a63378-cae3-4eae-a1a4-6988c3ecb596 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:39.705219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aecc0168-1c2b-4ed6-889b-a3d20d4810b5 req-58a63378-cae3-4eae-a1a4-6988c3ecb596 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:39.716776 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-aecc0168-1c2b-4ed6-889b-a3d20d4810b5 req-58a63378-cae3-4eae-a1a4-6988c3ecb596 service nova] Creating event network-vif-plugged:8ac23d6b-995f-4a03-8e2c-3436bb2388b1 for instance d226cb64-78cc-4727-a90c-024cb6e5e87d on n-h2-862876-2 Oct 28 13:04:39.722172 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-aecc0168-1c2b-4ed6-889b-a3d20d4810b5 req-58a63378-cae3-4eae-a1a4-6988c3ecb596 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032706 Oct 28 13:04:39.723439 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 387/735] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:04:39.896424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:39.897531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:39.914410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:39.915585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:39.917814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:39.919888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:39.923831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:39.926923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:40.127858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:40.136038 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-004e5af5-f1dd-4f8d-9c45-8dd2a0ee3d97 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1277 microversion: 2.1 time: 0.247658 Oct 28 13:04:40.151042 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 388/736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:39 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:40.209332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:40.209955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:40.227092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:40.227592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:40.228025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:40.235168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:40.235685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:40.236570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:40.519163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:04:40.520129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:04:40.521020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:04:40.521584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:04:40.522177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:04:40.533470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:40.534185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:40.534828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:40.535733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:40.536356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:40.536937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:40.560368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Getting quotas for project 4b572d677cfe48ccb19defc039f78bd8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:40.566861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Getting quotas for user c92551c6642f463b9e8ee3869bf010ad and project 4b572d677cfe48ccb19defc039f78bd8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:40.597442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:04:40.600277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:04:40.836097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd304a63-a0c7-4152-b6c1-5e91ab169fda tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.937578 Oct 28 13:04:40.836827 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 349/737] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:04:40.857283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:40.868863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:40.886818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:40.887471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] [instance: 7eec00cd-2700-47be-b870-c01c578074ec] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:40.889548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:40.890731 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b821cbe7-8f2d-4fab-8b73-d33eb4aadbb5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1361 microversion: 2.25 time: 0.685457 Oct 28 13:04:40.891321 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 389/738] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:40 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1361 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:40.913729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:40.914240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:40.914682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:40.915458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:40.915986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:40.916423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:40.933868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bcfdad58-1f97-4732-adab-9ab571a57be6 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9dc8430>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:40.961685 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] HTTP exception thrown: Instance 7eec00cd-2700-47be-b870-c01c578074ec could not be found. Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Request method failure captured: Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec HTTP/1.1 Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MLF9Wv-qKwwy-XSSxLUuENIoaHx_4Fk8s1bCR0I5XxII8N0g_DuRAUtjlVPWpUMKGEa4GyvsGogo6Tukws8h3p8MIGKIL_wm09DecbIZ5HDV_JnMqxfEzBJJ2fvdL5dIxKcXMFfwPS7IX9Q1o4ySq8rLGC2guskLdzzb0e4IZ0inM Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.75 Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 1e16a79f715647e7b21ca21bc516abec Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersAdmin275Test-2010740078 Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:40.964497 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e16a79f715647e7b21ca21bc516abec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e16a79f715647e7b21ca21bc516abec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e16a79f715647e7b21ca21bc516abec", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e16a79f715647e7b21ca21bc516abec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersAdmin275Test-2010740078 Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 1e16a79f715647e7b21ca21bc516abec Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersAdmin275Test-2010740078 Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersAdmin275Test-2010740078-project Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 5a8cd48d3f224ef1ba336772eaa4bf49 Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersAdmin275Test-2010740078-project Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7eec00cd-2700-47be-b870-c01c578074ec could not be found. Oct 28 13:04:40.965946 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7eec00cd-2700-47be-b870-c01c578074ec'} Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eec00cd-2700-47be-b870-c01c578074ec could not be found. Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:40.966687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eec00cd-2700-47be-b870-c01c578074ec could not be found. Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eec00cd-2700-47be-b870-c01c578074ec could not be found. Oct 28 13:04:40.967880 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:40.971559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] Returning 404 to user: Instance 7eec00cd-2700-47be-b870-c01c578074ec could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:40.972648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b3ec8df-9278-4c8d-adda-c9ed0b1c7fa4 tempest-ServersAdmin275Test-2010740078 tempest-ServersAdmin275Test-2010740078-project] 10.222.0.25 "GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec" status: 404 len: 111 microversion: 2.75 time: 0.131011 Oct 28 13:04:40.973614 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 350/739] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:40 2022] GET /compute/v2.1/servers/7eec00cd-2700-47be-b870-c01c578074ec => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:04:40.980168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c4a3b4b-05cb-44fc-849a-e4bce6d4374b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:40.981031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c4a3b4b-05cb-44fc-849a-e4bce6d4374b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:41.068137 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bcfdad58-1f97-4732-adab-9ab571a57be6 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.143381 Oct 28 13:04:41.068719 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 390/740] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:40 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:41.109169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c4a3b4b-05cb-44fc-849a-e4bce6d4374b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:41.115632 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c4a3b4b-05cb-44fc-849a-e4bce6d4374b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1224 microversion: 2.1 time: 0.140197 Oct 28 13:04:41.117806 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 351/741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:40 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:41.163778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:41.164485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:41.172251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:41.189282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:41.202918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:41.203640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:41.207526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:41.211143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:41.640654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:41.651328 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0079ed15-a3eb-472f-8826-161b476ed740 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1277 microversion: 2.1 time: 0.489057 Oct 28 13:04:41.654412 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 391/742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:41 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1277 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:41.922894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:41.924049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:41.945367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:41.946157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:41.948597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:41.949570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:41.951033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:41.952374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:42.083830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5368080f-0d66-4c82-b734-b99d9ba9aa55 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c80ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:42.177910 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5368080f-0d66-4c82-b734-b99d9ba9aa55 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.097850 Oct 28 13:04:42.179228 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 392/743] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:42 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:42.191754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05601893-ff15-4469-ae5e-33f009a5473c tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:42.192741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-05601893-ff15-4469-ae5e-33f009a5473c tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:42.310630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:42.324953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:42.344635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:42.346313 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9bad3a98-f397-49d6-a380-93493b5bcf67 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1558 microversion: 2.25 time: 0.428491 Oct 28 13:04:42.348811 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 352/744] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:41 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1558 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:42.392319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:42.393392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:42.399948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:42.401211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:42.401961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:42.402854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:42.403603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:42.404203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:42.543647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-05601893-ff15-4469-ae5e-33f009a5473c tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:42.638448 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-05601893-ff15-4469-ae5e-33f009a5473c tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1224 microversion: 2.1 time: 0.381668 Oct 28 13:04:42.638448 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 393/745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:42 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1224 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:42.711709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:42.711709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:42.711709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:42.711709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:42.712408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:42.712408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:42.712408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:42.712408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:42.725727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid d226cb64-78cc-4727-a90c-024cb6e5e87d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:42.772635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8a843e49-7fbc-43ce-ac57-7ef650071928 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 2050 microversion: 2.25 time: 0.386146 Oct 28 13:04:42.779525 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 353/746] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:42 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 2050 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:42.805635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:42.811818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:42.818437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:42.824874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:42.825483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:42.839621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:42.840786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:42.841739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:42.886482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:42.898680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0fea9ed6-0b18-4f51-9c03-42835420a19f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1277 microversion: 2.1 time: 0.222242 Oct 28 13:04:42.908078 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 394/747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:42 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:43.194451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dc559817-033d-4d18-bb56-8289d7df5db0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c80ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:43.207665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid d226cb64-78cc-4727-a90c-024cb6e5e87d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:43.252806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd710c0a-2653-44b6-98ca-aba0ca6c8ea9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 2050 microversion: 2.25 time: 0.452129 Oct 28 13:04:43.254017 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 354/748] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:42 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 2050 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:43.284082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:43.290377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.293348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.293838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.296210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.296872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.297029 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dc559817-033d-4d18-bb56-8289d7df5db0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.106494 Oct 28 13:04:43.297320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.297953 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 395/749] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:43 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:43.381971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5bd415c-2e08-4409-964f-e75bebe35d8a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.102165 Oct 28 13:04:43.384708 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 355/750] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Oct 28 13:04:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:04:43.404240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:43.405095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:43.419222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.420040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.420819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.421956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.423451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.424063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.593422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:43.594100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:43.611524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.612034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.612477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.613201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.613668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.614157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.733250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:43.743786 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-988f164b-6f99-4aad-a405-98befe1d87c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1228 microversion: 2.1 time: 0.152997 Oct 28 13:04:43.745577 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 356/751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:43 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:43.786660 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bacee9e7-17e7-494d-add9-c94dc092c3cf tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d/action" status: 202 len: 0 microversion: 2.25 time: 0.392420 Oct 28 13:04:43.787693 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 396/752] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:04:43 2022] POST /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:04:43.804628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:43.807024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:43.830435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.830435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.830435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.830435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.830815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.830815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.935297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:43.947508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:43.950669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.952072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.952860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:43.954009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:43.954683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:43.955495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:44.071568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid d226cb64-78cc-4727-a90c-024cb6e5e87d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:44.101480 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8ffce88-abdc-4d79-a38e-50a832a9c83a tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 2055 microversion: 2.25 time: 0.306063 Oct 28 13:04:44.102487 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 357/753] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:43 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 2055 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:44.313123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9fce1835-101e-43ca-86fd-b11c6474a276 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9eee5e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:44.402066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9fce1835-101e-43ca-86fd-b11c6474a276 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.092767 Oct 28 13:04:44.410338 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 358/754] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:44 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:44.443387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:44.767513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:44.768486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:44.785009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:44.785883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:44.787284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:44.788206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:44.790670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:44.803250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.003129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:45.018668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:45.022798 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b0fe647-8719-4221-9322-d6b39dc661b2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 1.085666 Oct 28 13:04:45.029304 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51c7526a-99b5-4217-91c1-f4b21ed88593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1276 microversion: 2.1 time: 0.266179 Oct 28 13:04:45.040263 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 397/755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:43 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:45.051023 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 359/756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:44 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:45.130777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:45.131718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:45.143893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.144421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.146319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.147554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.149377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.152338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.339073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Calling method '.version_select at 0x7f27b9d9cf70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:45.340900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.341384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.341821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.385807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.386309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.386794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.423450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.425634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.426467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.448579 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c3851b9-70f0-46ed-9625-cc0b8f4abdc2 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.394611 Oct 28 13:04:45.453686 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 398/757] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:04:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:45.467486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4acad67f-f315-4095-8664-8b17dd085f3e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c80c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:45.608028 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4acad67f-f315-4095-8664-8b17dd085f3e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.155113 Oct 28 13:04:45.608815 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 399/758] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:45 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:45.631315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3eea363c-4d4b-44f2-930a-1cbc4843c34d req-a60b4990-d4dd-4c1c-9462-38d2d6c0c541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f24c67-2a68-4503-b970-023af509105c", "name": "network-vif-plugged", "status": "completed", "tag": "c1cc3ab6-4dba-4722-ab4c-0acee2b8276e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:45.659138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3eea363c-4d4b-44f2-930a-1cbc4843c34d req-a60b4990-d4dd-4c1c-9462-38d2d6c0c541 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.659795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3eea363c-4d4b-44f2-930a-1cbc4843c34d req-a60b4990-d4dd-4c1c-9462-38d2d6c0c541 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.660253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3eea363c-4d4b-44f2-930a-1cbc4843c34d req-a60b4990-d4dd-4c1c-9462-38d2d6c0c541 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.687667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3eea363c-4d4b-44f2-930a-1cbc4843c34d req-a60b4990-d4dd-4c1c-9462-38d2d6c0c541 service nova] Creating event network-vif-plugged:c1cc3ab6-4dba-4722-ab4c-0acee2b8276e for instance 50f24c67-2a68-4503-b970-023af509105c on n-h1-862876-2 Oct 28 13:04:45.700318 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3eea363c-4d4b-44f2-930a-1cbc4843c34d req-a60b4990-d4dd-4c1c-9462-38d2d6c0c541 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078556 Oct 28 13:04:45.702098 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 400/759] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:45.714690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Calling method '.version_select at 0x7f27ba1a0820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:45.716658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.719408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.719866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.778827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.780466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.781272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.822552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.823407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.824216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.842389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f1f9a076-8322-4610-87a4-8842c4cc0533 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-862876-2/servers" status: 200 len: 433 microversion: 2.1 time: 0.125064 Oct 28 13:04:45.843806 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 401/760] 10.222.0.25 () {58 vars in 1212 bytes} [Fri Oct 28 13:04:45 2022] GET /compute/v2.1/os-hypervisors/n-h2-862876-2/servers => generated 433 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:45.857237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Calling method '.version_select at 0x7f27b9e16ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:45.859564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.860276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.860923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.903010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.903854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.904499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.918732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.919588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.920247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.928303 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a775387-0466-459e-9ed0-09b91aedce68 tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075503 Oct 28 13:04:45.929660 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 402/761] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:04:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:04:45.942831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Calling method '.version_select at 0x7f27b9c7c670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:45.963670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.965448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.966186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:45.992930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:45.995917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:45.996569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.012511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c1285d3-364a-46f9-8dc1-ba636b0a7b5d tempest-HypervisorAdminUnderV252Test-1749986583 tempest-HypervisorAdminUnderV252Test-1749986583-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-862876-2/search" status: 200 len: 104 microversion: 2.1 time: 0.076064 Oct 28 13:04:46.015865 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 403/762] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Oct 28 13:04:45 2022] GET /compute/v2.1/os-hypervisors/n-h2-862876-2/search => generated 104 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:46.035621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:46.043764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:46.066077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.067186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.070388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.073064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.076964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.084200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.172863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:04:46.236809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid d226cb64-78cc-4727-a90c-024cb6e5e87d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:46.279538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:46.292122 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c25ebba-1b3c-4f9e-b708-a4b139448302 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 2035 microversion: 2.25 time: 1.164491 Oct 28 13:04:46.293377 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 360/763] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:45 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 2035 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:46.303927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:46.314336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:46.324689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.325587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.326321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.327279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.331643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.332361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.636925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-16532494-7361-4506-8da3-ad725c0816fa tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 204 len: 0 microversion: 2.1 time: 0.619497 Oct 28 13:04:46.637863 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 404/764] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:04:46 2022] DELETE /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:04:46.644011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:46.645112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:46.663660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.665523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.667233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.668220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.670240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.675633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.738484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:46.746602 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0ff7f53e-cd4e-4fb5-a890-422ae30fbbf2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 0.451880 Oct 28 13:04:46.764621 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 361/765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:46 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:46.779561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862876-2", "block_migration": "auto"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:46.782462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:46.807523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.807933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.808373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.809085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:46.809545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:46.809973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:46.860717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'flavor' on Instance uuid d226cb64-78cc-4727-a90c-024cb6e5e87d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:04:46.887146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Going to try to live migrate instance to n-h1-862876-2 {{(pid=127793) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:04:46.927465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:46.950935 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b91ca60-64c5-4e7d-be89-dfb54e62c919 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1282 microversion: 2.1 time: 0.300976 Oct 28 13:04:46.963457 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 405/766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:46 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1282 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:46.977212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-dcd46381-1a58-427c-8305-69c945d1944d req-d3ddb555-8478-4590-8a78-28ecbfbbde8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9256c7bc-6b0f-4ee2-8b7f-49e469b5127a", "tag": "bef23a34-6bb3-4569-b8b4-40868b46c510"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:47.000834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dcd46381-1a58-427c-8305-69c945d1944d req-d3ddb555-8478-4590-8a78-28ecbfbbde8a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:47.001662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dcd46381-1a58-427c-8305-69c945d1944d req-d3ddb555-8478-4590-8a78-28ecbfbbde8a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:47.003210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dcd46381-1a58-427c-8305-69c945d1944d req-d3ddb555-8478-4590-8a78-28ecbfbbde8a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:47.030928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:47.034764 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-dcd46381-1a58-427c-8305-69c945d1944d req-d3ddb555-8478-4590-8a78-28ecbfbbde8a service nova] Creating event network-changed:bef23a34-6bb3-4569-b8b4-40868b46c510 for instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a on n-h2-862876-2 Oct 28 13:04:47.045882 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-dcd46381-1a58-427c-8305-69c945d1944d req-d3ddb555-8478-4590-8a78-28ecbfbbde8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079888 Oct 28 13:04:47.050721 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 406/767] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:47.061186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d914ea0b-5d8e-44ad-99c1-a9e47c4addaa tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27ba0c55e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:47.172058 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d914ea0b-5d8e-44ad-99c1-a9e47c4addaa tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.119631 Oct 28 13:04:47.177002 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 407/768] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:47 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:47.193751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:47.195610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:47.244547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:47.245063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:47.245513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:47.252722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:47.254848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:47.255711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:47.702479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:47.722381 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28d89c36-a313-4103-88a7-d1351f3e8585 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1713 microversion: 2.1 time: 0.538304 Oct 28 13:04:47.741945 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 408/769] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:47 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1713 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:47.782007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:47.783173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:47.792218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:47.793224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:47.793873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:47.794819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:47.796540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:47.797257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:48.708224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:48.720789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9b35c9d5-5551-4048-8cda-247d7b3fc657 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 0.943536 Oct 28 13:04:48.722907 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 409/770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:47 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:04:48.734703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:48.737210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:48.755541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:48.756867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:48.757871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:48.767196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:48.769713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:48.772034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:49.369481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:49.377663 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-926b8412-bcca-4f37-a6b7-5d0afaae5aa8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.653478 Oct 28 13:04:49.399159 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 410/771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:48 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:49.420217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4067b5e2-df46-4850-8013-29fcf863392a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27ba0c55e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:49.560666 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4067b5e2-df46-4850-8013-29fcf863392a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.160185 Oct 28 13:04:49.561256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 411/772] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:49 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:49.582734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:49.597790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:49.619280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:49.619799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:49.620247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:49.620982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:49.621441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:49.621869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:50.075870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:50.085488 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c21ad064-8986-421e-a771-f82e9adcfaa3 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1713 microversion: 2.1 time: 0.506542 Oct 28 13:04:50.096142 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 412/773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:49 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1713 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:50.105221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-311b1ed2-7fc7-4e99-ba8f-beb9352fb405 req-d3226001-7c3d-4979-9fa7-a65f2b0e0792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e87c31-9974-410f-9f71-0b6b1be84b79", "tag": "430649f6-ff29-40ac-a6de-de056f65aa53"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:50.152690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-311b1ed2-7fc7-4e99-ba8f-beb9352fb405 req-d3226001-7c3d-4979-9fa7-a65f2b0e0792 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:50.155476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-311b1ed2-7fc7-4e99-ba8f-beb9352fb405 req-d3226001-7c3d-4979-9fa7-a65f2b0e0792 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:50.155931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-311b1ed2-7fc7-4e99-ba8f-beb9352fb405 req-d3226001-7c3d-4979-9fa7-a65f2b0e0792 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:50.189975 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-311b1ed2-7fc7-4e99-ba8f-beb9352fb405 req-d3226001-7c3d-4979-9fa7-a65f2b0e0792 service nova] Creating event network-changed:430649f6-ff29-40ac-a6de-de056f65aa53 for instance 28e87c31-9974-410f-9f71-0b6b1be84b79 on n-h2-862876-2 Oct 28 13:04:50.201077 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-311b1ed2-7fc7-4e99-ba8f-beb9352fb405 req-d3226001-7c3d-4979-9fa7-a65f2b0e0792 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103717 Oct 28 13:04:50.204942 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 413/774] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:50.215565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:50.222307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:50.235610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:50.236646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:50.237324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:50.239245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:50.251390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:50.251390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:50.778017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:50.804330 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2262daf8-3a33-4dbd-8b21-faeb47ec4e2e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 0.589169 Oct 28 13:04:50.805240 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 414/775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:50 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:50.830627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:50.831692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:50.843057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:50.847004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:50.847817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:50.848788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:50.849494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:50.850142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:51.115758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:51.608935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:51.620302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-94650de0-f479-4ca5-bf36-00649d856116 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.805524 Oct 28 13:04:51.634772 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 415/776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:50 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:51.640859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57dc182a-109b-45fd-80c1-8929b163641d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9cad280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:51.757573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57dc182a-109b-45fd-80c1-8929b163641d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.132539 Oct 28 13:04:51.760585 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 416/777] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:51 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:51.769526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:51.770839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:51.783477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:51.784887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:51.788970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:51.790016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:51.791469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:51.792142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:52.086152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148f8a3614e048a1b858f2c9744d0a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3532105a140fdbaf84b5b2ffad712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:52.095540 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e39d06e-cf77-4f29-8d80-38f81ff12fe2 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 200 len: 1645 microversion: 2.1 time: 0.333356 Oct 28 13:04:52.112374 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 417/778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:51 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 1645 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:52.112374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a177547c-4ebd-4961-bb2b-eddbeefa0e36 req-fd58bfec-3112-47c2-b6ea-2850d19a450b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7618262d-4e39-4c6a-b425-6165b9aaf627", "tag": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:52.132526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a177547c-4ebd-4961-bb2b-eddbeefa0e36 req-fd58bfec-3112-47c2-b6ea-2850d19a450b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:52.133855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a177547c-4ebd-4961-bb2b-eddbeefa0e36 req-fd58bfec-3112-47c2-b6ea-2850d19a450b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:52.134334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a177547c-4ebd-4961-bb2b-eddbeefa0e36 req-fd58bfec-3112-47c2-b6ea-2850d19a450b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:52.159712 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a177547c-4ebd-4961-bb2b-eddbeefa0e36 req-fd58bfec-3112-47c2-b6ea-2850d19a450b service nova] Creating event network-changed:bd85d46b-11f3-4fb4-9a98-d233d1c433c5 for instance 7618262d-4e39-4c6a-b425-6165b9aaf627 on n-h1-862876-2 Oct 28 13:04:52.169586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a177547c-4ebd-4961-bb2b-eddbeefa0e36 req-fd58bfec-3112-47c2-b6ea-2850d19a450b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068508 Oct 28 13:04:52.172644 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 418/779] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:52.190788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:52.191720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:52.221194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:52.221194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:52.221194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:52.221194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:52.224123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:52.224646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:52.562250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=34 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:52.867299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:52.889116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9b000858-3503-4b02-93c3-95eee7c85e28 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 0.712512 Oct 28 13:04:52.890506 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 419/780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:52 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:52.991832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-401777029", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:53.110266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:04:53.331586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:53.767831 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef264499-40b4-4865-b188-862d0a1377ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d/action" status: 202 len: 0 microversion: 2.25 time: 7.003292 Oct 28 13:04:53.772846 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 362/781] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:04:46 2022] POST /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d/action => generated 0 bytes in 7005 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:04:53.776527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:53.777372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:53.795993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:53.801127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:53.803219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:53.805006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:53.830809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:53.830809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.184071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:04:54.186417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:04:54.187305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:04:54.188152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:04:54.188745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:04:54.217130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.221510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.222236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.225056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.226318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.227291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.289679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Getting quotas for project ca58f2828860400da616cba8da1c1a8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:54.292047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:54.301902 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-34e6dc7f-b57f-4a8e-9493-bd906d4a0bdd tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.531188 Oct 28 13:04:54.302581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Getting quotas for user e35d20fe60484d11982fd061614dbf54 and project ca58f2828860400da616cba8da1c1a8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:54.306409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 363/782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:53 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:54.321250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07bf02e3-621c-451b-8971-611579944641 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9d78820>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:54.321642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:54.329161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:04:54.337223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:04:54.417831 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07bf02e3-621c-451b-8971-611579944641 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.110132 Oct 28 13:04:54.427849 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 364/783] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:54 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:54.444107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:54.453610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:54.472206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.473213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.473901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.476721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.477526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.479408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.518369 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] HTTP exception thrown: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Request method failure captured: Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 HTTP/1.1 Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LoIBxgbLzfqaTAc3e3GYji44QO51DyuRkESPnBxf0CJkQZKTp6t3sGztXvjkbrcF506Cba-WeFVCP2xmeCncfvvfZyxFkmvP7gPr3SbRrKkJHXRKQbFlrNeO7KHovN8t3dBluKKfS1VkHz4OENujtk-9311Gt3pc2DQTW9XHqIIC4 Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:54.533127 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23e3532105a140fdbaf84b5b2ffad712", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 148f8a3614e048a1b858f2c9744d0a6e Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:04:54.534562 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '26cda74e-b1b2-45c9-b774-721ee27c2187'} Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:54.535384 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:04:54.536598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:54.544648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Returning 404 to user: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:54.544648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00275739-7f2e-4ee6-b663-035a939d94fc tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 404 len: 111 microversion: 2.1 time: 0.095228 Oct 28 13:04:54.544648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 365/784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:54 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:54.549474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:54.555790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:54.557971 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-874fcb68-42df-454a-ba19-8a99ea998bb9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.658190 Oct 28 13:04:54.559822 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 420/785] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:04:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:04:54.572773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:54.579878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:54.592544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.593168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:04:54.597536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.598169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.599240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.599866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.601175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.601806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.616305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.616900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:54.620586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:54.621401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:54.630273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.089734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:55.137802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:55.139322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:55.147132 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5df9e559-c3f2-48e6-8cf5-5b4101da63a4 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.602251 Oct 28 13:04:55.173171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 366/786] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:54 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:55.179547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4a1dc808-47df-4a25-a85f-d82a5cb96c3d req-04ff3bac-c25e-42d0-bfcd-8a0c381035ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cda74e-b1b2-45c9-b774-721ee27c2187", "name": "network-vif-deleted", "tag": "e28a0faa-c9a2-4eb6-8405-1897598332db"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:55.209281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4a1dc808-47df-4a25-a85f-d82a5cb96c3d req-04ff3bac-c25e-42d0-bfcd-8a0c381035ec service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.213126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4a1dc808-47df-4a25-a85f-d82a5cb96c3d req-04ff3bac-c25e-42d0-bfcd-8a0c381035ec service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.213126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4a1dc808-47df-4a25-a85f-d82a5cb96c3d req-04ff3bac-c25e-42d0-bfcd-8a0c381035ec service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.226861 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4a1dc808-47df-4a25-a85f-d82a5cb96c3d req-04ff3bac-c25e-42d0-bfcd-8a0c381035ec service nova] Creating event network-vif-deleted:e28a0faa-c9a2-4eb6-8405-1897598332db for instance 26cda74e-b1b2-45c9-b774-721ee27c2187 on n-h2-862876-2 Oct 28 13:04:55.232805 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4a1dc808-47df-4a25-a85f-d82a5cb96c3d req-04ff3bac-c25e-42d0-bfcd-8a0c381035ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057398 Oct 28 13:04:55.234529 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 367/787] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:55.240783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:55.242214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:55.252391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.253343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.254020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.255277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.256098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.256865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.274435 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] HTTP exception thrown: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Request method failure captured: Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 HTTP/1.1 Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9LoIBxgbLzfqaTAc3e3GYji44QO51DyuRkESPnBxf0CJkQZKTp6t3sGztXvjkbrcF506Cba-WeFVCP2xmeCncfvvfZyxFkmvP7gPr3SbRrKkJHXRKQbFlrNeO7KHovN8t3dBluKKfS1VkHz4OENujtk-9311Gt3pc2DQTW9XHqIIC4 Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:55.277602 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23e3532105a140fdbaf84b5b2ffad712", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 148f8a3614e048a1b858f2c9744d0a6e Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.279070 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'a69e5a01-bef1-4cb9-91d4-63e5124edbb3'} Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:55.279841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.281107 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.284322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Returning 404 to user: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:55.285421 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-02348535-4153-4268-9d15-eb98ceb5768d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 404 len: 111 microversion: 2.1 time: 0.049562 Oct 28 13:04:55.291102 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 368/788] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:04:55 2022] DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:55.299220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-131752435", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:55.381901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:04:55.738185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:04:55.739310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:04:55.759890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:04:55.759890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:04:55.759890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:04:55.759890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.759890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.760631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.760631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.760631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.760631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.779255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Getting quotas for project ca58f2828860400da616cba8da1c1a8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:55.803274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Getting quotas for user e35d20fe60484d11982fd061614dbf54 and project ca58f2828860400da616cba8da1c1a8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:55.837149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:04:55.837149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:04:55.839066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:55.843513 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50d4e0a8-a360-456c-b5f0-df08f17c9a7e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 1.280734 Oct 28 13:04:55.848376 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 421/789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:54 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:55.867059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:55.870225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:55.887977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.890538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.891201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.894022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.894777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.897330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.929643 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] HTTP exception thrown: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Request method failure captured: Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 HTTP/1.1 Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LoIBxgbLzfqaTAc3e3GYji44QO51DyuRkESPnBxf0CJkQZKTp6t3sGztXvjkbrcF506Cba-WeFVCP2xmeCncfvvfZyxFkmvP7gPr3SbRrKkJHXRKQbFlrNeO7KHovN8t3dBluKKfS1VkHz4OENujtk-9311Gt3pc2DQTW9XHqIIC4 Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:04:55.937854 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23e3532105a140fdbaf84b5b2ffad712", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 148f8a3614e048a1b858f2c9744d0a6e Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.939533 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a69e5a01-bef1-4cb9-91d4-63e5124edbb3'} Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:55.940387 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:04:55.941856 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:55.946698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Returning 404 to user: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:55.948484 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e799b5e-46e2-4121-9d55-0df866bea41d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 404 len: 111 microversion: 2.1 time: 0.096895 Oct 28 13:04:55.949311 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 422/790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:55 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:55.957045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:55.963912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:55.976671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.977517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.978225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:55.979324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:55.979987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:55.980566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:56.175966 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-abd2473b-c464-4ec5-9417-01533d1e2efd tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883468 Oct 28 13:04:56.178928 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 369/791] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:04:56.188382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-03fca838-a683-482f-bd09-a7eb8b5de83f tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9cc10d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:56.312744 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-03fca838-a683-482f-bd09-a7eb8b5de83f tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.131865 Oct 28 13:04:56.314926 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 370/792] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:56 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:56.315547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:56.325967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc5325f2-70a9-43c9-b9db-bb1b71691432 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '.version_select at 0x7f27b9f9bca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:56.334586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-90dd56dd-ca0c-487b-b5cb-d25325f8c2a6 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.371325 Oct 28 13:04:56.335554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 423/793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:55 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:56.437266 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc5325f2-70a9-43c9-b9db-bb1b71691432 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932122644" status: 202 len: 0 microversion: 2.1 time: 0.119606 Oct 28 13:04:56.438212 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 371/794] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:04:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932122644 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:04:56.443529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:56.444371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:56.467297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:56.472113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:56.473769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:56.479353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:56.482556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:56.483855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:56.989923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b2be145-d8a5-44aa-9a77-2105dcad9d71 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Action: 'create', calling method: .version_select at 0x7f27baf3bee0>, body: {"keypair": {"name": "tempest-keypair-559877595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvmT5paQkLEmZKn37Ua1P3fr8CNeBNuP5DhpYjwk+szQfMAkQPlYmCpuGlLUjs8g4pl2jgb7xVyDszfy0DUGp6P+bwRUHK0l/iLNs0iWmmQoCuwLBaNCJdwdXEFbOzk/A=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:57.035037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1b2be145-d8a5-44aa-9a77-2105dcad9d71 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Getting quotas for project 95b7cf075cae49ae838a0f75ca04b41a. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:04:57.051661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1b2be145-d8a5-44aa-9a77-2105dcad9d71 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Getting quotas for user c9bf2f7d1cdc47ed83175f036a574ca0 and project 95b7cf075cae49ae838a0f75ca04b41a. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:04:57.098336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:57.116723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:57.120361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:57.121900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3b03125-6cb4-4c06-8f3f-eeced96a5d81 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.682524 Oct 28 13:04:57.150322 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 372/795] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:56 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:04:57.155827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9f3b4421-b21d-4488-adf7-08aa221c1d53 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:57.156471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9f3b4421-b21d-4488-adf7-08aa221c1d53 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:57.236572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9f3b4421-b21d-4488-adf7-08aa221c1d53 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:57.246232 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9f3b4421-b21d-4488-adf7-08aa221c1d53 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1213 microversion: 2.1 time: 0.094427 Oct 28 13:04:57.260225 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 373/796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:57 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:57.267464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:57.269520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:57.286584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:57.287115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:57.287901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:57.288324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:57.288771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:57.289196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:57.339122 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b2be145-d8a5-44aa-9a77-2105dcad9d71 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.998327 Oct 28 13:04:57.340055 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 424/797] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:04:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:57.345646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b6ae98d6-0ac1-40fb-b90d-7eb01de3f1e4 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9e92e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:57.549579 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b6ae98d6-0ac1-40fb-b90d-7eb01de3f1e4 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.208248 Oct 28 13:04:57.551093 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 425/798] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:57 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:57.565090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:57.565821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:57.578656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:57.580876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:57.581582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:57.583017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:57.588854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:57.589606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:57.752548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:57.763828 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25865979-ab68-4934-a98a-fcc10c12f6e8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 0.507899 Oct 28 13:04:57.772180 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 374/799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:57 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:58.155884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:58.158693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:58.173130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:58.175244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:58.175991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:58.177448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:58.178137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:58.179288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:58.419119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:58.427870 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-84da8272-b6af-477c-975b-7a60e2009d33 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.875656 Oct 28 13:04:58.441812 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 426/800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:57 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:58.447427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:58.452795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:58.458551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:58.472442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:58.473742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:58.474243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:58.475874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:58.477373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c2453de-4482-405c-aee0-d403e4a02965 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.327965 Oct 28 13:04:58.480354 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 375/801] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:58 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:04:58.482720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:58.483512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:58.484152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:58.484777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:58.572700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b920359b-0a59-426d-bea7-3df0a6294279 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9fb4d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:58.624724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:58.638662 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97f3bb89-dce2-4700-a599-4611befdaaee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1217 microversion: 2.1 time: 0.195453 Oct 28 13:04:58.644157 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 427/802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:58 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:58.678802 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b920359b-0a59-426d-bea7-3df0a6294279 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.114471 Oct 28 13:04:58.679109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 376/803] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:04:58 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:58.686656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8831a1a2-67ed-4041-952c-d1731aff1640 req-dd6ca953-11b1-4df9-a676-2badc324a34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9256c7bc-6b0f-4ee2-8b7f-49e469b5127a", "name": "network-vif-plugged", "status": "completed", "tag": "bef23a34-6bb3-4569-b8b4-40868b46c510"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:04:58.701121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8831a1a2-67ed-4041-952c-d1731aff1640 req-dd6ca953-11b1-4df9-a676-2badc324a34d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:58.702068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8831a1a2-67ed-4041-952c-d1731aff1640 req-dd6ca953-11b1-4df9-a676-2badc324a34d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:58.703087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8831a1a2-67ed-4041-952c-d1731aff1640 req-dd6ca953-11b1-4df9-a676-2badc324a34d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:58.725955 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8831a1a2-67ed-4041-952c-d1731aff1640 req-dd6ca953-11b1-4df9-a676-2badc324a34d service nova] Creating event network-vif-plugged:bef23a34-6bb3-4569-b8b4-40868b46c510 for instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a on n-h2-862876-2 Oct 28 13:04:58.734125 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8831a1a2-67ed-4041-952c-d1731aff1640 req-dd6ca953-11b1-4df9-a676-2badc324a34d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051210 Oct 28 13:04:58.735754 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 377/804] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:04:58.799332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:58.802001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:58.816055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:58.816916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:58.819424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:58.820474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:58.821105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:58.823853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:58.922700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77f35c34-95fa-40c8-ad80-bff40be276e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:58.925826 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-77f35c34-95fa-40c8-ad80-bff40be276e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77f35c34-95fa-40c8-ad80-bff40be276e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085-project-admin] Request method failure captured: Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9N6xMkY1ZooszSrPu5oEdB2ub-pHWkJlpp9rc3zdC9N0a5Wqhl0xlUG3aQsFG6mz-NuwDjCl8V7LxomEP4UQY-uzPhVKl8ce3HCBNKG8IR4uMtJuPu2U73MjuK8c27Yzpyx3rwgQsAeEdS9pb5hUegJADTSYrSqqeHCM_lwf1StJlI Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f36df0116b54352bf494fd8344765a9 Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:04:58.936995 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f36df0116b54352bf494fd8344765a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f36df0116b54352bf494fd8344765a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f36df0116b54352bf494fd8344765a9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f36df0116b54352bf494fd8344765a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f36df0116b54352bf494fd8344765a9 Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085-project-admin Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 692a02b8ecd24701988dbd7e01165ae5 Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085-project-admin Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:04:58.938628 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid timestamp for date invalid_time Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'invalid_time'} Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:58.939519 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77f35c34-95fa-40c8-ad80-bff40be276e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:58.940871 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77f35c34-95fa-40c8-ad80-bff40be276e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085 tempest-InstanceUsageAuditLogNegativeTestJSON-1108921085-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.298219 Oct 28 13:04:58.941827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 428/805] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Oct 28 13:04:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 300 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:04:59.136325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:59.146076 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f1731f7-0dbd-4b0e-9849-e798b36d4476 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 0.356062 Oct 28 13:04:59.155862 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 378/806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:58 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:04:59.167442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbcd19cc-5d7d-40b2-9caa-9e93ce884a98 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:59.169635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cbcd19cc-5d7d-40b2-9caa-9e93ce884a98 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '2a0833d8bf3543068b13846d502c8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7ce992514342b99dccf56b95cba1ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbcd19cc-5d7d-40b2-9caa-9e93ce884a98 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Request method failure captured: Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9N4IPHNOKiLAcpAbFMf6EAEI8_yreBdJywCwo1rNDoaJil0J_-T7hE4PeYYwBy9Th84IFZ-bWF26HQ7IA-QAYeptjubGmvtIlvu6SmFU6k8Pi9i7Qbuzerv2oHfEs7cwXAGZ-szPTHWfKG8VxyqGqU0uFuvn4RFaym0A14Vvzs8yZQ Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: ad7ce992514342b99dccf56b95cba1ae Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:04:59.173351 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad7ce992514342b99dccf56b95cba1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad7ce992514342b99dccf56b95cba1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad7ce992514342b99dccf56b95cba1ae", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad7ce992514342b99dccf56b95cba1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: ad7ce992514342b99dccf56b95cba1ae Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2a0833d8bf3543068b13846d502c8c33 Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project Oct 28 13:04:59.175065 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: action_args: {} Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:04:59.175866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 13:04:59.177281 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:04:59.178516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbcd19cc-5d7d-40b2-9caa-9e93ce884a98 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:59.178516 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cbcd19cc-5d7d-40b2-9caa-9e93ce884a98 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.224938 Oct 28 13:04:59.179559 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 429/807] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Oct 28 13:04:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 233 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:04:59.189118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1d1d57d-6b2e-4e8f-9747-0dff72d07a91 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:59.191044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a1d1d57d-6b2e-4e8f-9747-0dff72d07a91 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '2a0833d8bf3543068b13846d502c8c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7ce992514342b99dccf56b95cba1ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1d1d57d-6b2e-4e8f-9747-0dff72d07a91 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Request method failure captured: Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2013:04:59 HTTP/1.1 Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9N4IPHNOKiLAcpAbFMf6EAEI8_yreBdJywCwo1rNDoaJil0J_-T7hE4PeYYwBy9Th84IFZ-bWF26HQ7IA-QAYeptjubGmvtIlvu6SmFU6k8Pi9i7Qbuzerv2oHfEs7cwXAGZ-szPTHWfKG8VxyqGqU0uFuvn4RFaym0A14Vvzs8yZQ Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: ad7ce992514342b99dccf56b95cba1ae Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:04:59.193060 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad7ce992514342b99dccf56b95cba1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad7ce992514342b99dccf56b95cba1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad7ce992514342b99dccf56b95cba1ae", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad7ce992514342b99dccf56b95cba1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: ad7ce992514342b99dccf56b95cba1ae Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2a0833d8bf3543068b13846d502c8c33 Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project Oct 28 13:04:59.194435 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '2022-10-28 13:04:59'} Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:04:59.195175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 13:04:59.196405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:04:59.198161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1d1d57d-6b2e-4e8f-9747-0dff72d07a91 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:04:59.198161 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1d1d57d-6b2e-4e8f-9747-0dff72d07a91 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946 tempest-InstanceUsageAuditLogNegativeTestJSON-1125156946-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 13:04:59" status: 403 len: 128 microversion: 2.1 time: 0.010552 Oct 28 13:04:59.198161 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 379/808] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:04:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2013%3A04%3A59 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:04:59.469125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:59.469746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:59.488825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:59.488825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:59.488825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:59.488825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:59.489545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:59.489545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:59.508224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:04:59.508848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:04:59.535344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:59.536277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:59.538240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:59.544486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:04:59.546501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:04:59.546985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:04:59.964717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:59.976935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:59.985964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:04:59.987379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0b5dcaae-b644-4b66-bd27-de65b0bb138c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.483574 Oct 28 13:04:59.996124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 380/809] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:04:59 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:05:00.014460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:00.016429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:00.036866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:00.037394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:00.037840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:00.038569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:00.049794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:00.050273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:00.194033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:00.212000 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6866cfb2-d8ce-419c-a22d-3373b9a58413 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1265 microversion: 2.1 time: 0.214027 Oct 28 13:05:00.214484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 381/810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:59 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:00.220653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9fed192-2ea2-47c7-bf1b-f6f5b781d163 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9ac0ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:00.393147 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f9fed192-2ea2-47c7-bf1b-f6f5b781d163 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.176143 Oct 28 13:05:00.394069 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 382/811] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:00 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:00.431933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3a4ed6d5-1b48-40a9-8d6a-963e8975bcef req-bd02f126-cc61-4d02-92f2-57a8d453e8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d226cb64-78cc-4727-a90c-024cb6e5e87d", "name": "network-vif-unplugged", "status": "completed", "tag": "8ac23d6b-995f-4a03-8e2c-3436bb2388b1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:00.453907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3a4ed6d5-1b48-40a9-8d6a-963e8975bcef req-bd02f126-cc61-4d02-92f2-57a8d453e8fd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:00.455331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3a4ed6d5-1b48-40a9-8d6a-963e8975bcef req-bd02f126-cc61-4d02-92f2-57a8d453e8fd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:00.456021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3a4ed6d5-1b48-40a9-8d6a-963e8975bcef req-bd02f126-cc61-4d02-92f2-57a8d453e8fd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:00.476539 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3a4ed6d5-1b48-40a9-8d6a-963e8975bcef req-bd02f126-cc61-4d02-92f2-57a8d453e8fd service nova] Creating event network-vif-unplugged:8ac23d6b-995f-4a03-8e2c-3436bb2388b1 for instance d226cb64-78cc-4727-a90c-024cb6e5e87d on n-h2-862876-2 Oct 28 13:05:00.486307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3a4ed6d5-1b48-40a9-8d6a-963e8975bcef req-bd02f126-cc61-4d02-92f2-57a8d453e8fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077381 Oct 28 13:05:00.487670 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 383/812] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:00.494542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:00.496291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:00.510013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:00.522392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:00.523223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:00.523858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:00.524070 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9332175f-810d-4e3f-8a62-0e68a3ea009b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 1.060301 Oct 28 13:05:00.525284 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 430/813] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:04:59 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:00.553857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:00.554506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:00.559549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:00.881840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b98f5688-86b2-478c-80b8-3d630f495251 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:01.048512 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b98f5688-86b2-478c-80b8-3d630f495251 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/785436589" status: 202 len: 0 microversion: 2.1 time: 0.171803 Oct 28 13:05:01.053892 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 431/814] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:05:00 2022] DELETE /compute/v2.1/flavors/785436589 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:05:01.059333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:01.060242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:01.074657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:01.075500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:01.076329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:01.078269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:01.080705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:01.081380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:01.472784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:01.488320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:01.494705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:01.496009 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-162be34c-5323-446c-ab4f-cd00aa5369ec tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.441278 Oct 28 13:05:01.503669 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 432/815] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:01 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:01.511230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c4c4bb9-7c4c-4504-bb65-8c5ba5cd6cd3 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:01.561481 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c4c4bb9-7c4c-4504-bb65-8c5ba5cd6cd3 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.056403 Oct 28 13:05:01.562088 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 433/816] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:05:01 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:01.582125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2e7e44af-0432-46a9-b2f5-ded00ae18c61 req-96b4a42f-e25e-42f0-a8ac-dc27ed068864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e87c31-9974-410f-9f71-0b6b1be84b79", "name": "network-vif-plugged", "status": "completed", "tag": "430649f6-ff29-40ac-a6de-de056f65aa53"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:01.620280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2e7e44af-0432-46a9-b2f5-ded00ae18c61 req-96b4a42f-e25e-42f0-a8ac-dc27ed068864 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:01.622664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2e7e44af-0432-46a9-b2f5-ded00ae18c61 req-96b4a42f-e25e-42f0-a8ac-dc27ed068864 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:01.622664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2e7e44af-0432-46a9-b2f5-ded00ae18c61 req-96b4a42f-e25e-42f0-a8ac-dc27ed068864 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:01.646256 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2e7e44af-0432-46a9-b2f5-ded00ae18c61 req-96b4a42f-e25e-42f0-a8ac-dc27ed068864 service nova] Creating event network-vif-plugged:430649f6-ff29-40ac-a6de-de056f65aa53 for instance 28e87c31-9974-410f-9f71-0b6b1be84b79 on n-h2-862876-2 Oct 28 13:05:01.663482 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2e7e44af-0432-46a9-b2f5-ded00ae18c61 req-96b4a42f-e25e-42f0-a8ac-dc27ed068864 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089104 Oct 28 13:05:01.671167 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 434/817] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:01.684574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:01.685403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:01.696581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:01.696581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:01.696581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:01.696581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:01.697433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:01.697433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:01.871955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:01.880200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:01.884706 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75eb337c-86cd-4890-a830-646fe2d6ca8f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1271 microversion: 2.1 time: 0.212075 Oct 28 13:05:01.885365 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 435/818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:01 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:01.915152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-988b77c2-6bef-4820-8ff6-e3d3132c4604 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27ba117b80>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:01.991250 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-988b77c2-6bef-4820-8ff6-e3d3132c4604 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.104723 Oct 28 13:05:01.994976 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 436/819] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:01 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:02.015158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.016562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:02.034201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.037930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.040082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.042224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.047834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.048300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.189208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:02.215133 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2cb11ad1-f9f7-46b1-ab39-0b13d8066bac tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 1.725862 Oct 28 13:05:02.237902 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 384/820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:00 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:02.254237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d5b5a1c-4988-4607-8c45-2e7a273d896b tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.389117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:02.396598 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d5b5a1c-4988-4607-8c45-2e7a273d896b tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1865344413" status: 202 len: 0 microversion: 2.1 time: 0.160300 Oct 28 13:05:02.397195 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 385/821] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:05:02 2022] DELETE /compute/v2.1/flavors/1865344413 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:05:02.410239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dd147370-a50b-4d68-81a1-78ad2894e896 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.414777 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30305e6e-fa94-4372-82ae-693e7af1966b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.416855 Oct 28 13:05:02.438114 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 437/822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:01 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:02.462947 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dd147370-a50b-4d68-81a1-78ad2894e896 tempest-ServersWithSpecificFlavorTestJSON-1197070556 tempest-ServersWithSpecificFlavorTestJSON-1197070556-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057925 Oct 28 13:05:02.463826 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 386/823] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:05:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:02.499357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.500236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:02.516555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.518057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.523977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.524919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:02.530489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.532443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.535164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.536618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.536900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.539497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.540152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.541725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.543291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.544650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.586186 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] HTTP exception thrown: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Request method failure captured: Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 HTTP/1.1 Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LoIBxgbLzfqaTAc3e3GYji44QO51DyuRkESPnBxf0CJkQZKTp6t3sGztXvjkbrcF506Cba-WeFVCP2xmeCncfvvfZyxFkmvP7gPr3SbRrKkJHXRKQbFlrNeO7KHovN8t3dBluKKfS1VkHz4OENujtk-9311Gt3pc2DQTW9XHqIIC4 Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:05:02.596335 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23e3532105a140fdbaf84b5b2ffad712", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 148f8a3614e048a1b858f2c9744d0a6e Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.597758 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '26cda74e-b1b2-45c9-b774-721ee27c2187'} Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:02.598479 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.599823 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.602269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Returning 404 to user: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:02.604583 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-61e8666e-22f4-4f7c-94fc-80871ac96534 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 404 len: 111 microversion: 2.1 time: 0.108879 Oct 28 13:05:02.610338 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 438/824] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:05:02 2022] DELETE /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:02.620402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.632334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: 26cda74e-b1b2-45c9-b774-721ee27c2187] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:02.639747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.644116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.645179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.646674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.652568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.653710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.686990 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] HTTP exception thrown: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Request method failure captured: Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 HTTP/1.1 Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LoIBxgbLzfqaTAc3e3GYji44QO51DyuRkESPnBxf0CJkQZKTp6t3sGztXvjkbrcF506Cba-WeFVCP2xmeCncfvvfZyxFkmvP7gPr3SbRrKkJHXRKQbFlrNeO7KHovN8t3dBluKKfS1VkHz4OENujtk-9311Gt3pc2DQTW9XHqIIC4 Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:05:02.689594 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23e3532105a140fdbaf84b5b2ffad712", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 148f8a3614e048a1b858f2c9744d0a6e Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.691110 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '26cda74e-b1b2-45c9-b774-721ee27c2187'} Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:02.691914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. Oct 28 13:05:02.693063 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.696177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Returning 404 to user: Instance 26cda74e-b1b2-45c9-b774-721ee27c2187 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:02.697370 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-300803ea-c758-44d9-9c6b-69178fd96dc0 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187" status: 404 len: 111 microversion: 2.1 time: 0.086900 Oct 28 13:05:02.698502 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 439/825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:02 2022] GET /compute/v2.1/servers/26cda74e-b1b2-45c9-b774-721ee27c2187 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:02.709122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.715840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:02.731695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.732542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.733257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.734215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.734868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.736026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.760111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] HTTP exception thrown: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Request method failure captured: Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 HTTP/1.1 Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LoIBxgbLzfqaTAc3e3GYji44QO51DyuRkESPnBxf0CJkQZKTp6t3sGztXvjkbrcF506Cba-WeFVCP2xmeCncfvvfZyxFkmvP7gPr3SbRrKkJHXRKQbFlrNeO7KHovN8t3dBluKKfS1VkHz4OENujtk-9311Gt3pc2DQTW9XHqIIC4 Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:05:02.761747 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23e3532105a140fdbaf84b5b2ffad712", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 148f8a3614e048a1b858f2c9744d0a6e Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.763992 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a69e5a01-bef1-4cb9-91d4-63e5124edbb3'} Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:02.765765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.767724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.770374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Returning 404 to user: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:02.770374 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be11e59f-24e8-46d7-aef9-e66943935f27 tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 404 len: 111 microversion: 2.1 time: 0.059623 Oct 28 13:05:02.770374 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 440/826] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:05:02 2022] DELETE /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:02.772021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b533cf51-0b4a-40f8-910a-82f5ce5e3bf4 req-20c14a0d-27bb-4655-af28-0b5729c4f6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d226cb64-78cc-4727-a90c-024cb6e5e87d", "tag": "8ac23d6b-995f-4a03-8e2c-3436bb2388b1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:02.791871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b533cf51-0b4a-40f8-910a-82f5ce5e3bf4 req-20c14a0d-27bb-4655-af28-0b5729c4f6dc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.791871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b533cf51-0b4a-40f8-910a-82f5ce5e3bf4 req-20c14a0d-27bb-4655-af28-0b5729c4f6dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.791871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b533cf51-0b4a-40f8-910a-82f5ce5e3bf4 req-20c14a0d-27bb-4655-af28-0b5729c4f6dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.799686 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b533cf51-0b4a-40f8-910a-82f5ce5e3bf4 req-20c14a0d-27bb-4655-af28-0b5729c4f6dc service nova] Creating event network-changed:8ac23d6b-995f-4a03-8e2c-3436bb2388b1 for instance d226cb64-78cc-4727-a90c-024cb6e5e87d on n-h2-862876-2 Oct 28 13:05:02.808200 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b533cf51-0b4a-40f8-910a-82f5ce5e3bf4 req-20c14a0d-27bb-4655-af28-0b5729c4f6dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041123 Oct 28 13:05:02.820078 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 441/827] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:02.833544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.834261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] [instance: a69e5a01-bef1-4cb9-91d4-63e5124edbb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:02.847591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.849523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.850192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.851450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.852635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.853383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.891825 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] HTTP exception thrown: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Request method failure captured: Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 HTTP/1.1 Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9LoIBxgbLzfqaTAc3e3GYji44QO51DyuRkESPnBxf0CJkQZKTp6t3sGztXvjkbrcF506Cba-WeFVCP2xmeCncfvvfZyxFkmvP7gPr3SbRrKkJHXRKQbFlrNeO7KHovN8t3dBluKKfS1VkHz4OENujtk-9311Gt3pc2DQTW9XHqIIC4 Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:05:02.893351 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23e3532105a140fdbaf84b5b2ffad712", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23e3532105a140fdbaf84b5b2ffad712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 23e3532105a140fdbaf84b5b2ffad712 Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632 Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 148f8a3614e048a1b858f2c9744d0a6e Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-661610632-project Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.894894 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a69e5a01-bef1-4cb9-91d4-63e5124edbb3'} Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:02.895739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. Oct 28 13:05:02.897237 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:02.898617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] Returning 404 to user: Instance a69e5a01-bef1-4cb9-91d4-63e5124edbb3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:02.899173 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5ea6950-2d61-406c-bb98-a09fd63e6d9d tempest-ServersWithSpecificFlavorTestJSON-661610632 tempest-ServersWithSpecificFlavorTestJSON-661610632-project] 10.222.0.25 "GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3" status: 404 len: 111 microversion: 2.1 time: 0.076107 Oct 28 13:05:02.900511 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 442/828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:02 2022] GET /compute/v2.1/servers/a69e5a01-bef1-4cb9-91d4-63e5124edbb3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:02.909613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:02.910371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:02.917253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.917924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.918527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:02.919306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:02.920019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:02.920464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:03.092682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:03.106405 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25d4dd98-0c69-49e2-8ccc-b04f76ffb4e5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1271 microversion: 2.1 time: 0.201030 Oct 28 13:05:03.107282 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 443/829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:02 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:03.116167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a880c66-5905-4b01-9c0e-a23c802537dc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9fb5310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:03.211789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a880c66-5905-4b01-9c0e-a23c802537dc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.101330 Oct 28 13:05:03.220327 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 444/830] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:03 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:03.246460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:03.247254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:03.260647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:03.261537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:03.262018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:03.263117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:03.263607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:03.264145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:03.390642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:03.426544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:03.439646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:03.441044 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ccd9b1fd-c8b5-44c7-9cc0-e85b914d31ac tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.921090 Oct 28 13:05:03.443354 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 387/831] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:02 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:05:03.465849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:03.471999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:03.490970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:03.493810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:03.494381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:03.495426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:03.502515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:03.503109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:03.529276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:04.011908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:04.020292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f0722c1-97ce-427f-b128-d26ba68bc75a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.572439 Oct 28 13:05:04.022122 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 388/832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:03 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:04.027582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-dd241e4d-534f-43a8-9fbf-8bf03136fbfa req-cf638f18-aee3-4afb-a1d6-0541c48e9cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7618262d-4e39-4c6a-b425-6165b9aaf627", "name": "network-vif-plugged", "status": "completed", "tag": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:04.038228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dd241e4d-534f-43a8-9fbf-8bf03136fbfa req-cf638f18-aee3-4afb-a1d6-0541c48e9cd7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:04.039054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dd241e4d-534f-43a8-9fbf-8bf03136fbfa req-cf638f18-aee3-4afb-a1d6-0541c48e9cd7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:04.039910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dd241e4d-534f-43a8-9fbf-8bf03136fbfa req-cf638f18-aee3-4afb-a1d6-0541c48e9cd7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:04.061751 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-dd241e4d-534f-43a8-9fbf-8bf03136fbfa req-cf638f18-aee3-4afb-a1d6-0541c48e9cd7 service nova] Creating event network-vif-plugged:bd85d46b-11f3-4fb4-9a98-d233d1c433c5 for instance 7618262d-4e39-4c6a-b425-6165b9aaf627 on n-h1-862876-2 Oct 28 13:05:04.071892 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-dd241e4d-534f-43a8-9fbf-8bf03136fbfa req-cf638f18-aee3-4afb-a1d6-0541c48e9cd7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047910 Oct 28 13:05:04.074298 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 389/833] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:04.137360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:04.139282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:04.164131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:04.164816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:04.170865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:04.172148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:04.175392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:04.179364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:04.264120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:04.288752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:04.298312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96f20274-0152-4a4e-b912-7ddb8ba341a2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1319 microversion: 2.1 time: 1.056324 Oct 28 13:05:04.311403 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 445/834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:03 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1319 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:04.320890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6e1f82b-6718-424f-9ff0-94389aad11f1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27ba1171f0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:04.392213 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6e1f82b-6718-424f-9ff0-94389aad11f1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.079046 Oct 28 13:05:04.395892 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 446/835] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:04 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:04.479838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:04.480732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:04.491319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:04.495287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:04.495854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:04.496728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:04.500693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:04.501217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:04.626938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:04.641673 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2db08e9c-bf41-4209-8683-9cd8f34c18ce tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.515613 Oct 28 13:05:04.642187 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 390/836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:04 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:05.046880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:05.047493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:05.059057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.060277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.061255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.062388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.063349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.063983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.207922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:05.217754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:05.232903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:05.234623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-380ffeda-045d-4182-81ca-1e15bc536875 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.759841 Oct 28 13:05:05.235325 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 447/837] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:04 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:05:05.327579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:05.328274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:05.334634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.335380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.335983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.336704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.337184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.338166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.643965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:05.654201 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a416cd3a-c6da-4699-85cd-2a83d37910f8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1324 microversion: 2.1 time: 0.611211 Oct 28 13:05:05.654945 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 391/838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:05 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1324 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:05.661554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c559af2f-595f-4b08-a4af-14b961359577 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27bb658ee0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:05.711783 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c559af2f-595f-4b08-a4af-14b961359577 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.055323 Oct 28 13:05:05.712993 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 392/839] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:05 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:05.718113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:05.718801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:05.726013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.726506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.727495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.728441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.729050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.729616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.770027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:05.805755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:05.814560 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f38b81c7-7669-4db1-94a8-c2f3a6b194f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1468 microversion: 2.1 time: 0.492916 Oct 28 13:05:05.815811 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 448/840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:05 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1468 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:05.838595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:05.839862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:05.845803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.846312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.847186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.847592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:05.848503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:05.848658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:05.923272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:05.930814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6660b553-87aa-4889-87e6-e12ed794be77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.216639 Oct 28 13:05:05.931563 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 393/841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:05 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:06.168589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:06.200909 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7d4fd67-018d-4827-8059-f6df4eefe6c4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 200 len: 1469 microversion: 2.1 time: 0.366281 Oct 28 13:05:06.216280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fab9c4a3-a870-49c2-990b-599f7022aa15 req-d598e3d3-494b-41fe-848c-9a6080d1222c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38", "tag": "60b34799-ae4b-4324-a0ea-12c82b338812"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:06.233140 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 449/842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:05 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 1469 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:06.238317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fab9c4a3-a870-49c2-990b-599f7022aa15 req-d598e3d3-494b-41fe-848c-9a6080d1222c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:06.239112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fab9c4a3-a870-49c2-990b-599f7022aa15 req-d598e3d3-494b-41fe-848c-9a6080d1222c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:06.241327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fab9c4a3-a870-49c2-990b-599f7022aa15 req-d598e3d3-494b-41fe-848c-9a6080d1222c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:06.263317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:06.283972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fab9c4a3-a870-49c2-990b-599f7022aa15 req-d598e3d3-494b-41fe-848c-9a6080d1222c service nova] Creating event network-changed:60b34799-ae4b-4324-a0ea-12c82b338812 for instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 on n-h1-862876-2 Oct 28 13:05:06.288422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:06.289616 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fab9c4a3-a870-49c2-990b-599f7022aa15 req-d598e3d3-494b-41fe-848c-9a6080d1222c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080956 Oct 28 13:05:06.290584 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 394/843] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:05:06.296129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:06.296835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:06.299070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Searching by: {'reservation_id': 'r-limo6cxm', 'deleted': False, 'project_id': '83f9bc35587c481ba2be5676f43c0672'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:06.307847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:06.308409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:06.308849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:06.309578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:06.310024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:06.310466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:06.348395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:06.349828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:06.350443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:06.351610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:06.352364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:06.352832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:06.553419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:05:06.801216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:06.815727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:06.820387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:06.824206 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a8a42f8d-2f0a-4812-aec6-1c2aa1ca358c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.530993 Oct 28 13:05:06.827376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 395/844] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:06 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:06.838649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2003909918", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f3a87850-8c8d-4f75-8512-56ce31a64f08"}], "security_groups": [{"name": "tempest-securitygroup--1971197004"}], "key_name": "tempest-keypair-559877595", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:06.846123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:06.865563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:06.866304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:06.872272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:07.241303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:07.275608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] validate_networks() for [('f3a87850-8c8d-4f75-8512-56ce31a64f08', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:05:07.638559 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f088f9a8-4f2b-4e98-8a2e-1f51ff4083d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-limo6cxm" status: 200 len: 2930 microversion: 2.1 time: 1.400125 Oct 28 13:05:07.641033 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 450/845] 10.222.0.25 () {58 vars in 1197 bytes} [Fri Oct 28 13:05:06 2022] GET /compute/v2.1/servers/detail?reservation_id=r-limo6cxm => generated 2930 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:07.646546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:07.649571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:07.670574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:07.671115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:07.671562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:07.681983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:07.681983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:07.681983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.143363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:08.152595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:05:08.153229 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a4326d2-b141-4eb7-ac94-c072cbc1db60 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1520 microversion: 2.1 time: 0.510468 Oct 28 13:05:08.153335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:05:08.153553 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 451/846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:07 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:08.154883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:05:08.154883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:05:08.155287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:05:08.163723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48fc2b67-6f8e-4abf-b688-db405559ef95 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9f169d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:08.170967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.171465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.172029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.172718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.173496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.174599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.198620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Getting quotas for project 95b7cf075cae49ae838a0f75ca04b41a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:08.208912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Getting quotas for user c9bf2f7d1cdc47ed83175f036a574ca0 and project 95b7cf075cae49ae838a0f75ca04b41a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:08.217752 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48fc2b67-6f8e-4abf-b688-db405559ef95 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1455 microversion: 2.1 time: 0.060361 Oct 28 13:05:08.218600 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 452/847] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:08 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:08.226582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:08.227226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:08.233130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:05:08.233698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.234198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.234639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.235547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.236174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.236849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.239604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:05:08.458240 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b325c831-3fe9-439b-8f47-6deef691c797 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.629543 Oct 28 13:05:08.463776 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 396/848] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:05:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:05:08.464250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9df37889-271c-40c1-afa1-93e48f0365bb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:08.491189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.server_groups [None req-9df37889-271c-40c1-afa1-93e48f0365bb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Querying cell 449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) for 2 instances {{(pid=127793) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 13:05:08.491969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9df37889-271c-40c1-afa1-93e48f0365bb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.498181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9df37889-271c-40c1-afa1-93e48f0365bb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.498181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9df37889-271c-40c1-afa1-93e48f0365bb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.544534 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9df37889-271c-40c1-afa1-93e48f0365bb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/233b0b5f-bf34-4784-bf4b-e2f2fdd54262" status: 200 len: 265 microversion: 2.1 time: 0.069521 Oct 28 13:05:08.545800 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 397/849] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:05:08 2022] GET /compute/v2.1/os-server-groups/233b0b5f-bf34-4784-bf4b-e2f2fdd54262 => generated 265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:08.551618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:08.552579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:08.554377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:08.560416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.561094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.561683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.562547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.563318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.563907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.571264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7ffa5d7-bfaf-432b-80ac-1a435bb066a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.351111 Oct 28 13:05:08.572200 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 453/850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:08 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:08.590186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5e2b348f-6c7e-4904-ac06-25153a265c3d tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'create', calling method: .version_select at 0x7f27ba284ee0>, body: {"pool": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:08.718561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:08.728820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:08.732121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:08.733493 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0543b24a-8eac-4fb2-b78a-a422ddef7739 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.185813 Oct 28 13:05:08.734587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 398/851] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:08 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:08.891409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-637a8947-3284-4ed9-8dfd-32857501406d tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:08.899209 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-637a8947-3284-4ed9-8dfd-32857501406d tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.163333 Oct 28 13:05:08.900475 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 399/852] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:08.905115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1558a85e-8de4-403b-851f-cc0cd87efaf1 req-16a392a3-cf8a-419c-80f1-97b588d8c67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db63d0f-2409-4753-a443-27f08d83707b", "tag": "b86bf7b1-8d12-44d8-acd6-b9778ceb01db"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:08.912200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:08.917714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1558a85e-8de4-403b-851f-cc0cd87efaf1 req-16a392a3-cf8a-419c-80f1-97b588d8c67d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:08.918192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1558a85e-8de4-403b-851f-cc0cd87efaf1 req-16a392a3-cf8a-419c-80f1-97b588d8c67d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:08.919425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1558a85e-8de4-403b-851f-cc0cd87efaf1 req-16a392a3-cf8a-419c-80f1-97b588d8c67d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:08.929752 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1558a85e-8de4-403b-851f-cc0cd87efaf1 req-16a392a3-cf8a-419c-80f1-97b588d8c67d service nova] Creating event network-changed:b86bf7b1-8d12-44d8-acd6-b9778ceb01db for instance 4db63d0f-2409-4753-a443-27f08d83707b on n-h1-862876-2 Oct 28 13:05:08.937284 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1558a85e-8de4-403b-851f-cc0cd87efaf1 req-16a392a3-cf8a-419c-80f1-97b588d8c67d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034875 Oct 28 13:05:08.942178 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 400/853] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:08.954412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c762884-4873-47c4-9a40-30b4e1225d17 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:08.959599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c762884-4873-47c4-9a40-30b4e1225d17 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:09.082272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c762884-4873-47c4-9a40-30b4e1225d17 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:09.094675 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c762884-4873-47c4-9a40-30b4e1225d17 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1241 microversion: 2.1 time: 0.150950 Oct 28 13:05:09.095580 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 401/854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:08 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:09.100263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:09.100814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:09.120107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:09.120819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:09.121502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:09.122400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:09.123094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:09.124059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:09.270159 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d15f9d54-23ba-467e-8a8f-837060172312 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 200 len: 1619 microversion: 2.1 time: 0.173280 Oct 28 13:05:09.270844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 402/855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:09 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 1619 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:09.315709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b87925e5-0560-4a07-a23c-8060bc0fa5f9 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:09.370170 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b87925e5-0560-4a07-a23c-8060bc0fa5f9 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.081379 Oct 28 13:05:09.371843 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 403/856] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:05:09 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:09.376997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67effbc7-265c-4a62-a15f-548d6b69ee7a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9eeec10>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:09.435488 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-67effbc7-265c-4a62-a15f-548d6b69ee7a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1464 microversion: 2.1 time: 0.062536 Oct 28 13:05:09.436806 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 404/857] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:09 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1464 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:09.442901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:09.443959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:09.451795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:09.453001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:09.453657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:09.454717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:09.455498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:09.456148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:10.394800 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac7ac3c4-4b39-4a8f-abe8-891cb6044ce2 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 200 len: 1620 microversion: 2.1 time: 0.956588 Oct 28 13:05:10.400110 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 405/858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:09 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 1620 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:10.403276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c4342c2-f2dd-4c2d-b2ca-0363d53b22cb tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:10.412536 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c4342c2-f2dd-4c2d-b2ca-0363d53b22cb tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014552 Oct 28 13:05:10.413496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 406/859] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:10.420112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1d96d84-92e7-4e5f-b98f-487964affc56 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9cc10d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:10.481693 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1d96d84-92e7-4e5f-b98f-487964affc56 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 200 len: 1464 microversion: 2.1 time: 0.066771 Oct 28 13:05:10.485469 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 407/860] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:10 2022] GET /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 1464 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:10.491422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:10.497032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:10.499786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:10.500846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:10.501556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:10.502996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:10.503681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:10.504329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:10.880527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:10.890073 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-53febeee-02c7-4e6c-827f-ee15d28aba59 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.403248 Oct 28 13:05:10.890659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 408/861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:10 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:10.895874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:10.896657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:10.905485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:10.906219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:10.906868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:10.909211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:10.909687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:10.910124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:11.143575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:11.154127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:11.155835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:11.164081 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e6b76813-c30d-4fb9-ade5-96e7f644a831 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1568 microversion: 2.25 time: 0.265306 Oct 28 13:05:11.164081 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 409/862] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:10 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:11.164081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:11.164081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:11.169978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:11.170471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:11.171093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:11.171970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:11.172598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:11.173143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:11.244143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:11.252757 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8cfacd5-8745-4f38-9477-b73e43516080 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1237 microversion: 2.1 time: 0.093772 Oct 28 13:05:11.254281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 410/863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:11 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:11.265947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-39c0c77c-275a-47eb-b57f-af1bfd7263e3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: .version_select at 0x7f27b9b2b1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-492204294", "policies": ["anti-affinity"]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:11.301642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-39c0c77c-275a-47eb-b57f-af1bfd7263e3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:11.307150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-39c0c77c-275a-47eb-b57f-af1bfd7263e3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:11.460922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-39c0c77c-275a-47eb-b57f-af1bfd7263e3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:11.465756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-39c0c77c-275a-47eb-b57f-af1bfd7263e3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:11.478482 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-39c0c77c-275a-47eb-b57f-af1bfd7263e3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.222480 Oct 28 13:05:11.479135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 411/864] 10.222.0.25 () {60 vars in 1174 bytes} [Fri Oct 28 13:05:11 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:11.483642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b0cb64a-67e7-4c39-8e08-d266b1bb6e05 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:11.490946 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b0cb64a-67e7-4c39-8e08-d266b1bb6e05 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010762 Oct 28 13:05:11.491502 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 412/865] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:11.496515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:11.497133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:11.503512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:11.504001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:11.504444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:11.505152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:11.505600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:11.506434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:11.777725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:11.799546 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-867e364a-33da-4bff-a554-b4a8c909704c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1468 microversion: 2.1 time: 0.295597 Oct 28 13:05:11.799546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 413/866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:11 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1468 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:11.799546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e1be184a-77c6-458b-bfdc-4219a0d76222 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:11.827496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e1be184a-77c6-458b-bfdc-4219a0d76222 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.036488 Oct 28 13:05:11.838907 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 414/867] 10.222.0.25 () {58 vars in 1165 bytes} [Fri Oct 28 13:05:11 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:11.838907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-450606130", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e7de2597-0c5f-49f6-8b4a-afad62b696dd"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:11.893268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:05:12.100763 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5e2b348f-6c7e-4904-ac06-25153a265c3d tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.527487 Oct 28 13:05:12.102221 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 454/868] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:05:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:12.108093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1157870419"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:12.131779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:12.156317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:12.157618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:12.161982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:12.163284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:12.165102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:12.173075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:12.505554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:05:12.510873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:05:12.510873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:05:12.510873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:05:12.510873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:05:12.526922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:12.527702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:12.533302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:12.534278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:12.535471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:12.545368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:12.585711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:12.593027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:12.616552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Going to run 2 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:05:12.620508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:05:12.738387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127793) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 13:05:12.765755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:12.771832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:12.898271 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d717de6e-dad2-432a-ad9c-ea6edd282f07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "POST /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294/action" status: 202 len: 0 microversion: 2.1 time: 0.791798 Oct 28 13:05:12.898271 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 455/869] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:05:12 2022] POST /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:05:12.904815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-323ceb98-0dea-41fb-9bdd-69d2fa3530ff tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:12.914494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-323ceb98-0dea-41fb-9bdd-69d2fa3530ff tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013621 Oct 28 13:05:12.917027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 456/870] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:12.923432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:12.924529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:12.933696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:12.934678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:12.935817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:12.936627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:12.937327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:12.937763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:12.943829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:12.950563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:12.979298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=a144e04f-8c59-43a5-a4d8-7a493e31f260,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:05:13.184589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:13.192899 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6094be7a-32aa-44d9-92eb-d558bef0f825 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.274474 Oct 28 13:05:13.194266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 457/871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:12 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:13.199188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:13.200065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:13.206858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:13.207805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:13.208509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:13.209438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:13.210111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:13.210782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:13.331644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:13.341512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:13.409924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:13.473960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:13.473960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:13.475536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:13.476842 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-df8c1d23-4b9e-44a5-9789-311267c05b63 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1543 microversion: 2.25 time: 0.281339 Oct 28 13:05:13.477945 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 458/872] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:13 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1543 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:13.509353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1163164099", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a791660c-7eb7-446a-a3be-2b028b5235c0"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:13.509576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:13.514907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:13.582671 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-655837a7-b59c-4249-a416-4d1388b508ab tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.752485 Oct 28 13:05:13.587695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] validate_networks() for [('a791660c-7eb7-446a-a3be-2b028b5235c0', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:05:13.588728 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 415/873] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:05:11 2022] POST /compute/v2.1/servers => generated 32 bytes in 1760 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:05:13.594032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:13.610007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:13.614936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:13.615436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:13.615899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:13.616569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:13.617022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:13.620137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.042197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:14.050606 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0613739-5b7e-4ed0-a93a-126796411d30 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1367 microversion: 2.1 time: 0.460750 Oct 28 13:05:14.052620 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 416/874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:13 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:14.058214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-226e7b2d-8181-4743-a7c2-e182ecdcb52b req-d109226c-5a72-4638-a9f3-e37dcf37a838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38", "name": "network-vif-plugged", "status": "completed", "tag": "60b34799-ae4b-4324-a0ea-12c82b338812"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:14.070178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-226e7b2d-8181-4743-a7c2-e182ecdcb52b req-d109226c-5a72-4638-a9f3-e37dcf37a838 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.072631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-226e7b2d-8181-4743-a7c2-e182ecdcb52b req-d109226c-5a72-4638-a9f3-e37dcf37a838 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.073326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-226e7b2d-8181-4743-a7c2-e182ecdcb52b req-d109226c-5a72-4638-a9f3-e37dcf37a838 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.089222 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-226e7b2d-8181-4743-a7c2-e182ecdcb52b req-d109226c-5a72-4638-a9f3-e37dcf37a838 service nova] Creating event network-vif-plugged:60b34799-ae4b-4324-a0ea-12c82b338812 for instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 on n-h1-862876-2 Oct 28 13:05:14.096845 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-226e7b2d-8181-4743-a7c2-e182ecdcb52b req-d109226c-5a72-4638-a9f3-e37dcf37a838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042846 Oct 28 13:05:14.099953 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 417/875] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:14.104304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e833e66-9431-4784-98cc-b98ceb3e53ce tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9ac0700>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.187317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e833e66-9431-4784-98cc-b98ceb3e53ce tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.088307 Oct 28 13:05:14.195546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 418/876] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:14.200453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e4cfcb2d-f223-4c69-97b0-47d3701a9073 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.263623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e4cfcb2d-f223-4c69-97b0-47d3701a9073 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.073019 Oct 28 13:05:14.265194 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 419/877] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:14.279665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc22769b-573d-4c82-b7eb-54247665c53b tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '.version_select at 0x7f27b9a7bb80>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.294485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc22769b-573d-4c82-b7eb-54247665c53b tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.294485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc22769b-573d-4c82-b7eb-54247665c53b tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.294485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc22769b-573d-4c82-b7eb-54247665c53b tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.319478 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bc22769b-573d-4c82-b7eb-54247665c53b tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.052725 Oct 28 13:05:14.331630 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 420/878] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:14.340080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.348494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:14.349611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Searching by: {'deleted': False, 'project_id': '83f9bc35587c481ba2be5676f43c0672'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:14.380999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.383557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.383699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:05:14.384812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:05:14.385493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:05:14.386069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:05:14.386660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:05:14.391302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.391302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.391302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.391302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.406737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.407552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.409886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.410954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.411589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.414221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.426409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:05:14.440600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Getting quotas for project 4b572d677cfe48ccb19defc039f78bd8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:14.447323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Getting quotas for user c92551c6642f463b9e8ee3869bf010ad and project 4b572d677cfe48ccb19defc039f78bd8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:14.456628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:14.464604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:05:14.468213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:05:14.487542 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab1ed9a5-0f80-4880-b7fa-925819e4a13a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.152392 Oct 28 13:05:14.488945 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 421/879] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/servers => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:14.495819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.497217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:14.504148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.505010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.505725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.506977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.507651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.508280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.585517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:14.706170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5d08f150-9e14-43fa-90f9-74a438566593 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.225668 Oct 28 13:05:14.709730 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 459/880] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:05:14.719566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c328e5da-4209-4112-8568-1a4fbfd48250 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.752620 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c328e5da-4209-4112-8568-1a4fbfd48250 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.041023 Oct 28 13:05:14.754303 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 460/881] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:14.765123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.766288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:14.780439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.780439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.780439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.780439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:14.781018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:14.781018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:14.796710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:14.815878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:14.822531 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54dcf761-f92c-4404-8c6b-aafaddde13aa tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.331526 Oct 28 13:05:14.823309 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 422/882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:14.844235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c44df5d-ab29-430f-b5fb-0e169a74a8ec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.845241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c44df5d-ab29-430f-b5fb-0e169a74a8ec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:14.924825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c44df5d-ab29-430f-b5fb-0e169a74a8ec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:14.934402 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c44df5d-ab29-430f-b5fb-0e169a74a8ec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1218 microversion: 2.1 time: 0.094196 Oct 28 13:05:14.955722 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 423/883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:14.959805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c8bd4f2-e885-491d-8fdd-9044abbdbb9a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:14.967469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c8bd4f2-e885-491d-8fdd-9044abbdbb9a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:15.075102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c8bd4f2-e885-491d-8fdd-9044abbdbb9a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:15.085206 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c8bd4f2-e885-491d-8fdd-9044abbdbb9a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1224 microversion: 2.1 time: 0.136516 Oct 28 13:05:15.086475 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 424/884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:15.091574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3019643a-9d44-44a7-aee0-224fd955e051 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.099477 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3019643a-9d44-44a7-aee0-224fd955e051 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011686 Oct 28 13:05:15.100758 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 425/885] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:15.107249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.108232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:15.115359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:15.116019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:15.116840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:15.117822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:15.118516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:15.119122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:15.130555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid d226cb64-78cc-4727-a90c-024cb6e5e87d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:05:15.162779 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0113fb90-8c12-41dc-adb5-c62adb9f69ad tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 2035 microversion: 2.25 time: 0.406570 Oct 28 13:05:15.171533 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 461/886] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:14 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 2035 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:15.201691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-db47eefc-6fd4-4b0a-93bc-d6a1f9da52d1 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.248923 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-db47eefc-6fd4-4b0a-93bc-d6a1f9da52d1 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.075719 Oct 28 13:05:15.249958 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 462/887] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:15.255472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e68b3fc-9bdb-4dc2-9473-36f63dd43b3a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9f169d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.308359 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e68b3fc-9bdb-4dc2-9473-36f63dd43b3a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.057100 Oct 28 13:05:15.308949 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 463/888] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:15.318392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77b1dc67-70f4-4d52-8d67-c0733494cc54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Action: 'create', calling method: .version_select at 0x7f27ba18cee0>, body: {"keypair": {"name": "tempest-keypair-1890038187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDI4y6arjfMb1jnQds4KN/SCEqsXMw2AzkU3o23keinuf9j4huIOauBT21KJGJ7NcUbyt2Fzrkp7hVm4LFyN1ViJU2h7LZYlLSKPSah1n9UaQem5HfNjhYi7F8EOiTdDXg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:15.354668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-77b1dc67-70f4-4d52-8d67-c0733494cc54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:15.366474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-77b1dc67-70f4-4d52-8d67-c0733494cc54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for user 17a50d2f7a154acbbf6bc218efb8b67d and project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:15.442115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:15.450518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-603a855b-512e-4c38-904d-5d508bb28875 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1367 microversion: 2.1 time: 0.348599 Oct 28 13:05:15.451124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 426/889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:15.455736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ddea5293-72da-43e7-9cf5-5df34f590440 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.463256 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ddea5293-72da-43e7-9cf5-5df34f590440 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010915 Oct 28 13:05:15.464150 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 427/890] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:15.475261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8c6e3df-b568-4064-8b7a-05ea16d9a2ef tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.492674 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8c6e3df-b568-4064-8b7a-05ea16d9a2ef tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.020988 Oct 28 13:05:15.493839 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 428/891] 10.222.0.25 () {58 vars in 1144 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:15.508139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0b38e65-bf54-4e0d-8283-3085d7b4ea20 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.515971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0b38e65-bf54-4e0d-8283-3085d7b4ea20 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011521 Oct 28 13:05:15.516585 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 429/892] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:15.528077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4058a351-c514-4a6f-8cda-f006c22e76f8 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.533654 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77b1dc67-70f4-4d52-8d67-c0733494cc54 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.221638 Oct 28 13:05:15.533654 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 464/893] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:05:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 224 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 13:05:15.555269 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4058a351-c514-4a6f-8cda-f006c22e76f8 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030698 Oct 28 13:05:15.556387 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 430/894] 10.222.0.25 () {58 vars in 1148 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:15.572853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbe32224-c909-47c7-82cc-b8e435375a1f tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.600080 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cbe32224-c909-47c7-82cc-b8e435375a1f tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.031545 Oct 28 13:05:15.601409 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 465/895] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:15.617282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-210a523b-a852-4b09-92fb-11c3b03a6d64 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.617784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6c6c4471-6ccf-495d-98f6-cb05802f4b1d req-f4e29410-4b6c-4428-b100-8e9c3e75fb72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e2255e-0110-43c2-aa75-2a244f709e61", "tag": "56171582-952a-45f3-a22b-71387e72cd2b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:15.627912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-210a523b-a852-4b09-92fb-11c3b03a6d64 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015175 Oct 28 13:05:15.637970 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 466/896] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:15.638226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6c6c4471-6ccf-495d-98f6-cb05802f4b1d req-f4e29410-4b6c-4428-b100-8e9c3e75fb72 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:15.640173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6c6c4471-6ccf-495d-98f6-cb05802f4b1d req-f4e29410-4b6c-4428-b100-8e9c3e75fb72 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:15.644428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d470753c-b2f5-4269-9deb-f59ad9a1ed43 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.644870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6c6c4471-6ccf-495d-98f6-cb05802f4b1d req-f4e29410-4b6c-4428-b100-8e9c3e75fb72 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:15.672877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6c6c4471-6ccf-495d-98f6-cb05802f4b1d req-f4e29410-4b6c-4428-b100-8e9c3e75fb72 service nova] Creating event network-changed:56171582-952a-45f3-a22b-71387e72cd2b for instance 78e2255e-0110-43c2-aa75-2a244f709e61 on n-h2-862876-2 Oct 28 13:05:15.678989 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6c6c4471-6ccf-495d-98f6-cb05802f4b1d req-f4e29410-4b6c-4428-b100-8e9c3e75fb72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068824 Oct 28 13:05:15.679704 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 431/897] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:15.682475 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d470753c-b2f5-4269-9deb-f59ad9a1ed43 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.042948 Oct 28 13:05:15.687902 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 467/898] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:15.707806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3a1e8e11-8d5c-4e00-80cd-73fa6ae33029 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.727065 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3a1e8e11-8d5c-4e00-80cd-73fa6ae33029 tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032983 Oct 28 13:05:15.727696 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 432/899] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:15.747868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4383a5aa-bc19-4b17-a123-b34ff98c30fc tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.762910 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4383a5aa-bc19-4b17-a123-b34ff98c30fc tempest-FlavorsV2TestJSON-315256730 tempest-FlavorsV2TestJSON-315256730-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020424 Oct 28 13:05:15.764325 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 468/900] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:15.847106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.848125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:15.854841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:15.856866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:15.859355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:15.860133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:15.861751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:15.862197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:15.966058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5119b30-8b97-4844-b7c9-d37cb1134750 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:15.967500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d5119b30-8b97-4844-b7c9-d37cb1134750 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:16.044530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d5119b30-8b97-4844-b7c9-d37cb1134750 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:16.053182 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d5119b30-8b97-4844-b7c9-d37cb1134750 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1218 microversion: 2.1 time: 0.095556 Oct 28 13:05:16.063174 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 469/901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:16.124803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:16.129965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:16.144746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:16.147217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:16.150262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:16.152854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:16.157906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:16.159829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:16.210675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:16.220505 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-058fd984-8b15-4154-b611-15cbfb7d9839 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.378646 Oct 28 13:05:16.221600 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 433/902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:15 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:16.229429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-525abb50-23b7-4210-abc7-eef1ae92eae0 req-4d0104da-4aeb-487e-8cab-ccbdf7dbc45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f24c67-2a68-4503-b970-023af509105c", "name": "network-vif-unplugged", "status": "completed", "tag": "c1cc3ab6-4dba-4722-ab4c-0acee2b8276e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:16.240474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-525abb50-23b7-4210-abc7-eef1ae92eae0 req-4d0104da-4aeb-487e-8cab-ccbdf7dbc45a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:16.240964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-525abb50-23b7-4210-abc7-eef1ae92eae0 req-4d0104da-4aeb-487e-8cab-ccbdf7dbc45a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:16.241394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-525abb50-23b7-4210-abc7-eef1ae92eae0 req-4d0104da-4aeb-487e-8cab-ccbdf7dbc45a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:16.267744 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-525abb50-23b7-4210-abc7-eef1ae92eae0 req-4d0104da-4aeb-487e-8cab-ccbdf7dbc45a service nova] Creating event network-vif-unplugged:c1cc3ab6-4dba-4722-ab4c-0acee2b8276e for instance 50f24c67-2a68-4503-b970-023af509105c on n-h1-862876-2 Oct 28 13:05:16.278006 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-525abb50-23b7-4210-abc7-eef1ae92eae0 req-4d0104da-4aeb-487e-8cab-ccbdf7dbc45a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054514 Oct 28 13:05:16.285646 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 434/903] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:16.306685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:16.339444 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-842a2132-6e59-4654-afda-5f3f1f16113b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1228 microversion: 2.1 time: 0.208777 Oct 28 13:05:16.342280 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 470/904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:16 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1228 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:16.342432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f6dc499-1fc3-4354-86fe-c81e041f17ce tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9d969d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:16.435114 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f6dc499-1fc3-4354-86fe-c81e041f17ce tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.111302 Oct 28 13:05:16.439054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 435/905] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:16 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:16.476168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:16.478072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:16.507232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:16.510042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:16.510719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:16.513129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:16.515665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:16.516140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:17.054946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:17.066535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e83c31e2-146c-4c99-a0a7-f2d3283db2f0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1367 microversion: 2.1 time: 0.596657 Oct 28 13:05:17.078528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:17.079521 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 471/906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:16 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1367 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:17.080113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:17.089424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:17.090210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:17.090916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:17.091697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:17.092205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:17.092632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:17.195590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:17.217323 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e98b89d8-dcb1-4657-a0bf-6459ebd9070e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1214 microversion: 2.1 time: 0.143450 Oct 28 13:05:17.218590 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 436/907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:17 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1214 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:17.247109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:17.250491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:17.261626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:17.264242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:17.264935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:17.265917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:17.266576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:17.267884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:17.362877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:17.363925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:17.373815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:17.374323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:17.380985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:17.382104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:17.382822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:17.383721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:17.466087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:17.495508 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2acf56ac-e335-42ec-8bb6-7a735806f717 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.253518 Oct 28 13:05:17.500932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 472/908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:17 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:17.507907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-56fcab06-b7c0-4e53-8754-26d3019041a3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9fb53a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:17.672169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-56fcab06-b7c0-4e53-8754-26d3019041a3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.169779 Oct 28 13:05:17.672813 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 473/909] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:17 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:17.877435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:17.894192 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-119f8039-74a6-4c14-813a-57eaad2c5173 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1220 microversion: 2.1 time: 0.535213 Oct 28 13:05:17.906780 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 437/910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:17 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1220 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:18.094075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:18.094661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:18.124737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:18.126900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:18.127975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:18.129167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:18.133214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:18.136079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:18.245301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:18.246699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:18.258033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:18.266218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:18.267349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:18.271918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:18.282284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:18.288195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:18.510855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:18.524146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6114c87e-fdd5-481d-a176-abf511524f3d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1270 microversion: 2.1 time: 0.283475 Oct 28 13:05:18.526625 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 438/911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:18 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1270 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:18.538146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ee455aa5-75e6-4e37-8dc8-1afa405a3811 req-23ee144a-1dbf-4e1b-a163-50844631c743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db63d0f-2409-4753-a443-27f08d83707b", "name": "network-vif-plugged", "status": "completed", "tag": "b86bf7b1-8d12-44d8-acd6-b9778ceb01db"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:18.565355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ee455aa5-75e6-4e37-8dc8-1afa405a3811 req-23ee144a-1dbf-4e1b-a163-50844631c743 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:18.565938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ee455aa5-75e6-4e37-8dc8-1afa405a3811 req-23ee144a-1dbf-4e1b-a163-50844631c743 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:18.566383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ee455aa5-75e6-4e37-8dc8-1afa405a3811 req-23ee144a-1dbf-4e1b-a163-50844631c743 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:18.588749 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ee455aa5-75e6-4e37-8dc8-1afa405a3811 req-23ee144a-1dbf-4e1b-a163-50844631c743 service nova] Creating event network-vif-plugged:b86bf7b1-8d12-44d8-acd6-b9778ceb01db for instance 4db63d0f-2409-4753-a443-27f08d83707b on n-h1-862876-2 Oct 28 13:05:18.594606 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ee455aa5-75e6-4e37-8dc8-1afa405a3811 req-23ee144a-1dbf-4e1b-a163-50844631c743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060571 Oct 28 13:05:18.595549 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 439/912] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:18.601212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:18.602211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:18.610207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:18.611086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:18.617315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:18.617315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:18.617315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:18.617315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:19.079599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:19.093078 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-56ca888b-e0f2-4986-99e1-9288a3a7a231 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1367 microversion: 2.1 time: 1.003441 Oct 28 13:05:19.095302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 474/913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:18 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1367 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:19.117954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-506e0611-ce28-4417-bed7-df4304210a95 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9dc8310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:19.242256 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-506e0611-ce28-4417-bed7-df4304210a95 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.137716 Oct 28 13:05:19.252455 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 475/914] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:19 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:19.285753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:19.294543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:19.304124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:19.308798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:19.309325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:19.311411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:19.311916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:19.312379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:19.392084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:19.407853 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c960427-dcd4-4734-b956-b5d3402a1431 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.807000 Oct 28 13:05:19.407853 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 440/915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:18 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:19.550593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:19.551653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:19.558949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:19.560828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:19.561914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:19.563552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:19.565531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:19.578292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:19.603116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:19.614585 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9abafe59-ede3-4cc5-8cf8-85d77e20f17e tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1284 microversion: 2.1 time: 0.349054 Oct 28 13:05:19.618481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 476/916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:19 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1284 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:19.896650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:19.902600 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9c23e44-7cae-46c1-9801-f0591bb62da7 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1276 microversion: 2.1 time: 0.354002 Oct 28 13:05:19.904715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 441/917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:19 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:20.122938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:20.134596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:20.160453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:20.161323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:20.162034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:20.163311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:20.164249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:20.165086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:20.268667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4903102-c74c-4f80-b9d4-c404d2551fc1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9b203a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:20.369654 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4903102-c74c-4f80-b9d4-c404d2551fc1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.101662 Oct 28 13:05:20.371496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 442/918] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:20 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:20.431071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:20.433005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:20.445378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:20.446181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:20.448171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:20.449159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:20.449806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:20.450516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:20.782971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:20.789119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-349cf833-75f1-45ff-92c6-8f27489041e3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1367 microversion: 2.1 time: 0.671257 Oct 28 13:05:20.808385 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 477/919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:20 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1367 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:20.813916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:20.817593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:20.842708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:20.850260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:20.850260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:20.850260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:20.850260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:20.850690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:20.947400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:20.959390 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fa20ff86-9483-48fb-949e-209dabe576a4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1313 microversion: 2.1 time: 0.531588 Oct 28 13:05:20.964531 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 443/920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:20 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:20.981743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5ef2cf03-191c-4ed6-ac4d-b0c79dadf578 req-3d4239bb-e3f8-4fb2-a416-ad6a8a060eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b3df7-aba2-4aa3-b02a-525e788cf294", "name": "network-vif-plugged", "status": "completed", "tag": "5bf284c1-9f73-4970-ad51-e0c6eeaf0d88"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:21.012761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ef2cf03-191c-4ed6-ac4d-b0c79dadf578 req-3d4239bb-e3f8-4fb2-a416-ad6a8a060eb7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:21.014375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ef2cf03-191c-4ed6-ac4d-b0c79dadf578 req-3d4239bb-e3f8-4fb2-a416-ad6a8a060eb7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:21.015086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ef2cf03-191c-4ed6-ac4d-b0c79dadf578 req-3d4239bb-e3f8-4fb2-a416-ad6a8a060eb7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:21.055911 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5ef2cf03-191c-4ed6-ac4d-b0c79dadf578 req-3d4239bb-e3f8-4fb2-a416-ad6a8a060eb7 service nova] Creating event network-vif-plugged:5bf284c1-9f73-4970-ad51-e0c6eeaf0d88 for instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 on n-h1-862876-2 Oct 28 13:05:21.077115 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5ef2cf03-191c-4ed6-ac4d-b0c79dadf578 req-3d4239bb-e3f8-4fb2-a416-ad6a8a060eb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107688 Oct 28 13:05:21.080717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:21.081310 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 444/921] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:21.090641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a8228766-85bf-48ba-a7e0-c5db2d9a2a83 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1282 microversion: 2.1 time: 0.281045 Oct 28 13:05:21.091804 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 478/922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:20 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1282 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:21.093416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:21.097288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:21.105665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:21.107176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:21.107798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:21.108660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:21.109267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:21.109991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:21.201140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:21.222919 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-62687a31-91fb-402c-80b6-a7ca015b6638 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1276 microversion: 2.1 time: 0.135108 Oct 28 13:05:21.227102 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 445/923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:21 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:21.388421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce46a6a9-1563-4e38-9793-3e69226595cc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9b2eaf0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:21.476887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce46a6a9-1563-4e38-9793-3e69226595cc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.092200 Oct 28 13:05:21.477134 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 479/924] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:21 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:21.820465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:21.823126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:21.844738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:21.846534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:21.849698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:21.851226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:21.853723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:21.854424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:21.989005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:21.993104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:22.005420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:22.007722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:22.011332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:22.012285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:22.012915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:22.013506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:22.543996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:22.557929 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87a50814-38dc-40eb-a36a-9d3d2b02691c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1462 microversion: 2.1 time: 0.572767 Oct 28 13:05:22.558534 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 480/925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:21 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1462 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:22.570738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:22.575041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:22.594097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:22.594606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:22.596106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:22.600332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:22.600823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:22.601465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:23.099683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:23.108020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-055c700f-020d-441f-b704-bf5464b8f291 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.545508 Oct 28 13:05:23.110996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:23.111777 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 481/926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:22 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:23.122166 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-182f1226-0047-4387-998b-8776a79ee8cd tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1367 microversion: 2.1 time: 1.310501 Oct 28 13:05:23.125816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:23.128005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 446/927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:21 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1367 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:23.129357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:23.143498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:23.144020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:23.144648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d551f800-6bfb-4556-9e7a-915fc004624a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9f6ae50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:23.145442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:23.147274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:23.149038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:23.150161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:23.213801 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d551f800-6bfb-4556-9e7a-915fc004624a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.078191 Oct 28 13:05:23.224911 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 447/928] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:23 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:23.233175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:23.234393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:23.241975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:23.242780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:23.243599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:23.245988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:23.246870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:23.247945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:23.522879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:23.538078 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81b1dc35-6944-4631-b10d-e056a105ab9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1318 microversion: 2.1 time: 0.421247 Oct 28 13:05:23.543702 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 482/929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:23 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:23.559004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1706594715", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "1217f953-ad0c-48ca-a39a-bfdf8506b13b"}], "security_groups": [{"name": "tempest-securitygroup--359393130"}], "key_name": "tempest-keypair-1890038187", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:23.860766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] validate_networks() for [('1217f953-ad0c-48ca-a39a-bfdf8506b13b', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:05:24.213022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:24.226068 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b4f931c-22fd-46d7-9879-08633e44bf11 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1462 microversion: 2.1 time: 0.994629 Oct 28 13:05:24.226814 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 448/930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:23 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1462 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:24.232380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fef43a1d-d73d-41b2-9cdc-b0ad3258653b req-8a2bcb2b-647a-4886-89bd-3df8c9219a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e2255e-0110-43c2-aa75-2a244f709e61", "name": "network-vif-plugged", "status": "completed", "tag": "56171582-952a-45f3-a22b-71387e72cd2b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:24.243015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fef43a1d-d73d-41b2-9cdc-b0ad3258653b req-8a2bcb2b-647a-4886-89bd-3df8c9219a82 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:24.244705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fef43a1d-d73d-41b2-9cdc-b0ad3258653b req-8a2bcb2b-647a-4886-89bd-3df8c9219a82 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:24.245361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fef43a1d-d73d-41b2-9cdc-b0ad3258653b req-8a2bcb2b-647a-4886-89bd-3df8c9219a82 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:24.258701 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fef43a1d-d73d-41b2-9cdc-b0ad3258653b req-8a2bcb2b-647a-4886-89bd-3df8c9219a82 service nova] Creating event network-vif-plugged:56171582-952a-45f3-a22b-71387e72cd2b for instance 78e2255e-0110-43c2-aa75-2a244f709e61 on n-h2-862876-2 Oct 28 13:05:24.265060 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fef43a1d-d73d-41b2-9cdc-b0ad3258653b req-8a2bcb2b-647a-4886-89bd-3df8c9219a82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036106 Oct 28 13:05:24.276346 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 449/931] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:24.303794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:24.304600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:24.329320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:24.330065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:24.330779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:24.331651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:24.333081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:24.334304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:24.405449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:24.427488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:24.788108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:24.822905 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4be8bceb-979f-4dd1-a0a0-a941819ab194 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.547668 Oct 28 13:05:24.827840 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 450/932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:24 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:24.854576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:24.858087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:24.907003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:24.907003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:24.907003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:24.907003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:24.907335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:24.907335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:25.089345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=42 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:25.143289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:25.154154 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63b304e3-0a37-40ef-8fca-a26bbcd3bf98 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1367 microversion: 2.1 time: 0.324794 Oct 28 13:05:25.155014 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 451/933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:24 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:25.161202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a105f03-00ae-471b-a09c-f22174081fdc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9fa8550>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:25.218093 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1a105f03-00ae-471b-a09c-f22174081fdc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.061744 Oct 28 13:05:25.220202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 452/934] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:25 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:25.231157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1912040621", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:25.301454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:05:25.554433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:05:25.556038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:05:25.557294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:05:25.557893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:05:25.558495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:05:25.565846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=25 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:25.569829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:25.570580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:25.574293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:25.575260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:25.575820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:25.576486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:25.602332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:25.608525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for user 17a50d2f7a154acbbf6bc218efb8b67d and project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:25.622533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:05:25.624847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:05:25.703562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:05:25.704310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:05:25.704943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:05:25.705500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:05:25.706068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:05:25.729854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:25.731144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:25.731765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:25.734671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:25.735398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:25.736009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:25.786210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Getting quotas for project ca58f2828860400da616cba8da1c1a8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:25.792452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Getting quotas for user e35d20fe60484d11982fd061614dbf54 and project ca58f2828860400da616cba8da1c1a8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:25.824898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:25.826594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:05:25.830843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:05:26.236929 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a509b269-e51e-4910-9c43-25515b2fcad6 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.688987 Oct 28 13:05:26.237535 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 483/935] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:05:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:05:26.242992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:26.248538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:26.250036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.250527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.250999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.251699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.252150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.252827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.316966 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-55c69075-2f43-47bd-a81a-37146f5b8354 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091918 Oct 28 13:05:26.318414 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 453/936] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:05:26.329167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-12476a8f-c61e-4f27-9acc-00c0ca6739ed req-eca39da9-ec79-475b-9c10-fc59d258c3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9462cff6-308f-4b3a-a627-4508524824b4", "tag": "1cde4ffc-c886-4795-841c-6193dd3fd963"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:26.339614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-12476a8f-c61e-4f27-9acc-00c0ca6739ed req-eca39da9-ec79-475b-9c10-fc59d258c3cd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.345908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-12476a8f-c61e-4f27-9acc-00c0ca6739ed req-eca39da9-ec79-475b-9c10-fc59d258c3cd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.345908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-12476a8f-c61e-4f27-9acc-00c0ca6739ed req-eca39da9-ec79-475b-9c10-fc59d258c3cd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.356847 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-12476a8f-c61e-4f27-9acc-00c0ca6739ed req-eca39da9-ec79-475b-9c10-fc59d258c3cd service nova] Creating event network-changed:1cde4ffc-c886-4795-841c-6193dd3fd963 for instance 9462cff6-308f-4b3a-a627-4508524824b4 on n-h1-862876-2 Oct 28 13:05:26.366786 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-12476a8f-c61e-4f27-9acc-00c0ca6739ed req-eca39da9-ec79-475b-9c10-fc59d258c3cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045655 Oct 28 13:05:26.368682 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 454/937] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:26.378298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-bd8e130c-1a98-429d-ac33-f53fa81f7325 req-1fec23da-f70e-4d79-8d78-7ba8ec27baae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afdf702d-0ff5-4877-b3e3-a5c5b0849d54", "tag": "07774673-ffa9-48ad-bf64-d35c3f61c97f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:26.393124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bd8e130c-1a98-429d-ac33-f53fa81f7325 req-1fec23da-f70e-4d79-8d78-7ba8ec27baae service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.393960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bd8e130c-1a98-429d-ac33-f53fa81f7325 req-1fec23da-f70e-4d79-8d78-7ba8ec27baae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.394548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bd8e130c-1a98-429d-ac33-f53fa81f7325 req-1fec23da-f70e-4d79-8d78-7ba8ec27baae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.400557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:26.416165 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-bd8e130c-1a98-429d-ac33-f53fa81f7325 req-1fec23da-f70e-4d79-8d78-7ba8ec27baae service nova] Creating event network-changed:07774673-ffa9-48ad-bf64-d35c3f61c97f for instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 on n-h2-862876-2 Oct 28 13:05:26.421407 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-bd8e130c-1a98-429d-ac33-f53fa81f7325 req-1fec23da-f70e-4d79-8d78-7ba8ec27baae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051167 Oct 28 13:05:26.422865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 455/938] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:26.452268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:26.453120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:26.471090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.474221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.475316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.479053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.482297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.482712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.740410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:26.753318 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8a8be3fe-5876-4a67-98d0-62fa90fc15eb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.323195 Oct 28 13:05:26.754621 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 456/939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:26 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:26.763802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:26.764771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:26.772936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.773751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.777661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.780588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:26.781311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:26.782785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:26.911430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:26.961792 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35351724-4f48-4489-b43a-48536d8efa91 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1318 microversion: 2.1 time: 0.722887 Oct 28 13:05:26.965947 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 484/940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:26 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:26.993953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3a8f36c-467b-4233-9a98-ccc1106dd812 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9f57a60>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:27.085958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:27.095109 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3a8f36c-467b-4233-9a98-ccc1106dd812 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.123948 Oct 28 13:05:27.096249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 485/941] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:26 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:27.103766 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5cd7b4d-0415-4b8c-a193-63451694490a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1558 microversion: 2.1 time: 0.347330 Oct 28 13:05:27.108151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-852aaf4c-4720-4df7-825a-d1ec1a902473 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:27.109274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-852aaf4c-4720-4df7-825a-d1ec1a902473 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:27.126451 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 457/942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:26 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1558 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:27.137613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-735735d9-0ee6-4015-a45e-bc03e897743a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:27.139482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-735735d9-0ee6-4015-a45e-bc03e897743a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:27.288884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-852aaf4c-4720-4df7-825a-d1ec1a902473 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:27.289606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-735735d9-0ee6-4015-a45e-bc03e897743a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:27.307196 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-735735d9-0ee6-4015-a45e-bc03e897743a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1214 microversion: 2.1 time: 0.173501 Oct 28 13:05:27.308415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-852aaf4c-4720-4df7-825a-d1ec1a902473 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:27.310294 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 458/943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:27 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:27.316005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-852aaf4c-4720-4df7-825a-d1ec1a902473 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:27.335681 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-852aaf4c-4720-4df7-825a-d1ec1a902473 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1286 microversion: 2.25 time: 0.220081 Oct 28 13:05:27.336208 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 486/944] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:27 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:27.341793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:27.342864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:27.376119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:27.377262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:27.378481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:27.380539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:27.383949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:27.385473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:27.627223 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-338cfac0-a48c-405a-9efd-ac58bee0cd5a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.313097 Oct 28 13:05:27.628575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 459/945] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:05:27 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-interface => generated 285 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:27.782375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:27.782925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:27.802212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:27.803073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:27.803728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:27.805977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:27.814048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:27.825162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:27.991576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:27.992588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:28.002676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:28.003573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:28.004233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:28.005158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:28.005838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:28.006495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:28.387712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:28.404027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bbc4e559-c144-4d4c-93ed-5dd4ef92c466 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.626252 Oct 28 13:05:28.411511 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 487/946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:27 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:28.441102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96e9e406-07f7-42d1-8930-5fb5ce2a6876 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27ba2ea1f0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:28.518467 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96e9e406-07f7-42d1-8930-5fb5ce2a6876 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.097335 Oct 28 13:05:28.526772 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 488/947] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:28 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:28.526772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:28.526772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:28.551343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:28.551964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:28.552515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:28.553313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:28.555424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:28.556785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:28.596385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:28.617197 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5eede918-fea7-49db-bcc7-1772360a855e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1318 microversion: 2.1 time: 0.630332 Oct 28 13:05:28.619237 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 460/948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:27 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:28.636419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:28.639970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:28.653683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:28.654644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:28.655128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:28.655858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:28.656311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:28.656735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:28.716281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:28.729380 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-957d4067-af13-4bb6-88e8-85890e115c42 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1210 microversion: 2.1 time: 0.208659 Oct 28 13:05:28.730653 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 489/949] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:28 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1210 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:28.738319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a2336710-8ec0-4be9-85ad-a35177b336ef req-b05ac9af-e9e7-4227-bbbe-19bf27b459d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a144e04f-8c59-43a5-a4d8-7a493e31f260", "tag": "db4b6691-6a43-4df6-9cc6-b6ab6c752d6d"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:28.751057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a2336710-8ec0-4be9-85ad-a35177b336ef req-b05ac9af-e9e7-4227-bbbe-19bf27b459d6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:28.751783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a2336710-8ec0-4be9-85ad-a35177b336ef req-b05ac9af-e9e7-4227-bbbe-19bf27b459d6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:28.753237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a2336710-8ec0-4be9-85ad-a35177b336ef req-b05ac9af-e9e7-4227-bbbe-19bf27b459d6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:28.765973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a2336710-8ec0-4be9-85ad-a35177b336ef req-b05ac9af-e9e7-4227-bbbe-19bf27b459d6 service nova] Creating event network-changed:db4b6691-6a43-4df6-9cc6-b6ab6c752d6d for instance a144e04f-8c59-43a5-a4d8-7a493e31f260 on n-h2-862876-2 Oct 28 13:05:28.774777 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a2336710-8ec0-4be9-85ad-a35177b336ef req-b05ac9af-e9e7-4227-bbbe-19bf27b459d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042419 Oct 28 13:05:28.776017 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 490/950] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:28.929322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:28.947799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:28.951078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:28.953553 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4856707-3d9d-498b-bea8-6cf4cc724882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1282 microversion: 2.25 time: 0.330394 Oct 28 13:05:28.968494 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 461/951] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:28 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:29.439229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:29.440561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:29.460712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:29.461223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:29.467220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:29.467220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:29.467220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:29.482075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:29.539950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-447e6af3-cc09-440d-a4c7-9af89ef84a21 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b983c4c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:29.610412 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-447e6af3-cc09-440d-a4c7-9af89ef84a21 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.080580 Oct 28 13:05:29.611716 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 462/952] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:29 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:29.646832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:29.647498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:29.663272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:29.664536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:29.665260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:29.675568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:29.676438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:29.678219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:29.922310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:29.935074 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b275228f-59bf-4789-9ebb-555a022250be tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.499944 Oct 28 13:05:29.936113 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 491/953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:29 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:29.980763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:29.988209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:30.003351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:30.007611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:30.010431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:30.011456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:30.013110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:30.018128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:30.085304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:30.094292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe55e45b-d0f6-48b0-a9c8-8bfa058d3851 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1318 microversion: 2.1 time: 0.452186 Oct 28 13:05:30.099891 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 463/954] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:29 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:30.105534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:30.110827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:30.124685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:30.125541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:30.126190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:30.127111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:30.131415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:30.132118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:30.285161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:30.295801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:30.299920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:30.305307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5b9d11b0-5903-42f9-949e-98baa706c882 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1338 microversion: 2.25 time: 0.199796 Oct 28 13:05:30.305307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 464/955] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:30 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1338 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:30.628567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a4e61e2-0f42-4403-9d95-979605af36fd tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9864af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:30.708907 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1a4e61e2-0f42-4403-9d95-979605af36fd tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.085452 Oct 28 13:05:30.710047 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 465/956] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:30 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:30.893974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:30.904153 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9107c8d9-b9c9-4678-9bf8-076b92766ec5 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1266 microversion: 2.1 time: 0.936609 Oct 28 13:05:30.909390 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 492/957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:29 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1266 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:30.969343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:30.970155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:30.988412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:30.991395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:30.993322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:30.994182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:30.996102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:30.998539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:31.128690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:31.130118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:31.137524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:31.138458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:31.139041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:31.139916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:31.140512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:31.141040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:31.145537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:31.440789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:31.455383 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-80570452-34b4-4f3d-8777-5d6a1f30deaa tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.492325 Oct 28 13:05:31.456281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 466/958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:30 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:31.463274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:31.466476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:31.479675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:31.480169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:31.485904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:31.486577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:31.488262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:31.488691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:31.593839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:31.604981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:31.606436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:31.607596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b34be300-c976-449b-a2c1-1ad9fa398c06 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1338 microversion: 2.25 time: 0.150394 Oct 28 13:05:31.608543 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 467/959] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:31 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:31.624776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a170753c-f444-47d0-992b-2a59943f5809 req-cafe60fd-7519-4d65-a37b-d5ff3472ca31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e2255e-0110-43c2-aa75-2a244f709e61", "tag": "56171582-952a-45f3-a22b-71387e72cd2b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:31.663222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a170753c-f444-47d0-992b-2a59943f5809 req-cafe60fd-7519-4d65-a37b-d5ff3472ca31 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:31.663882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a170753c-f444-47d0-992b-2a59943f5809 req-cafe60fd-7519-4d65-a37b-d5ff3472ca31 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:31.664131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a170753c-f444-47d0-992b-2a59943f5809 req-cafe60fd-7519-4d65-a37b-d5ff3472ca31 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:31.750452 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a170753c-f444-47d0-992b-2a59943f5809 req-cafe60fd-7519-4d65-a37b-d5ff3472ca31 service nova] Creating event network-changed:56171582-952a-45f3-a22b-71387e72cd2b for instance 78e2255e-0110-43c2-aa75-2a244f709e61 on n-h2-862876-2 Oct 28 13:05:31.776526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a170753c-f444-47d0-992b-2a59943f5809 req-cafe60fd-7519-4d65-a37b-d5ff3472ca31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166532 Oct 28 13:05:31.791061 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 468/960] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:31.822911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-996cbb42-be1e-4d30-8a0a-14c8edc200ad tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9bc9a60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:31.913830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:31.931733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41b4e25a-878f-47df-9a51-69a042520d5e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1318 microversion: 2.1 time: 0.807539 Oct 28 13:05:31.942932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 493/961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:31 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:31.947962 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-996cbb42-be1e-4d30-8a0a-14c8edc200ad tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.153508 Oct 28 13:05:31.949161 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 469/962] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:31 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:31.972913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:31.973545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:31.979741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:31.980234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:31.980848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:31.981757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:31.982581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:31.983268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:32.261854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:32.274699 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abbf040c-9e48-4359-9d74-0bbf09a10f9a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1272 microversion: 2.1 time: 0.328753 Oct 28 13:05:32.286890 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 494/963] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:31 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1272 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:32.484215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:32.485329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:32.497058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:32.497515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:32.498086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:32.498782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:32.499147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:32.499583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:32.636844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:32.637741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:32.646258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:32.647055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:32.647682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:32.648764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:32.649929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:32.650532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:32.826454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:32.854650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:32.856135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:32.858272 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1769e180-2e66-436e-80a2-16b9d273b540 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1344 microversion: 2.25 time: 0.226347 Oct 28 13:05:32.876016 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 495/964] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:32 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:32.955585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:32.961147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:32.969710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:32.970328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:32.970790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:32.971508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:32.971970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:32.972392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:33.130529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:33.143926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-632a5336-53bf-4ad5-ae64-f550aeb8fb1b tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.664616 Oct 28 13:05:33.145535 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 470/965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:32 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:33.159765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a298d167-56d9-4491-8caf-36f64a0ddf40 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9bc9ee0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:33.251001 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a298d167-56d9-4491-8caf-36f64a0ddf40 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.104264 Oct 28 13:05:33.251785 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 471/966] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:33 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:33.300159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:33.301030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:33.313938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:33.318368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:33.319074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:33.320014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:33.320637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:33.321266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:33.484420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:33.502782 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc3a8bd4-3e50-418e-83d2-a54f6bf9767f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1272 microversion: 2.1 time: 0.206739 Oct 28 13:05:33.504048 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 472/967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:33 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:33.567196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:33.576930 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-555ad5be-750d-400a-9471-136f52eda846 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1318 microversion: 2.1 time: 0.625031 Oct 28 13:05:33.590925 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 496/968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:32 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:33.899365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:33.900455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:33.909235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:33.910036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:33.910653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:33.911647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:33.912261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:33.912846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:33.942906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a0a55db-74b5-443b-b1d3-3a0ca7c2a029 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-23061225", "id": 297150668, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:34.141152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a0a55db-74b5-443b-b1d3-3a0ca7c2a029 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.86 time: 0.635776 Oct 28 13:05:34.155089 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 473/969] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:05:33 2022] POST /compute/v2.1/flavors => generated 466 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:05:34.160605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6589ccb2-dd86-4e67-846a-38d0ed5f6994 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:34.211135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:34.245817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:34.250425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:34.255142 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2672f3ba-8e99-4cab-844b-23bbefee9471 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1344 microversion: 2.25 time: 0.372454 Oct 28 13:05:34.257925 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 497/970] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:33 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1344 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:05:34.266705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:34.267774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:34.291936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:34.295627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:34.299560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:34.304649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:34.305148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:34.306122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:34.610840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:34.620355 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd7fbcda-c2cb-4046-ba5b-ea3f2b5ed830 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.360952 Oct 28 13:05:34.636362 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 498/971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:34 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:34.641800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e13150c3-a0d3-48cc-8794-b18ec2b4e0bd tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9d0e160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:34.686013 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6589ccb2-dd86-4e67-846a-38d0ed5f6994 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/297150668/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.529229 Oct 28 13:05:34.686635 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 474/972] 10.222.0.25 () {62 vars in 1262 bytes} [Fri Oct 28 13:05:34 2022] POST /compute/v2.1/flavors/297150668/os-extra_specs => generated 62 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:34.709639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-74cd11f2-f0e6-4830-bc8a-22b09359bb62 req-b423d545-9b46-4c1f-a0bf-b6e25f86cbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9462cff6-308f-4b3a-a627-4508524824b4", "name": "network-vif-plugged", "status": "completed", "tag": "1cde4ffc-c886-4795-841c-6193dd3fd963"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:34.730851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-74cd11f2-f0e6-4830-bc8a-22b09359bb62 req-b423d545-9b46-4c1f-a0bf-b6e25f86cbb9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:34.731602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-74cd11f2-f0e6-4830-bc8a-22b09359bb62 req-b423d545-9b46-4c1f-a0bf-b6e25f86cbb9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:34.732191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-74cd11f2-f0e6-4830-bc8a-22b09359bb62 req-b423d545-9b46-4c1f-a0bf-b6e25f86cbb9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:34.758640 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-74cd11f2-f0e6-4830-bc8a-22b09359bb62 req-b423d545-9b46-4c1f-a0bf-b6e25f86cbb9 service nova] Creating event network-vif-plugged:1cde4ffc-c886-4795-841c-6193dd3fd963 for instance 9462cff6-308f-4b3a-a627-4508524824b4 on n-h1-862876-2 Oct 28 13:05:34.770855 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-74cd11f2-f0e6-4830-bc8a-22b09359bb62 req-b423d545-9b46-4c1f-a0bf-b6e25f86cbb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080530 Oct 28 13:05:34.772007 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 475/973] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:34.804612 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e13150c3-a0d3-48cc-8794-b18ec2b4e0bd tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.166652 Oct 28 13:05:34.809715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 499/974] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:34 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:34.835656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:34.838147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:34.842903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:34.844185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:34.859366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:34.860929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:34.861428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:34.865764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:34.867963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:34.873261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:34.873261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:34.874286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:34.874858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:34.875232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:34.875936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:34.876389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:34.876806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:35.453392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:35.465934 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13a49f3c-0720-4b20-afbd-4ec5ade2de48 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.691664 Oct 28 13:05:35.466929 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 476/975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:34 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:35.473344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ee6e7f1-4b12-451b-b425-38324c5794b3 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:35.626972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ee6e7f1-4b12-451b-b425-38324c5794b3 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/297150668" status: 202 len: 0 microversion: 2.86 time: 0.156975 Oct 28 13:05:35.628277 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 477/976] 10.222.0.25 () {60 vars in 1199 bytes} [Fri Oct 28 13:05:35 2022] DELETE /compute/v2.1/flavors/297150668 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:05:35.638622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:35.640223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:35.648223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:35.649846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:35.650519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:35.651944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:35.653144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:35.653827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:35.889193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:35.909604 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-70e4a52d-2b9f-4c3e-9693-578f766f0de5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1318 microversion: 2.1 time: 1.097987 Oct 28 13:05:35.911570 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 500/977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:34 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1318 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:35.918757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3614843c-30fe-4575-9c17-7b6c7287a3c9 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:35.979689 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3614843c-30fe-4575-9c17-7b6c7287a3c9 tempest-FlavorMetadataValidation-2066674105 tempest-FlavorMetadataValidation-2066674105-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.066827 Oct 28 13:05:35.981497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 501/978] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:05:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:35.992380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:36.003551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:36.006818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:36.007659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:36.012768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:36.014938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:36.015279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:36.016155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:36.016837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:36.016967 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d7a7e2d-8a65-4f77-802b-3a575c2ebc78 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.386488 Oct 28 13:05:36.017811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:36.018421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:36.019036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:36.019790 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 478/979] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:35 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:36.024499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0285d9f-522e-40d3-889d-83b4aaff4955 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a45790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:36.132451 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0285d9f-522e-40d3-889d-83b4aaff4955 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.111452 Oct 28 13:05:36.132954 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 479/980] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:36 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:36.301529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:36.495055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:36.496620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:36.528210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:36.530653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:36.532207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:36.538341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:36.542365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:36.543070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:36.566798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:36.577663 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8eeb440-526a-4bce-9053-1e916244bddf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.593631 Oct 28 13:05:36.578385 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 502/981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:35 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:36.602815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cf2e2e9d-1b75-4c0e-b791-4ad480459068 req-b8188055-daaf-42c0-9aa9-43712a5ca613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2fb646-8cf8-49a2-aada-1e938586b442", "tag": "63a50445-fbbf-44d4-ae03-0a0354416325"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:36.626767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf2e2e9d-1b75-4c0e-b791-4ad480459068 req-b8188055-daaf-42c0-9aa9-43712a5ca613 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:36.628683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf2e2e9d-1b75-4c0e-b791-4ad480459068 req-b8188055-daaf-42c0-9aa9-43712a5ca613 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:36.629311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf2e2e9d-1b75-4c0e-b791-4ad480459068 req-b8188055-daaf-42c0-9aa9-43712a5ca613 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:36.658573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cf2e2e9d-1b75-4c0e-b791-4ad480459068 req-b8188055-daaf-42c0-9aa9-43712a5ca613 service nova] Creating event network-changed:63a50445-fbbf-44d4-ae03-0a0354416325 for instance 7b2fb646-8cf8-49a2-aada-1e938586b442 on n-h1-862876-2 Oct 28 13:05:36.674107 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cf2e2e9d-1b75-4c0e-b791-4ad480459068 req-b8188055-daaf-42c0-9aa9-43712a5ca613 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079395 Oct 28 13:05:36.681761 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 503/982] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:36.960157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7ecbc8bb-651c-494c-ad57-f7d3ca424ba2 req-c59603d2-3ee6-42bc-acd1-f8ff40eba2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a144e04f-8c59-43a5-a4d8-7a493e31f260", "name": "network-vif-plugged", "status": "completed", "tag": "db4b6691-6a43-4df6-9cc6-b6ab6c752d6d"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:36.981523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ecbc8bb-651c-494c-ad57-f7d3ca424ba2 req-c59603d2-3ee6-42bc-acd1-f8ff40eba2cc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:36.982075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ecbc8bb-651c-494c-ad57-f7d3ca424ba2 req-c59603d2-3ee6-42bc-acd1-f8ff40eba2cc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:36.982518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ecbc8bb-651c-494c-ad57-f7d3ca424ba2 req-c59603d2-3ee6-42bc-acd1-f8ff40eba2cc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:36.997766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:37.008137 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7ecbc8bb-651c-494c-ad57-f7d3ca424ba2 req-c59603d2-3ee6-42bc-acd1-f8ff40eba2cc service nova] Creating event network-vif-plugged:db4b6691-6a43-4df6-9cc6-b6ab6c752d6d for instance a144e04f-8c59-43a5-a4d8-7a493e31f260 on n-h2-862876-2 Oct 28 13:05:37.012756 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cb32faa6-cc1d-40a8-974c-04ce3158a963 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.523190 Oct 28 13:05:37.026688 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7ecbc8bb-651c-494c-ad57-f7d3ca424ba2 req-c59603d2-3ee6-42bc-acd1-f8ff40eba2cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099741 Oct 28 13:05:37.040139 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 504/983] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:05:37.045824 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 480/984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:36 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:05:37.057368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:37.058255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:37.060829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:37.067737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:37.069776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:37.070493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:37.071233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:37.073892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:37.077469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:37.082319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:37.097867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:37.098452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:37.098923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:37.099732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:37.100215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:37.100638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:37.373596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:37.592080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:37.606606 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0ff5a905-e80b-42f2-bbf1-2f3d21cf483c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1467 microversion: 2.1 time: 0.562438 Oct 28 13:05:37.610308 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 505/985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:37 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1467 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:37.630108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2913ee62-b00d-4b52-8bd8-5cdf516d16a5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9fb53a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:37.763841 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2913ee62-b00d-4b52-8bd8-5cdf516d16a5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.149520 Oct 28 13:05:37.763841 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 506/986] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:37 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:37.772994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:37.773624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:37.791402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:37.792798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:37.793305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:37.793746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:37.794465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:37.807164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:37.807730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:38.270007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:38.290314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:38.291784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:38.292902 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b88da0b6-6125-4d6c-b9c8-4da5afa111ff tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 1.244882 Oct 28 13:05:38.293986 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 481/987] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:37 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:38.301264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:38.301986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:38.322153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:38.323003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:38.323614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:38.324538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:38.325232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:38.325805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:38.575664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:38.589711 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7de5a85-4c04-4c58-999e-53ca17104066 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.824523 Oct 28 13:05:38.590716 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 507/988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:37 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:38.620691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:38.621691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:38.635886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:38.636810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:38.637595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:38.638543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:38.642520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:38.643263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:38.766248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:38.780564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b926bfc-7eb3-4cb8-a9ad-d3c6b5eb1330 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 200 len: 1318 microversion: 2.1 time: 0.485302 Oct 28 13:05:38.798778 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 482/989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:38 2022] GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:38.800932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de87aa94-3852-4764-ac48-33cb516d8f86 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27ba05bca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:38.889245 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de87aa94-3852-4764-ac48-33cb516d8f86 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.102958 Oct 28 13:05:38.889832 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 483/990] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:38 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:38.895045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-628ca109-ee3d-4cf5-a4fd-770bda2ea51e req-3c3b25aa-f57e-4c32-80c9-660c26c7f831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e873a2-b078-4190-9f83-0644b1075f4a", "tag": "c40493ea-ef8b-4cf6-895b-5e07519f7ce3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:38.941275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-628ca109-ee3d-4cf5-a4fd-770bda2ea51e req-3c3b25aa-f57e-4c32-80c9-660c26c7f831 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:38.941275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-628ca109-ee3d-4cf5-a4fd-770bda2ea51e req-3c3b25aa-f57e-4c32-80c9-660c26c7f831 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:38.941275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-628ca109-ee3d-4cf5-a4fd-770bda2ea51e req-3c3b25aa-f57e-4c32-80c9-660c26c7f831 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:38.943856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:38.956854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:38.968242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-628ca109-ee3d-4cf5-a4fd-770bda2ea51e req-3c3b25aa-f57e-4c32-80c9-660c26c7f831 service nova] Creating event network-changed:c40493ea-ef8b-4cf6-895b-5e07519f7ce3 for instance 33e873a2-b078-4190-9f83-0644b1075f4a on n-h2-862876-2 Oct 28 13:05:38.970584 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-939bde7b-ca15-418f-ad1e-509a0047ab6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.362059 Oct 28 13:05:38.984294 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 508/991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:38 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:39.000340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-628ca109-ee3d-4cf5-a4fd-770bda2ea51e req-3c3b25aa-f57e-4c32-80c9-660c26c7f831 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105856 Oct 28 13:05:39.002677 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 484/992] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:39.168132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-72d43d84-ef54-4f60-ba65-2d26eb83eae6 req-9ed6c470-b47f-4a9b-ba35-96820656bb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdf702d-0ff5-4877-b3e3-a5c5b0849d54", "name": "network-vif-plugged", "status": "completed", "tag": "07774673-ffa9-48ad-bf64-d35c3f61c97f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:39.184920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-72d43d84-ef54-4f60-ba65-2d26eb83eae6 req-9ed6c470-b47f-4a9b-ba35-96820656bb34 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:39.185396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-72d43d84-ef54-4f60-ba65-2d26eb83eae6 req-9ed6c470-b47f-4a9b-ba35-96820656bb34 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:39.187698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-72d43d84-ef54-4f60-ba65-2d26eb83eae6 req-9ed6c470-b47f-4a9b-ba35-96820656bb34 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:39.230458 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-72d43d84-ef54-4f60-ba65-2d26eb83eae6 req-9ed6c470-b47f-4a9b-ba35-96820656bb34 service nova] Creating event network-vif-plugged:07774673-ffa9-48ad-bf64-d35c3f61c97f for instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 on n-h2-862876-2 Oct 28 13:05:39.254505 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-72d43d84-ef54-4f60-ba65-2d26eb83eae6 req-9ed6c470-b47f-4a9b-ba35-96820656bb34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080222 Oct 28 13:05:39.254505 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 509/993] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:05:39.322226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:39.323496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:39.333987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:39.334673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:39.335479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:39.337346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:39.337973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:39.338579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:39.517479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:39.525959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:39.532258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:39.534504 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e932fc1-66d2-48c8-98fc-f32d0cf5301d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.216268 Oct 28 13:05:39.537463 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 485/994] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:39 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:39.618972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:39.618972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:39.633443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:39.636187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:39.636625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:39.637343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:39.637798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:39.638223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:39.811224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:39.812478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:39.825324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:39.826653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:39.827086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:39.830612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:39.831186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:39.833270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.083826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:40.096596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-33b05d0c-55d8-4bc3-a12b-d9cd9a258cc8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 200 len: 1468 microversion: 2.1 time: 0.289208 Oct 28 13:05:40.097715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 486/995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:39 2022] GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:40.103380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37cd5e97-c1b5-4008-a6df-325461ed59b0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a45790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:40.155492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:40.183497 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f853115-6bf3-4888-ae69-e3ae3c5cc261 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1324 microversion: 2.1 time: 0.573539 Oct 28 13:05:40.184082 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 510/996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:39 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:40.193351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:40.194197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:40.211449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:40.211932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:40.212370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.214418 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37cd5e97-c1b5-4008-a6df-325461ed59b0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.098558 Oct 28 13:05:40.217406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:40.217866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:40.218255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.227837 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 487/997] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:40 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:40.245283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:40.256793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:40.261021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Searching by: {'reservation_id': 'r-gtl9fkn0', 'deleted': False, 'project_id': '83f9bc35587c481ba2be5676f43c0672'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:40.282041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:40.283220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:40.283914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.285734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:40.287169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:40.289182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.450662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:05:40.514019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:40.529589 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c0f2bad4-f9bc-4591-bcde-698e33b848a1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.337513 Oct 28 13:05:40.549889 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 511/998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:40 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:40.552279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:40.560979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:40.562034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:40.575270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.575486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:40.575486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:40.595336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:40.595860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:40.598497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.599331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:40.599783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:40.600931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:40.925607 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58c0e3a3-faa4-4114-8625-652a802d459f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-gtl9fkn0" status: 200 len: 2928 microversion: 2.1 time: 0.690251 Oct 28 13:05:40.927195 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 488/999] 10.222.0.25 () {58 vars in 1197 bytes} [Fri Oct 28 13:05:40 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gtl9fkn0 => generated 2928 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:41.180242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:41.190923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:41.197340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:41.198635 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a05b5e01-7b66-49e7-a775-571501a8a09e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.635161 Oct 28 13:05:41.199113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f3152c1-a3dd-48f6-bd11-347555cd29cf tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Calling method '.version_select at 0x7f27b983ca60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.215537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 512/1000] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:40 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:41.224723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b560d94-cdd6-4631-b424-b16b27f2c84a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.253565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.server_groups [None req-5b560d94-cdd6-4631-b424-b16b27f2c84a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Querying cell 449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) for 2 instances {{(pid=127794) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 13:05:41.254584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b560d94-cdd6-4631-b424-b16b27f2c84a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.255265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b560d94-cdd6-4631-b424-b16b27f2c84a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.256282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b560d94-cdd6-4631-b424-b16b27f2c84a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.314135 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f3152c1-a3dd-48f6-bd11-347555cd29cf tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.385362 Oct 28 13:05:41.315308 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 489/1001] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:05:40 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:05:41.317715 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b560d94-cdd6-4631-b424-b16b27f2c84a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/e7de2597-0c5f-49f6-8b4a-afad62b696dd" status: 200 len: 270 microversion: 2.1 time: 0.100937 Oct 28 13:05:41.351925 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 513/1002] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:05:41 2022] GET /compute/v2.1/os-server-groups/e7de2597-0c5f-49f6-8b4a-afad62b696dd => generated 270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:41.353006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.353006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:41.353163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35a80d39-7fce-4fe8-b9ce-cabb311bfbed tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9cad3a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.353241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.353241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.353241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.353241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.353527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.353527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.390680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35a80d39-7fce-4fe8-b9ce-cabb311bfbed tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.071169 Oct 28 13:05:41.391900 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 514/1003] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:41 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:41.396428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0f125c2-0abc-43d1-b0c8-8d745992f507 tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Action: 'create', calling method: .version_select at 0x7f27b9ad9940>, body: {"pool": "non_exist_pool"} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:41.433782 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b0f125c2-0abc-43d1-b0c8-8d745992f507 tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] HTTP exception thrown: Floating IP pool not found. Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0f125c2-0abc-43d1-b0c8-8d745992f507 tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Request method failure captured: Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 26 Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9OkqqbSRzqHeWhdw84eTozWh6KnfuNwm2PdGheZexeGUiJ3FU9o2mNcmKtMcRVegt_7_XhScVzCLvxku_Nhv9W42QUdnKqFeyY1_v8vglJzSBdYR-XYfGx-X3RMxUD9VMIsz3qQDc0K6fV6lJXquD7dyKiusw22TtM3KDsMzyZ2nbM Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c647300073b44c7abecbb43d5d694461 Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-917145351 Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:05:41.437339 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c647300073b44c7abecbb43d5d694461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c647300073b44c7abecbb43d5d694461"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c647300073b44c7abecbb43d5d694461", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c647300073b44c7abecbb43d5d694461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-917145351 Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c647300073b44c7abecbb43d5d694461 Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-917145351 Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsNegativeTestJSON-917145351-project Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369da8c8eab94992a5a925e5a08abaf0 Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-917145351-project Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: {"pool": "non_exist_pool"} Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: exception: Floating IP pool not found. Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 28 13:05:41.438815 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:41.440066 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0f125c2-0abc-43d1-b0c8-8d745992f507 tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Returning 404 to user: Floating IP pool not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:41.442032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0f125c2-0abc-43d1-b0c8-8d745992f507 tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.046161 Oct 28 13:05:41.443240 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 515/1004] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:05:41 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:05:41.452269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.453221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:41.462614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.463493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.464206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.465211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.466098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.466691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.524742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:41.546540 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c8ec6a7-6225-4ea8-a5ad-6d6640ec7a76 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 200 len: 1520 microversion: 2.1 time: 0.229947 Oct 28 13:05:41.547391 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 490/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:41 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:41.552260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4fec363d-8660-449c-8be0-a38c4f27f66b tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Calling method '.version_select at 0x7f27b9d4dd30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.596789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-4fec363d-8660-449c-8be0-a38c4f27f66b tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e1674aec-9841-4740-a1c1-7cbddcb2b83b could not be found", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:05:41.597505 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-4fec363d-8660-449c-8be0-a38c4f27f66b tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] HTTP exception thrown: Floating IP not found for ID e1674aec-9841-4740-a1c1-7cbddcb2b83b Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4fec363d-8660-449c-8be0-a38c4f27f66b tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Request method failure captured: Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-floating-ips/e1674aec-9841-4740-a1c1-7cbddcb2b83b HTTP/1.1 Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9OkqqbSRzqHeWhdw84eTozWh6KnfuNwm2PdGheZexeGUiJ3FU9o2mNcmKtMcRVegt_7_XhScVzCLvxku_Nhv9W42QUdnKqFeyY1_v8vglJzSBdYR-XYfGx-X3RMxUD9VMIsz3qQDc0K6fV6lJXquD7dyKiusw22TtM3KDsMzyZ2nbM Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c647300073b44c7abecbb43d5d694461 Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-917145351 Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:05:41.614622 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c647300073b44c7abecbb43d5d694461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c647300073b44c7abecbb43d5d694461"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c647300073b44c7abecbb43d5d694461", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c647300073b44c7abecbb43d5d694461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-917145351 Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c647300073b44c7abecbb43d5d694461 Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-917145351 Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FloatingIPsNegativeTestJSON-917145351-project Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369da8c8eab94992a5a925e5a08abaf0 Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-917145351-project Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: exception: Floating IP not found for ID e1674aec-9841-4740-a1c1-7cbddcb2b83b Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'e1674aec-9841-4740-a1c1-7cbddcb2b83b'} Oct 28 13:05:41.615956 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:05:41.616726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e1674aec-9841-4740-a1c1-7cbddcb2b83b could not be found Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca1e1426-39c9-4951-b318-1cbd05c946bd'] Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e1674aec-9841-4740-a1c1-7cbddcb2b83b. Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:41.617944 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e1674aec-9841-4740-a1c1-7cbddcb2b83b Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:41.622265 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:41.624082 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e1674aec-9841-4740-a1c1-7cbddcb2b83b Oct 28 13:05:41.624082 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:41.624082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4fec363d-8660-449c-8be0-a38c4f27f66b tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] Returning 404 to user: Floating IP not found for ID e1674aec-9841-4740-a1c1-7cbddcb2b83b {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:41.624082 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4fec363d-8660-449c-8be0-a38c4f27f66b tempest-FloatingIPsNegativeTestJSON-917145351 tempest-FloatingIPsNegativeTestJSON-917145351-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e1674aec-9841-4740-a1c1-7cbddcb2b83b" status: 404 len: 111 microversion: 2.1 time: 0.068168 Oct 28 13:05:41.624082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 491/1006] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:05:41 2022] DELETE /compute/v2.1/os-floating-ips/e1674aec-9841-4740-a1c1-7cbddcb2b83b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:41.624646 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ac9de3c5-5669-4fdd-9fbf-650d1633c334 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1618 microversion: 2.1 time: 0.175791 Oct 28 13:05:41.627200 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 516/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:41 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1618 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:41.627337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.630673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:41.639101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'action', calling method: .version_select at 0x7f27bb3cbb80>, body: {"addFloatingIp": {"address": "172.25.8.90"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:41.641195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.641797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.642406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:41.642573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.643786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.644731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.645312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.649978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.650738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.651196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.651901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.652362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.652787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.655595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:41.724754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:05:41.725155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquired lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:05:41.800407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:41.808704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35db3526-819b-4251-9254-73bb7136da02 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.190086 Oct 28 13:05:41.809281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 492/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:41 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:41.813579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:41.814488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:41.821981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.822484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.822963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.823681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:41.824413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:41.824854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:41.965635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1527466-e6c3-4104-9b13-1945a11aa683 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 200 len: 1619 microversion: 2.1 time: 0.155289 Oct 28 13:05:41.966379 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 493/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:41 2022] GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 1619 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:42.114692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1221238951", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7b9de8fb-d31e-4f62-b8cb-cafb20df5769"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:42.218219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:05:42.656278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:05:42.656905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:05:42.657159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:05:42.659223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:05:42.659887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:05:42.676277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:42.677133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:42.677785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:42.678763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:42.679457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:42.680202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:42.700758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:05:42.707146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:05:42.720877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:42.731767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:05:42.738739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:05:42.997082 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4a3f2e5-1986-4ebc-a2f4-7757c0d4e661 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886211 Oct 28 13:05:43.012789 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 494/1010] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:05:43.021136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:43.022088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:43.044842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:43.045518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:43.046774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:43.047674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:43.048285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:43.048863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:43.365401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:43.380303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:43.384936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:43.386525 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-336f5034-5e1c-4112-b2bd-26fd99aebfe2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.372192 Oct 28 13:05:43.387913 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 495/1011] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:43 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:43.393441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d6fd8c9-cf9a-4a1b-b14f-ef85f89d7212 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96955e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:43.513539 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d6fd8c9-cf9a-4a1b-b14f-ef85f89d7212 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1455 microversion: 2.1 time: 0.123745 Oct 28 13:05:43.514836 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 496/1012] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:43 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:43.528178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:43.528925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:43.568135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:43.568638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:43.569074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:43.569777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:43.570236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:43.570654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:43.821179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:43.833362 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-24ccbb16-9c03-488f-944a-0e6ddb5804ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.316855 Oct 28 13:05:43.834242 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 497/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:43 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:43.854676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-91cafe90-7bf8-4328-ba45-df920038c426 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:43.857600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91cafe90-7bf8-4328-ba45-df920038c426 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:43.932185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-91cafe90-7bf8-4328-ba45-df920038c426 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:43.939577 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-91cafe90-7bf8-4328-ba45-df920038c426 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1217 microversion: 2.1 time: 0.104127 Oct 28 13:05:43.940497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 498/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:43 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:44.420172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:44.420785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:44.448090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:44.452469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:44.455655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:44.458071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:44.458273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:44.464834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:44.731123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:44.741575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:44.744166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:44.745655 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-16a3c01b-db02-46d3-b18c-d7a14e9ff338 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.329464 Oct 28 13:05:44.746351 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 499/1015] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:44 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:05:44.751577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-38b03284-9165-4075-82bb-108f3309e8df tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96a6670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:44.801887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-38b03284-9165-4075-82bb-108f3309e8df tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1464 microversion: 2.1 time: 0.054137 Oct 28 13:05:44.803195 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 500/1016] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:44 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:44.818161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b124de8-652c-428a-a2d7-00e5ab3773af tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96a6c10>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:44.872390 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b124de8-652c-428a-a2d7-00e5ab3773af tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 200 len: 1464 microversion: 2.1 time: 0.058244 Oct 28 13:05:44.877867 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 501/1017] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:44 2022] GET /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 1464 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:44.883665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:44.884408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:44.891077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:44.891669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:44.892184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:44.892976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:44.893533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:44.894138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.081900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:45.109047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-91a6b16c-cfd5-4d36-ada0-27c5328f90e8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.229877 Oct 28 13:05:45.109665 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 502/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:44 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:45.130814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:45.131391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Building network info cache for instance {{(pid=127794) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:05:45.135469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:45.153734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.155741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.156383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.157275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.157891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.158520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.441312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:45.449693 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c589c89-fb32-4177-8915-117dea84e606 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1467 microversion: 2.1 time: 0.334987 Oct 28 13:05:45.450778 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 503/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:45 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1467 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:45.458626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:45.459468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:45.470664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.478212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.478847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.479864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.480446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.481008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.572672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:45.580944 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf9c7ff5-78a2-4d8a-b97f-db1519e5c298 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1213 microversion: 2.1 time: 0.128939 Oct 28 13:05:45.594170 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 504/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:45 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1213 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:45.601794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0c82e971-f882-43da-98f5-6c287613b225 req-79a4ec7a-a071-47bf-bc76-29661699f8dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7618262d-4e39-4c6a-b425-6165b9aaf627", "tag": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:45.631012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0c82e971-f882-43da-98f5-6c287613b225 req-79a4ec7a-a071-47bf-bc76-29661699f8dd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.631855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0c82e971-f882-43da-98f5-6c287613b225 req-79a4ec7a-a071-47bf-bc76-29661699f8dd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.632454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0c82e971-f882-43da-98f5-6c287613b225 req-79a4ec7a-a071-47bf-bc76-29661699f8dd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.660742 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0c82e971-f882-43da-98f5-6c287613b225 req-79a4ec7a-a071-47bf-bc76-29661699f8dd service nova] Creating event network-changed:bd85d46b-11f3-4fb4-9a98-d233d1c433c5 for instance 7618262d-4e39-4c6a-b425-6165b9aaf627 on n-h1-862876-2 Oct 28 13:05:45.671188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0c82e971-f882-43da-98f5-6c287613b225 req-79a4ec7a-a071-47bf-bc76-29661699f8dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075758 Oct 28 13:05:45.673575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 505/1021] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:45.922348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Calling method '.version_select at 0x7f27b96a6ee0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:45.924158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.925005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.925448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.953451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.955054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.955741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.982766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:45.983274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:45.983717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:45.996152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-458cf7e9-7fdd-4493-bbd3-af5ef7777bc2 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.320570 Oct 28 13:05:46.003197 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 506/1022] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:05:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:46.020858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82d72fa6-2093-4bcc-ba42-596c9cba5a9f tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96a6dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:46.243118 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82d72fa6-2093-4bcc-ba42-596c9cba5a9f tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-10-28T13%3A03%3A38Z" status: 200 len: 2377 microversion: 2.1 time: 0.237949 Oct 28 13:05:46.258304 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 507/1023] 10.222.0.25 () {58 vars in 1199 bytes} [Fri Oct 28 13:05:46 2022] GET /compute/v2.1/images?changes-since=2022-10-28T13%3A03%3A38Z => generated 2377 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:46.282452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:46.284532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:46.292142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:46.292916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:46.293700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:46.294622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:46.295262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:46.296531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:46.696848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:46.708101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:46.710206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:46.714461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d0b3d49-e823-40e3-ad78-da679d9ee62f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.454726 Oct 28 13:05:46.717681 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 508/1024] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:46 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:46.909294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49f5dd88-7a62-4988-aaff-aafd6885544d tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Calling method '.version_select at 0x7f27b96b70d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:46.913922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49f5dd88-7a62-4988-aaff-aafd6885544d tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'deb377dad5ce41329e2f8951f3404a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c482160e1e64564ac0649d970fcf98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49f5dd88-7a62-4988-aaff-aafd6885544d tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Request method failure captured: Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/n-h2-862876-2/search HTTP/1.1 Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9OnN-WY6dep_hElgNuBj-jLsWfc61EqVxW0_xKDEPIiXBgv298nTnNEqvpA9zZkin018bKuoGTwIFPJYNzcmfmAkvFdv8tbHA7CuKQdN_nSDB2VU1cEUala4XJJK2CgdMGD2KhHAWzl5YbN85LzwyUduL_NNjwVhFtbre-fO5HQYHk Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5c482160e1e64564ac0649d970fcf98a Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-11394137 Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:05:46.918032 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c482160e1e64564ac0649d970fcf98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c482160e1e64564ac0649d970fcf98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c482160e1e64564ac0649d970fcf98a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c482160e1e64564ac0649d970fcf98a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-11394137 Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5c482160e1e64564ac0649d970fcf98a Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-11394137 Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-11394137-project Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: deb377dad5ce41329e2f8951f3404a9f Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-11394137-project Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 13:05:46.928717 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'n-h2-862876-2'} Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:05:46.929620 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 13:05:46.931631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:46.933190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49f5dd88-7a62-4988-aaff-aafd6885544d tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:46.933190 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49f5dd88-7a62-4988-aaff-aafd6885544d tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-862876-2/search" status: 403 len: 117 microversion: 2.1 time: 0.186943 Oct 28 13:05:46.936609 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 509/1025] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Oct 28 13:05:46 2022] GET /compute/v2.1/os-hypervisors/n-h2-862876-2/search => generated 117 bytes in 219 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:46.948438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:46.950459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:46.975249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:46.977589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:46.978369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:46.979798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:46.980706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:46.981932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:46.995252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Updating instance_info_cache with network_info: [{"id": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5", "address": "fa:16:3e:f3:f3:eb", "network": {"id": "a791660c-7eb7-446a-a3be-2b028b5235c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1903749844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b572d677cfe48ccb19defc039f78bd8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd85d46b-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127794) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:05:47.006032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Releasing lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:05:47.012100 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-edb45b53-32c4-467f-8653-4700ecaf6a27 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action" status: 202 len: 0 microversion: 2.1 time: 5.381941 Oct 28 13:05:47.014546 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 517/1026] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:05:41 2022] POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action => generated 0 bytes in 5387 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:05:47.029941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-87f2facc-70bd-4200-a4cd-2c086bb29c0b req-1ff69c2b-3566-4c76-a4d2-b88713b353cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2fb646-8cf8-49a2-aada-1e938586b442", "name": "network-vif-plugged", "status": "completed", "tag": "63a50445-fbbf-44d4-ae03-0a0354416325"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:47.054901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-87f2facc-70bd-4200-a4cd-2c086bb29c0b req-1ff69c2b-3566-4c76-a4d2-b88713b353cb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.056383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-87f2facc-70bd-4200-a4cd-2c086bb29c0b req-1ff69c2b-3566-4c76-a4d2-b88713b353cb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.058428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-87f2facc-70bd-4200-a4cd-2c086bb29c0b req-1ff69c2b-3566-4c76-a4d2-b88713b353cb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.073485 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-87f2facc-70bd-4200-a4cd-2c086bb29c0b req-1ff69c2b-3566-4c76-a4d2-b88713b353cb service nova] Creating event network-vif-plugged:63a50445-fbbf-44d4-ae03-0a0354416325 for instance 7b2fb646-8cf8-49a2-aada-1e938586b442 on n-h1-862876-2 Oct 28 13:05:47.094099 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-87f2facc-70bd-4200-a4cd-2c086bb29c0b req-1ff69c2b-3566-4c76-a4d2-b88713b353cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074618 Oct 28 13:05:47.094692 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 518/1027] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:47.106947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1bb53851-f111-40c8-904f-963dcbd86bff tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9c6c040>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.207930 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1bb53851-f111-40c8-904f-963dcbd86bff tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1586569835" status: 200 len: 485 microversion: 2.1 time: 0.111837 Oct 28 13:05:47.208981 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 519/1028] 10.222.0.25 () {58 vars in 1231 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1586569835 => generated 485 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:47.214201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.215157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:47.222566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.223142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.223714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.224773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.225536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.226109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.274390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:47.287881 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6803a1f-ef72-417a-b357-c783de0d6bdf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.349623 Oct 28 13:05:47.289078 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 510/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:46 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:47.295714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Calling method '.version_select at 0x7f27bba105e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.299564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.300266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.300885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.307801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:47.313963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 13:05:47.324123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:47.334125 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0eab42d-f91d-4f2a-8bf4-e8e17821338d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1275 microversion: 2.1 time: 0.123813 Oct 28 13:05:47.337226 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 520/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:47.348612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.90"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Request method failure captured: Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Op5GTgDYInZP2_HPQokvOHaTBWJG-GDezKijy-9eOB3tdwDcQvOKl1hRmnNYCCihdt2mLrhHIuBVTu1RRhuzaRzhRMKwC8RXYKW1JlQYrj9BokT70mu1EAo7DpzSY5ZFnnX3vPodgYDKuM6UZuuGfBTiNC4-u79A0VtqYhlPcpvWE Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a3486c2514a84af2aaed3e9c2db82c19 Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-287413548 Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:05:47.355656 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3486c2514a84af2aaed3e9c2db82c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3486c2514a84af2aaed3e9c2db82c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3486c2514a84af2aaed3e9c2db82c19", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3486c2514a84af2aaed3e9c2db82c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-287413548 Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a3486c2514a84af2aaed3e9c2db82c19 Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-287413548 Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ac08cf570a6145988a160792c575a099 Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 13:05:47.357315 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:47.358224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:47.360866 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:47.360866 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:47.360866 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:47.360866 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 13:05:47.360866 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.361259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:47.363442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:47.364743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aad4b2e0-cc3b-46a8-ae9a-d3a8b9178049 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.073945 Oct 28 13:05:47.366207 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 511/1031] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:47.371547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fb44537-96fb-4c6e-b9c2-4be9a046f0c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96b7a60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.375077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.375693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.376338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.378435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.382133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.388368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.451015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "refresh_cache-afdf702d-0ff5-4877-b3e3-a5c5b0849d54" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:05:47.453483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquired lock "refresh_cache-afdf702d-0ff5-4877-b3e3-a5c5b0849d54" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:05:47.493060 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fb44537-96fb-4c6e-b9c2-4be9a046f0c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?server=aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 958 microversion: 2.1 time: 0.124753 Oct 28 13:05:47.493972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 512/1032] 10.222.0.25 () {58 vars in 1209 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/images?server=aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 958 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:47.498798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Calling method '.version_select at 0x7f27b96b7e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.501761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.501761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.501761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.518241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.521899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.522585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.540050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.540819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.541528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.549180 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e3b3b83-d774-44e7-882c-c5bcc83809f4 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054070 Oct 28 13:05:47.549872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 513/1033] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:47.557539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7630429a-bd8d-4c61-b04b-82002c8033c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27bba10ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.621434 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7630429a-bd8d-4c61-b04b-82002c8033c5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 485 microversion: 2.1 time: 0.070207 Oct 28 13:05:47.623611 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 514/1034] 10.222.0.25 () {58 vars in 1317 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c => generated 485 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:47.638365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6900c265-9ef3-4e4f-8bb4-eff6170e87a0 tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Calling method '.version_select at 0x7f27b967f790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6900c265-9ef3-4e4f-8bb4-eff6170e87a0 tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'deb377dad5ce41329e2f8951f3404a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c482160e1e64564ac0649d970fcf98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6900c265-9ef3-4e4f-8bb4-eff6170e87a0 tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Request method failure captured: Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9OnN-WY6dep_hElgNuBj-jLsWfc61EqVxW0_xKDEPIiXBgv298nTnNEqvpA9zZkin018bKuoGTwIFPJYNzcmfmAkvFdv8tbHA7CuKQdN_nSDB2VU1cEUala4XJJK2CgdMGD2KhHAWzl5YbN85LzwyUduL_NNjwVhFtbre-fO5HQYHk Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5c482160e1e64564ac0649d970fcf98a Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-11394137 Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:05:47.644258 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c482160e1e64564ac0649d970fcf98a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c482160e1e64564ac0649d970fcf98a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c482160e1e64564ac0649d970fcf98a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c482160e1e64564ac0649d970fcf98a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-11394137 Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5c482160e1e64564ac0649d970fcf98a Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-11394137 Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-11394137-project Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: deb377dad5ce41329e2f8951f3404a9f Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-11394137-project Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 13:05:47.645705 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1'} Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:05:47.646442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 13:05:47.648034 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.650105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6900c265-9ef3-4e4f-8bb4-eff6170e87a0 tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:47.650105 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6900c265-9ef3-4e4f-8bb4-eff6170e87a0 tempest-HypervisorAdminNegativeUnderV252Test-11394137 tempest-HypervisorAdminNegativeUnderV252Test-11394137-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018033 Oct 28 13:05:47.650105 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 515/1035] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:47.653885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fe336ce-3d81-417a-b359-c5c85ac3de7d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96e3670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.718382 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fe336ce-3d81-417a-b359-c5c85ac3de7d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 485 microversion: 2.1 time: 0.067618 Oct 28 13:05:47.719761 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 516/1036] 10.222.0.25 () {58 vars in 1303 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c => generated 485 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:47.725009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Calling method '.version_select at 0x7f27b96f54c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.730491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.730491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.730491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.735515 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] HTTP exception thrown: No hypervisor matching '6ed17fb2-cff9-4ec5-898f-8c2ef87838f3' could be found. Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Request method failure captured: Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-hypervisors/6ed17fb2-cff9-4ec5-898f-8c2ef87838f3/servers HTTP/1.1 Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Op5GTgDYInZP2_HPQokvOHaTBWJG-GDezKijy-9eOB3tdwDcQvOKl1hRmnNYCCihdt2mLrhHIuBVTu1RRhuzaRzhRMKwC8RXYKW1JlQYrj9BokT70mu1EAo7DpzSY5ZFnnX3vPodgYDKuM6UZuuGfBTiNC4-u79A0VtqYhlPcpvWE Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a3486c2514a84af2aaed3e9c2db82c19 Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-287413548 Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:05:47.737218 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3486c2514a84af2aaed3e9c2db82c19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a3486c2514a84af2aaed3e9c2db82c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a3486c2514a84af2aaed3e9c2db82c19", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a3486c2514a84af2aaed3e9c2db82c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-287413548 Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a3486c2514a84af2aaed3e9c2db82c19 Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-287413548 Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ac08cf570a6145988a160792c575a099 Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: exception: No hypervisor matching '6ed17fb2-cff9-4ec5-898f-8c2ef87838f3' could be found. Oct 28 13:05:47.738526 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6ed17fb2-cff9-4ec5-898f-8c2ef87838f3'} Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6ed17fb2-cff9-4ec5-898f-8c2ef87838f3' could be found. Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.744022 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6ed17fb2-cff9-4ec5-898f-8c2ef87838f3' could be found. Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] Returning 404 to user: No hypervisor matching '6ed17fb2-cff9-4ec5-898f-8c2ef87838f3' could be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81c44b24-01ae-4db3-8dc9-c23245d7a331 tempest-HypervisorAdminNegativeUnderV252Test-287413548 tempest-HypervisorAdminNegativeUnderV252Test-287413548-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/6ed17fb2-cff9-4ec5-898f-8c2ef87838f3/servers" status: 404 len: 123 microversion: 2.1 time: 0.017761 Oct 28 13:05:47.745676 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 517/1037] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/os-hypervisors/6ed17fb2-cff9-4ec5-898f-8c2ef87838f3/servers => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:05:47.746980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9cb7f5d4-b6d5-4ec1-94f1-88d33d1b619a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96b7af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.888080 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9cb7f5d4-b6d5-4ec1-94f1-88d33d1b619a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3283 microversion: 2.1 time: 0.146873 Oct 28 13:05:47.888796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 518/1038] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:47.894016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:47.894906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:47.902495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.905201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.905201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:47.905201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:47.905201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:47.905638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:48.059076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:48.065164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:48.066878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:48.068516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-83d0605a-5cfd-441a-942a-b56d0c14f312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.178526 Oct 28 13:05:48.069091 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 519/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:47 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:48.080263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3071e03c-bbf7-437f-9827-a5b2375aee16 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96e31f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:48.176963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3071e03c-bbf7-437f-9827-a5b2375aee16 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.106813 Oct 28 13:05:48.177557 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 520/1040] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:05:48 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:48.192512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-614b9d4c-a38e-465d-9bd5-557cfac563d5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96e3940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:48.275986 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-614b9d4c-a38e-465d-9bd5-557cfac563d5 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.087283 Oct 28 13:05:48.276560 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 521/1041] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:05:48 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:05:48.290469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d3e66e2-f437-4be9-be9f-222bc224a490 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96e34c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:48.465362 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d3e66e2-f437-4be9-be9f-222bc224a490 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-10-28T13%3A03%3A33Z" status: 200 len: 6336 microversion: 2.1 time: 0.179206 Oct 28 13:05:48.465980 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 522/1042] 10.222.0.25 () {58 vars in 1220 bytes} [Fri Oct 28 13:05:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-28T13%3A03%3A33Z => generated 6336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:48.473032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:48.473759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:48.485773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:48.486562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:48.489906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:48.489906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:48.489906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:48.489906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:48.714433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:48.723344 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0fc68a6-31df-4a8c-bd1b-9398be231c95 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1314 microversion: 2.1 time: 0.256191 Oct 28 13:05:48.724592 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 523/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:48 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:48.740030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:48.741126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:48.748035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:48.748872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:48.749554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:48.750274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:48.750733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:48.751349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:48.955440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:48.976521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7fb1ee00-8529-4d20-886e-3a78d7e3a827 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1317 microversion: 2.1 time: 0.247542 Oct 28 13:05:48.976521 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 524/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:48 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:48.979792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee97fcce-a96d-472e-8a1c-486ec19d9c9e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96e3c10>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:49.082417 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ee97fcce-a96d-472e-8a1c-486ec19d9c9e tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1586569835" status: 200 len: 665 microversion: 2.1 time: 0.107173 Oct 28 13:05:49.083960 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 525/1045] 10.222.0.25 () {58 vars in 1252 bytes} [Fri Oct 28 13:05:48 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1586569835 => generated 665 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:49.101112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:49.102822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:49.112065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:49.113174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:49.114124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:49.115187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:49.116874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:49.117755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:49.391730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:49.401446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:49.403056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:49.404559 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-75fb8d7a-90d9-40b4-8bc2-9dbb388860de tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.312306 Oct 28 13:05:49.405500 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 526/1046] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:49 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:49.428494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-536fe12c-0b9d-4c94-ad87-87544fd9a226 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96e38b0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:49.517711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-536fe12c-0b9d-4c94-ad87-87544fd9a226 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1467 microversion: 2.1 time: 0.110851 Oct 28 13:05:49.518279 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 527/1047] 10.222.0.25 () {58 vars in 1338 bytes} [Fri Oct 28 13:05:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c => generated 1467 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:49.522860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b991daa6-8ff0-400e-978c-098a96ea0fba req-e0106928-681f-44ab-9779-348a01aa7c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e873a2-b078-4190-9f83-0644b1075f4a", "name": "network-vif-plugged", "status": "completed", "tag": "c40493ea-ef8b-4cf6-895b-5e07519f7ce3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:49.534404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b991daa6-8ff0-400e-978c-098a96ea0fba req-e0106928-681f-44ab-9779-348a01aa7c77 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:49.534935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b991daa6-8ff0-400e-978c-098a96ea0fba req-e0106928-681f-44ab-9779-348a01aa7c77 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:49.535379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b991daa6-8ff0-400e-978c-098a96ea0fba req-e0106928-681f-44ab-9779-348a01aa7c77 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:49.559937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b991daa6-8ff0-400e-978c-098a96ea0fba req-e0106928-681f-44ab-9779-348a01aa7c77 service nova] Creating event network-vif-plugged:c40493ea-ef8b-4cf6-895b-5e07519f7ce3 for instance 33e873a2-b078-4190-9f83-0644b1075f4a on n-h2-862876-2 Oct 28 13:05:49.564651 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b991daa6-8ff0-400e-978c-098a96ea0fba req-e0106928-681f-44ab-9779-348a01aa7c77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045073 Oct 28 13:05:49.565409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 528/1048] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:49.572105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4c39db1-1352-4e41-9291-94a0ee92dd07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96951f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:49.629638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4c39db1-1352-4e41-9291-94a0ee92dd07 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1467 microversion: 2.1 time: 0.062859 Oct 28 13:05:49.630610 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 529/1049] 10.222.0.25 () {58 vars in 1324 bytes} [Fri Oct 28 13:05:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2F50f24c67-2a68-4503-b970-023af509105c => generated 1467 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:49.646386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f68f76ad-7162-46ac-8ee8-3d105e51ef4c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96f59d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:49.792017 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f68f76ad-7162-46ac-8ee8-3d105e51ef4c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7111 microversion: 2.1 time: 0.149382 Oct 28 13:05:49.808910 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 530/1050] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Oct 28 13:05:49 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7111 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:49.821810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:49.822559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:49.835255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:49.835819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:49.836793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:49.837853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:49.838501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:49.839129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:49.987470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:50.005814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a8cc68c1-9f99-4ea2-b34a-dbd3750c69ff tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1463 microversion: 2.1 time: 0.195376 Oct 28 13:05:50.006434 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 531/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:49 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:50.011885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe9b0913-356a-4e27-a466-8186b63b534d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96a6dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:50.162066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe9b0913-356a-4e27-a466-8186b63b534d tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.154050 Oct 28 13:05:50.164070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 532/1052] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Oct 28 13:05:50 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:50.183568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:50.184521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:50.194271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:50.195202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:50.196218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:50.197203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:50.197618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:50.198044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:50.467372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:50.480503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e467eea6-1bb1-4443-9726-db5fcdafaefb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1317 microversion: 2.1 time: 0.302096 Oct 28 13:05:50.492819 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 533/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:50 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:50.843279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:50.848849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Searching by: {'deleted': False, 'project_id': 'ba37dbacdf3243f484342b8c106ca4ee'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:50.855638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:50.856497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:50.857475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:50.858574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:50.859296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:50.860197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:50.959435 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1fc5dda2-c419-4292-a1ec-9a684a86b139 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.465450 Oct 28 13:05:50.960008 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 534/1054] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:05:50 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:05:50.965386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5150b11-0d92-4c84-9051-c19890695d2c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27bba10ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:51.028147 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5150b11-0d92-4c84-9051-c19890695d2c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/65e1a51d-1f44-4651-86a6-90233a26cd48" status: 200 len: 784 microversion: 2.1 time: 0.066396 Oct 28 13:05:51.039587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 535/1055] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:05:50 2022] GET /compute/v2.1/images/65e1a51d-1f44-4651-86a6-90233a26cd48 => generated 784 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:51.039587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:51.039587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:51.049693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:51.052268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:51.052844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:51.053554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:51.055008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:51.055008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:51.303714 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.neutron [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] re-assign floating IP 172.25.8.90 from instance 7618262d-4e39-4c6a-b425-6165b9aaf627 Oct 28 13:05:51.362147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Building network info cache for instance {{(pid=127794) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:05:51.425084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:51.436214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:51.437655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:51.438994 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e5dbc5b-7bce-4318-8628-5eab164acf3a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1411 microversion: 2.25 time: 0.409309 Oct 28 13:05:51.440055 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 536/1056] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:51 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1411 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:51.458336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:51.466409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Searching by: {'deleted': False} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:51.476129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:51.477674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:51.478112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:51.479244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:51.480931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:51.481534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:51.654096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Listed batch of 17 results from cell out of 1000 limit. Returned 17 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:05:51.781586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:51.782429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:51.782950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:52.324857 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-204961a9-f4c6-4350-85b3-a1630b7c81ea tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 27817 microversion: 2.1 time: 0.883485 Oct 28 13:05:52.327433 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 537/1057] 10.222.0.25 () {58 vars in 1171 bytes} [Fri Oct 28 13:05:51 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 27817 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:05:52.333235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-182f3fcd-e6ac-4ff8-8a38-180a65d763f9 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9653670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:52.443540 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-182f3fcd-e6ac-4ff8-8a38-180a65d763f9 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.114521 Oct 28 13:05:52.444609 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 538/1058] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:05:52 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:52.451703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-05d1db26-ab15-4abf-8210-30831747e146 req-a3164faa-5979-4065-972f-e0de3169c301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2e9d9c-7859-4f35-a682-330113388325", "tag": "2e664a52-fb0e-479a-80ef-bfb438be1f88"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:52.468806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-05d1db26-ab15-4abf-8210-30831747e146 req-a3164faa-5979-4065-972f-e0de3169c301 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:52.469403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-05d1db26-ab15-4abf-8210-30831747e146 req-a3164faa-5979-4065-972f-e0de3169c301 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:52.470091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-05d1db26-ab15-4abf-8210-30831747e146 req-a3164faa-5979-4065-972f-e0de3169c301 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:52.489857 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-05d1db26-ab15-4abf-8210-30831747e146 req-a3164faa-5979-4065-972f-e0de3169c301 service nova] Creating event network-changed:2e664a52-fb0e-479a-80ef-bfb438be1f88 for instance 4d2e9d9c-7859-4f35-a682-330113388325 on n-h2-862876-2 Oct 28 13:05:52.495853 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-05d1db26-ab15-4abf-8210-30831747e146 req-a3164faa-5979-4065-972f-e0de3169c301 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047807 Oct 28 13:05:52.497206 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 539/1059] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:52.504952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:52.506062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:52.513750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:52.514526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:52.515596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:52.528422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:52.528422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:52.528422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:52.600986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Updating instance_info_cache with network_info: [{"id": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5", "address": "fa:16:3e:f3:f3:eb", "network": {"id": "a791660c-7eb7-446a-a3be-2b028b5235c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1903749844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b572d677cfe48ccb19defc039f78bd8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd85d46b-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127794) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:05:52.707081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:52.716756 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be6e157d-6195-4f88-be2f-243cd7dbf568 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1317 microversion: 2.1 time: 0.218090 Oct 28 13:05:52.717349 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 540/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:52 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:52.724438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Building network info cache for instance {{(pid=127794) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:05:52.727369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a9fb822d-e453-4db3-bb17-30a4d94faff2 req-b6eb9778-3122-4d05-b633-7ff582ec139c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b3df7-aba2-4aa3-b02a-525e788cf294", "name": "network-vif-unplugged", "status": "completed", "tag": "5bf284c1-9f73-4970-ad51-e0c6eeaf0d88"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:52.737476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a9fb822d-e453-4db3-bb17-30a4d94faff2 req-b6eb9778-3122-4d05-b633-7ff582ec139c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:52.737969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a9fb822d-e453-4db3-bb17-30a4d94faff2 req-b6eb9778-3122-4d05-b633-7ff582ec139c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:52.738964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a9fb822d-e453-4db3-bb17-30a4d94faff2 req-b6eb9778-3122-4d05-b633-7ff582ec139c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:52.751986 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a9fb822d-e453-4db3-bb17-30a4d94faff2 req-b6eb9778-3122-4d05-b633-7ff582ec139c service nova] Creating event network-vif-unplugged:5bf284c1-9f73-4970-ad51-e0c6eeaf0d88 for instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 on n-h1-862876-2 Oct 28 13:05:52.760186 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a9fb822d-e453-4db3-bb17-30a4d94faff2 req-b6eb9778-3122-4d05-b633-7ff582ec139c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041611 Oct 28 13:05:52.762228 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 541/1061] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:52.767413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:52.773302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Searching by: {'deleted': False, 'project_id': 'ba37dbacdf3243f484342b8c106ca4ee'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:52.778632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:52.779224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:52.779660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:52.780913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:52.780913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:52.781288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:52.815091 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-acdb8ab0-0d58-4f03-8666-5dc8bd170cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=ca58f2828860400da616cba8da1c1a8a" status: 200 len: 15 microversion: 2.1 time: 0.051492 Oct 28 13:05:52.816479 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 542/1062] 10.222.0.25 () {58 vars in 1231 bytes} [Fri Oct 28 13:05:52 2022] GET /compute/v2.1/servers/detail?tenant_id=ca58f2828860400da616cba8da1c1a8a => generated 15 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:05:52.823176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-337face5-3cc8-4520-af00-f7a733f74e34 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b96959d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:53.365977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Updating instance_info_cache with network_info: [{"id": "07774673-ffa9-48ad-bf64-d35c3f61c97f", "address": "fa:16:3e:1b:1c:81", "network": {"id": "a791660c-7eb7-446a-a3be-2b028b5235c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1903749844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b572d677cfe48ccb19defc039f78bd8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap07774673-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127794) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:05:53.499937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Releasing lock "refresh_cache-afdf702d-0ff5-4877-b3e3-a5c5b0849d54" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:05:53.501324 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4050abb8-ca4e-4dd6-b309-ad4575c90ebf tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54/action" status: 202 len: 0 microversion: 2.1 time: 6.162279 Oct 28 13:05:53.501990 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 521/1063] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:05:47 2022] POST /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54/action => generated 0 bytes in 6164 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:05:53.507428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:53.508660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:53.515065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:53.516153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:53.519661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:53.521422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:53.521993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:53.522602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:53.702770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:53.713363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:53.715311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:53.716838 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdb73ff5-febf-4962-a754-81eaea2fbc75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1607 microversion: 2.25 time: 0.213607 Oct 28 13:05:53.723401 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 522/1064] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:05:53 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1607 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:05:53.723401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:53.739720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Searching by: {'tenant_id': 'ca58f2828860400da616cba8da1c1a8a', 'deleted': False} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:53.747332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:53.747860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:53.748415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:53.749153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:53.749909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:53.750347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:53.856014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:05:53.946460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:53.947872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:53.948510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.165955 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7cf0d23-3abc-4041-95f3-7c0c75b67a9e tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ca58f2828860400da616cba8da1c1a8a" status: 200 len: 4823 microversion: 2.1 time: 0.446877 Oct 28 13:05:54.166951 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 523/1065] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Oct 28 13:05:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ca58f2828860400da616cba8da1c1a8a => generated 4823 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:54.172430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'action', calling method: .version_select at 0x7f27bb3cbca0>, body: {"removeFloatingIp": {"address": "172.25.8.90"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:54.365785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:54.372365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.372853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.376977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.376977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.376977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.376977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.603374 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-337face5-3cc8-4520-af00-f7a733f74e34 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d" status: 204 len: 0 microversion: 2.1 time: 1.786021 Oct 28 13:05:54.603958 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 543/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:52 2022] DELETE /compute/v2.1/images/543e09ab-1847-4e73-8d92-364651f2d93d => generated 0 bytes in 1787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:05:54.608931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:54.609547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:54.616100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.616595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.617035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.617761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.618223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.618655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.644513 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] HTTP exception thrown: Floating IP 172.25.8.90 is not associated with instance 7618262d-4e39-4c6a-b425-6165b9aaf627. Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Request method failure captured: Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action HTTP/1.1 Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 48 Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Nmg6vQgKPsmNfT2R1VpA16WC46l9G9jlsN31nfuPmWUr6bMrF0Yzw639MzpnIFuyzCX5n9_c1v7Rau_wCGY0p5_GH0fWrsyS3n3psM7rZJ7SHUKAVnrAWnj6eXTmLMUDKC7kHEsly7aIruXA5F6V8BoA1v6thrkQHdXyRX5Azf2XI Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:05:54.646199 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b572d677cfe48ccb19defc039f78bd8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: c92551c6642f463b9e8ee3869bf010ad Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: {"removeFloatingIp": {"address": "172.25.8.90"}} Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:05:54.647878 n-d-862876-2 devstack@n-api.service[127794]: exception: Floating IP 172.25.8.90 is not associated with instance 7618262d-4e39-4c6a-b425-6165b9aaf627. Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7618262d-4e39-4c6a-b425-6165b9aaf627', 'body': {'removeFloatingIp': {'address': '172.25.8.90'}}} Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.90 is not associated with instance 7618262d-4e39-4c6a-b425-6165b9aaf627. Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:54.649375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.90 is not associated with instance 7618262d-4e39-4c6a-b425-6165b9aaf627. Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Returning 409 to user: Floating IP 172.25.8.90 is not associated with instance 7618262d-4e39-4c6a-b425-6165b9aaf627. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:05:54.650877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f0ded7b8-b13e-46b8-be3a-45673cd1c3b3 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action" status: 409 len: 145 microversion: 2.1 time: 0.482055 Oct 28 13:05:54.651790 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 524/1067] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:05:54 2022] POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action => generated 145 bytes in 484 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:05:54.656371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:54.656979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:54.663057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.663541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.664033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.665302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.665754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.666207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.698085 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1e16060-1b37-403d-b6f1-2d50ad11cdab tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.093015 Oct 28 13:05:54.698717 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 544/1068] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Oct 28 13:05:54 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:05:54.703416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:54.709573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Searching by: {'tenant_id': 'ba37dbacdf3243f484342b8c106ca4ee', 'deleted': False} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:54.714767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.722696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.722696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.722696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.722696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.723110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.746541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1e919eaa-c205-4029-b2a4-8dcffef90898 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ba37dbacdf3243f484342b8c106ca4ee" status: 200 len: 15 microversion: 2.1 time: 0.046525 Oct 28 13:05:54.764415 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 545/1069] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Oct 28 13:05:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ba37dbacdf3243f484342b8c106ca4ee => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:05:54.800711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:54.809537 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6b1c06b-96c2-4e6f-abb9-198a78b46c6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1317 microversion: 2.1 time: 0.156689 Oct 28 13:05:54.810435 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 525/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:54 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:54.818786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c28f2233-a573-4e01-8685-425a32529cf7 req-7382def4-4004-4907-ad27-77bfc2d1d41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7618262d-4e39-4c6a-b425-6165b9aaf627", "tag": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5"}, {"name": "network-changed", "server_uuid": "afdf702d-0ff5-4877-b3e3-a5c5b0849d54", "tag": "07774673-ffa9-48ad-bf64-d35c3f61c97f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:54.832879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c28f2233-a573-4e01-8685-425a32529cf7 req-7382def4-4004-4907-ad27-77bfc2d1d41a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:54.833474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c28f2233-a573-4e01-8685-425a32529cf7 req-7382def4-4004-4907-ad27-77bfc2d1d41a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:54.834079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c28f2233-a573-4e01-8685-425a32529cf7 req-7382def4-4004-4907-ad27-77bfc2d1d41a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:54.850427 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c28f2233-a573-4e01-8685-425a32529cf7 req-7382def4-4004-4907-ad27-77bfc2d1d41a service nova] Creating event network-changed:bd85d46b-11f3-4fb4-9a98-d233d1c433c5 for instance 7618262d-4e39-4c6a-b425-6165b9aaf627 on n-h1-862876-2 Oct 28 13:05:54.850958 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c28f2233-a573-4e01-8685-425a32529cf7 req-7382def4-4004-4907-ad27-77bfc2d1d41a service nova] Creating event network-changed:07774673-ffa9-48ad-bf64-d35c3f61c97f for instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 on n-h2-862876-2 Oct 28 13:05:54.860273 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c28f2233-a573-4e01-8685-425a32529cf7 req-7382def4-4004-4907-ad27-77bfc2d1d41a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048574 Oct 28 13:05:54.860884 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 526/1071] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:54.866371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee6b77d0-781f-4bf6-a7e9-296d34d3fa77 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b9a064c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:55.025751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ec6a9042-9b85-4517-ad81-251b2dfc64f6 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] Calling method '.version_select at 0x7f27b9695160>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:55.045409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ec6a9042-9b85-4517-ad81-251b2dfc64f6 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.297372 Oct 28 13:05:55.046309 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 546/1072] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Oct 28 13:05:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:55.051345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'action', calling method: .version_select at 0x7f27bb3c5ee0>, body: {"removeFloatingIp": {"address": "172.25.8.90"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:55.734097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:55.744012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:55.744678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:55.745128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:55.746636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:55.747204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:55.747987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:56.312746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "refresh_cache-afdf702d-0ff5-4877-b3e3-a5c5b0849d54" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:05:56.313307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquired lock "refresh_cache-afdf702d-0ff5-4877-b3e3-a5c5b0849d54" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:05:56.636593 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee6b77d0-781f-4bf6-a7e9-296d34d3fa77 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2" status: 204 len: 0 microversion: 2.1 time: 1.774201 Oct 28 13:05:56.640776 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 527/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:54 2022] DELETE /compute/v2.1/images/88317e27-7e26-4f89-9b5a-b47339e1c7e2 => generated 0 bytes in 1776 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:05:56.647837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4287be40-5261-4a41-bce6-dd2b97ed3000 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:56.662089 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4287be40-5261-4a41-bce6-dd2b97ed3000 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.019739 Oct 28 13:05:56.665718 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 528/1074] 10.222.0.25 () {58 vars in 1189 bytes} [Fri Oct 28 13:05:56 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:05:56.691946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5a22e9a-d8fe-44bb-9f93-fec673d42698 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] Action: 'update', calling method: .version_select at 0x7f27b99b8820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:57.861196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Building network info cache for instance {{(pid=127793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:05:58.295524 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5a22e9a-d8fe-44bb-9f93-fec673d42698 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.627219 Oct 28 13:05:58.297996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 529/1075] 10.222.0.25 () {60 vars in 1206 bytes} [Fri Oct 28 13:05:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:58.308840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:58.309590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:58.327883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:58.328489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:58.328942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:58.332566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:58.333794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:58.335812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:58.568903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Updating instance_info_cache with network_info: [{"id": "07774673-ffa9-48ad-bf64-d35c3f61c97f", "address": "fa:16:3e:1b:1c:81", "network": {"id": "a791660c-7eb7-446a-a3be-2b028b5235c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1903749844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b572d677cfe48ccb19defc039f78bd8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap07774673-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:05:58.700310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Releasing lock "refresh_cache-afdf702d-0ff5-4877-b3e3-a5c5b0849d54" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:05:58.701294 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f636df9-5b7b-4b1f-88bd-2ac99754e9c8 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54/action" status: 202 len: 0 microversion: 2.1 time: 3.653769 Oct 28 13:05:58.702106 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 547/1076] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:05:55 2022] POST /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54/action => generated 0 bytes in 3655 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:05:58.710500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b4fe9a6-5544-4cf6-be3a-cccc7c09fc7a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b952c8b0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:58.717713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:58.729941 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6062d2fe-0bb7-432d-9af3-47add7479c9a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1317 microversion: 2.1 time: 0.429232 Oct 28 13:05:58.742084 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 530/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:58 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:05:58.751816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:58.751816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:58.776037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:58.776636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:58.777119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:58.777850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:58.778301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:58.778719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:59.274168 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bfae1b19-80f2-42c4-8658-839133d0ceec tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action" status: 202 len: 0 microversion: 2.1 time: 0.538124 Oct 28 13:05:59.275407 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 531/1078] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:05:58 2022] POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:05:59.285717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5370e024-20f2-417a-89f5-39191162d8bf req-eb7681f2-bd28-49cf-8857-65004a93c8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e873a2-b078-4190-9f83-0644b1075f4a", "tag": "c40493ea-ef8b-4cf6-895b-5e07519f7ce3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:59.288515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:59.296876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5370e024-20f2-417a-89f5-39191162d8bf req-eb7681f2-bd28-49cf-8857-65004a93c8bb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:59.297486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5370e024-20f2-417a-89f5-39191162d8bf req-eb7681f2-bd28-49cf-8857-65004a93c8bb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:59.297761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5370e024-20f2-417a-89f5-39191162d8bf req-eb7681f2-bd28-49cf-8857-65004a93c8bb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:59.310003 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5370e024-20f2-417a-89f5-39191162d8bf req-eb7681f2-bd28-49cf-8857-65004a93c8bb service nova] Creating event network-changed:c40493ea-ef8b-4cf6-895b-5e07519f7ce3 for instance 33e873a2-b078-4190-9f83-0644b1075f4a on n-h2-862876-2 Oct 28 13:05:59.316741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5370e024-20f2-417a-89f5-39191162d8bf req-eb7681f2-bd28-49cf-8857-65004a93c8bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039868 Oct 28 13:05:59.317670 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 532/1079] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:59.326278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-179fc1b7-0589-40e4-b41f-1e0c33762e10 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] Calling method '.version_select at 0x7f27b98a5820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:59.339752 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-179fc1b7-0589-40e4-b41f-1e0c33762e10 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.020657 Oct 28 13:05:59.348426 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 533/1080] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Oct 28 13:05:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:59.357556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:59.361584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:05:59.369131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:59.369839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:59.370522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:59.371435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:59.372134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:59.372846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:59.407492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:05:59.456823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:UPDATE=5,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:05:59.798597 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff70dd4d-49f5-4d69-aa4b-c5a972f8b098 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 204 len: 0 microversion: 2.1 time: 0.448778 Oct 28 13:05:59.800017 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 534/1081] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:05:59 2022] DELETE /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:05:59.809426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d0e26430-fe0d-4454-9b01-fcdd7d6480b5 req-6b8b0be7-3315-488b-abfd-788462f610b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2e9d9c-7859-4f35-a682-330113388325", "name": "network-vif-plugged", "status": "completed", "tag": "2e664a52-fb0e-479a-80ef-bfb438be1f88"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:05:59.827021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0e26430-fe0d-4454-9b01-fcdd7d6480b5 req-6b8b0be7-3315-488b-abfd-788462f610b4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:59.827868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0e26430-fe0d-4454-9b01-fcdd7d6480b5 req-6b8b0be7-3315-488b-abfd-788462f610b4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:59.828512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0e26430-fe0d-4454-9b01-fcdd7d6480b5 req-6b8b0be7-3315-488b-abfd-788462f610b4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:59.862370 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d0e26430-fe0d-4454-9b01-fcdd7d6480b5 req-6b8b0be7-3315-488b-abfd-788462f610b4 service nova] Creating event network-vif-plugged:2e664a52-fb0e-479a-80ef-bfb438be1f88 for instance 4d2e9d9c-7859-4f35-a682-330113388325 on n-h2-862876-2 Oct 28 13:05:59.871491 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d0e26430-fe0d-4454-9b01-fcdd7d6480b5 req-6b8b0be7-3315-488b-abfd-788462f610b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066176 Oct 28 13:05:59.872818 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 535/1082] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:05:59.881118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:05:59.905877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:05:59.905877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ca58f2828860400da616cba8da1c1a8a'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:05:59.905877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:59.906453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:59.906453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:05:59.906453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:05:59.906453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:05:59.906941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:00.000086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:06:00.068333 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f0ba203-5896-42aa-bb84-18be23610a7e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.192526 Oct 28 13:06:00.075914 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 536/1083] 10.222.0.25 () {58 vars in 1150 bytes} [Fri Oct 28 13:05:59 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:00.078953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0fd8f5e2-24b5-4ebd-8659-ac5c39cdf7f8 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9888af0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:00.509586 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b4fe9a6-5544-4cf6-be3a-cccc7c09fc7a tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f" status: 204 len: 0 microversion: 2.1 time: 1.805016 Oct 28 13:06:00.512300 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 548/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:05:58 2022] DELETE /compute/v2.1/images/c17f1e96-0e47-4c61-9ceb-40644019fd5f => generated 0 bytes in 1808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:00.521170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:00.522349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:00.533318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:00.534147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:00.535492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:00.536524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:00.537196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:00.537894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:00.689204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:00.693864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:00.699384 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-036fb774-f008-4016-a0ba-6f18fc1693ad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1317 microversion: 2.1 time: 0.184737 Oct 28 13:06:00.699999 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 549/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:00 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:00.704919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'action', calling method: .version_select at 0x7f27bb3c5f70>, body: {"addFloatingIp": {"address": "172.25.8.90"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:00.708252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:00.715969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:00.716460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:00.716919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:00.717653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:00.718102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:00.718720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:00.747005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:06:00.747400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquired lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:06:01.256925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0fd8f5e2-24b5-4ebd-8659-ac5c39cdf7f8 tempest-QuotaClassesAdminTestJSON-1213281229 tempest-QuotaClassesAdminTestJSON-1213281229-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.182179 Oct 28 13:06:01.259318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 537/1086] 10.222.0.25 () {60 vars in 1206 bytes} [Fri Oct 28 13:06:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:01.272686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:01.277107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:01.284157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:01.287324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:01.289437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:01.290421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:01.291081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:01.291681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:01.611947 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2327ec9c-7065-4edd-81e1-9b32407d575f tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action" status: 202 len: 0 microversion: 2.1 time: 0.348666 Oct 28 13:06:01.618052 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 538/1087] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:06:01 2022] POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:06:01.633305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:01.633827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:01.658097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:01.659009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:01.659729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:01.660640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:01.661204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:01.661983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:01.742664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:06:02.153245 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5abcaec-e347-4122-ac28-b95c77a0d165 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 204 len: 0 microversion: 2.1 time: 0.539022 Oct 28 13:06:02.154296 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 539/1088] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:06:01 2022] DELETE /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:02.168705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5b9824f6-1927-4fb8-9c08-e2c1c0be33cc req-ad4e71aa-ce57-4bda-bb8b-f986dc504a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afdf702d-0ff5-4877-b3e3-a5c5b0849d54", "tag": "07774673-ffa9-48ad-bf64-d35c3f61c97f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:02.184485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5b9824f6-1927-4fb8-9c08-e2c1c0be33cc req-ad4e71aa-ce57-4bda-bb8b-f986dc504a2c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:02.185058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5b9824f6-1927-4fb8-9c08-e2c1c0be33cc req-ad4e71aa-ce57-4bda-bb8b-f986dc504a2c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:02.186863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5b9824f6-1927-4fb8-9c08-e2c1c0be33cc req-ad4e71aa-ce57-4bda-bb8b-f986dc504a2c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:02.217548 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5b9824f6-1927-4fb8-9c08-e2c1c0be33cc req-ad4e71aa-ce57-4bda-bb8b-f986dc504a2c service nova] Creating event network-changed:07774673-ffa9-48ad-bf64-d35c3f61c97f for instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 on n-h2-862876-2 Oct 28 13:06:02.228143 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5b9824f6-1927-4fb8-9c08-e2c1c0be33cc req-ad4e71aa-ce57-4bda-bb8b-f986dc504a2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072017 Oct 28 13:06:02.228977 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 540/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:02.248884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:02.249691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:02.266959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:02.271322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:02.271865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:02.272628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:02.273161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:02.274657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:02.661402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Building network info cache for instance {{(pid=127793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:06:02.749314 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb15ca99-958b-4e43-97fb-de63913f61ce tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1613 microversion: 2.1 time: 0.517420 Oct 28 13:06:02.750227 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 541/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:02 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1613 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:02.759031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:02.759648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:02.780019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:02.780594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:02.781050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:02.781776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:02.782272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:02.782652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:03.142905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:03.151077 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7347f09f-d05d-4c50-8bc8-59ecd5ad0837 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1317 microversion: 2.1 time: 0.400047 Oct 28 13:06:03.154886 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 542/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:02 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:03.162662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:03.168344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:03.180802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:03.181294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:03.181726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:03.182435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:03.182924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:03.183399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:03.446179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:03.461755 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-242fd30a-6c20-43d1-9539-2796fdad89a1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1474 microversion: 2.1 time: 0.304935 Oct 28 13:06:03.475468 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 543/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:03 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1474 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:03.483288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:03.484264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:03.494521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:03.495110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:03.495767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:03.496675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:03.498101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:03.498536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:03.709940 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec16c369-2764-4ae0-9d36-fc64a4774119 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1613 microversion: 2.1 time: 0.233009 Oct 28 13:06:03.711520 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 544/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:03 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1613 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:04.074668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dca8c2ff-d21b-4dd8-bcc2-71d540a6afc5 tempest-FloatingIPDetailsNegativeTestJSON-1007993503 tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project] Calling method '.version_select at 0x7f27b99b8ee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:04.165171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-dca8c2ff-d21b-4dd8-bcc2-71d540a6afc5 tempest-FloatingIPDetailsNegativeTestJSON-1007993503 tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dc5d55dc-109f-4d1c-a659-22f6596b256b could not be found", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:06:04.165865 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-dca8c2ff-d21b-4dd8-bcc2-71d540a6afc5 tempest-FloatingIPDetailsNegativeTestJSON-1007993503 tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project] HTTP exception thrown: Floating IP not found for ID dc5d55dc-109f-4d1c-a659-22f6596b256b Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dca8c2ff-d21b-4dd8-bcc2-71d540a6afc5 tempest-FloatingIPDetailsNegativeTestJSON-1007993503 tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project] Request method failure captured: Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-floating-ips/dc5d55dc-109f-4d1c-a659-22f6596b256b HTTP/1.1 Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9O6r82YwxJIFmb0aJQ_Wh4o-sV_scy8Fouyjg0qqkBRlXrBz-LA8I6WE4DhbZSXl155RwuI80K0PdRZVEgr3LlrZOScVLw0KSGAaVVcfIt3OHrnScIf2Fz16WXSd7QwSbONU0LcD1xpg1zYmvtzkWhzkkSn2CIx2OO0DWeUH0isF0s Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: bc4ee98bef5c472e93cd674beb1d0216 Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1007993503 Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:06:04.173057 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc4ee98bef5c472e93cd674beb1d0216"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bc4ee98bef5c472e93cd674beb1d0216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bc4ee98bef5c472e93cd674beb1d0216", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bc4ee98bef5c472e93cd674beb1d0216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1007993503 Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: bc4ee98bef5c472e93cd674beb1d0216 Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1007993503 Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 00a96709fbf84e3bb0390ec380ff0a0c Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: exception: Floating IP not found for ID dc5d55dc-109f-4d1c-a659-22f6596b256b Oct 28 13:06:04.174376 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'dc5d55dc-109f-4d1c-a659-22f6596b256b'} Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:06:04.175690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dc5d55dc-109f-4d1c-a659-22f6596b256b could not be found Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f566202-a09d-46c2-8ac0-69b9b190e18b'] Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dc5d55dc-109f-4d1c-a659-22f6596b256b. Oct 28 13:06:04.176834 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dc5d55dc-109f-4d1c-a659-22f6596b256b Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:04.177994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:04.179265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:04.179265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dc5d55dc-109f-4d1c-a659-22f6596b256b Oct 28 13:06:04.179265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:04.179265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dca8c2ff-d21b-4dd8-bcc2-71d540a6afc5 tempest-FloatingIPDetailsNegativeTestJSON-1007993503 tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project] Returning 404 to user: Floating IP not found for ID dc5d55dc-109f-4d1c-a659-22f6596b256b {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:04.179265 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dca8c2ff-d21b-4dd8-bcc2-71d540a6afc5 tempest-FloatingIPDetailsNegativeTestJSON-1007993503 tempest-FloatingIPDetailsNegativeTestJSON-1007993503-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/dc5d55dc-109f-4d1c-a659-22f6596b256b" status: 404 len: 111 microversion: 2.1 time: 0.461909 Oct 28 13:06:04.181988 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 545/1094] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:06:03 2022] GET /compute/v2.1/os-floating-ips/dc5d55dc-109f-4d1c-a659-22f6596b256b => generated 111 bytes in 469 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:06:04.190806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5386e6f8-2ba3-4a8f-bdb9-5af63b2b1809 req-f7313052-b8a4-4a7e-8f07-6c0996260e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdf702d-0ff5-4877-b3e3-a5c5b0849d54", "name": "network-vif-deleted", "tag": "07774673-ffa9-48ad-bf64-d35c3f61c97f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:04.205993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5386e6f8-2ba3-4a8f-bdb9-5af63b2b1809 req-f7313052-b8a4-4a7e-8f07-6c0996260e57 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.207052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5386e6f8-2ba3-4a8f-bdb9-5af63b2b1809 req-f7313052-b8a4-4a7e-8f07-6c0996260e57 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.207699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5386e6f8-2ba3-4a8f-bdb9-5af63b2b1809 req-f7313052-b8a4-4a7e-8f07-6c0996260e57 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.220988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5386e6f8-2ba3-4a8f-bdb9-5af63b2b1809 req-f7313052-b8a4-4a7e-8f07-6c0996260e57 service nova] Creating event network-vif-deleted:07774673-ffa9-48ad-bf64-d35c3f61c97f for instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 on n-h2-862876-2 Oct 28 13:06:04.227514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5386e6f8-2ba3-4a8f-bdb9-5af63b2b1809 req-f7313052-b8a4-4a7e-8f07-6c0996260e57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043087 Oct 28 13:06:04.232100 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 546/1095] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:04.237738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:04.248746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Searching by: {'host': 'n-h1-862876-2', 'deleted': False} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:06:04.255123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.255658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.256193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.256959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.257414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.258242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.390209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:06:04.492623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e4c3170e-255e-49a6-906f-8cd35b26e493 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h1-862876-2&all_tenants=1" status: 200 len: 3314 microversion: 2.1 time: 0.258659 Oct 28 13:06:04.494982 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 547/1096] 10.222.0.25 () {58 vars in 1190 bytes} [Fri Oct 28 13:06:04 2022] GET /compute/v2.1/servers?host=n-h1-862876-2&all_tenants=1 => generated 3314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:04.502591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:04.504380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:04.513924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.515745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.517131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.518184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.518937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.519737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.528657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Updating instance_info_cache with network_info: [{"id": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5", "address": "fa:16:3e:f3:f3:eb", "network": {"id": "a791660c-7eb7-446a-a3be-2b028b5235c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1903749844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b572d677cfe48ccb19defc039f78bd8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd85d46b-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:06:04.620907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Releasing lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:06:04.625232 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0dcd3b2-fcba-4c58-b132-b309d15e89a5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action" status: 202 len: 0 microversion: 2.1 time: 3.922323 Oct 28 13:06:04.627623 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 550/1097] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:06:00 2022] POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action => generated 0 bytes in 3927 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:06:04.644971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a9e6f056-35fc-40cc-9964-105956a634aa req-a691160e-8ef4-4d2e-8846-33178aeeb07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7618262d-4e39-4c6a-b425-6165b9aaf627", "tag": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:04.669308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a9e6f056-35fc-40cc-9964-105956a634aa req-a691160e-8ef4-4d2e-8846-33178aeeb07e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.671632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a9e6f056-35fc-40cc-9964-105956a634aa req-a691160e-8ef4-4d2e-8846-33178aeeb07e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.672559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a9e6f056-35fc-40cc-9964-105956a634aa req-a691160e-8ef4-4d2e-8846-33178aeeb07e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.689669 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a9e6f056-35fc-40cc-9964-105956a634aa req-a691160e-8ef4-4d2e-8846-33178aeeb07e service nova] Creating event network-changed:bd85d46b-11f3-4fb4-9a98-d233d1c433c5 for instance 7618262d-4e39-4c6a-b425-6165b9aaf627 on n-h1-862876-2 Oct 28 13:06:04.698331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a9e6f056-35fc-40cc-9964-105956a634aa req-a691160e-8ef4-4d2e-8846-33178aeeb07e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068890 Oct 28 13:06:04.988118 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 551/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:04.988118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:04.988118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:04.988118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:04.988118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.989919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.989919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.989919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.989919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.991074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.994035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:04.994035 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4ea697e-f8a2-4a12-b09a-58f35a51e78b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1466 microversion: 2.1 time: 0.307541 Oct 28 13:06:04.994035 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 548/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:04 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1466 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:04.994035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:04.996026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:06:04.996026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.996026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.996026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.997021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:04.997021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:04.997021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:04.997021 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c461995-fa79-4989-9cdb-40038c544d88 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.041282 Oct 28 13:06:04.998070 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 549/1100] 10.222.0.25 () {58 vars in 1196 bytes} [Fri Oct 28 13:06:04 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:06:04.998070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b6405d2-284e-4055-980e-17c74b8189cb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '.version_select at 0x7f27b96e4ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:05.037465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=14 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:05.094031 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b6405d2-284e-4055-980e-17c74b8189cb tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/ccf8ac1f-063a-4454-aa57-818469767adf" status: 200 len: 183 microversion: 2.1 time: 0.242915 Oct 28 13:06:05.095885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 550/1101] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:06:04 2022] GET /compute/v2.1/os-floating-ips/ccf8ac1f-063a-4454-aa57-818469767adf => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:05.100831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:05.104343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:05.111772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.112259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.112888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.114167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.114650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.115311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.184327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:05.192340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-08843a6f-6e1f-40e5-a464-94204b196f41 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1474 microversion: 2.1 time: 0.491888 Oct 28 13:06:05.192920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 552/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:04 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1474 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:05.197759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:05.198365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:05.204212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.207933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.207933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.207933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.207933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.208308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.352443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:05.517223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7fec9c70-d795-434d-b09c-c6648fc2f066 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action" status: 202 len: 0 microversion: 2.1 time: 0.420976 Oct 28 13:06:05.518573 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 551/1103] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:06:05 2022] POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:06:05.524020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.90"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:05.620798 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52baf13b-93f6-4983-88f3-1f1a7dc1ed18 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1617 microversion: 2.1 time: 0.426775 Oct 28 13:06:05.626912 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 553/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:05 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1617 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:05.637546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:05.641675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:05.657245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.657928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.658464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.659907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.660311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:05.660577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.661129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.668995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.669551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.669940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.671532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:05.672070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:05.672494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:05.829605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:05.835103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:05.839713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:05.840250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:05.841963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:05.967589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:06:05.968004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquired lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:06:06.115890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:06.130466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:06.134692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:06.135397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:06.136310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:06.136959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:06.139095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:06.209454 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-83009902-820c-4170-8a6c-9dde4022e5ac tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action" status: 202 len: 1066 microversion: 2.1 time: 0.578600 Oct 28 13:06:06.210918 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 554/1105] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:06:05 2022] POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action => generated 1066 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 13:06:06.225549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-862796277", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7b9de8fb-d31e-4f62-b8cb-cafb20df5769"]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:06.288555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:06:07.352372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:07.352918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:07.355791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:07.356348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:07.357020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:07.383036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:07.383036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:07.383451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:07.385260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:07.386890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:07.389430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:07.427908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:07.448520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:07.454641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:07.485798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:06:07.488624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:06:07.700010 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-89e31ce6-399a-46aa-b8c3-a5132d19ac72 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.483238 Oct 28 13:06:07.706452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 555/1106] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:06:07.730100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:07.732126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:07.749400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:07.762695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:07.762695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:07.762695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:07.762695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:07.764518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:07.866576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:07.868920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:07.869551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:07.871435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lazy-loading 'fault' on Instance uuid 50f24c67-2a68-4503-b970-023af509105c {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:07.963899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Building network info cache for instance {{(pid=127794) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:06:08.214929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:08.223220 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-612098a9-f779-48b7-aaf2-4a2be72d94a0 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 200 len: 1308 microversion: 2.1 time: 0.514229 Oct 28 13:06:08.223810 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 556/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:07 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:08.234410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:08.235098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:08.261875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:08.264475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:08.267360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:08.268397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:08.270494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:08.274372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:08.923698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:08.937190 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d075d438-974a-4402-a9ed-3cd2ae84435a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1470 microversion: 2.1 time: 0.712259 Oct 28 13:06:08.939202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 557/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:08 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1470 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:08.957766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2199b6b3-0139-4179-a428-92ce3ae54de6 req-f0799f66-210f-4cc5-95c9-a7ec1c80e24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f24c67-2a68-4503-b970-023af509105c", "name": "network-vif-deleted", "tag": "c1cc3ab6-4dba-4722-ab4c-0acee2b8276e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:09.024501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2199b6b3-0139-4179-a428-92ce3ae54de6 req-f0799f66-210f-4cc5-95c9-a7ec1c80e24b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.028609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2199b6b3-0139-4179-a428-92ce3ae54de6 req-f0799f66-210f-4cc5-95c9-a7ec1c80e24b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.028609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2199b6b3-0139-4179-a428-92ce3ae54de6 req-f0799f66-210f-4cc5-95c9-a7ec1c80e24b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.079646 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2199b6b3-0139-4179-a428-92ce3ae54de6 req-f0799f66-210f-4cc5-95c9-a7ec1c80e24b service nova] Creating event network-vif-deleted:c1cc3ab6-4dba-4722-ab4c-0acee2b8276e for instance 50f24c67-2a68-4503-b970-023af509105c on n-h1-862876-2 Oct 28 13:06:09.085164 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2199b6b3-0139-4179-a428-92ce3ae54de6 req-f0799f66-210f-4cc5-95c9-a7ec1c80e24b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144337 Oct 28 13:06:09.086445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 558/1109] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:09.117122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40dfac4f-f5b6-4ee9-8b6c-0d120cc824ca tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:09.123570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40dfac4f-f5b6-4ee9-8b6c-0d120cc824ca tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:09.321403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Updating instance_info_cache with network_info: [{"id": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5", "address": "fa:16:3e:f3:f3:eb", "network": {"id": "a791660c-7eb7-446a-a3be-2b028b5235c0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1903749844-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b572d677cfe48ccb19defc039f78bd8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd85d46b-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127794) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:06:09.323459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40dfac4f-f5b6-4ee9-8b6c-0d120cc824ca tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:09.344894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40dfac4f-f5b6-4ee9-8b6c-0d120cc824ca tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1216 microversion: 2.1 time: 0.255692 Oct 28 13:06:09.345843 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 559/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:09 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:09.374340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-076a8d07-b091-469b-8c8d-417508805837 req-15bd960f-ed85-47bc-89c5-a48bb4cf4585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7618262d-4e39-4c6a-b425-6165b9aaf627", "tag": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:09.388468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-076a8d07-b091-469b-8c8d-417508805837 req-15bd960f-ed85-47bc-89c5-a48bb4cf4585 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.388954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-076a8d07-b091-469b-8c8d-417508805837 req-15bd960f-ed85-47bc-89c5-a48bb4cf4585 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.389546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-076a8d07-b091-469b-8c8d-417508805837 req-15bd960f-ed85-47bc-89c5-a48bb4cf4585 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.405526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-076a8d07-b091-469b-8c8d-417508805837 req-15bd960f-ed85-47bc-89c5-a48bb4cf4585 service nova] Creating event network-changed:bd85d46b-11f3-4fb4-9a98-d233d1c433c5 for instance 7618262d-4e39-4c6a-b425-6165b9aaf627 on n-h1-862876-2 Oct 28 13:06:09.417570 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-076a8d07-b091-469b-8c8d-417508805837 req-15bd960f-ed85-47bc-89c5-a48bb4cf4585 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048929 Oct 28 13:06:09.418289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 560/1111] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:09.424901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:09.425615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: 50f24c67-2a68-4503-b970-023af509105c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:09.432582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.433300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.433899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.434964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.435584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.436169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.443407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Releasing lock "refresh_cache-7618262d-4e39-4c6a-b425-6165b9aaf627" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:06:09.446882 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef57b47d-0d21-4fba-b97e-984c77b595c2 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action" status: 202 len: 0 microversion: 2.1 time: 3.924615 Oct 28 13:06:09.446882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 552/1112] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:06:05 2022] POST /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627/action => generated 0 bytes in 3926 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:06:09.461367 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] HTTP exception thrown: Instance 50f24c67-2a68-4503-b970-023af509105c could not be found. Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Request method failure captured: Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c HTTP/1.1 Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Mk72dPc-qG0sIQzYRugdUAZhqZKnWZTuWcE8nuOcgOs66japcpmhxfzVcR_opHJFGSpXW7K4-dBcucNYnPT2VCWq_p-UxSdKmgTzHnnQREcAN_1q0nMZcX2vFPiajCAKSmCWraZhVYf6erBF4fai2m-bl7tZQBAhrme1EhnOK4eII Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 4f51dc9ea4fd4a00b97d3a43d851acbd Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListImageFiltersTestJSON-1763150665 Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:06:09.463505 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f51dc9ea4fd4a00b97d3a43d851acbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f51dc9ea4fd4a00b97d3a43d851acbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f51dc9ea4fd4a00b97d3a43d851acbd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f51dc9ea4fd4a00b97d3a43d851acbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListImageFiltersTestJSON-1763150665 Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 4f51dc9ea4fd4a00b97d3a43d851acbd Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1763150665 Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListImageFiltersTestJSON-1763150665-project Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 419066f907e545a39fd554ca1fc680a4 Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListImageFiltersTestJSON-1763150665-project Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 50f24c67-2a68-4503-b970-023af509105c could not be found. Oct 28 13:06:09.465209 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '50f24c67-2a68-4503-b970-023af509105c'} Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50f24c67-2a68-4503-b970-023af509105c could not be found. Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:09.466192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50f24c67-2a68-4503-b970-023af509105c could not be found. Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50f24c67-2a68-4503-b970-023af509105c could not be found. Oct 28 13:06:09.467785 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.470230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Returning 404 to user: Instance 50f24c67-2a68-4503-b970-023af509105c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:09.471280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37dda48c-e4d7-43a6-bf18-eb9a155e4d7c tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c" status: 404 len: 111 microversion: 2.1 time: 0.051543 Oct 28 13:06:09.472364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 561/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:09 2022] GET /compute/v2.1/servers/50f24c67-2a68-4503-b970-023af509105c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:06:09.486236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:09.487171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:09.496400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.497179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.497807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.498921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.500535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.501149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.535977 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] HTTP exception thrown: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Request method failure captured: Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 HTTP/1.1 Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Nmg6vQgKPsmNfT2R1VpA16WC46l9G9jlsN31nfuPmWUr6bMrF0Yzw639MzpnIFuyzCX5n9_c1v7Rau_wCGY0p5_GH0fWrsyS3n3psM7rZJ7SHUKAVnrAWnj6eXTmLMUDKC7kHEsly7aIruXA5F6V8BoA1v6thrkQHdXyRX5Azf2XI Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:06:09.538477 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b572d677cfe48ccb19defc039f78bd8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c92551c6642f463b9e8ee3869bf010ad Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.540206 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'afdf702d-0ff5-4877-b3e3-a5c5b0849d54'} Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:09.541124 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.542584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.547148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Returning 404 to user: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:09.556086 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99e78f22-129d-41c4-893a-8711e2682693 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 404 len: 111 microversion: 2.1 time: 0.082341 Oct 28 13:06:09.561879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 562/1114] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:06:09 2022] DELETE /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:06:09.573308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:09.573827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:09.593669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.594180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.594621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.595370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.595833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.596260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.672305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:06:09.732947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7aa6ecc8-3897-4731-a30e-0b4a8e1372c2 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Calling method '.version_select at 0x7f27b9787700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:09.833066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7aa6ecc8-3897-4731-a30e-0b4a8e1372c2 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e" status: 200 len: 371 microversion: 2.1 time: 0.386864 Oct 28 13:06:09.847147 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 553/1115] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 13:06:09 2022] GET /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e => generated 371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:09.858549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:09.864340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: afdf702d-0ff5-4877-b3e3-a5c5b0849d54] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:09.879557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.883400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.883400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.884644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:09.885363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:09.885959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:09.918924 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] HTTP exception thrown: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Request method failure captured: Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 HTTP/1.1 Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Nmg6vQgKPsmNfT2R1VpA16WC46l9G9jlsN31nfuPmWUr6bMrF0Yzw639MzpnIFuyzCX5n9_c1v7Rau_wCGY0p5_GH0fWrsyS3n3psM7rZJ7SHUKAVnrAWnj6eXTmLMUDKC7kHEsly7aIruXA5F6V8BoA1v6thrkQHdXyRX5Azf2XI Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:06:09.924040 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b572d677cfe48ccb19defc039f78bd8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: c92551c6642f463b9e8ee3869bf010ad Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.925863 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'afdf702d-0ff5-4877-b3e3-a5c5b0849d54'} Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:09.926739 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. Oct 28 13:06:09.928175 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:09.930786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Returning 404 to user: Instance afdf702d-0ff5-4877-b3e3-a5c5b0849d54 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:09.933976 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-572dbe00-5e9d-4bda-800c-8857250225f4 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54" status: 404 len: 111 microversion: 2.1 time: 0.083438 Oct 28 13:06:09.936010 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 554/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:09 2022] GET /compute/v2.1/servers/afdf702d-0ff5-4877-b3e3-a5c5b0849d54 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:06:09.950458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Action: 'update', calling method: .version_select at 0x7f27b98a5670>, body: {"quota_set": {"ram": "5120"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:10.065775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:10.066521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:10.067292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:10.068821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:10.071205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:10.071867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:10.238088 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0011144-03cf-41d5-93db-5cc302eb4ae3 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 204 len: 0 microversion: 2.1 time: 0.673475 Oct 28 13:06:10.241872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 563/1117] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:06:09 2022] DELETE /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:10.248099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ec5578c1-c8da-4f44-a258-5906078c3a77 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '.version_select at 0x7f27b96f59d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:10.422738 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5ece2a5-c931-4cd3-bab8-853d36566f47 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e" status: 200 len: 328 microversion: 2.1 time: 0.485415 Oct 28 13:06:10.427437 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 555/1118] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:06:09 2022] PUT /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e => generated 328 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:10.436901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:10.437782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:10.453192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:10.453992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:10.454668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:10.457742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:10.458460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:10.459121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:10.895075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:10.905143 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3e98c8e4-4c72-4f20-a18c-7aeeb9ba7ee8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1470 microversion: 2.1 time: 0.476372 Oct 28 13:06:10.905721 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 556/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:10 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1470 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:10.919208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:10.920116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:10.929241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:10.930878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:10.931580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:10.933150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:10.933917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:10.934658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:11.108050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:11.115800 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5078d7c4-c329-4dd5-be3a-bf2ecf8a8474 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1473 microversion: 2.1 time: 0.208937 Oct 28 13:06:11.116372 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 557/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:10 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:11.121568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:11.122476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:11.130412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:11.131516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:11.132273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:11.133778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:11.134470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:11.135203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:11.201517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:11.209432 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8158e8f8-e876-4161-a5d4-27dc8ca96765 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1268 microversion: 2.1 time: 0.091336 Oct 28 13:06:11.210027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 558/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:11 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1268 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:11.214899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36cfaa29-0b25-4eaf-b1b9-5e623a701e04 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:11.219449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=14,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:11.325787 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36cfaa29-0b25-4eaf-b1b9-5e623a701e04 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e" status: 202 len: 0 microversion: 2.1 time: 0.114110 Oct 28 13:06:11.330324 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 559/1122] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:06:11 2022] DELETE /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:06:11.337234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c2e4346e-0ad4-461e-ad94-da1ea8c9e656 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Calling method '.version_select at 0x7f27b98a5790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:11.387994 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ec5578c1-c8da-4f44-a258-5906078c3a77 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ccf8ac1f-063a-4454-aa57-818469767adf" status: 202 len: 0 microversion: 2.1 time: 1.143423 Oct 28 13:06:11.388407 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 564/1123] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:06:10 2022] DELETE /compute/v2.1/os-floating-ips/ccf8ac1f-063a-4454-aa57-818469767adf => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:06:11.396279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:11.397033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:11.416569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:11.416569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:11.416569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:11.421394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:11.422281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:11.425224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:11.467761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:06:11.474836 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c2e4346e-0ad4-461e-ad94-da1ea8c9e656 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e" status: 200 len: 371 microversion: 2.1 time: 0.143221 Oct 28 13:06:11.489669 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 560/1124] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 13:06:11 2022] GET /compute/v2.1/os-quota-sets/b5aa853768dc4767a46bc197e785522e => generated 371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:11.889021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-280080da-fc50-4996-8ad6-34e3c036cf98 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Calling method '.version_select at 0x7f27b96e44c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:11.895065 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20e34634-63c6-4f2c-9b9e-466a56884081 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 204 len: 0 microversion: 2.1 time: 0.502427 Oct 28 13:06:11.895660 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 565/1125] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:06:11 2022] DELETE /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:11.914155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:11.915131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:11.925338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:11.926195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:11.927008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:11.927959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:11.928625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:11.929247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:11.935356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:12.161187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-280080da-fc50-4996-8ad6-34e3c036cf98 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.276234 Oct 28 13:06:12.172151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 561/1126] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:06:11 2022] GET /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e/defaults => generated 371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:06:12.202961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:12.203538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:12.228566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.229280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.230255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.230409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.230929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.231338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.394082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:12.408339 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d35276cd-56ea-4b95-b53f-848cb9801c56 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1526 microversion: 2.1 time: 0.507698 Oct 28 13:06:12.409437 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 566/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:11 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1526 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:12.417510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:12.421857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:12.434846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.435727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.436461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.437353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.437962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.438835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.592661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:12.603789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abb0b6e9-3cf9-4b23-914d-751418456a8d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1470 microversion: 2.1 time: 0.417131 Oct 28 13:06:12.618157 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 562/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:12 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1470 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:12.627032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:12.627746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:12.635812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.636372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.637026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.637926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.638626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.639295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.695678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:12.703910 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0376fbea-5a86-4cf3-bac0-68487da00cf1 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1473 microversion: 2.1 time: 0.293337 Oct 28 13:06:12.704762 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 567/1129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:12 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:12.711303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Action: 'update', calling method: .version_select at 0x7f27b967f790>, body: {"quota_set": {"ram": "5120"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:12.746343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:12.762657 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-21f4b046-f8ca-4992-9f5f-ac6954d7389d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1274 microversion: 2.1 time: 0.143224 Oct 28 13:06:12.763599 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 563/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:12 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:12.779080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96ac7d09-63ff-49a0-8240-e79eab5d677e"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:12.784030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:12.791355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.792173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.792759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.793812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.794481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.795140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.881435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.881927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.882485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:12.883772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:12.884228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:12.884655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:13.068827 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5645e166-790d-421f-b3e1-89ac8387a04e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007" status: 200 len: 328 microversion: 2.1 time: 0.362994 Oct 28 13:06:13.069497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 568/1131] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:06:12 2022] PUT /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007 => generated 328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:13.081840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Calling method '.version_select at 0x7f27b94a43a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:13.158277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:13.159230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:13.159895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:13.160909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:13.161829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:13.162459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:13.183438 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cea28f06-b367-4d90-ba30-2b0e2391ff7c tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007/detail" status: 200 len: 916 microversion: 2.1 time: 0.105087 Oct 28 13:06:13.184433 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 569/1132] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:06:13 2022] GET /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007/detail => generated 916 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:06:13.438883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:13.442175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:13.462295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:13.463985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:13.473759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:13.473759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:13.473759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:13.473759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:13.937950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:13.945870 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be3cfb0c-919d-440f-b945-ecd86c441cbc tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1526 microversion: 2.1 time: 0.511093 Oct 28 13:06:13.962113 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 570/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:13 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1526 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:13.967562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Action: 'update', calling method: .version_select at 0x7f27b9d4d790>, body: {"quota_set": {"ram": "2048"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:13.983955 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b463120-713b-42a0-8b06-5191802c2230 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "POST /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.218612 Oct 28 13:06:13.985202 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 564/1134] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:06:12 2022] POST /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 194 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:14.010572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:14.013083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:14.028966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.034305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.036909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.041945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.043027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.043498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.249808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.250501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.251156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.252152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.252772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.253608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.291742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.292594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.293228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.294144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.294808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.295415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.415853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:14.428770 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b15feec-3dc7-4c75-a683-b8f79a41fb50 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1470 microversion: 2.1 time: 0.442253 Oct 28 13:06:14.435440 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 565/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:13 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1470 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:14.449259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:14.449567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:14.468128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.468631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.476859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.476859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.476859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.476859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.478349 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cbccd1eb-4b75-4fa3-9515-dc102744ad4a tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007?user_id=3567882c61a94d1080bede8b9bfb85d9" status: 200 len: 328 microversion: 2.1 time: 0.513470 Oct 28 13:06:14.481466 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 571/1136] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:06:13 2022] PUT /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007?user_id=3567882c61a94d1080bede8b9bfb85d9 => generated 328 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:14.495573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:14.496553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:14.511376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.512129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.512569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.513279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.513843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.514421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.698172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:14.715870 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dbe11afd-267a-466c-b97f-028b2498a717 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1473 microversion: 2.1 time: 0.279009 Oct 28 13:06:14.716464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 566/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:14 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1473 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:14.736090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-720cfb6c-aeb4-44da-91a3-e6b5fae5cf41 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Calling method '.version_select at 0x7f27b966aaf0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:14.884666 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-720cfb6c-aeb4-44da-91a3-e6b5fae5cf41 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007?user_id=3567882c61a94d1080bede8b9bfb85d9" status: 200 len: 370 microversion: 2.1 time: 0.156573 Oct 28 13:06:14.886027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 567/1138] 10.222.0.25 () {58 vars in 1323 bytes} [Fri Oct 28 13:06:14 2022] GET /compute/v2.1/os-quota-sets/7a53a7d340ac427d9bc6a5db62d76007?user_id=3567882c61a94d1080bede8b9bfb85d9 => generated 370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:14.890984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b48b3cf6-19e2-4c36-a2d5-39ef6345a527 req-dbda7b6c-1ed1-4ae0-9431-2637df68df68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7618262d-4e39-4c6a-b425-6165b9aaf627", "name": "network-vif-deleted", "tag": "bd85d46b-11f3-4fb4-9a98-d233d1c433c5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:14.901588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b48b3cf6-19e2-4c36-a2d5-39ef6345a527 req-dbda7b6c-1ed1-4ae0-9431-2637df68df68 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.914337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b48b3cf6-19e2-4c36-a2d5-39ef6345a527 req-dbda7b6c-1ed1-4ae0-9431-2637df68df68 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:14.914337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b48b3cf6-19e2-4c36-a2d5-39ef6345a527 req-dbda7b6c-1ed1-4ae0-9431-2637df68df68 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:14.916039 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b48b3cf6-19e2-4c36-a2d5-39ef6345a527 req-dbda7b6c-1ed1-4ae0-9431-2637df68df68 service nova] Creating event network-vif-deleted:bd85d46b-11f3-4fb4-9a98-d233d1c433c5 for instance 7618262d-4e39-4c6a-b425-6165b9aaf627 on n-h1-862876-2 Oct 28 13:06:14.922815 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b48b3cf6-19e2-4c36-a2d5-39ef6345a527 req-dbda7b6c-1ed1-4ae0-9431-2637df68df68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034449 Oct 28 13:06:14.924603 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 568/1139] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:14.944617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:14.955654 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c421888a-9f34-4f5c-ad0b-8fb090d423e9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1316 microversion: 2.1 time: 0.472934 Oct 28 13:06:14.972459 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 572/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:14 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:14.978087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:14.986877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:14.998407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:14.999338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.000125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.001073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.001540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.002519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.094057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-71bb8f77-ca25-4dda-ace1-d14fc40c4eec req-a1c2a8ea-8ef4-47a0-ad65-639cf598b56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7b3df7-aba2-4aa3-b02a-525e788cf294", "name": "network-vif-deleted", "tag": "5bf284c1-9f73-4970-ad51-e0c6eeaf0d88"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:15.117929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:15.127829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-58b1b4c2-a8e5-4b50-bf6f-e338e575ed0a tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1309 microversion: 2.1 time: 0.159190 Oct 28 13:06:15.131826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-71bb8f77-ca25-4dda-ace1-d14fc40c4eec req-a1c2a8ea-8ef4-47a0-ad65-639cf598b56a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.133215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-71bb8f77-ca25-4dda-ace1-d14fc40c4eec req-a1c2a8ea-8ef4-47a0-ad65-639cf598b56a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.133912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-71bb8f77-ca25-4dda-ace1-d14fc40c4eec req-a1c2a8ea-8ef4-47a0-ad65-639cf598b56a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.134634 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 569/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:14 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:15.166893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-71bb8f77-ca25-4dda-ace1-d14fc40c4eec req-a1c2a8ea-8ef4-47a0-ad65-639cf598b56a service nova] Creating event network-vif-deleted:5bf284c1-9f73-4970-ad51-e0c6eeaf0d88 for instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 on n-h1-862876-2 Oct 28 13:06:15.176352 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-71bb8f77-ca25-4dda-ace1-d14fc40c4eec req-a1c2a8ea-8ef4-47a0-ad65-639cf598b56a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086677 Oct 28 13:06:15.177240 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 573/1142] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:06:15.473154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:15.474245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:15.491214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.492422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.492945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.501480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.502119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.502665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.744013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:15.744866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:15.756080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.756894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.758359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.759315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.760097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.766900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.767297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:15.776068 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-726343b0-ecee-4c44-bd60-1b98b7b65790 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1470 microversion: 2.1 time: 0.316497 Oct 28 13:06:15.777311 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 570/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:15 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:15.803630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:15.812799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.812799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.812799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:15.812799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lazy-loading 'fault' on Instance uuid aa7b3df7-aba2-4aa3-b02a-525e788cf294 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:15.862653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:15.870997 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-33a0fefb-3de5-49c8-9e89-58bea33e1844 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1307 microversion: 2.1 time: 0.134208 Oct 28 13:06:15.871569 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 574/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:15 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:15.913546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-73cb5f56-27ca-4fbe-a3e3-ebe7f918793e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Calling method '.version_select at 0x7f27b9673e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:15.980101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:15.981317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:15.993502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:15.996435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:15.998425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.000654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.002810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.004602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.215446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-73cb5f56-27ca-4fbe-a3e3-ebe7f918793e tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.305807 Oct 28 13:06:16.216876 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 571/1145] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:06:15 2022] GET /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e/defaults => generated 371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:16.234134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:16.241737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:16.270625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.277632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.281663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.281663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.281663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.281663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.301787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:16.316012 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c28528ca-a159-4472-a4ae-2a796874da19 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1316 microversion: 2.1 time: 0.341219 Oct 28 13:06:16.336650 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 575/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:15 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:16.337526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.338114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.338804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.339612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lazy-loading 'fault' on Instance uuid 7618262d-4e39-4c6a-b425-6165b9aaf627 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:16.349619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Action: 'update', calling method: .version_select at 0x7f27b94798b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:16.412449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92551c6642f463b9e8ee3869bf010ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b572d677cfe48ccb19defc039f78bd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:16.420875 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97de84da-8587-4682-9d48-b675f69805f5 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 200 len: 1314 microversion: 2.1 time: 0.193300 Oct 28 13:06:16.421728 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 572/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:16 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:16.457927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.458640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.459143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.459876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.460333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.461531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.799370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:16.800003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:16.807281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.807908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.808449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.809283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.809749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.810180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.829678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:16.974159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:16.975614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b1902c5c-456b-474d-91ad-f8e5de9c8f22 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1470 microversion: 2.1 time: 0.179895 Oct 28 13:06:16.976189 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 573/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:16 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:16.980529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:16.981181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:16.986962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.987454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.987924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:16.988615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:16.989076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:16.989503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:17.022912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:17.023512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:17.023948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:17.024395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lazy-loading 'fault' on Instance uuid aa7b3df7-aba2-4aa3-b02a-525e788cf294 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:17.076991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419066f907e545a39fd554ca1fc680a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f51dc9ea4fd4a00b97d3a43d851acbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:17.090831 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c04f749-6dae-41da-89b9-df0bbd3daeee tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 200 len: 1307 microversion: 2.1 time: 0.113182 Oct 28 13:06:17.092494 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 574/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:16 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:17.196750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3bbdd232-9c94-4dd1-93f7-20f1223d4f28 req-46e9cd47-12fc-4804-8d1a-a3f74d15e61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "914c9c62-0736-40db-ae49-117f378f90d1", "tag": "6efb5b84-7fcb-4952-9d80-eb0d22418a84"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:17.206389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3bbdd232-9c94-4dd1-93f7-20f1223d4f28 req-46e9cd47-12fc-4804-8d1a-a3f74d15e61e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:17.206898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3bbdd232-9c94-4dd1-93f7-20f1223d4f28 req-46e9cd47-12fc-4804-8d1a-a3f74d15e61e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:17.207399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3bbdd232-9c94-4dd1-93f7-20f1223d4f28 req-46e9cd47-12fc-4804-8d1a-a3f74d15e61e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:17.218613 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3bbdd232-9c94-4dd1-93f7-20f1223d4f28 req-46e9cd47-12fc-4804-8d1a-a3f74d15e61e service nova] Creating event network-changed:6efb5b84-7fcb-4952-9d80-eb0d22418a84 for instance 914c9c62-0736-40db-ae49-117f378f90d1 on n-h2-862876-2 Oct 28 13:06:17.223389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3bbdd232-9c94-4dd1-93f7-20f1223d4f28 req-46e9cd47-12fc-4804-8d1a-a3f74d15e61e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030474 Oct 28 13:06:17.223980 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 575/1150] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:06:17.342054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:17.342783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:17.348825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:17.349534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:17.350153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:17.350878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:17.351870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:17.352298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:17.534086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:17.556365 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3ae20a99-8d9e-4f93-8445-c4ffa42728bf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1316 microversion: 2.1 time: 0.217563 Oct 28 13:06:17.572616 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 576/1151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:17 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:17.572616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:17.572616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] [instance: 7618262d-4e39-4c6a-b425-6165b9aaf627] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:17.572616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:17.573108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:17.573108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:17.573108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:17.573515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:17.573963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:17.589672 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] HTTP exception thrown: Instance 7618262d-4e39-4c6a-b425-6165b9aaf627 could not be found. Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Request method failure captured: Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 HTTP/1.1 Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Nmg6vQgKPsmNfT2R1VpA16WC46l9G9jlsN31nfuPmWUr6bMrF0Yzw639MzpnIFuyzCX5n9_c1v7Rau_wCGY0p5_GH0fWrsyS3n3psM7rZJ7SHUKAVnrAWnj6eXTmLMUDKC7kHEsly7aIruXA5F6V8BoA1v6thrkQHdXyRX5Azf2XI Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:06:17.591408 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b572d677cfe48ccb19defc039f78bd8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b572d677cfe48ccb19defc039f78bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 4b572d677cfe48ccb19defc039f78bd8 Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1634085858 Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: c92551c6642f463b9e8ee3869bf010ad Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1634085858-project Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7618262d-4e39-4c6a-b425-6165b9aaf627 could not be found. Oct 28 13:06:17.593120 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7618262d-4e39-4c6a-b425-6165b9aaf627'} Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7618262d-4e39-4c6a-b425-6165b9aaf627 could not be found. Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:17.594283 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7618262d-4e39-4c6a-b425-6165b9aaf627 could not be found. Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7618262d-4e39-4c6a-b425-6165b9aaf627 could not be found. Oct 28 13:06:17.595789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:17.597119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] Returning 404 to user: Instance 7618262d-4e39-4c6a-b425-6165b9aaf627 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:17.597119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e9f50cb-fae3-41fd-bf8f-c92db02c8476 tempest-FloatingIPsAssociationTestJSON-1634085858 tempest-FloatingIPsAssociationTestJSON-1634085858-project] 10.222.0.25 "GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627" status: 404 len: 111 microversion: 2.1 time: 0.034587 Oct 28 13:06:17.597119 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 577/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:17 2022] GET /compute/v2.1/servers/7618262d-4e39-4c6a-b425-6165b9aaf627 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:06:18.000333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:18.001479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:18.010736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:18.011797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:18.012711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:18.013602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:18.014370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:18.015896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:18.177150 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40908e27-10b7-408a-96a4-c893e7c51ea7 tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e" status: 200 len: 329 microversion: 2.1 time: 1.839025 Oct 28 13:06:18.184493 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 576/1153] 10.222.0.25 () {60 vars in 1263 bytes} [Fri Oct 28 13:06:16 2022] PUT /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e => generated 329 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:18.184493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:18.185063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] [instance: aa7b3df7-aba2-4aa3-b02a-525e788cf294] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:18.191397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:18.191918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:18.198924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:18.198924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:18.198924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:18.198924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:18.210139 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] HTTP exception thrown: Instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 could not be found. Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Request method failure captured: Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 HTTP/1.1 Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Mk72dPc-qG0sIQzYRugdUAZhqZKnWZTuWcE8nuOcgOs66japcpmhxfzVcR_opHJFGSpXW7K4-dBcucNYnPT2VCWq_p-UxSdKmgTzHnnQREcAN_1q0nMZcX2vFPiajCAKSmCWraZhVYf6erBF4fai2m-bl7tZQBAhrme1EhnOK4eII Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 4f51dc9ea4fd4a00b97d3a43d851acbd Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListImageFiltersTestJSON-1763150665 Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:06:18.211950 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f51dc9ea4fd4a00b97d3a43d851acbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f51dc9ea4fd4a00b97d3a43d851acbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f51dc9ea4fd4a00b97d3a43d851acbd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f51dc9ea4fd4a00b97d3a43d851acbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListImageFiltersTestJSON-1763150665 Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 4f51dc9ea4fd4a00b97d3a43d851acbd Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1763150665 Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListImageFiltersTestJSON-1763150665-project Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 419066f907e545a39fd554ca1fc680a4 Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListImageFiltersTestJSON-1763150665-project Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 could not be found. Oct 28 13:06:18.213258 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'aa7b3df7-aba2-4aa3-b02a-525e788cf294'} Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 could not be found. Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:18.213991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 could not be found. Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 could not be found. Oct 28 13:06:18.215253 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:06:18.216367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Returning 404 to user: Instance aa7b3df7-aba2-4aa3-b02a-525e788cf294 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:18.216367 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52ef2dd9-b7da-4b50-80d0-05f99849c208 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294" status: 404 len: 111 microversion: 2.1 time: 0.034111 Oct 28 13:06:18.216367 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 577/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:18 2022] GET /compute/v2.1/servers/aa7b3df7-aba2-4aa3-b02a-525e788cf294 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:06:18.220850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Action: 'update', calling method: .version_select at 0x7f27b96a6280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:18.277685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:18.289833 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-721fa33a-0aa1-4649-bffc-72b63be14a77 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1470 microversion: 2.1 time: 0.293552 Oct 28 13:06:18.293881 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 578/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:17 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:18.301127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d4c5679-0ed3-4802-8973-975bd385c631 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b95de430>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:18.488875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:18.489482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:18.489961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:18.491514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:18.492732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:18.493240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:19.275709 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d4c5679-0ed3-4802-8973-975bd385c631 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/images/c99302d8-d9be-4eb7-ba8b-04bd21646bef" status: 204 len: 0 microversion: 2.1 time: 0.979848 Oct 28 13:06:19.276548 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 579/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:18 2022] DELETE /compute/v2.1/images/c99302d8-d9be-4eb7-ba8b-04bd21646bef => generated 0 bytes in 981 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:19.282182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:19.283921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:19.300423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:19.301109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:19.302047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:19.303757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:19.305013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:19.307634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:19.581466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:19.597912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7a3d1e7-fb20-4519-9b9e-0f85e9324e31 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1316 microversion: 2.1 time: 0.319899 Oct 28 13:06:19.600126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 580/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:19 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:19.611172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ab98e80-add1-4d01-88f7-a535216217fc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b95de700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:20.103562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:20.475498 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ab98e80-add1-4d01-88f7-a535216217fc tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/images/ada6ac05-4e26-4ba7-83dc-e8007ef14fbd" status: 204 len: 0 microversion: 2.1 time: 0.874685 Oct 28 13:06:20.478903 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 581/1158] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:19 2022] DELETE /compute/v2.1/images/ada6ac05-4e26-4ba7-83dc-e8007ef14fbd => generated 0 bytes in 880 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:20.485215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:20.486587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:20.507240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:20.508692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:20.509402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:20.510390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:20.510990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:20.511542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:20.731171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=26,nova_api:UPDATE=11 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:20.763128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:20.771848 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-646aaa13-398d-48d6-b9d7-277cf89799c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1476 microversion: 2.1 time: 0.291840 Oct 28 13:06:20.776298 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 582/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:20 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:20.791402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9c487b60-5704-4dd6-b6bd-bcfc06102ac9 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] Calling method '.version_select at 0x7f27b957f4c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:21.233888 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8bb8305d-fa52-417e-b40b-c115fe6e8e4b tempest-QuotasAdminTestJSON-1775105687 tempest-QuotasAdminTestJSON-1775105687-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e" status: 200 len: 329 microversion: 2.1 time: 3.018101 Oct 28 13:06:21.234875 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 578/1160] 10.222.0.25 () {60 vars in 1263 bytes} [Fri Oct 28 13:06:18 2022] PUT /compute/v2.1/os-quota-sets/d507427ecb5143a0af835f55cafb651e => generated 329 bytes in 3020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:21.239778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:21.240907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:21.247979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:21.248838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:21.249505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:21.251376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:21.252003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:21.253443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:21.604389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:21.610507 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c12198d5-b889-4995-ae7e-73854dba2a69 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1316 microversion: 2.1 time: 0.373739 Oct 28 13:06:21.613402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 579/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:21 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:21.624132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f6cc0659-fd70-4158-bb96-a93c0caa41e8 req-cdc0d58c-ebc3-4239-9ad1-43355f045ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "914c9c62-0736-40db-ae49-117f378f90d1", "name": "network-vif-plugged", "status": "completed", "tag": "6efb5b84-7fcb-4952-9d80-eb0d22418a84"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:21.636234 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9c487b60-5704-4dd6-b6bd-bcfc06102ac9 tempest-ListImageFiltersTestJSON-1763150665 tempest-ListImageFiltersTestJSON-1763150665-project] 10.222.0.25 "DELETE /compute/v2.1/images/eceddf71-03bd-4fb1-a048-916e4470701d" status: 204 len: 0 microversion: 2.1 time: 0.858005 Oct 28 13:06:21.637190 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 583/1162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:20 2022] DELETE /compute/v2.1/images/eceddf71-03bd-4fb1-a048-916e4470701d => generated 0 bytes in 860 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:21.645349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f6cc0659-fd70-4158-bb96-a93c0caa41e8 req-cdc0d58c-ebc3-4239-9ad1-43355f045ff4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:21.645906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f6cc0659-fd70-4158-bb96-a93c0caa41e8 req-cdc0d58c-ebc3-4239-9ad1-43355f045ff4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:21.646676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f6cc0659-fd70-4158-bb96-a93c0caa41e8 req-cdc0d58c-ebc3-4239-9ad1-43355f045ff4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:21.662537 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f6cc0659-fd70-4158-bb96-a93c0caa41e8 req-cdc0d58c-ebc3-4239-9ad1-43355f045ff4 service nova] Creating event network-vif-plugged:6efb5b84-7fcb-4952-9d80-eb0d22418a84 for instance 914c9c62-0736-40db-ae49-117f378f90d1 on n-h2-862876-2 Oct 28 13:06:21.670272 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f6cc0659-fd70-4158-bb96-a93c0caa41e8 req-cdc0d58c-ebc3-4239-9ad1-43355f045ff4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054598 Oct 28 13:06:21.671051 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 580/1163] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:21.807052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:21.808020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:21.815201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:21.816132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:21.816784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:21.817706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:21.818265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:21.818848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:22.087763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:22.100608 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cc76ca1b-da32-4a15-974d-87d150b28b0e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1476 microversion: 2.1 time: 0.300239 Oct 28 13:06:22.102375 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 584/1164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:21 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:22.638584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:22.639927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:22.650497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:22.652999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:22.652999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:22.652999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:22.652999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:22.653353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:23.101918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:23.116259 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c6e715f1-b8b1-4644-b90d-62700a993fa3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1316 microversion: 2.1 time: 0.480214 Oct 28 13:06:23.118185 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 581/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:22 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:23.131471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:23.132975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:23.142798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:23.144999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:23.145445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:23.146165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:23.146615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:23.149786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:23.525599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:23.535006 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-049e670b-c712-426d-890a-b66dc5dadc5b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1476 microversion: 2.1 time: 0.413771 Oct 28 13:06:23.539883 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 585/1166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:23 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1476 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:23.750919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-dd3727ae-2bbc-48ef-aef4-8c28a4bccd67 req-7090e36d-5bee-4987-839f-24e56ea4d944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38", "name": "network-vif-unplugged", "status": "completed", "tag": "60b34799-ae4b-4324-a0ea-12c82b338812"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:23.824227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dd3727ae-2bbc-48ef-aef4-8c28a4bccd67 req-7090e36d-5bee-4987-839f-24e56ea4d944 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:23.827333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dd3727ae-2bbc-48ef-aef4-8c28a4bccd67 req-7090e36d-5bee-4987-839f-24e56ea4d944 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:23.830183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dd3727ae-2bbc-48ef-aef4-8c28a4bccd67 req-7090e36d-5bee-4987-839f-24e56ea4d944 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:23.877171 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-dd3727ae-2bbc-48ef-aef4-8c28a4bccd67 req-7090e36d-5bee-4987-839f-24e56ea4d944 service nova] Creating event network-vif-unplugged:60b34799-ae4b-4324-a0ea-12c82b338812 for instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 on n-h1-862876-2 Oct 28 13:06:23.888435 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-dd3727ae-2bbc-48ef-aef4-8c28a4bccd67 req-7090e36d-5bee-4987-839f-24e56ea4d944 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142218 Oct 28 13:06:23.889934 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 582/1167] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:24.149520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:24.150185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:24.166511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:24.167736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:24.169972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:24.171461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:24.173838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:24.175004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:24.567482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:24.568140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:24.584605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:24.585101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:24.592246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:24.592246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:24.592246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:24.593365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:24.774281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:24.787737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1ec556e-54ef-42b3-9077-c18ca8dc821c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1466 microversion: 2.1 time: 0.649673 Oct 28 13:06:24.790804 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 586/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:24 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1466 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:24.877307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:24.890569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:24.902251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78f190e6-a387-4c1a-a4e1-f375e22ddaa9 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1476 microversion: 2.1 time: 0.339372 Oct 28 13:06:24.902858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 583/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:24 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:24.907899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:24.908828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:24.917669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:24.920931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:24.923361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:24.929618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:24.931101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:24.932305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:25.050956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5822e920-1ed8-492d-aa39-978ea812f9cf tempest-ListImageFiltersNegativeTestJSON-1314434697 tempest-ListImageFiltersNegativeTestJSON-1314434697-project] Calling method '.version_select at 0x7f27b95ff3a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:25.126176 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5822e920-1ed8-492d-aa39-978ea812f9cf tempest-ListImageFiltersNegativeTestJSON-1314434697 tempest-ListImageFiltersNegativeTestJSON-1314434697-project] HTTP exception thrown: Image not found. Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5822e920-1ed8-492d-aa39-978ea812f9cf tempest-ListImageFiltersNegativeTestJSON-1314434697 tempest-ListImageFiltersNegativeTestJSON-1314434697-project] Request method failure captured: Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/images/f16a01c0-ea05-457f-9cf8-e891110ca9fd HTTP/1.1 Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9PQfuYYa9-l9TCxuKKaxJkjaJm85XYMeDCrfSzCfZwSKge0nTSRHuY99B2POsm-wX18Cpg0gBQMaaKIKOxc1-yRkB9ZHW1lQaKOAZE3v2SUOjJel0X2KSr48udeur7fH3OAaNxLIRv2K-tkddLR8LR1ElzyolKD21kwpY2cVBxlr3Y Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 60302f8ce53543a5bead7b8650aa4395 Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1314434697 Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:06:25.135124 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60302f8ce53543a5bead7b8650aa4395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/60302f8ce53543a5bead7b8650aa4395"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_60302f8ce53543a5bead7b8650aa4395", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/60302f8ce53543a5bead7b8650aa4395"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1314434697 Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 60302f8ce53543a5bead7b8650aa4395 Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1314434697 Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ListImageFiltersNegativeTestJSON-1314434697-project Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7f6c2df7641e496daa28845e9c774742 Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1314434697-project Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: exception: Image not found. Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'f16a01c0-ea05-457f-9cf8-e891110ca9fd'} Oct 28 13:06:25.136758 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:06:25.137581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f16a01c0-ea05-457f-9cf8-e891110ca9fd Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:06:25.139599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f16a01c0-ea05-457f-9cf8-e891110ca9fd could not be found. Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:06:25.143150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:06:25.149267 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:25.151535 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47978ea0-4af5-4690-8dbc-8cfe744cc48a tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1617 microversion: 2.1 time: 0.236032 Oct 28 13:06:25.151797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5822e920-1ed8-492d-aa39-978ea812f9cf tempest-ListImageFiltersNegativeTestJSON-1314434697 tempest-ListImageFiltersNegativeTestJSON-1314434697-project] Returning 404 to user: Image not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:25.151797 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5822e920-1ed8-492d-aa39-978ea812f9cf tempest-ListImageFiltersNegativeTestJSON-1314434697 tempest-ListImageFiltersNegativeTestJSON-1314434697-project] 10.222.0.25 "GET /compute/v2.1/images/f16a01c0-ea05-457f-9cf8-e891110ca9fd" status: 404 len: 62 microversion: 2.1 time: 0.353915 Oct 28 13:06:25.151797 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 587/1170] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:06:24 2022] GET /compute/v2.1/images/f16a01c0-ea05-457f-9cf8-e891110ca9fd => generated 62 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:06:25.152149 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 584/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:24 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1617 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:25.816889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1603317128", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7b9de8fb-d31e-4f62-b8cb-cafb20df5769"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:25.912931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:06:25.929914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:25.930545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:25.949806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:25.950454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:25.950958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:25.951861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:25.952655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:25.953104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:26.203339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:26.216344 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-072e306a-b20f-4590-b35a-d89192080b20 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1476 microversion: 2.1 time: 0.292255 Oct 28 13:06:26.230463 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 585/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:25 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:26.385445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:26.386449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:26.387392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:26.387962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:26.392000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:26.405493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:26.406340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:26.407021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:26.407984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:26.408647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:26.409276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:26.433057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:26.449102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Getting quotas for user afa79bf0f26a4ce6bf786026a76ce92a and project 83f9bc35587c481ba2be5676f43c0672. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:26.469990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:06:26.477386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:06:26.711150 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-45366e63-2d50-4351-9b19-fd886c049659 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898935 Oct 28 13:06:26.712109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 588/1173] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:06:26.724107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db044a77-35e2-4ddc-9314-0f62fb53a0a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:26.724867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db044a77-35e2-4ddc-9314-0f62fb53a0a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:26.814876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-db044a77-35e2-4ddc-9314-0f62fb53a0a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:26.827430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:26.829875 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db044a77-35e2-4ddc-9314-0f62fb53a0a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1217 microversion: 2.1 time: 0.110270 Oct 28 13:06:26.831350 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 586/1174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:26 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:27.077609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ac257c35-c9fa-4c72-bd49-2186b1719572 req-e5448e6c-4517-4adb-ae56-3a8f76a82dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38", "name": "network-vif-plugged", "status": "completed", "tag": "60b34799-ae4b-4324-a0ea-12c82b338812"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:27.090906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ac257c35-c9fa-4c72-bd49-2186b1719572 req-e5448e6c-4517-4adb-ae56-3a8f76a82dd8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:27.091281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ac257c35-c9fa-4c72-bd49-2186b1719572 req-e5448e6c-4517-4adb-ae56-3a8f76a82dd8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:27.091709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ac257c35-c9fa-4c72-bd49-2186b1719572 req-e5448e6c-4517-4adb-ae56-3a8f76a82dd8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:27.105631 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ac257c35-c9fa-4c72-bd49-2186b1719572 req-e5448e6c-4517-4adb-ae56-3a8f76a82dd8 service nova] Creating event network-vif-plugged:60b34799-ae4b-4324-a0ea-12c82b338812 for instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 on n-h1-862876-2 Oct 28 13:06:27.111427 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ac257c35-c9fa-4c72-bd49-2186b1719572 req-e5448e6c-4517-4adb-ae56-3a8f76a82dd8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040196 Oct 28 13:06:27.112136 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 587/1175] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:06:27.243647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:27.245150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:27.262040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:27.262819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:27.264191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:27.265451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:27.268148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:27.279258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:27.306237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-229e98a9-22fa-4697-b799-522d82a51bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Action: 'create', calling method: .version_select at 0x7f27b954eaf0>, body: {"keypair": {"name": "tempest-keypair-729096927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODtkiaQk9FOMIQ2Lz2kwiyvKjnv3ICC9270Ut4TAOQDCTZ8ioP81W/PG7CKtNAZTMUwakoLWlTqhhUFsTkpV8EFbfIdCi4+SMUBj1Iu/8kzjZUnrCuzjn1TyQr3WcHLWg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:27.343731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-229e98a9-22fa-4697-b799-522d82a51bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Getting quotas for project 1ed3491e1ce043e3a27c05cd35dee95c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:27.360604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-229e98a9-22fa-4697-b799-522d82a51bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Getting quotas for user ae36e9615c454d9b914aeb585e172af6 and project 1ed3491e1ce043e3a27c05cd35dee95c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:27.489830 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-229e98a9-22fa-4697-b799-522d82a51bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.515663 Oct 28 13:06:27.492100 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 589/1176] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:06:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:27.596180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:27.614592 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d64a4d3-b345-4979-9189-6272515cce25 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1476 microversion: 2.1 time: 0.376682 Oct 28 13:06:27.615252 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 588/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:27 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:27.863434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d392664-45cb-4faa-b8fa-e2dfe9aecdb1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:27.864449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d392664-45cb-4faa-b8fa-e2dfe9aecdb1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:27.973375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d392664-45cb-4faa-b8fa-e2dfe9aecdb1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:27.983582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d392664-45cb-4faa-b8fa-e2dfe9aecdb1 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1217 microversion: 2.1 time: 0.125760 Oct 28 13:06:27.986192 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 590/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:27 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:28.638834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:28.640126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:28.644081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=15 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:28.656025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:28.656542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:28.657021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:28.657728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:28.658191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:28.658624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:28.683607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:28.867669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:28.876897 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef1f218c-f97f-400b-a676-bbffae787774 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1476 microversion: 2.1 time: 0.242137 Oct 28 13:06:28.877858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 589/1179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:28 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:29.009201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:29.010068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:29.016907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.017624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.020354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.020354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.020354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.020354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.140799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:29.150929 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4addc21a-fdc6-4a46-b206-13e0eb8bc5a4 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1213 microversion: 2.1 time: 0.146661 Oct 28 13:06:29.152142 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 590/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:29 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:29.153000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "baf2a677-837c-4c2f-9337-3cdcd8889473"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:29.155820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:29.173997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.175073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.175936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.178115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.178937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.181424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] HTTP exception thrown: Volume baf2a677-837c-4c2f-9337-3cdcd8889473 could not be found. Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Request method failure captured: Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments/96ac7d09-63ff-49a0-8240-e79eab5d677e HTTP/1.1 Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 74 Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9N3LWxpUyTccoamHXIe3X2vBat8WcT-Or2PBm73UQvpAGM3K93hxBDpGBFF8ulYMoVAxl-9kMqzhPzOAe_D7ZTn2iCfAy_Fpob2W6xTIovyPM0m3JhTeCT7aq37U1UmKAAgtBU8z6HoBMtwV1GSBUqAJlTq1v_ZayXy9pKelvpFPXs Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: bbc587ee8675498796ba79d58e537396 Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesAdminNegativeTest-1444888104 Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:06:29.494378 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bbc587ee8675498796ba79d58e537396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bbc587ee8675498796ba79d58e537396"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bbc587ee8675498796ba79d58e537396", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bbc587ee8675498796ba79d58e537396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesAdminNegativeTest-1444888104 Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: bbc587ee8675498796ba79d58e537396 Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1444888104 Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesAdminNegativeTest-1444888104-project-admin Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 76113ac2b0014230b24894edca2c8536 Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesAdminNegativeTest-1444888104-project-admin Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: {"volumeAttachment": {"volumeId": "baf2a677-837c-4c2f-9337-3cdcd8889473"}} Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:06:29.496199 n-d-862876-2 devstack@n-api.service[127794]: exception: Volume baf2a677-837c-4c2f-9337-3cdcd8889473 could not be found. Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '78e2255e-0110-43c2-aa75-2a244f709e61', 'id': '96ac7d09-63ff-49a0-8240-e79eab5d677e', 'body': {'volumeAttachment': {'volumeId': 'baf2a677-837c-4c2f-9337-3cdcd8889473'}}} Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:06:29.497167 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baf2a677-837c-4c2f-9337-3cdcd8889473 could not be found. (HTTP 404) (Request-ID: req-42539970-3b9e-49ea-a729-48d494bda4cd) Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:06:29.498722 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baf2a677-837c-4c2f-9337-3cdcd8889473 could not be found. Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:06:29.500837 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume baf2a677-837c-4c2f-9337-3cdcd8889473 could not be found. Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baf2a677-837c-4c2f-9337-3cdcd8889473 could not be found. Oct 28 13:06:29.502223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:06:29.504011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Returning 400 to user: Volume baf2a677-837c-4c2f-9337-3cdcd8889473 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:06:29.504011 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-18253a10-489b-4e16-9814-7ae6433391d0 tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments/96ac7d09-63ff-49a0-8240-e79eab5d677e" status: 400 len: 107 microversion: 2.1 time: 0.685854 Oct 28 13:06:29.504011 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 591/1181] 10.222.0.25 () {60 vars in 1433 bytes} [Fri Oct 28 13:06:28 2022] PUT /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments/96ac7d09-63ff-49a0-8240-e79eab5d677e => generated 107 bytes in 693 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:06:29.625789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:29.626288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:29.633572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.634055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.634484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.640352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.647327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.651395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.752017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:29.756260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.756955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.759148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.760952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.762821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.766607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.845102 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a80852a-98d1-434e-a01e-f0b4e0244b10 tempest-AZV2TestJSON-1090514884 tempest-AZV2TestJSON-1090514884-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.343999 Oct 28 13:06:29.846844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 591/1182] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Oct 28 13:06:29 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:06:29.903122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:29.903921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:29.915280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.915975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.916588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.917514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:29.918457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:29.919183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:29.932130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lazy-loading 'services' on Instance uuid 78e2255e-0110-43c2-aa75-2a244f709e61 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:30.154314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:30.166926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e94106bb-081a-42a6-b0d7-4bf9544c37ee tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1462 microversion: 2.1 time: 0.268534 Oct 28 13:06:30.182784 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 592/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:29 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1462 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:30.346963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Action: 'update', calling method: .version_select at 0x7f27b93d61f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:30.439473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.451725 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-784602c6-e03e-4cc6-97cc-4daa7f925f26 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments/96ac7d09-63ff-49a0-8240-e79eab5d677e" status: 202 len: 0 microversion: 2.1 time: 0.829852 Oct 28 13:06:30.453122 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 592/1184] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:06:29 2022] DELETE /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments/96ac7d09-63ff-49a0-8240-e79eab5d677e => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:06:30.455252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.457076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.460602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.461921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.464952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.465663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:30.466562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:30.484669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.490630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.490630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.490630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.490630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.491155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.667361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:30.688878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3efe3a0c-ae7d-4a1d-a8dc-e34c6ed9b52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1277 microversion: 2.1 time: 0.229853 Oct 28 13:06:30.703720 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 593/1185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:30 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:30.717741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:30.720258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:30.732632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:30.736227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.739120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.739731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.740583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.741159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.748192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.769173 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5a6b35f-cd15-4e78-958e-63bb318f2083 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae" status: 200 len: 148 microversion: 2.57 time: 0.599560 Oct 28 13:06:30.773659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 593/1186] 10.222.0.25 () {62 vars in 1303 bytes} [Fri Oct 28 13:06:30 2022] PUT /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae => generated 148 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:06:30.784028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:30.790151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:30.815543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.816087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.816681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.817412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:30.817872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:30.818534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:30.895357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4a8a388-ac6b-4ba6-a01f-eda24ae9fa25 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120294 Oct 28 13:06:30.902676 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 594/1187] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:06:30 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:30.915080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Calling method '.version_select at 0x7f27b952cca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:31.056506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:31.069581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd2f9d42-a3a3-4612-a7dd-3b6f6c427324 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1462 microversion: 2.1 time: 0.370359 Oct 28 13:06:31.082770 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 594/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:30 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1462 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:31.096306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:31.099563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:31.110705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.115421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.115876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.117291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.117758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.118189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.239615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:31.239988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:31.240566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:31.240864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:31.241402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:31.283201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.285810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.286495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.289557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.290830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.291287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.314526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6445047f-7f32-4059-8080-92302925b347 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae/detail" status: 200 len: 463 microversion: 2.57 time: 0.405634 Oct 28 13:06:31.315786 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 595/1189] 10.222.0.25 () {60 vars in 1304 bytes} [Fri Oct 28 13:06:30 2022] GET /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae/detail => generated 463 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:06:31.591248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:31.609475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.610117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.611603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.614108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.614715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.620102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.624586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:31.686058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Action: 'update', calling method: .version_select at 0x7f27b93bd0d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:31.687785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59377260-5042-4cd4-bbfc-661b882749a8 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action" status: 202 len: 1066 microversion: 2.1 time: 0.595519 Oct 28 13:06:31.692774 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 595/1190] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:06:31 2022] POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action => generated 1066 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 13:06:31.717988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:31.717988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:31.725755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.728732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.729298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.731942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.733422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.734387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.853471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.856518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.858079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.859479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.864728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.868690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.961577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.962957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.963747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:31.964663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:31.966422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:31.967577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:32.109513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:32.125409 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-309c8699-37d1-48cb-a04f-198e4b38d90c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.415712 Oct 28 13:06:32.128312 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 596/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:31 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:32.141781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:32.142710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:32.150029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:32.154621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:32.154621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:32.154621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:32.154621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:32.155395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:32.221486 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de8c6ec1-fce4-46b3-9a65-7944882651ac tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae?user_id=118f9d5c13034cfe8103422ccd33f29a" status: 200 len: 148 microversion: 2.57 time: 0.540026 Oct 28 13:06:32.224121 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 596/1192] 10.222.0.25 () {62 vars in 1384 bytes} [Fri Oct 28 13:06:31 2022] PUT /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae?user_id=118f9d5c13034cfe8103422ccd33f29a => generated 148 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:06:32.234988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:32.239776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:32.249765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:32.256517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:32.256908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:32.258025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:32.259242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:32.259873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:32.260000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ceaaf33-1ccd-403f-b80a-f056b832dda8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1275 microversion: 2.1 time: 0.130280 Oct 28 13:06:32.261677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:32.271611 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 597/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:32 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:32.287300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-518f2cdb-a825-47b8-adbe-47747f359643 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] Calling method '.version_select at 0x7f27b94afaf0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:32.321228 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f8a3037-8d40-47d5-aa83-371a19cfd48c tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093177 Oct 28 13:06:32.323497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 597/1194] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:06:32 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:32.364195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "bbea821d-e7d6-4c5a-8958-89f54957c9d4"}], "security_groups": [{"name": "tempest-securitygroup--1387636467"}], "key_name": "tempest-keypair-729096927", "user_data": "}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:32.698666 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-518f2cdb-a825-47b8-adbe-47747f359643 tempest-QuotasAdminTestV257-34636768 tempest-QuotasAdminTestV257-34636768-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae?user_id=118f9d5c13034cfe8103422ccd33f29a" status: 200 len: 190 microversion: 2.57 time: 0.418656 Oct 28 13:06:32.699725 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 598/1195] 10.222.0.25 () {60 vars in 1364 bytes} [Fri Oct 28 13:06:32 2022] GET /compute/v2.1/os-quota-sets/7e760a7d830346a1b7a07fa0c60d2fae?user_id=118f9d5c13034cfe8103422ccd33f29a => generated 190 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:06:32.905315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] validate_networks() for [('bbea821d-e7d6-4c5a-8958-89f54957c9d4', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:06:33.154865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:33.155504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:33.168351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:33.168850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:33.169291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:33.173090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:33.173090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:33.173090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:33.437025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:33.458229 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-720a0dc8-9773-4f8c-90d2-fab47fc3bc9c tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.303178 Oct 28 13:06:33.475395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 599/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:33 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:33.488836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:33.490410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:33.500412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:33.501322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:33.501978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:33.502940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:33.504793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:33.506185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:33.767507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:33.780732 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-15b2540f-ff4d-490b-afc4-c7e15df96e6a tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.296801 Oct 28 13:06:33.791449 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 600/1197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:33 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:33.797886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:33.807674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:33.814117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:33.815277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:33.815903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:33.817713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:33.818335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:33.819193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:33.869405 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2fbc661c-df6a-4587-b8cc-a29d1cf0365e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075929 Oct 28 13:06:33.870432 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 601/1198] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:06:33 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:34.157244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:34.162812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:34.182586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.185985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.186618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.188108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.189943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.190589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.406149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:34.406649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:34.410082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:34.414549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:34.416008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:34.440514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.441301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.442094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.446637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.447510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.448130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.522917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid 33e873a2-b078-4190-9f83-0644b1075f4a {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:34.526361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:34.567326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Getting quotas for project 1ed3491e1ce043e3a27c05cd35dee95c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:34.588261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-67e56dbf-ebc3-433e-a202-a0987163fae9 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 2345 microversion: 2.25 time: 0.463803 Oct 28 13:06:34.603014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Getting quotas for user ae36e9615c454d9b914aeb585e172af6 and project 1ed3491e1ce043e3a27c05cd35dee95c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:34.614896 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 602/1199] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:06:34 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 2345 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:06:34.629719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:34.639260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:34.679892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:06:34.681826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.681826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.686036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:06:34.691527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.692226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.692709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.693143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.865981 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a6d6bf57-2a75-48e2-8e6e-17677608947c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.506017 Oct 28 13:06:34.868003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 598/1200] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:06:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:06:34.878930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:34.883425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.884158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.885088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.886098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.886711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.887315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.923975 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-30ed41cd-dbdf-42e0-b305-379da1bd2ee4 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054236 Oct 28 13:06:34.933677 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 599/1201] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Oct 28 13:06:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:06:34.939763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:34.940564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:34.947633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.948365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.949174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:34.950060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:34.950680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:34.951383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:35.119347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:35.125628 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-653ecafc-3495-46fb-97ca-33bc5c5a2846 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.518636 Oct 28 13:06:35.141978 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 603/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:34 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:35.157463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-758bea1a-17e3-4f0f-8120-969fbd14d335 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:35.160493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-758bea1a-17e3-4f0f-8120-969fbd14d335 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:35.290561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-758bea1a-17e3-4f0f-8120-969fbd14d335 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:35.300737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-758bea1a-17e3-4f0f-8120-969fbd14d335 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1225 microversion: 2.1 time: 0.156784 Oct 28 13:06:35.301859 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 604/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:35 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:35.308545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:35.311698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:35.322218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:35.323189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:35.323669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:35.324822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:35.325482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:35.326013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:35.374045 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-39ebe222-9f63-45b9-b74b-29409b4e7664 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070309 Oct 28 13:06:35.374941 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 605/1204] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:06:35 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:35.470895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:35.479774 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0dcbd26-0f5b-4577-b74f-42accd24b857 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.544823 Oct 28 13:06:35.480541 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 600/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:34 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:35.824578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ecfa71dc-5951-4e04-ad39-709c9f282cbc req-fe154dca-a74c-4924-86f4-0411e20f65d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffdd3e45-da04-4d94-b665-7d58fdfcdb02", "tag": "e9512d3b-8d47-436d-86b6-9d36a071aed1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:35.845996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ecfa71dc-5951-4e04-ad39-709c9f282cbc req-fe154dca-a74c-4924-86f4-0411e20f65d5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:35.849283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ecfa71dc-5951-4e04-ad39-709c9f282cbc req-fe154dca-a74c-4924-86f4-0411e20f65d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:35.850039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ecfa71dc-5951-4e04-ad39-709c9f282cbc req-fe154dca-a74c-4924-86f4-0411e20f65d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:35.868534 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ecfa71dc-5951-4e04-ad39-709c9f282cbc req-fe154dca-a74c-4924-86f4-0411e20f65d5 service nova] Creating event network-changed:e9512d3b-8d47-436d-86b6-9d36a071aed1 for instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 on n-h1-862876-2 Oct 28 13:06:35.881381 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ecfa71dc-5951-4e04-ad39-709c9f282cbc req-fe154dca-a74c-4924-86f4-0411e20f65d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068368 Oct 28 13:06:35.882013 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 606/1206] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:36.154398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:36.155101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:36.162582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:36.163113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:36.163603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:36.164527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:36.164990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:36.165416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:36.337559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c53d6f14-5a88-4758-b406-38fc180a9784 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:36.342430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c53d6f14-5a88-4758-b406-38fc180a9784 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:36.407989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:36.417904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:36.420699 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-289786ea-e80b-45ab-a0bb-a71be6f3ffe3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.270655 Oct 28 13:06:36.421379 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 601/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:36 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:36.436950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:36.444722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:36.456431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:36.456431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:36.456431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:36.456796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:36.457209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:36.457518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:36.466085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c53d6f14-5a88-4758-b406-38fc180a9784 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:36.476706 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c53d6f14-5a88-4758-b406-38fc180a9784 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1225 microversion: 2.1 time: 0.152607 Oct 28 13:06:36.477885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 607/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:36 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:36.504597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:36.505773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:36.514736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:36.515763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:36.516783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:36.517832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:36.518876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:36.519500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:36.588164 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-12e3e540-1dd0-4e77-b376-a1cef2306ae3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161265 Oct 28 13:06:36.589971 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 602/1209] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:06:36 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:36.781600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:36.793209 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b3dbbd1-358e-417e-951b-3218f9ab8987 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.293835 Oct 28 13:06:36.794345 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 608/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:36 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:37.447571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:37.448194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:37.461453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.461958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.462401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.463152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.465440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.466583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.501658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:37.503422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:37.516668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.517530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.518434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.520963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.521680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.526101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.703572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:37.714766 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4dcbcc2-eb59-4f9c-acfc-b6460114fff9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1229 microversion: 2.1 time: 0.216117 Oct 28 13:06:37.715736 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 609/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:37 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1229 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:37.731007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:37.733482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:37.743926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.745264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.748798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.749571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.750051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.750485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.800633 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bd0b4e3-52f1-4b90-be5a-4dc1df3c1bac tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081467 Oct 28 13:06:37.801263 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 610/1212] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:06:37 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:37.817931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:37.819558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:37.828564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.829484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.830168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.831709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:37.832425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:37.833409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:37.975788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:37.990394 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-483c6219-f612-4b23-b8a7-5dbf4fb63ecf tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.544016 Oct 28 13:06:37.990394 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 603/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:37 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:38.042327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:38.060221 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bbd77281-29ad-4b28-978a-7523a4807b9c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.247563 Oct 28 13:06:38.064250 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 611/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:37 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:38.739980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:38.740752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:38.764471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:38.767235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:38.767784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:38.770201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:38.772709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:38.773393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:38.819104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:38.828274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:38.848849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:38.849799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:38.852686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:38.853871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:38.856499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:38.857543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:38.920512 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ab3aaeb-a63e-4103-91a0-95654de52e64 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111867 Oct 28 13:06:38.921720 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 612/1215] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:06:38 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:06:39.015694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:39.016835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:39.024754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:39.025826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:39.026558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:39.027564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:39.028263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:39.028914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:39.061289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:39.096569 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f9deae10-9ac3-44a9-a605-7a059ece9bf9 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1277 microversion: 2.1 time: 0.360327 Oct 28 13:06:39.125835 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 604/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:38 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1277 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:39.140565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:39.149086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:39.175067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:39.176028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:39.178620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:39.182369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:39.183462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:39.186346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:39.498411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:39.511382 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-853e2c6f-0d9a-4b50-8dfb-1058db85af16 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.500991 Oct 28 13:06:39.515135 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 613/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:39 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:39.523352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22715f85-80ec-4960-898d-8f0fcd3cb8e8", "device": "/dev/xvdb"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:39.533831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:39.546609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:39.547131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:39.547614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:39.548912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:39.553644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:39.554278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:39.676954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:39.689223 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f256fa6-754a-43f6-892c-93f6c3dcece9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.561949 Oct 28 13:06:39.689813 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 605/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:39 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:39.702261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-867733404", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f3a87850-8c8d-4f75-8512-56ce31a64f08"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:39.854694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] validate_networks() for [('f3a87850-8c8d-4f75-8512-56ce31a64f08', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:06:39.904249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:40.704605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b41bfe4-9ccc-46d2-ae79-9179ef01796b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "POST /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.187895 Oct 28 13:06:40.705218 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 614/1219] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Oct 28 13:06:39 2022] POST /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 194 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:06:40.722456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:40.723592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:40.742627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:40.744752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:40.745859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:40.747416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:40.748754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:40.749518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:40.876577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:40.899399 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-73946c24-361e-45bf-a788-48a3eb6c418f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1283 microversion: 2.1 time: 0.182045 Oct 28 13:06:40.901109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 615/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:40 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1283 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:40.916811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:40.918087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:40.927582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:40.928260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:40.929412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:40.930279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:40.931036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:40.931948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:41.175839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:41.193802 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9e6de4fa-381d-4465-b03d-d4b8b4215aca tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.291206 Oct 28 13:06:41.194397 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 616/1221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:40 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:41.199904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:41.213664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:41.231990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:41.233788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:41.234356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:41.235583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:41.238329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:41.246008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:41.492326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:41.492781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:41.493820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:41.494265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:41.494678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:41.520651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:41.525667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:41.528659 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b24428db-023c-46a0-9d55-040fbfa48ce6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.332375 Oct 28 13:06:41.532277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:41.532827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:41.533348 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 617/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:41 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:41.543000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:41.548129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:41.550316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:41.605328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Getting quotas for project 95b7cf075cae49ae838a0f75ca04b41a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:41.619710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Getting quotas for user c9bf2f7d1cdc47ed83175f036a574ca0 and project 95b7cf075cae49ae838a0f75ca04b41a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:41.650260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:06:41.652761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:06:41.899751 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-876e1daa-3022-420f-af3c-741b98f031ee tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.207587 Oct 28 13:06:41.903216 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 606/1223] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:06:41.914606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a992c4d7-1b60-4210-90e8-56dafd71a788 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:41.924719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a992c4d7-1b60-4210-90e8-56dafd71a788 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:41.939280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:41.947553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:41.982788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:41.987536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:41.988850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:41.997715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:41.999338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:42.006694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:42.124222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a992c4d7-1b60-4210-90e8-56dafd71a788 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:42.147608 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a992c4d7-1b60-4210-90e8-56dafd71a788 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1217 microversion: 2.1 time: 0.231310 Oct 28 13:06:42.171665 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 618/1224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:41 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:42.220808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:42.221818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:42.238011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:42.238524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:42.238999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:42.239385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:42.245549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:42.248877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:42.249378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:42.256447 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d920be93-75da-47c3-82f1-e092915be8ed tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1283 microversion: 2.1 time: 0.327064 Oct 28 13:06:42.259292 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 607/1225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:41 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1283 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:42.562019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:42.562716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:42.571048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:42.574903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:42.575486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:42.576761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:42.583284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:42.583879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:42.653783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:42.664296 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9701b18d-6726-4b7d-9a6c-ef91580f576d tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.449971 Oct 28 13:06:42.666549 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 619/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:42 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:42.919886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-828244698", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:43.030048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:06:43.073321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:43.086576 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1cb1799b-1c30-4d7d-b416-09c5aaae7f83 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.533418 Oct 28 13:06:43.111782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 608/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:42 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:43.176161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-387a40fb-0fa3-444e-a070-8610979714e9 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:43.177024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-387a40fb-0fa3-444e-a070-8610979714e9 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:43.473334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:43.473928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:43.475131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:43.476749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:43.477715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:43.484559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-387a40fb-0fa3-444e-a070-8610979714e9 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:43.490161 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-387a40fb-0fa3-444e-a070-8610979714e9 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1217 microversion: 2.1 time: 0.318388 Oct 28 13:06:43.491945 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 609/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:43 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1217 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:43.494464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:43.495190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:43.495833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:43.497236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:43.498081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:43.498683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:43.544536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Getting quotas for project 5ece3c3598a3497fbbcf125f7d9ee7c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:43.589612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Getting quotas for user b3d39873294c4d6ca4a79b55642d1ea6 and project 5ece3c3598a3497fbbcf125f7d9ee7c4. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:43.624445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:06:43.635515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:06:43.669509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-399478930", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "44e15281-3ffd-4847-8d17-931aae7767ee"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:43.821009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] validate_networks() for [('44e15281-3ffd-4847-8d17-931aae7767ee', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:06:43.892515 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87519ada-0001-4cb7-947e-f2d579165f8b tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186985 Oct 28 13:06:43.900639 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 620/1229] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:06:43.916051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:43.917679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:43.934002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:43.934680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:43.935336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:43.936689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:43.937363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:43.937943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:44.204599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:44.217975 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef078252-928d-4a10-9448-693b681a3216 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.314699 Oct 28 13:06:44.234039 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 621/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:43 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:44.240168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:44.241193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:44.252960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:44.252960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:44.252960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:44.252960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:44.253674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:44.253674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:44.611192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:44.626695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b9d2eec3-9677-4462-b05f-a4207e1c91f0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.389503 Oct 28 13:06:44.627322 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 622/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:44 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:44.639595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea89d67e-0ab0-4e22-b4c1-41ce0200adfe tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:44.642315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ea89d67e-0ab0-4e22-b4c1-41ce0200adfe tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:44.781314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ea89d67e-0ab0-4e22-b4c1-41ce0200adfe tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:44.798492 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea89d67e-0ab0-4e22-b4c1-41ce0200adfe tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1222 microversion: 2.1 time: 0.168152 Oct 28 13:06:44.800524 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 623/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:44 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:44.813604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:44.815347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:44.828082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:44.828739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:44.829232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:44.830013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:44.830470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:44.830925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.114205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:45.122915 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-10a0292c-fa26-42af-8a50-e8cb0968ee65 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.321664 Oct 28 13:06:45.136497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 624/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:44 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:45.144190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:45.145074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:45.155981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.157303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.157897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.159151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.159769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.160716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.295939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:45.309023 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2e7da19b-808b-4b66-8d83-29104c02e47d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1269 microversion: 2.1 time: 0.180840 Oct 28 13:06:45.310174 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 625/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:45 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:45.330991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:45.331924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:45.341193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.342014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.342737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.343749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.344420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.345103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.726187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:45.737244 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dbae088e-bd92-4558-a611-beaf8487b75f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.425663 Oct 28 13:06:45.737846 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 626/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:45 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:45.747777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:45.756688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:45.772164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.773916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.773916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.775159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.775645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.776075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.853869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:45.854299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:45.854766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:45.860036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:45.860036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:45.873072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.873564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.876179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.877243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:45.878918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:45.880710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:45.931141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Getting quotas for project e87eb708efd84b7cb25c366bb340b453. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:45.949146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Getting quotas for user ceafc4ec019349dba728a9b9d850da61 and project e87eb708efd84b7cb25c366bb340b453. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:46.004978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:06:46.007795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:06:46.231694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:46.246365 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d975d19-2bd3-4dce-b780-5e780087fc18 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.502558 Oct 28 13:06:46.247345 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 627/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:45 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:46.263583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:46.263583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:46.280049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.281000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.281998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:46.282892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.285316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.286159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:46.415757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:46.423158 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63a1791c-51bc-4d0a-b77f-8d87e95766a1 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.927266 Oct 28 13:06:46.431430 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-04cadbb4-42ef-45bd-86ef-28060aec7ad5 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1218 microversion: 2.1 time: 0.182844 Oct 28 13:06:46.431900 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 610/1237] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:06:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:06:46.432674 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 628/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:46 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:46.450127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-80bb56da-f3df-4f19-8c89-6198031555c7 req-f0049a7d-786f-421d-addd-ddb2df10d16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdd3e45-da04-4d94-b665-7d58fdfcdb02", "name": "network-vif-plugged", "status": "completed", "tag": "e9512d3b-8d47-436d-86b6-9d36a071aed1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:46.459058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:46.459681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:46.483132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.484703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.485312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:46.496258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.496555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:46.497200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.497808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:46.508386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-80bb56da-f3df-4f19-8c89-6198031555c7 req-f0049a7d-786f-421d-addd-ddb2df10d16e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.511504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-80bb56da-f3df-4f19-8c89-6198031555c7 req-f0049a7d-786f-421d-addd-ddb2df10d16e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.514186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-80bb56da-f3df-4f19-8c89-6198031555c7 req-f0049a7d-786f-421d-addd-ddb2df10d16e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:46.563054 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-80bb56da-f3df-4f19-8c89-6198031555c7 req-f0049a7d-786f-421d-addd-ddb2df10d16e service nova] Creating event network-vif-plugged:e9512d3b-8d47-436d-86b6-9d36a071aed1 for instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 on n-h1-862876-2 Oct 28 13:06:46.577714 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-80bb56da-f3df-4f19-8c89-6198031555c7 req-f0049a7d-786f-421d-addd-ddb2df10d16e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141551 Oct 28 13:06:46.578816 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 629/1239] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:46.602218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-16783489-2c91-430c-bd36-dc5255f4f6c9 req-d60c8bc6-9879-4507-822a-758498600822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50ef387-14f5-40f0-9911-b97b6b862054", "tag": "802e41ae-314e-4eea-beb0-e3d09a4e41df"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:46.649198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-16783489-2c91-430c-bd36-dc5255f4f6c9 req-d60c8bc6-9879-4507-822a-758498600822 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.649656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-16783489-2c91-430c-bd36-dc5255f4f6c9 req-d60c8bc6-9879-4507-822a-758498600822 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.650095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-16783489-2c91-430c-bd36-dc5255f4f6c9 req-d60c8bc6-9879-4507-822a-758498600822 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:46.674219 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-16783489-2c91-430c-bd36-dc5255f4f6c9 req-d60c8bc6-9879-4507-822a-758498600822 service nova] Creating event network-changed:802e41ae-314e-4eea-beb0-e3d09a4e41df for instance d50ef387-14f5-40f0-9911-b97b6b862054 on n-h2-862876-2 Oct 28 13:06:46.688489 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-16783489-2c91-430c-bd36-dc5255f4f6c9 req-d60c8bc6-9879-4507-822a-758498600822 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108070 Oct 28 13:06:46.691062 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 630/1240] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:46.705736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:46.706450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:46.735699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.736261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.736713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:46.737458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:46.737910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:46.738336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:47.187844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:47.199554 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb2ed271-b0b4-41ca-884d-12f62a177f2a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1275 microversion: 2.1 time: 0.507197 Oct 28 13:06:47.202895 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 631/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:46 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1275 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:47.222856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7de36b50-660c-4ae4-8fa3-96e7ec42bad8 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:47.224266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7de36b50-660c-4ae4-8fa3-96e7ec42bad8 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:47.375158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7de36b50-660c-4ae4-8fa3-96e7ec42bad8 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:47.385389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7de36b50-660c-4ae4-8fa3-96e7ec42bad8 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1231 microversion: 2.1 time: 0.181084 Oct 28 13:06:47.385987 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 632/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:47 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1231 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:47.414265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:47.414911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:47.424812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:47.442284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:47.442794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:47.443241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:47.443949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:47.444936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:47.445364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:47.454119 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e1ca2fdb-b15b-4e28-afb7-235b5e9ef22f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.998330 Oct 28 13:06:47.455810 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 611/1243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:46 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:47.471413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:47.474550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:47.483071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:47.484034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:47.484720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:47.485709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:47.486451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:47.487694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:47.495557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:47.936652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:47.960614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8c4f045-29f3-4b9e-b06b-06a1bd0ef63c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.552503 Oct 28 13:06:47.961498 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 633/1244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:47 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:47.973482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:47.977766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:47.999044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:47.999044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:47.999894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:48.000835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:48.002535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:48.003633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:48.266252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:48.275530 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b97691f5-f2ad-4fa5-98d8-304b2919e794 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.816305 Oct 28 13:06:48.283615 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 612/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:47 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:48.307557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:48.308176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:48.323196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:48.342490 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-466590d6-d8ef-46a2-9b01-5ebd09c11c88 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1282 microversion: 2.1 time: 0.375041 Oct 28 13:06:48.343375 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 634/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:47 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1282 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:48.363136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:48.363658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:48.364100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:48.365949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:48.367238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:48.367828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:48.410050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-090e4945-a47c-4e4e-be3d-0c468c2681c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:48.410818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-090e4945-a47c-4e4e-be3d-0c468c2681c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:48.678916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-090e4945-a47c-4e4e-be3d-0c468c2681c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:48.686816 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-090e4945-a47c-4e4e-be3d-0c468c2681c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1231 microversion: 2.1 time: 0.282372 Oct 28 13:06:48.711211 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 635/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:48 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1231 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:48.731655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:48.732312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:48.738610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:48.739360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:48.740747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:48.740747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:48.741431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:48.750824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:48.936131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:48.936131 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c8c3e8a-6016-48cd-8681-73d06538713d tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.632858 Oct 28 13:06:48.936764 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 613/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:48 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:48.986427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:48.987080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:48.998244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:48.998738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.001599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.002380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.003092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.003989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.227188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:49.233431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:49.244274 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0119fb97-1583-469d-8a86-a4cdbc11a90b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1317 microversion: 2.1 time: 0.530226 Oct 28 13:06:49.245350 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 636/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:48 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:49.306324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:49.306967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:49.313336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.313831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.314261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.322303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.323074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.323668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.428407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:49.449266 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-510d3c8f-5a65-42e2-8d3b-fdebd5bd4ba3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.466425 Oct 28 13:06:49.452342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 614/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:48 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:49.469155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:49.470086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:49.493980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.497072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.497751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.500810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.501916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.503614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.629177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:49.639783 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9e8900ae-b40b-43e4-adce-34683372bcb7 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1280 microversion: 2.1 time: 0.186106 Oct 28 13:06:49.658867 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 615/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:49 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:49.723626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:49.724381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:49.742760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.744371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.744828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.746629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.750102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.750574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.784335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:49.796545 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0ade3e87-b941-48fa-8ca1-a597c319e7de tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.493159 Oct 28 13:06:49.812929 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 637/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:49 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:49.924867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:49.935455 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5e8704c-c975-4c40-b274-0b2ddc7a39f6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1283 microversion: 2.1 time: 0.216576 Oct 28 13:06:49.941995 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 616/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:49 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1283 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:49.959847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:49.961284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:49.970159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.971440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.972766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:49.973646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:49.974255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:49.974860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.269161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:50.269958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:50.278898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.279816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.280429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.281394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.282063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.282716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.405920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:50.418494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-408436b7-4431-4fe6-b5e3-8c1760f86af1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.462043 Oct 28 13:06:50.429745 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 638/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:49 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:50.476898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:50.477679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:50.487661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.491954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.492512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.493351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.494042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.495008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.809460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:50.821432 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d4d4f76-eaff-4429-8321-ec77213fcfd4 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.348915 Oct 28 13:06:50.822338 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 639/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:50 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:50.843224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:50.843965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:50.851514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.852146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.852689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.853507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.854074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.854591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.930222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:50.940208 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2c0a9d3-43c8-4076-a71a-1c6f4c3d7a60 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1280 microversion: 2.1 time: 0.102837 Oct 28 13:06:50.940895 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 640/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:50 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:50.946027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:50.948147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:50.968514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.969544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.970206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:50.971665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:50.973894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:50.974637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:51.003665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:51.021458 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28fae9e0-c8ff-40d2-82b0-1fdf51be5465 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1467 microversion: 2.1 time: 0.754311 Oct 28 13:06:51.022331 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 617/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:50 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1467 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:51.034975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:51.036988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:51.054587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:51.055301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:51.055847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:51.056715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:51.057513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:51.058211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:51.284193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:51.299243 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3a033a4-b647-4c50-b87c-6dd424d20ae7 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1301 microversion: 2.1 time: 0.273522 Oct 28 13:06:51.303265 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 618/1258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:51 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1301 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:51.322593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-69f8d531-7771-4e08-aa32-40d833d40c79 req-41d89a6c-e746-44d9-b62b-8959ce03d56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f966e217-39e0-425f-8478-cc310191bfb5", "tag": "b61fc208-0741-4a6f-ac24-2d7fbbbb8823"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:51.350225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-69f8d531-7771-4e08-aa32-40d833d40c79 req-41d89a6c-e746-44d9-b62b-8959ce03d56c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:51.351146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-69f8d531-7771-4e08-aa32-40d833d40c79 req-41d89a6c-e746-44d9-b62b-8959ce03d56c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:51.351828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-69f8d531-7771-4e08-aa32-40d833d40c79 req-41d89a6c-e746-44d9-b62b-8959ce03d56c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:51.371482 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-69f8d531-7771-4e08-aa32-40d833d40c79 req-41d89a6c-e746-44d9-b62b-8959ce03d56c service nova] Creating event network-changed:b61fc208-0741-4a6f-ac24-2d7fbbbb8823 for instance f966e217-39e0-425f-8478-cc310191bfb5 on n-h2-862876-2 Oct 28 13:06:51.380226 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-69f8d531-7771-4e08-aa32-40d833d40c79 req-41d89a6c-e746-44d9-b62b-8959ce03d56c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074382 Oct 28 13:06:51.382056 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 619/1259] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:51.390220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:51.391806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:51.400699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:51.401209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:51.401823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:51.402548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:51.403268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:51.404814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:51.737576 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b9c0aef-b3dd-4ca9-9dc0-58ecce054028 tempest-ServersOnMultiNodesTest-1425795912 tempest-ServersOnMultiNodesTest-1425795912-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1618 microversion: 2.1 time: 0.351918 Oct 28 13:06:51.738923 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 620/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:51 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1618 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:51.810037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-147117023", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "5d811f6e-cc55-4a5f-85b2-3720ed1ab191"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:51.891116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] validate_networks() for [('5d811f6e-cc55-4a5f-85b2-3720ed1ab191', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:06:51.993152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:52.005793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-181cce77-7a6b-4740-a59d-d3b9afaac334 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 1.063453 Oct 28 13:06:52.024450 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 641/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:50 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:52.033131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:52.035562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:52.045382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.047020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.051747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:52.053140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.053830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.054569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:52.452884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:52.462767 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-350899ec-c447-4dd4-8d7e-758193a2a0d7 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.435848 Oct 28 13:06:52.481466 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 642/1262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:52 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:52.491914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:52.492458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:52.501663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.502081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.502508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:52.505974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.506455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.507433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:52.517688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:06:52.519761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:06:52.520554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:06:52.521119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:06:52.521731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:06:52.560108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.561141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.579809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:52.580454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:06:52.580775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.581269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.581710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:52.641429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Getting quotas for project 54902a27bc8e4736a3ea3e48c1c6924a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:06:52.660873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Getting quotas for user 6655019d4e204241b8f97a5d2cdbd0bf and project 54902a27bc8e4736a3ea3e48c1c6924a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:06:52.690102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:06:52.693387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:06:52.758379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:52.908236 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6b6ede12-83f6-482b-a5b8-c26e6dac0720 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167937 Oct 28 13:06:52.911766 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 621/1263] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:06:52.922036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:52.922689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:52.936637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.943400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.943878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:52.944673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:52.945149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:52.945585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.252319 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-13454071-2590-4c40-a4b7-60b538acbacb tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 204 len: 0 microversion: 2.1 time: 0.774907 Oct 28 13:06:53.253082 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 643/1264] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:06:52 2022] DELETE /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:06:53.262772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:53.263721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:53.269849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.270336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.270792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.271486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.271941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.273421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.278971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:53.288002 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d9a4b07-793d-4295-a841-9fbf8eb468bd tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.375834 Oct 28 13:06:53.289162 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 622/1265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:52 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:53.298611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:53.300035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:53.309174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.309725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.310149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.310882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.311335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.311757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.504143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:53.516256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:53.522116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71f9b4a4-81f3-4c3f-bcbc-74e04eb4cb43 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.265675 Oct 28 13:06:53.523697 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 644/1266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:53 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:53.542292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b77217b8-7ba3-4441-adaf-8d6d47cbd54f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:53.544366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b77217b8-7ba3-4441-adaf-8d6d47cbd54f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:53.563586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:53.572773 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09709606-7193-4e05-8d75-cb08904955dc tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1331 microversion: 2.1 time: 0.281724 Oct 28 13:06:53.573567 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 623/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:53 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1331 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:53.578259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:53.579110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:53.586319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.586884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.587326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.588114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.588568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.588991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.613988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b77217b8-7ba3-4441-adaf-8d6d47cbd54f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:53.622987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b77217b8-7ba3-4441-adaf-8d6d47cbd54f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1217 microversion: 2.1 time: 0.096713 Oct 28 13:06:53.623580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 645/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:53 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:53.648813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:53.649751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:53.661138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.661787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.662504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.664274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.664864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.665360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.842869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:53.852042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14c2912e-970b-4e25-bd53-cdb1517e73ba tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.277285 Oct 28 13:06:53.868133 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 624/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:53 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:53.868133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:53.868133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:53.875280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.876003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.876668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.877581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.878213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.878977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.886658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:53.901715 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-321ee275-4da1-46f5-bf91-bb06639d31e0 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1473 microversion: 2.1 time: 0.273149 Oct 28 13:06:53.902783 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 646/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:53 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1473 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:53.910358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ad63721c-8ec7-44ee-a5bb-18f50b6aa55f req-60a44f8c-30dc-4c40-8915-7dcf432e262a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0faf8dd-2c19-473f-a2e9-e78233a88309", "tag": "af8efb9e-f9f4-412e-acf3-8d7561d56193"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:53.927505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad63721c-8ec7-44ee-a5bb-18f50b6aa55f req-60a44f8c-30dc-4c40-8915-7dcf432e262a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:53.928273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad63721c-8ec7-44ee-a5bb-18f50b6aa55f req-60a44f8c-30dc-4c40-8915-7dcf432e262a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:53.928876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad63721c-8ec7-44ee-a5bb-18f50b6aa55f req-60a44f8c-30dc-4c40-8915-7dcf432e262a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:53.953811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ad63721c-8ec7-44ee-a5bb-18f50b6aa55f req-60a44f8c-30dc-4c40-8915-7dcf432e262a service nova] Creating event network-changed:af8efb9e-f9f4-412e-acf3-8d7561d56193 for instance f0faf8dd-2c19-473f-a2e9-e78233a88309 on n-h2-862876-2 Oct 28 13:06:53.962135 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ad63721c-8ec7-44ee-a5bb-18f50b6aa55f req-60a44f8c-30dc-4c40-8915-7dcf432e262a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056988 Oct 28 13:06:53.963528 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 647/1271] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:54.156218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:54.165207 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e3fc72a-4342-4e42-bf19-593abc62eade tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.311133 Oct 28 13:06:54.165805 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 625/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:53 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:54.317928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:54.318624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:54.351157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:54.351682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:54.352417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-cc4cf7d9-7ae9-496e-83b4-c76b96d1b7dd req-203bcb62-269b-4179-b86f-703f828a60b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56888387-b0fe-4b83-88b9-d4a2d57a95c4", "tag": "f7c834b9-7b6a-476d-b581-8e0d73b7f350"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:54.353280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:54.354474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:54.357276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:54.361542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:54.368801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cc4cf7d9-7ae9-496e-83b4-c76b96d1b7dd req-203bcb62-269b-4179-b86f-703f828a60b7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:54.369448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cc4cf7d9-7ae9-496e-83b4-c76b96d1b7dd req-203bcb62-269b-4179-b86f-703f828a60b7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:54.370916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cc4cf7d9-7ae9-496e-83b4-c76b96d1b7dd req-203bcb62-269b-4179-b86f-703f828a60b7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:54.395315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-cc4cf7d9-7ae9-496e-83b4-c76b96d1b7dd req-203bcb62-269b-4179-b86f-703f828a60b7 service nova] Creating event network-changed:f7c834b9-7b6a-476d-b581-8e0d73b7f350 for instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 on n-h1-862876-2 Oct 28 13:06:54.408070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-cc4cf7d9-7ae9-496e-83b4-c76b96d1b7dd req-203bcb62-269b-4179-b86f-703f828a60b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058860 Oct 28 13:06:54.409977 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 626/1273] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:54.460892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0d303217-d042-4f34-a881-a9b2c39e9a19 req-7ada539a-b792-4235-899b-6efd4cbe0cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50ef387-14f5-40f0-9911-b97b6b862054", "name": "network-vif-plugged", "status": "completed", "tag": "802e41ae-314e-4eea-beb0-e3d09a4e41df"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:54.482486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d303217-d042-4f34-a881-a9b2c39e9a19 req-7ada539a-b792-4235-899b-6efd4cbe0cd3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:54.483004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d303217-d042-4f34-a881-a9b2c39e9a19 req-7ada539a-b792-4235-899b-6efd4cbe0cd3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:54.483429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d303217-d042-4f34-a881-a9b2c39e9a19 req-7ada539a-b792-4235-899b-6efd4cbe0cd3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:54.519345 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0d303217-d042-4f34-a881-a9b2c39e9a19 req-7ada539a-b792-4235-899b-6efd4cbe0cd3 service nova] Creating event network-vif-plugged:802e41ae-314e-4eea-beb0-e3d09a4e41df for instance d50ef387-14f5-40f0-9911-b97b6b862054 on n-h2-862876-2 Oct 28 13:06:54.528435 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0d303217-d042-4f34-a881-a9b2c39e9a19 req-7ada539a-b792-4235-899b-6efd4cbe0cd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071901 Oct 28 13:06:54.528944 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 627/1274] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:06:54.556591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:54.557586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:54.580557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:54.581157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:54.581491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:54.582198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:54.582656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:54.583141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:54.998223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:55.011563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3dd0e287-70d9-40ce-b671-ee3aba245164 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.469007 Oct 28 13:06:55.012454 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 628/1275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:54 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:55.018024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:55.019086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:55.026196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.026959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.027619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.028516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.034553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.034553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.057291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:55.066845 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ac77bdd5-0915-4981-a06c-6f2f54afe90f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.753483 Oct 28 13:06:55.074522 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 648/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:54 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:55.091497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:55.092341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:55.105212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.105721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.106162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.106908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.108181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.115081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.248835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:55.268964 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc0eef37-8f43-465f-9462-e753be7ad2b6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1331 microversion: 2.1 time: 0.255264 Oct 28 13:06:55.270232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 629/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:55 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1331 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:55.277462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:55.278411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:55.292679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.292679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.292679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.292679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.293141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.293141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.338974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:55.353878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ce531fe-303d-43f8-aa9e-a9ce2ef0beff tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1213 microversion: 2.1 time: 0.277888 Oct 28 13:06:55.355220 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 649/1278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:55 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1213 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:55.360137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:55.369611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:55.385781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.386628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.387280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.389404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.391473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.392139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.673022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:55.681747 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36d570c9-f64b-4377-961d-c6f3347fb4aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1473 microversion: 2.1 time: 0.325313 Oct 28 13:06:55.682599 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 650/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:55 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:55.704133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:55.704670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:55.711283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.712076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.712718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.713611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:55.714253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:55.714888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:55.779864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:55.789501 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61ec1450-c5c5-40a7-a028-9a8b0757d510 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.517234 Oct 28 13:06:55.790096 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 630/1280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:55 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:56.027744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:56.038771 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4abb9104-e000-439c-a5f9-86278e107df5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.342309 Oct 28 13:06:56.041096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:56.042063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:56.051125 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 651/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:55 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:56.064260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.065031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.069929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.070934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.077480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.078294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.100133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:56.100937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:56.114051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.115152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.115812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.117532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.118258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.118908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.167350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:56.360887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:56.370239 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5e33803-9f50-4183-adf8-e90aec92f4b3 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1351 microversion: 2.1 time: 0.274463 Oct 28 13:06:56.375946 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 652/1282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:56 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1351 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:56.393358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-904a3d71-2e33-433b-a19b-ef328c21e2dd req-0b703d67-8378-4811-bf31-5320e3acde8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffdd3e45-da04-4d94-b665-7d58fdfcdb02", "name": "network-vif-deleted", "tag": "e9512d3b-8d47-436d-86b6-9d36a071aed1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:56.407355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-904a3d71-2e33-433b-a19b-ef328c21e2dd req-0b703d67-8378-4811-bf31-5320e3acde8d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.408563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-904a3d71-2e33-433b-a19b-ef328c21e2dd req-0b703d67-8378-4811-bf31-5320e3acde8d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.410025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-904a3d71-2e33-433b-a19b-ef328c21e2dd req-0b703d67-8378-4811-bf31-5320e3acde8d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.427132 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-904a3d71-2e33-433b-a19b-ef328c21e2dd req-0b703d67-8378-4811-bf31-5320e3acde8d service nova] Creating event network-vif-deleted:e9512d3b-8d47-436d-86b6-9d36a071aed1 for instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 on n-h1-862876-2 Oct 28 13:06:56.434310 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-904a3d71-2e33-433b-a19b-ef328c21e2dd req-0b703d67-8378-4811-bf31-5320e3acde8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056464 Oct 28 13:06:56.436379 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 653/1283] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:56.445100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:56.446270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:56.456567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.457698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.458376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.459417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.460277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.461643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.468118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:06:56.694648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:56.707980 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-338c7465-7517-48c0-8155-b2a2ce804f89 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1331 microversion: 2.1 time: 0.269449 Oct 28 13:06:56.708958 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 654/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:56 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1331 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:56.724340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:56.735239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:56.735948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:56.741748 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1cc3b01-6f27-445a-ba20-0aba562fc962 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.706515 Oct 28 13:06:56.742337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.742830 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 631/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:56 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:56.742971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.751826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.754638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:56.757517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:56.757681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.758467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.764455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.771907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.771907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.772158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.772796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.772796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.772796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.856404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:56.859522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:56.870311 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4c30dbb-137c-4bd4-8b86-21eb553c449e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1269 microversion: 2.1 time: 0.150460 Oct 28 13:06:56.871535 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 655/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:56 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:56.873595 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52b73de3-4e69-4d96-a69d-9c3478ba16aa tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1431 microversion: 2.1 time: 0.126019 Oct 28 13:06:56.874481 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 632/1287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:56 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1431 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:56.878643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:56.879766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:56.887783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.888473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.889053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:56.892203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:56.892203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:56.892203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.039592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:57.050159 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fddc38b7-51b5-4273-90be-4cd575a18206 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.176922 Oct 28 13:06:57.062771 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 656/1288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:56 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:57.071891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:57.072611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:57.079265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.080046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.080720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.081338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.082009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.082506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.401605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:57.403710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:57.412324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.414650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.416660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.421271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.422090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.422689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.496411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:57.505313 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de8d5fad-b9c3-4419-8930-7c768bc28b47 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.440751 Oct 28 13:06:57.505889 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 633/1289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:57 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:57.654372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:57.663740 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e117a5e9-018c-43e2-b59c-847652b1a811 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1539 microversion: 2.1 time: 0.268008 Oct 28 13:06:57.664600 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 657/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:57 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1539 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:57.692215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:57.692712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:57.698865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.699363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.699816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.700531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.700982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.701405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.740175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:57.740990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:57.747868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.748429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.748933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.749695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.750148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.754364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.783163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-95201632-5fa0-4d87-876d-d015253b8e52 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094327 Oct 28 13:06:57.783696 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 634/1291] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:06:57 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:57.789394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:57.790298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:57.812399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.812399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.812399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.812952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.813576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.814009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.895222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:57.902968 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-46f814dd-3fda-4e7d-a3b9-b7b02d69da8d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1331 microversion: 2.1 time: 0.166835 Oct 28 13:06:57.903540 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 658/1292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:57 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:57.908269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:57.908876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:57.915295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.915779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.916214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.916882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:57.917334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:57.917751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:57.984182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:57.992716 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f746206a-4a39-4b79-ab19-420423776cc4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1277 microversion: 2.1 time: 0.088163 Oct 28 13:06:57.993624 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 659/1293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:57 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:57.997720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:57.998324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:58.004492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.004968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.005399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.006090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.006547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.007048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.039259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.039740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.040167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.040627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid ffdd3e45-da04-4d94-b665-7d58fdfcdb02 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:58.084484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:58.092708 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32a68ffd-b4b8-484b-8526-9eb390373106 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1307 microversion: 2.1 time: 0.098415 Oct 28 13:06:58.093496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 660/1294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:57 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:58.096032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:58.097746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:58.098351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:58.104125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.119412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.119412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.119648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66124a45-792e-40ea-a074-ae79de9decb8 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.320325 Oct 28 13:06:58.119735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.119816 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 635/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:57 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:58.119907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.119907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.238110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:58.246510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a2439e7-b5da-4b51-9cce-5d4a805c6851 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1471 microversion: 2.1 time: 0.152213 Oct 28 13:06:58.247112 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 661/1296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:58 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:58.529625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:58.530240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:58.537145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.538472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.538944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.539650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.540280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.540734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.774312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:58.783857 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cdf03a41-0818-4667-9181-8fb2bbb5f6d4 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.258083 Oct 28 13:06:58.784998 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 636/1297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:58 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:58.929662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:58.930832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:58.939995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.940783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.941688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:58.942874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:58.943551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:58.944743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.018227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:59.019174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:59.030310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.031100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.031613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.032446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.032970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.033457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.148347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:59.165072 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4710e34a-cbff-4c42-8f42-a6f54b8a90d4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1277 microversion: 2.1 time: 0.152362 Oct 28 13:06:59.166015 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 637/1298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:59 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:59.174090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:59.175816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:59.190387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.191211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.192027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.192913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.195222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.203817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.422611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid 33e873a2-b078-4190-9f83-0644b1075f4a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:59.427032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:59.434904 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1de7f746-047b-4454-87f3-77ad3db34e59 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1331 microversion: 2.1 time: 0.511369 Oct 28 13:06:59.437972 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 662/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:58 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1331 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:06:59.438692 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-df2479b0-177a-43ea-be90-08de96699f26 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 2423 microversion: 2.25 time: 0.271310 Oct 28 13:06:59.440476 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 638/1300] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:06:59 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 2423 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:06:59.446592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:59.447572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:59.457214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.457214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.457214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.457214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.457620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.458109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.468594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:59.469450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:59.476471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.477182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.477765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.478606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.479239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.479890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.515383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.516302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.516892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.517498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid ffdd3e45-da04-4d94-b665-7d58fdfcdb02 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:59.611057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:59.619410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f9c3100-a8ed-45d0-befc-33fee1dff52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1307 microversion: 2.1 time: 0.180242 Oct 28 13:06:59.620266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 663/1301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:59 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:59.650786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bb4c4a6f-979c-4460-bee1-0b971b560711 req-3a32b615-cc5c-413b-9bc2-b9ce693b6357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50ef387-14f5-40f0-9911-b97b6b862054", "tag": "802e41ae-314e-4eea-beb0-e3d09a4e41df"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:59.651461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:59.660096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bb4c4a6f-979c-4460-bee1-0b971b560711 req-3a32b615-cc5c-413b-9bc2-b9ce693b6357 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.660510 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1dc4658f-ebfd-4853-902b-f5433d0c800c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.217561 Oct 28 13:06:59.661017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bb4c4a6f-979c-4460-bee1-0b971b560711 req-3a32b615-cc5c-413b-9bc2-b9ce693b6357 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.661602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bb4c4a6f-979c-4460-bee1-0b971b560711 req-3a32b615-cc5c-413b-9bc2-b9ce693b6357 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.662892 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 639/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:59 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:59.667959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:59.670463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:59.676615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.677239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.677780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.679167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.679765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.680344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.688020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bb4c4a6f-979c-4460-bee1-0b971b560711 req-3a32b615-cc5c-413b-9bc2-b9ce693b6357 service nova] Creating event network-changed:802e41ae-314e-4eea-beb0-e3d09a4e41df for instance d50ef387-14f5-40f0-9911-b97b6b862054 on n-h2-862876-2 Oct 28 13:06:59.693500 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bb4c4a6f-979c-4460-bee1-0b971b560711 req-3a32b615-cc5c-413b-9bc2-b9ce693b6357 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056540 Oct 28 13:06:59.695245 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 664/1303] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:06:59.701888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862876-2", "block_migration": "auto"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:06:59.715253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:59.723127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.724027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.724801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.726552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.727293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.728032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.758415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'flavor' on Instance uuid 33e873a2-b078-4190-9f83-0644b1075f4a {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:06:59.773075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Going to try to live migrate instance to n-h1-862876-2 {{(pid=127794) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:06:59.843962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:06:59.852270 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e44f40c-881f-4a78-a881-1f34c7843703 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1477 microversion: 2.1 time: 0.187938 Oct 28 13:06:59.852842 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 640/1304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:59 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:06:59.857553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:06:59.858324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:06:59.864431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.865075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.865671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:06:59.867794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:06:59.868425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:06:59.869078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.025226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:00.033781 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0414e7a7-8b8d-4d19-87d2-025dc434da13 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.179757 Oct 28 13:07:00.034689 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 641/1305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:06:59 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:00.188309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:00.189662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:00.196697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.197198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.197815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.198714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.199357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.199983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.369469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:00.382572 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-afe2b882-c15a-4177-8b1e-5b687e298a69 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1317 microversion: 2.1 time: 0.197218 Oct 28 13:07:00.383472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 642/1306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:00 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:00.458444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:00.459121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:00.467137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.467707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.468097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.469049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.469697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.470624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.702489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:00.712087 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-644f3c6c-a8be-46a8-b5cf-b3aee1b7126e tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1331 microversion: 2.1 time: 0.257742 Oct 28 13:07:00.731355 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 643/1307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:00 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1331 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:00.733400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:00.734062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:00.740794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.741447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.741976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.742770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.743297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.743786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.786055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.786626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.787177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.787687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid ffdd3e45-da04-4d94-b665-7d58fdfcdb02 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:00.847504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:00.858218 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10b434d4-8eb1-470c-a091-50ad79b2d1c9 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 200 len: 1307 microversion: 2.1 time: 0.127311 Oct 28 13:07:00.858218 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 644/1308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:00 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:00.867028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:00.868068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:00.875300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.876724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.877382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:00.878691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:00.879367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:00.879990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.052438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:01.060491 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40eb6274-985a-4330-a916-33cd6995b535 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.202709 Oct 28 13:07:01.075461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 645/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:00 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:01.082278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:01.082984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:01.089810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.090384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.091085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.091860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.092448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.092940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.235024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:01.245329 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d292c1f-0782-45b6-b07b-eef892fa6f36 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1477 microversion: 2.1 time: 0.168338 Oct 28 13:07:01.245935 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 646/1310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:01 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:01.265802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:01.266430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:01.277807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.278409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.279333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.280065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.280555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.281167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.442947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:01.446660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:01.454493 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49c0d558-1786-4e69-9597-187ddc0c81f3 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.206504 Oct 28 13:07:01.455293 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 647/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:01 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:01.461185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-bb2b2a58-fea5-4ecb-be36-c40198bc0cdf req-eb86c544-55ce-49c3-8799-5031f0044f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56888387-b0fe-4b83-88b9-d4a2d57a95c4", "name": "network-vif-plugged", "status": "completed", "tag": "f7c834b9-7b6a-476d-b581-8e0d73b7f350"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:01.471201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bb2b2a58-fea5-4ecb-be36-c40198bc0cdf req-eb86c544-55ce-49c3-8799-5031f0044f69 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.471685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bb2b2a58-fea5-4ecb-be36-c40198bc0cdf req-eb86c544-55ce-49c3-8799-5031f0044f69 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.472127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bb2b2a58-fea5-4ecb-be36-c40198bc0cdf req-eb86c544-55ce-49c3-8799-5031f0044f69 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.485441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-bb2b2a58-fea5-4ecb-be36-c40198bc0cdf req-eb86c544-55ce-49c3-8799-5031f0044f69 service nova] Creating event network-vif-plugged:f7c834b9-7b6a-476d-b581-8e0d73b7f350 for instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 on n-h1-862876-2 Oct 28 13:07:01.490539 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-bb2b2a58-fea5-4ecb-be36-c40198bc0cdf req-eb86c544-55ce-49c3-8799-5031f0044f69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033322 Oct 28 13:07:01.491583 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 648/1312] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:01.497030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:01.497819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:01.504934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.505648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.506251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.507817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.508996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.509659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.714237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:01.722668 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1c132e2-6d26-4061-b8c3-cd6c7c67f84f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1317 microversion: 2.1 time: 0.229691 Oct 28 13:07:01.723503 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 649/1313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:01 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:01.742129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c8b7d2ee-b82d-40bf-8547-21a60a4c7689 req-37a83e07-aa00-4567-a922-a01564619006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba1c3df-c727-4cdd-b65a-bfe984620b9a", "tag": "612a149a-9dba-4d19-8b87-7ef164f8e1a6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:01.755775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c8b7d2ee-b82d-40bf-8547-21a60a4c7689 req-37a83e07-aa00-4567-a922-a01564619006 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.756502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c8b7d2ee-b82d-40bf-8547-21a60a4c7689 req-37a83e07-aa00-4567-a922-a01564619006 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.757153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c8b7d2ee-b82d-40bf-8547-21a60a4c7689 req-37a83e07-aa00-4567-a922-a01564619006 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.768679 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c8b7d2ee-b82d-40bf-8547-21a60a4c7689 req-37a83e07-aa00-4567-a922-a01564619006 service nova] Creating event network-changed:612a149a-9dba-4d19-8b87-7ef164f8e1a6 for instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a on n-h1-862876-2 Oct 28 13:07:01.773523 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c8b7d2ee-b82d-40bf-8547-21a60a4c7689 req-37a83e07-aa00-4567-a922-a01564619006 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041584 Oct 28 13:07:01.774333 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 650/1314] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:01.779190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:01.779883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:01.786019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.786509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.786969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.787652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.788683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.789100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.923682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:01.931503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c651910-4d3a-40a4-89dd-7108a2d4cb95 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1331 microversion: 2.1 time: 0.156190 Oct 28 13:07:01.932078 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 651/1315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:01 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:01.936492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:01.937128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: ffdd3e45-da04-4d94-b665-7d58fdfcdb02] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:01.943435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.943926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.944387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.945071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.945526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.945944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.965186 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 could not be found. Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 HTTP/1.1 Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:01.970885 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 could not be found. Oct 28 13:07:01.973075 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ffdd3e45-da04-4d94-b665-7d58fdfcdb02'} Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 could not be found. Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:01.974087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 could not be found. Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 could not be found. Oct 28 13:07:01.976487 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:01.977938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance ffdd3e45-da04-4d94-b665-7d58fdfcdb02 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:01.977938 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2156aba0-c9be-46f7-9701-a7963c5c1aad tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02" status: 404 len: 111 microversion: 2.1 time: 0.035970 Oct 28 13:07:01.977938 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 652/1316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:01 2022] GET /compute/v2.1/servers/ffdd3e45-da04-4d94-b665-7d58fdfcdb02 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:01.979203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:01.979695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:01.986779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.987277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.987717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:01.988417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:01.989096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:01.989325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.015630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:02.419429 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1bfbe47-1684-4824-b3e1-738552907a18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 204 len: 0 microversion: 2.1 time: 0.445190 Oct 28 13:07:02.420073 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 653/1317] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:01 2022] DELETE /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:02.425445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:02.432037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:02.432646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.432646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.433062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.433789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.434241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.434668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.608648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=21 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:02.656535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:02.665303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c1bf1e5-f255-4765-9e1e-323f226c4393 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.244114 Oct 28 13:07:02.666925 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 654/1318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:02 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:02.669327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=48 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:02.678298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:02.681597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:02.689497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.690026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.690471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.691216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.691676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.692106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.758182 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d5804444-3d26-415b-8f3b-1cb62aef3f97 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/action" status: 202 len: 0 microversion: 2.25 time: 3.061461 Oct 28 13:07:02.762082 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 665/1319] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:06:59 2022] POST /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/action => generated 0 bytes in 3063 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:02.767031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:02.768061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:02.779744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.780631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.781151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.782965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.783759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.784277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.889912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:02.898722 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a01938b-6f41-422c-bf1c-700d96497be0 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1477 microversion: 2.1 time: 0.231043 Oct 28 13:07:02.911016 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 655/1320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:02 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:02.919130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:02.920143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:02.926441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.932351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.932351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.932351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.932351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.932740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.939434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:02.947617 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3ccd59c3-3f29-4569-8404-3554cd134d70 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1472 microversion: 2.1 time: 0.187371 Oct 28 13:07:02.948195 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 666/1321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:02 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:02.953028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:02.953668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:02.959898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.960714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.961156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:02.961850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:02.962464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:02.963084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.112762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:03.120447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:03.122258 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58e15bbf-d5f2-41e0-a1ad-71816bf2da3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.210004 Oct 28 13:07:03.134472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 656/1322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:02 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:03.134472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:03.134472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:03.134859 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c5167aa9-5180-4c39-91c8-db90d68ec966 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1317 microversion: 2.1 time: 0.178842 Oct 28 13:07:03.134859 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 667/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:02 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:03.134859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:03.134859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:03.138076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.138819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.139416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.140734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.140848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.141339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.141829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.141934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.142735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.142887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.144202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.150026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.292076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:03.295010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:03.297709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:03.301994 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-306e78c1-b05d-4c52-bc39-3c55d5a597a3 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1535 microversion: 2.1 time: 0.171749 Oct 28 13:07:03.302668 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 668/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:03 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1535 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:03.307475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:03.309789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:03.311166 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61fd0a3b-aecc-48a8-820e-3178371b9d5d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.187174 Oct 28 13:07:03.311875 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 657/1325] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:03 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:03.325269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f1059a0-4f93-44f2-9915-29aac7fda5d4 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'create', calling method: .version_select at 0x7f27b99ced30>, body: {"pool": "1be8f2a9-1883-44e8-a6c6-76b51d50fa9f"} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:03.508784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38", "name": "network-vif-unplugged", "status": "completed", "tag": "60b34799-ae4b-4324-a0ea-12c82b338812"}, {"server_uuid": "f966e217-39e0-425f-8478-cc310191bfb5", "name": "network-vif-plugged", "status": "completed", "tag": "b61fc208-0741-4a6f-ac24-2d7fbbbb8823"}, {"server_uuid": "f0faf8dd-2c19-473f-a2e9-e78233a88309", "name": "network-vif-plugged", "status": "completed", "tag": "af8efb9e-f9f4-412e-acf3-8d7561d56193"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:03.520607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.521354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.525451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.536901 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] Creating event network-vif-unplugged:60b34799-ae4b-4324-a0ea-12c82b338812 for instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 on n-h1-862876-2 Oct 28 13:07:03.537706 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] Creating event network-vif-plugged:b61fc208-0741-4a6f-ac24-2d7fbbbb8823 for instance f966e217-39e0-425f-8478-cc310191bfb5 on n-h2-862876-2 Oct 28 13:07:03.538378 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] Creating event network-vif-plugged:af8efb9e-f9f4-412e-acf3-8d7561d56193 for instance f0faf8dd-2c19-473f-a2e9-e78233a88309 on n-h2-862876-2 Oct 28 13:07:03.548914 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ccb98940-ca5a-43fa-96ef-321c7f188b18 req-8a788f02-31ba-4687-9531-0e51bf6d11ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.044205 Oct 28 13:07:03.549744 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 658/1326] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:03.618546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=36 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:03.689957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:03.690971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:03.698349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.698880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.699319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.700049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.700478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.700906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.846855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:03.864350 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e0037efa-0548-45d3-80a0-052211342671 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.179310 Oct 28 13:07:03.866645 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 659/1327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:03 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:03.926262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:03.927305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:03.934427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.935370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.935887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:03.936655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:03.937356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:03.937852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:04.576832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:04.586423 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab48583d-db7b-434f-bdf0-cfac867840b3 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1477 microversion: 2.1 time: 0.664071 Oct 28 13:07:04.587365 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 660/1328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:03 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1477 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:04.592425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:04.593074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:04.599200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:04.599715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:04.600145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:04.601379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:04.601845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:04.602709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:04.944231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:04.952550 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c59911ea-38de-412a-9963-24cb772c2b18 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1472 microversion: 2.1 time: 0.363658 Oct 28 13:07:04.969598 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 661/1329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:04 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:04.980107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:04.981549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:04.990196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:04.990924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:04.994518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:04.994518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:04.994518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:04.994518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.213614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f1059a0-4f93-44f2-9915-29aac7fda5d4 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.891762 Oct 28 13:07:05.214559 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 669/1330] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:07:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:05.221469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:05.222470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:05.236167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.237331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.239404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.239404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.240087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.240687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.295486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:05.304801 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-89af17a2-43a1-42f1-b151-3fd19711f185 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1317 microversion: 2.1 time: 0.333139 Oct 28 13:07:05.310050 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 662/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:04 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:05.317257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:05.321086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:05.337969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.342608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.342608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.342608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.342608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.343064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.537082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:05.552714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:05.567816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:05.571692 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cc82369d-f5ac-4b36-96e5-56ab3669d931 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.257804 Oct 28 13:07:05.573597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 663/1332] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:05 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:05.596725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:05.600094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:05.614483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.615456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.616589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.617469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.618090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.618700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.650796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:05.673230 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6377245f-9d61-4471-a3d4-c10d4403e390 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1317 microversion: 2.1 time: 0.457311 Oct 28 13:07:05.683866 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 670/1333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:05 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:05.706507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.124"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:05.710230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:05.727640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:05.732925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.733793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.734490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.735485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.738881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.739689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.769080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:07:05.769669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquired lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:07:05.845970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:05.858639 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b742f9d-5df6-456c-8a13-5f079995e25a tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1322 microversion: 2.1 time: 0.272348 Oct 28 13:07:05.863889 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 664/1334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:05 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:05.888839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f0f5bdd5-2238-47b4-a304-f7e4c7cbf87f req-833135fa-13e4-452e-ab1f-16dfbb27224b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "914c9c62-0736-40db-ae49-117f378f90d1", "name": "network-vif-deleted", "tag": "6efb5b84-7fcb-4952-9d80-eb0d22418a84"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:05.919198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f0f5bdd5-2238-47b4-a304-f7e4c7cbf87f req-833135fa-13e4-452e-ab1f-16dfbb27224b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.921137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f0f5bdd5-2238-47b4-a304-f7e4c7cbf87f req-833135fa-13e4-452e-ab1f-16dfbb27224b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.924228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f0f5bdd5-2238-47b4-a304-f7e4c7cbf87f req-833135fa-13e4-452e-ab1f-16dfbb27224b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.940029 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f0f5bdd5-2238-47b4-a304-f7e4c7cbf87f req-833135fa-13e4-452e-ab1f-16dfbb27224b service nova] Creating event network-vif-deleted:6efb5b84-7fcb-4952-9d80-eb0d22418a84 for instance 914c9c62-0736-40db-ae49-117f378f90d1 on n-h2-862876-2 Oct 28 13:07:05.947192 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f0f5bdd5-2238-47b4-a304-f7e4c7cbf87f req-833135fa-13e4-452e-ab1f-16dfbb27224b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077026 Oct 28 13:07:05.947802 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 665/1335] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:05.958824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c9c4c0d5-707d-4959-83cc-0afab3262e5a req-305e86f9-17e0-49a5-9219-d0b44df7ff6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38", "name": "network-vif-plugged", "status": "completed", "tag": "60b34799-ae4b-4324-a0ea-12c82b338812"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:05.973209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:05.978186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c9c4c0d5-707d-4959-83cc-0afab3262e5a req-305e86f9-17e0-49a5-9219-d0b44df7ff6e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:05.978898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c9c4c0d5-707d-4959-83cc-0afab3262e5a req-305e86f9-17e0-49a5-9219-d0b44df7ff6e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:05.979504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c9c4c0d5-707d-4959-83cc-0afab3262e5a req-305e86f9-17e0-49a5-9219-d0b44df7ff6e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:05.983180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:05.993882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c9c4c0d5-707d-4959-83cc-0afab3262e5a req-305e86f9-17e0-49a5-9219-d0b44df7ff6e service nova] Creating event network-vif-plugged:60b34799-ae4b-4324-a0ea-12c82b338812 for instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 on n-h1-862876-2 Oct 28 13:07:05.999290 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c9c4c0d5-707d-4959-83cc-0afab3262e5a req-305e86f9-17e0-49a5-9219-d0b44df7ff6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047519 Oct 28 13:07:06.000784 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 666/1336] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:06.007854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:06.008885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:06.017039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.017598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.019441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.020349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.020971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.021544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.238372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:06.247585 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e9ebeadd-b4ed-4633-917b-02574d3cf9c4 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1477 microversion: 2.1 time: 0.245328 Oct 28 13:07:06.248184 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 667/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:06 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1477 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:06.263687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:06.264327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:06.283018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.283669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.284456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.286175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.286806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.287372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.321909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.322463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.323022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.323519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid 914c9c62-0736-40db-ae49-117f378f90d1 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:06.367663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:06.375655 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a4c6566-f6fe-4813-b2b1-1e124a08c445 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 200 len: 1306 microversion: 2.1 time: 0.123974 Oct 28 13:07:06.376416 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 668/1338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:06 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 1306 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:06.384359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:06.385631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:06.393598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.394224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.397961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.398716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.399303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.399768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.553485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:06.564582 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bae5a69-e4f9-4dbc-bfe9-91a254eff04f tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1508 microversion: 2.1 time: 0.186885 Oct 28 13:07:06.565859 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 669/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:06 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:06.602577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:06.603504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:06.623844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.625826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.627463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.628235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.629784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.630232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.828725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:06.838615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:06.840047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:06.849160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-366468ba-5dfa-4c70-a620-a8352104a1ef tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.244165 Oct 28 13:07:06.849160 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 670/1340] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:06 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:07:06.849944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:06.851571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:06.873278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.873827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.874262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:06.875055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:06.875630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:06.877920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.060503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:07.068825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4676bd70-bde5-4861-a401-6e76f280bc2d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1317 microversion: 2.1 time: 0.222813 Oct 28 13:07:07.083138 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 671/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:06 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:07.083138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:07.083138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:07.083654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.083758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.084121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.088585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.088585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.088585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.232366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:07.240531 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-130c27c3-df31-4a90-88ab-c835b20c9ce6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1470 microversion: 2.1 time: 0.169523 Oct 28 13:07:07.243771 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 672/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:07 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:07.263578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:07.264069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:07.274382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.274712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.275413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.282564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.282564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.282564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.302491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Request method failure captured: Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309/diagnostics HTTP/1.1 Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Pg8U3xmhTt7mGMWfXIWIRpxbZZIDRwNuRtaC5ZnC_dtDzGNmeUrqxdpedmbIoXg1xDDuepyPOxe72ERcEUNXuqOJoL6xSkGPDz7cqOI6NPuHidRKNNhqxh8QyVgXU6oCz8K8GEOw6q_Gh1zrIwpZdtq7vCcyHixn1Cn5DTthOzmCw Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5ece3c3598a3497fbbcf125f7d9ee7c4 Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-348602097 Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:07.305042 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ece3c3598a3497fbbcf125f7d9ee7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ece3c3598a3497fbbcf125f7d9ee7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ece3c3598a3497fbbcf125f7d9ee7c4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ece3c3598a3497fbbcf125f7d9ee7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-348602097 Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5ece3c3598a3497fbbcf125f7d9ee7c4 Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-348602097 Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerDiagnosticsNegativeTest-348602097-project Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: b3d39873294c4d6ca4a79b55642d1ea6 Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-348602097-project Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:07.306666 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'server_id': 'f0faf8dd-2c19-473f-a2e9-e78233a88309'} Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:07:07.312410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.313842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:07.315238 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7a227b96-a8a0-44c1-bcdf-d663f02441e6 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.046865 Oct 28 13:07:07.315238 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 673/1343] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:07:07 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309/diagnostics => generated 117 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:07:07.315238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:07.315238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:07.319692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.320397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.320964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.321671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.322129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.322557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.477686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:07.485584 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2e6559e-71ab-4de0-bb20-81a6d4bd7dd1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1477 microversion: 2.1 time: 0.177212 Oct 28 13:07:07.486159 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 674/1344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:07 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:07.491490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:07.492302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:07.498571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.502137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.502137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.502137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.502137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.502548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.529402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:07.928956 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f46bd4c-9441-4f13-8e58-18e077aaa499 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 204 len: 0 microversion: 2.1 time: 0.440595 Oct 28 13:07:07.929605 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 675/1345] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:07 2022] DELETE /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:07.937673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:07.938395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 914c9c62-0736-40db-ae49-117f378f90d1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:07.953802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.954278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.954716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.955474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:07.955935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:07.956357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:07.984408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance 914c9c62-0736-40db-ae49-117f378f90d1 could not be found. Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 HTTP/1.1 Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:07.986154 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 914c9c62-0736-40db-ae49-117f378f90d1 could not be found. Oct 28 13:07:07.987938 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '914c9c62-0736-40db-ae49-117f378f90d1'} Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 914c9c62-0736-40db-ae49-117f378f90d1 could not be found. Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:07.989180 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 914c9c62-0736-40db-ae49-117f378f90d1 could not be found. Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 914c9c62-0736-40db-ae49-117f378f90d1 could not be found. Oct 28 13:07:07.990683 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:07.992711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance 914c9c62-0736-40db-ae49-117f378f90d1 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:07.992711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fbc9e1d-52f9-4943-8bc7-9156a9130bea tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1" status: 404 len: 111 microversion: 2.1 time: 0.054265 Oct 28 13:07:07.992711 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 676/1346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:07 2022] GET /compute/v2.1/servers/914c9c62-0736-40db-ae49-117f378f90d1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:08.004297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:08.004925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:08.021310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:08.023376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:08.026182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:08.027190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:08.027823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:08.028432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:08.136098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Building network info cache for instance {{(pid=127794) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:07:08.281983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:08.293053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:08.298041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:08.300631 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17905c6d-e3dc-4a2b-801e-f865612d3c5b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.305478 Oct 28 13:07:08.304613 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 677/1347] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:07 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:08.313078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:08.317823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:08.331188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:08.335463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:08.338159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:08.340299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:08.343493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:08.344198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:08.572201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:08.585981 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e386e96-c830-4d3c-bc50-a834e4f83c85 tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1476 microversion: 2.1 time: 0.279762 Oct 28 13:07:08.590150 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 678/1348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:08 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:08.607152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:08.607912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:08.614784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:08.615483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:08.616879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:08.617876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:08.619307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:08.620248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:08.653645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:09.014775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Updating instance_info_cache with network_info: [{"id": "f7c834b9-7b6a-476d-b581-8e0d73b7f350", "address": "fa:16:3e:1c:ff:81", "network": {"id": "44e15281-3ffd-4847-8d17-931aae7767ee", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2054692787-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e87eb708efd84b7cb25c366bb340b453", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf7c834b9-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127794) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:07:09.043886 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f261c2a3-f54b-457e-9006-7709e451568e tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 204 len: 0 microversion: 2.1 time: 0.443432 Oct 28 13:07:09.048377 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 679/1349] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:08 2022] DELETE /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:09.051300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8edfe43c-8d59-4659-8e7f-af0c7a39d137 req-b5cf6664-1261-4493-9ce6-fd3e8f115564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba1c3df-c727-4cdd-b65a-bfe984620b9a", "name": "network-vif-plugged", "status": "completed", "tag": "612a149a-9dba-4d19-8b87-7ef164f8e1a6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:09.077409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8edfe43c-8d59-4659-8e7f-af0c7a39d137 req-b5cf6664-1261-4493-9ce6-fd3e8f115564 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.078210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8edfe43c-8d59-4659-8e7f-af0c7a39d137 req-b5cf6664-1261-4493-9ce6-fd3e8f115564 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.086941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8edfe43c-8d59-4659-8e7f-af0c7a39d137 req-b5cf6664-1261-4493-9ce6-fd3e8f115564 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.104146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8edfe43c-8d59-4659-8e7f-af0c7a39d137 req-b5cf6664-1261-4493-9ce6-fd3e8f115564 service nova] Creating event network-vif-plugged:612a149a-9dba-4d19-8b87-7ef164f8e1a6 for instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a on n-h1-862876-2 Oct 28 13:07:09.111456 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8edfe43c-8d59-4659-8e7f-af0c7a39d137 req-b5cf6664-1261-4493-9ce6-fd3e8f115564 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063591 Oct 28 13:07:09.119922 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 680/1350] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:09.140765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Releasing lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:07:09.142214 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f8b629b-cfc1-4e67-a3b2-61c8548b2789 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action" status: 202 len: 0 microversion: 2.1 time: 3.456489 Oct 28 13:07:09.143358 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 671/1351] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:05 2022] POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action => generated 0 bytes in 3458 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:07:09.155570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2fa45838-d562-48e9-83a4-3c62c46ad89f req-df928492-008a-4a22-904f-33fab691bf6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56888387-b0fe-4b83-88b9-d4a2d57a95c4", "tag": "f7c834b9-7b6a-476d-b581-8e0d73b7f350"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:09.158777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:09.159545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:09.190549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.191293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.191754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.192838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.194817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.195310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.196522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2fa45838-d562-48e9-83a4-3c62c46ad89f req-df928492-008a-4a22-904f-33fab691bf6b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.198189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2fa45838-d562-48e9-83a4-3c62c46ad89f req-df928492-008a-4a22-904f-33fab691bf6b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.200390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2fa45838-d562-48e9-83a4-3c62c46ad89f req-df928492-008a-4a22-904f-33fab691bf6b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.230165 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2fa45838-d562-48e9-83a4-3c62c46ad89f req-df928492-008a-4a22-904f-33fab691bf6b service nova] Creating event network-changed:f7c834b9-7b6a-476d-b581-8e0d73b7f350 for instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 on n-h1-862876-2 Oct 28 13:07:09.244834 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2fa45838-d562-48e9-83a4-3c62c46ad89f req-df928492-008a-4a22-904f-33fab691bf6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099953 Oct 28 13:07:09.255061 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 672/1352] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:09.261266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:09.270883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:09.281557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.286364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.287039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.291635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.292248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.292775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.537764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:09.559667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36b8381d-94e4-42dd-ab56-b0d0b736c098 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1462 microversion: 2.1 time: 0.300947 Oct 28 13:07:09.565823 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 673/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:09 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1462 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:09.583002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:09.587630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:09.594239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.595029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.595631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.596744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.608953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.608953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.634296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:09.652451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:09.666338 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d674c40d-8f11-49a0-ac2d-e0aa92bae22f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1317 microversion: 2.1 time: 0.549268 Oct 28 13:07:09.668975 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 681/1354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:09 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:09.679844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f691d17-0e4c-437e-9b96-33a01f218b60 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'create', calling method: .version_select at 0x7f27b95c4790>, body: {"pool": "1be8f2a9-1883-44e8-a6c6-76b51d50fa9f"} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:09.820964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:09.831115 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f49addb7-7b22-47ab-a48c-9b75cb4e5580 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1472 microversion: 2.1 time: 0.262960 Oct 28 13:07:09.832087 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 674/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:09 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:09.847431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:09.849591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:09.855018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.855514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.856490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:09.858330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:09.858834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:09.859272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:10.120119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:10.133138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:10.135780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:10.136079 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1acce4fb-0659-49fc-b548-fa2e607650d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.302846 Oct 28 13:07:10.142734 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 675/1356] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:09 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:10.148973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:10.151626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:10.158178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:10.158909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:10.159300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:10.160063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:10.160562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:10.161032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:10.670326 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17e5e235-8fe4-4236-a506-0f2944ac56c2 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action" status: 202 len: 0 microversion: 2.1 time: 0.525763 Oct 28 13:07:10.674482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 676/1357] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:10 2022] POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:10.675675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:10.676579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:10.683567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:10.684157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:10.684695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:10.685744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:10.686431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:10.687131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:11.134395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:11.163507 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c59f9f27-22b6-4b9b-b94b-5b5870342e2c tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1476 microversion: 2.1 time: 0.490825 Oct 28 13:07:11.169362 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 677/1358] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:10 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:11.187515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0fb158cc-521d-4715-b00d-f6b5044bdb46"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:11.191334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:11.204141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:11.208665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:11.210149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:11.214585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:11.216569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:11.217289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:11.299452 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] HTTP exception thrown: Volume 320501bd-673a-44cc-a885-b7c3fd654d25 could not be found. Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Request method failure captured: Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5/os-volume_attachments/320501bd-673a-44cc-a885-b7c3fd654d25 HTTP/1.1 Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 74 Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9N3LWxpUyTccoamHXIe3X2vBat8WcT-Or2PBm73UQvpAGM3K93hxBDpGBFF8ulYMoVAxl-9kMqzhPzOAe_D7ZTn2iCfAy_Fpob2W6xTIovyPM0m3JhTeCT7aq37U1UmKAAgtBU8z6HoBMtwV1GSBUqAJlTq1v_ZayXy9pKelvpFPXs Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: bbc587ee8675498796ba79d58e537396 Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesAdminNegativeTest-1444888104 Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:07:11.301643 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bbc587ee8675498796ba79d58e537396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bbc587ee8675498796ba79d58e537396"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bbc587ee8675498796ba79d58e537396", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bbc587ee8675498796ba79d58e537396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesAdminNegativeTest-1444888104 Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: bbc587ee8675498796ba79d58e537396 Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1444888104 Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesAdminNegativeTest-1444888104-project-admin Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 76113ac2b0014230b24894edca2c8536 Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesAdminNegativeTest-1444888104-project-admin Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: {"volumeAttachment": {"volumeId": "0fb158cc-521d-4715-b00d-f6b5044bdb46"}} Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:07:11.310255 n-d-862876-2 devstack@n-api.service[127794]: exception: Volume 320501bd-673a-44cc-a885-b7c3fd654d25 could not be found. Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': 'f966e217-39e0-425f-8478-cc310191bfb5', 'id': '320501bd-673a-44cc-a885-b7c3fd654d25', 'body': {'volumeAttachment': {'volumeId': '0fb158cc-521d-4715-b00d-f6b5044bdb46'}}} Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:07:11.311370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 320501bd-673a-44cc-a885-b7c3fd654d25 could not be found. (HTTP 404) (Request-ID: req-c5c9e5cc-2d00-459a-9a06-65c04adfacd4) Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:07:11.312423 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 320501bd-673a-44cc-a885-b7c3fd654d25 could not be found. Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:11.313634 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 320501bd-673a-44cc-a885-b7c3fd654d25 could not be found. Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 320501bd-673a-44cc-a885-b7c3fd654d25 could not be found. Oct 28 13:07:11.314886 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:11.316068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] Returning 404 to user: Volume 320501bd-673a-44cc-a885-b7c3fd654d25 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:11.316068 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef5da39b-3d35-4e36-96c1-47e70f928a9a tempest-VolumesAdminNegativeTest-1444888104 tempest-VolumesAdminNegativeTest-1444888104-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5/os-volume_attachments/320501bd-673a-44cc-a885-b7c3fd654d25" status: 404 len: 109 microversion: 2.1 time: 0.131998 Oct 28 13:07:11.316068 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 678/1359] 10.222.0.25 () {60 vars in 1433 bytes} [Fri Oct 28 13:07:11 2022] PUT /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5/os-volume_attachments/320501bd-673a-44cc-a885-b7c3fd654d25 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:11.316068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:11.316068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:11.320592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:11.321087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:11.321523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:11.322227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:11.322683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:11.323142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:11.359224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:11.360028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:11.360675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:11.365595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lazy-loading 'fault' on Instance uuid 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:11.730966 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30191346-bd81-4d89-b25c-3a8736e45010 tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1596 microversion: 2.1 time: 0.419465 Oct 28 13:07:11.732331 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 679/1360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:11 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1596 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:11.749778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:11.749778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:11.755678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:11.759713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:11.761888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:11.762822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:11.763452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:11.764884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.086604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:12.096353 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6918278-3829-4ba9-b47b-ec6b934cf8a6 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1507 microversion: 2.1 time: 0.362696 Oct 28 13:07:12.097565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 680/1361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:11 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:12.104711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:12.105318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:12.111827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.112316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.112749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.113449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.114182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.114631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.206721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:12.215573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-716fea5a-7479-41e1-be5e-0f7bc62e59fd tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1430 microversion: 2.1 time: 0.116626 Oct 28 13:07:12.216978 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 681/1362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:12 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1430 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:12.222675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:12.223504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:12.233516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.234739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.235206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.235913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.236367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.236788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.457018 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f691d17-0e4c-437e-9b96-33a01f218b60 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.786866 Oct 28 13:07:12.457707 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 682/1363] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:07:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:12.464112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e41520d6-3d19-43c4-99a7-2ef5f7a40212 req-5fceef09-345f-46ff-8cb6-6f61637c02c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0faf8dd-2c19-473f-a2e9-e78233a88309", "name": "network-vif-deleted", "tag": "af8efb9e-f9f4-412e-acf3-8d7561d56193"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:12.483231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e41520d6-3d19-43c4-99a7-2ef5f7a40212 req-5fceef09-345f-46ff-8cb6-6f61637c02c3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.487792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e41520d6-3d19-43c4-99a7-2ef5f7a40212 req-5fceef09-345f-46ff-8cb6-6f61637c02c3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.487792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e41520d6-3d19-43c4-99a7-2ef5f7a40212 req-5fceef09-345f-46ff-8cb6-6f61637c02c3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.506217 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e41520d6-3d19-43c4-99a7-2ef5f7a40212 req-5fceef09-345f-46ff-8cb6-6f61637c02c3 service nova] Creating event network-vif-deleted:af8efb9e-f9f4-412e-acf3-8d7561d56193 for instance f0faf8dd-2c19-473f-a2e9-e78233a88309 on n-h2-862876-2 Oct 28 13:07:12.519213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:12.521143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e41520d6-3d19-43c4-99a7-2ef5f7a40212 req-5fceef09-345f-46ff-8cb6-6f61637c02c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061593 Oct 28 13:07:12.522831 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 683/1364] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:12.535642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:12.546709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:12.549760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:12.550039 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-61861eb5-caf0-425a-80ef-e018c78cf90b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.330094 Oct 28 13:07:12.556571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:12.564228 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 682/1365] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:12 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:12.579817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.580656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.581284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.582339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.582872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:12.583258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.583880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.585291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:12.596744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.603778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.604572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.605566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.606198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.606874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.812661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:12.821283 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef6f62f5-fc35-4b1c-9fca-c761d061e7fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1507 microversion: 2.1 time: 0.247846 Oct 28 13:07:12.821878 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 683/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:12 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:12.831949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:12.832631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:12.840820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.841636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.842262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.843278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.843919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.844518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.893976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.894378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.894907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.895451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lazy-loading 'fault' on Instance uuid f0faf8dd-2c19-473f-a2e9-e78233a88309 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:12.900334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:12.943466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d39873294c4d6ca4a79b55642d1ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ece3c3598a3497fbbcf125f7d9ee7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:12.951656 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36546cba-3054-4459-a946-8537ba9979eb tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 200 len: 1312 microversion: 2.1 time: 0.128689 Oct 28 13:07:12.952659 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 684/1367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:12 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:12.958693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.132"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:12.961808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:12.968001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.968428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.968918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.969706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:12.970564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:12.970657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:12.987018 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6124ea4d-0f90-4317-9398-a5cc50207cde tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action" status: 202 len: 0 microversion: 2.1 time: 0.462577 Oct 28 13:07:12.992738 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 684/1368] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:12 2022] POST /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:13.004020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:07:13.004458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquired lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:07:13.008633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:13.025505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:13.033677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.034333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.035006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.035883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.036543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.037164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.138271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:07:13.138789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:07:13.139361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:07:13.139847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:07:13.140341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:07:13.365411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:13.381214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.383598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.384145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.386116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.388091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.389709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.422725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-64567379-5998-439a-9f44-3c98f57aa4df tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "POST /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a/action" status: 202 len: 1109 microversion: 2.1 time: 0.420475 Oct 28 13:07:13.423484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 685/1369] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:12 2022] POST /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a/action => generated 1109 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 13:07:13.428133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:13.428776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:13.434894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.435388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.435824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.436579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.437050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.437473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.469290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f.", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:07:13.469290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Releasing lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:07:13.469290 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f. Oct 28 13:07:13.469290 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-85f492a6-23b4-4a93-adff-716ae1f96e4f'] Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Request method failure captured: Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action HTTP/1.1 Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 46 Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Pihg5AAzFWmbACgBdB1lcsuTK-yDbqqqsUlU54ZlFHFVUtCX0mS2i8ib3PWW3Ng26CRRSJ7jrIZHq9DykA_4UTZR7o67RzTUm527i0Y6dZpLcyRnTy7bILaMTXW373kw7pv9M8GzOSG05-k-hMAnDHHmXKsNbIYh6P3oJDnSzNYi8 Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:13.470681 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e87eb708efd84b7cb25c366bb340b453", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ceafc4ec019349dba728a9b9d850da61 Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: {"addFloatingIp": {"address": "172.25.8.132"}} Oct 28 13:07:13.472199 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f. Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-85f492a6-23b4-4a93-adff-716ae1f96e4f'] Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '56888387-b0fe-4b83-88b9-d4a2d57a95c4', 'body': {'addFloatingIp': {'address': '172.25.8.132'}}} Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:07:13.473029 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:07:13.474677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f. Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85f492a6-23b4-4a93-adff-716ae1f96e4f'] Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f. Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85f492a6-23b4-4a93-adff-716ae1f96e4f'] Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:13.477076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f. Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85f492a6-23b4-4a93-adff-716ae1f96e4f'] Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:13.479159 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f. Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85f492a6-23b4-4a93-adff-716ae1f96e4f'] Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Returning 400 to user: Cannot associate floating IP 172.25.8.132 (9270d663-a0fb-4dbd-9645-d28026e56edc) with port f7c834b9-7b6a-476d-b581-8e0d73b7f350 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 1be8f2a9-1883-44e8-a6c6-76b51d50fa9f. Oct 28 13:07:13.481403 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-85f492a6-23b4-4a93-adff-716ae1f96e4f'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:13.483128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6aa52d7a-e0b8-446e-9a30-740b7f3c2986 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action" status: 400 len: 381 microversion: 2.1 time: 0.518578 Oct 28 13:07:13.483128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 685/1370] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:12 2022] POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action => generated 381 bytes in 520 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:07:13.483128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:13.483128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:13.489181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.489683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.490126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.490935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.491403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.491839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.527441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.527738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.528285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.528616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid 4d2e9d9c-7859-4f35-a682-330113388325 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:13.588612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:13.596971 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca0112a3-6d0c-496b-8fbc-df39335a82b5 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1307 microversion: 2.1 time: 0.123014 Oct 28 13:07:13.597943 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 686/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:13 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:13.603637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:13.604491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:13.615974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.616760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.617373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.618356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:13.619026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:13.619638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:13.885958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:13.899442 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6aca51c-148f-4dd7-8787-0a9a3731f5f2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.299552 Oct 28 13:07:13.900502 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 687/1372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:13 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:13.907206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd3d9d43-a77f-42b5-b5f6-9d29205ff66d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '.version_select at 0x7f27b9dc8550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:14.014925 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1c88504-fa1c-45ff-a607-145ff28dc5dc tempest-ServersAdminTestJSON-318005686 tempest-ServersAdminTestJSON-318005686-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1613 microversion: 2.1 time: 0.590016 Oct 28 13:07:14.015749 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 686/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:13 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1613 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:14.020617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:14.021581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:14.040802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.040802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.041399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.042406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.043146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.043788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.220736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:14.230884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:14.233600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:14.233745 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-024c8416-dd4f-48cc-9dee-7597a48bc88f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.216971 Oct 28 13:07:14.238780 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 687/1374] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:14 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:14.239949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:14.240127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] [instance: f0faf8dd-2c19-473f-a2e9-e78233a88309] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:14.246415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.246928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.247568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.248266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.248721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.249141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.265031 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] HTTP exception thrown: Instance f0faf8dd-2c19-473f-a2e9-e78233a88309 could not be found. Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Request method failure captured: Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 HTTP/1.1 Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Pg8U3xmhTt7mGMWfXIWIRpxbZZIDRwNuRtaC5ZnC_dtDzGNmeUrqxdpedmbIoXg1xDDuepyPOxe72ERcEUNXuqOJoL6xSkGPDz7cqOI6NPuHidRKNNhqxh8QyVgXU6oCz8K8GEOw6q_Gh1zrIwpZdtq7vCcyHixn1Cn5DTthOzmCw Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5ece3c3598a3497fbbcf125f7d9ee7c4 Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-348602097 Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:14.266854 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ece3c3598a3497fbbcf125f7d9ee7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ece3c3598a3497fbbcf125f7d9ee7c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ece3c3598a3497fbbcf125f7d9ee7c4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ece3c3598a3497fbbcf125f7d9ee7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-348602097 Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5ece3c3598a3497fbbcf125f7d9ee7c4 Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-348602097 Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerDiagnosticsNegativeTest-348602097-project Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: b3d39873294c4d6ca4a79b55642d1ea6 Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-348602097-project Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance f0faf8dd-2c19-473f-a2e9-e78233a88309 could not be found. Oct 28 13:07:14.269737 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f0faf8dd-2c19-473f-a2e9-e78233a88309'} Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0faf8dd-2c19-473f-a2e9-e78233a88309 could not be found. Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:14.270679 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0faf8dd-2c19-473f-a2e9-e78233a88309 could not be found. Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0faf8dd-2c19-473f-a2e9-e78233a88309 could not be found. Oct 28 13:07:14.272829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:14.274181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] Returning 404 to user: Instance f0faf8dd-2c19-473f-a2e9-e78233a88309 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:14.274181 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1dc78ebe-998c-4b22-8296-8d499e4c041e tempest-ServerDiagnosticsNegativeTest-348602097 tempest-ServerDiagnosticsNegativeTest-348602097-project] 10.222.0.25 "GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309" status: 404 len: 111 microversion: 2.1 time: 0.032374 Oct 28 13:07:14.274181 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 688/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:14 2022] GET /compute/v2.1/servers/f0faf8dd-2c19-473f-a2e9-e78233a88309 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:14.278688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:14.279278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:14.286685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.287503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.288003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.288721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.289182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.289618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.318561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:14.715901 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-42468a0d-dafc-4363-809d-3f609f67de6a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 204 len: 0 microversion: 2.1 time: 0.439939 Oct 28 13:07:14.719557 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 689/1376] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:14 2022] DELETE /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:14.722942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:14.723605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:14.731935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.732807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.733412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.734628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.735301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.735885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.757392 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 13:07:14.757549 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:07:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 (ip 10.222.0.25) !!! Oct 28 13:07:14.777378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.778478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.778478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.778739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid 4d2e9d9c-7859-4f35-a682-330113388325 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:14.823989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:14.833600 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0533d006-5fb1-4d67-a69c-c028c3400c5c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 200 len: 1307 microversion: 2.1 time: 0.115444 Oct 28 13:07:14.834184 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 690/1377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:14 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:14.839372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:14.840234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:14.846834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.850733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.850733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:14.850733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:14.850733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:14.851170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.030204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:15.039926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-002d9c93-30d2-40b8-aeb3-601dc8a6c35a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1469 microversion: 2.1 time: 0.204148 Oct 28 13:07:15.055392 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 691/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:14 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:15.061494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a5059f19-9b9c-4d79-81a7-1b5d9b315429 req-614d4798-fd9c-4d16-9b25-e46fab5b720b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2e9d9c-7859-4f35-a682-330113388325", "name": "network-vif-deleted", "tag": "2e664a52-fb0e-479a-80ef-bfb438be1f88"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:15.073178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5059f19-9b9c-4d79-81a7-1b5d9b315429 req-614d4798-fd9c-4d16-9b25-e46fab5b720b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.074047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5059f19-9b9c-4d79-81a7-1b5d9b315429 req-614d4798-fd9c-4d16-9b25-e46fab5b720b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.074542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5059f19-9b9c-4d79-81a7-1b5d9b315429 req-614d4798-fd9c-4d16-9b25-e46fab5b720b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.086363 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a5059f19-9b9c-4d79-81a7-1b5d9b315429 req-614d4798-fd9c-4d16-9b25-e46fab5b720b service nova] Creating event network-vif-deleted:2e664a52-fb0e-479a-80ef-bfb438be1f88 for instance 4d2e9d9c-7859-4f35-a682-330113388325 on n-h2-862876-2 Oct 28 13:07:15.092471 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a5059f19-9b9c-4d79-81a7-1b5d9b315429 req-614d4798-fd9c-4d16-9b25-e46fab5b720b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Oct 28 13:07:15.103055 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 692/1379] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:15.106079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:15.106870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:15.113494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.114415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.115110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.116599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.117260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.117883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.152160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:15.314447 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd3d9d43-a77f-42b5-b5f6-9d29205ff66d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/9270d663-a0fb-4dbd-9645-d28026e56edc" status: 202 len: 0 microversion: 2.1 time: 1.409555 Oct 28 13:07:15.315016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:15.315267 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 688/1380] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:07:13 2022] DELETE /compute/v2.1/os-floating-ips/9270d663-a0fb-4dbd-9645-d28026e56edc => generated 0 bytes in 1411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:15.318264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:15.319022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:15.326827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.327328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.327769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.328716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.329559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.330224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.464654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:15.472900 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c68dd0e-e5e0-4104-8a09-287d7e1d16ce tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.159265 Oct 28 13:07:15.473481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 689/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:15 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:15.484329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:15.484329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:15.489383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.489383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.489383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.489383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.489781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.489781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.556197 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b8c7696-b4e5-4672-92a7-043e5fc22db0 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 204 len: 0 microversion: 2.1 time: 0.459357 Oct 28 13:07:15.557006 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 693/1382] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:15 2022] DELETE /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:15.564508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.124"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:15.645206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:15.657081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:15.658622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:15.659881 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be9d6a19-3b05-44d4-9876-331bdc96b88d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.185410 Oct 28 13:07:15.660880 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 690/1383] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:15 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:15.667300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:15.667928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:15.674545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.675080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.675565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.676279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.676877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.677309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.716814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:15.723695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.724169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.724612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.725884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.726345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.726861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.840074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:15.849840 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e305afec-0af1-4d2a-b9fa-3122bcc9435e tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1514 microversion: 2.1 time: 0.187515 Oct 28 13:07:15.850865 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 691/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:15 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:15.860956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:15.861626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 4d2e9d9c-7859-4f35-a682-330113388325] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:15.869808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.870656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.872100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.872931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.873444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.878953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.891229 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance 4d2e9d9c-7859-4f35-a682-330113388325 could not be found. Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 HTTP/1.1 Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:15.892953 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 4d2e9d9c-7859-4f35-a682-330113388325 could not be found. Oct 28 13:07:15.894350 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4d2e9d9c-7859-4f35-a682-330113388325'} Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2e9d9c-7859-4f35-a682-330113388325 could not be found. Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:15.895273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2e9d9c-7859-4f35-a682-330113388325 could not be found. Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2e9d9c-7859-4f35-a682-330113388325 could not be found. Oct 28 13:07:15.896533 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:15.897783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance 4d2e9d9c-7859-4f35-a682-330113388325 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:15.897783 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4f3c6627-7824-4b0a-bcbb-094dc9848052 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325" status: 404 len: 111 microversion: 2.1 time: 0.038810 Oct 28 13:07:15.900068 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 692/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:15 2022] GET /compute/v2.1/servers/4d2e9d9c-7859-4f35-a682-330113388325 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:15.906766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:15.908776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:15.918180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.918700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.919130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.920581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:15.921067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:15.921687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:15.959161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:15.975733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:07:15.978069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquired lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:07:16.270789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31800649-9281-44a9-8889-0ad8afa2c94c tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 204 len: 0 microversion: 2.1 time: 0.369245 Oct 28 13:07:16.271653 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 693/1386] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:15 2022] DELETE /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:16.277798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:16.282996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:16.289683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:16.290646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:16.290646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:16.291433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:16.291909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:16.297014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:16.491061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:16.499341 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-79095081-530f-4757-90a9-1bcec0a2128e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1469 microversion: 2.1 time: 0.226027 Oct 28 13:07:16.499956 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 694/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:16 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:16.505857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:16.506912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:16.513258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:16.513761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:16.514208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:16.515064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:16.515643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:16.516344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:16.543134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:16.947321 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c39b078c-a23c-442f-8fa8-8224619c0a80 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 204 len: 0 microversion: 2.1 time: 0.445039 Oct 28 13:07:16.951469 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 695/1388] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:16 2022] DELETE /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:16.958559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:16.959808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:16.970372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:16.970918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:16.971362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:16.972132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:16.972600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:16.973029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.004540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Building network info cache for instance {{(pid=127793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:07:17.233349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:17.249722 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a002a57a-6891-41cb-9190-394e6c359e7a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.295683 Oct 28 13:07:17.251278 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 696/1389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:16 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:17.256088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:17.257270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:17.263344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.263830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.264416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.265266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.265436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.265856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.417996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:17.436726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:17.438188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:17.439495 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-653edf5d-6631-4801-bdbb-a36f075672b1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.187364 Oct 28 13:07:17.441467 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 697/1390] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:17 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:17.459019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:17.467886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:17.477155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.478450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.479494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.481107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.483254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.483824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.675383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:17.682169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b6107ca4-6c17-4337-b901-26bebfc870e5 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1514 microversion: 2.1 time: 0.232906 Oct 28 13:07:17.699953 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 698/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:17 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:17.705988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:17.706921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:17.713958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.714731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.715383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.716102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.716566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.716995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.733362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Updating instance_info_cache with network_info: [{"id": "f7c834b9-7b6a-476d-b581-8e0d73b7f350", "address": "fa:16:3e:1c:ff:81", "network": {"id": "44e15281-3ffd-4847-8d17-931aae7767ee", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2054692787-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e87eb708efd84b7cb25c366bb340b453", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf7c834b9-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:07:17.800958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Releasing lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:07:17.801851 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0b3ed7ff-bb4e-4c4c-951c-d276452319dd tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action" status: 202 len: 0 microversion: 2.1 time: 2.242986 Oct 28 13:07:17.802475 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 694/1392] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:15 2022] POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action => generated 0 bytes in 2245 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:07:17.808706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-baae5cda-480a-41ac-9163-d2b1ce0f3424 req-a2c191dd-286f-44f2-894b-306dcd03fbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56888387-b0fe-4b83-88b9-d4a2d57a95c4", "tag": "f7c834b9-7b6a-476d-b581-8e0d73b7f350"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:17.817287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-baae5cda-480a-41ac-9163-d2b1ce0f3424 req-a2c191dd-286f-44f2-894b-306dcd03fbd7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.817789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-baae5cda-480a-41ac-9163-d2b1ce0f3424 req-a2c191dd-286f-44f2-894b-306dcd03fbd7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.818262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-baae5cda-480a-41ac-9163-d2b1ce0f3424 req-a2c191dd-286f-44f2-894b-306dcd03fbd7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.830533 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-baae5cda-480a-41ac-9163-d2b1ce0f3424 req-a2c191dd-286f-44f2-894b-306dcd03fbd7 service nova] Creating event network-changed:f7c834b9-7b6a-476d-b581-8e0d73b7f350 for instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 on n-h1-862876-2 Oct 28 13:07:17.835896 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-baae5cda-480a-41ac-9163-d2b1ce0f3424 req-a2c191dd-286f-44f2-894b-306dcd03fbd7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031711 Oct 28 13:07:17.836503 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 695/1393] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:17.842275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:17.843184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:17.850568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.851146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.851765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.853167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:17.853781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:17.854523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:17.944943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:17.952810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:17.953890 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-909e4926-481d-4e4f-8cdf-ba8012f39b57 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1427 microversion: 2.1 time: 0.116023 Oct 28 13:07:17.955013 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 696/1394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:17 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:17.961465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c72448c-b674-4b48-ab8e-ea624f98594d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '.version_select at 0x7f27b96f5f70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:17.963787 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aa9a76d5-7d10-4eac-ba12-915661d9dc38 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 200 len: 1474 microversion: 2.1 time: 0.262375 Oct 28 13:07:17.964481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 699/1395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:17 2022] GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 1474 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:18.274638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:18.275291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:18.283894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:18.284389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:18.284826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:18.285612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:18.286071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:18.286500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:18.475455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:18.723151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:18.735291 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8130af71-f87e-48dc-8a23-95cecb4dffae tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.465493 Oct 28 13:07:18.737027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 700/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:18 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:18.743390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:18.744211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:18.764908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:18.765432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:18.765872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:18.766592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:18.767253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:18.768165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.273666 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c72448c-b674-4b48-ab8e-ea624f98594d tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/16b0afec-34c0-45a2-b311-41c0f5014229" status: 202 len: 0 microversion: 2.1 time: 1.317319 Oct 28 13:07:19.274850 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 697/1397] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:07:17 2022] DELETE /compute/v2.1/os-floating-ips/16b0afec-34c0-45a2-b311-41c0f5014229 => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:19.279181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:19.279793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:19.289653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.290194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.290860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.291568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.292860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.292860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.308350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:19.321809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:19.329890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:19.334093 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-025de63b-f7c6-4dd5-a433-3edd1b0c6656 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.595917 Oct 28 13:07:19.344895 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 701/1398] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:18 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:19.362592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:19.365374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:19.382550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.383194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.383755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.384734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.385429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.385935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.413849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:19.421020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.421822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.422316 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b4e7ab8-8ddf-4fbd-a6cc-54ab75ffcfb1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1472 microversion: 2.1 time: 0.146331 Oct 28 13:07:19.422656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.423364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lazy-loading 'fault' on Instance uuid 7b2fb646-8cf8-49a2-aada-1e938586b442 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:19.423853 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 698/1399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:19 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1472 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:19.428677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:19.429495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:19.441842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.441842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.441842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.441842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.442251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.442251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.508787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:19.520562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:19.529543 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c71762f7-3e3f-453b-be73-7a99193c1673 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1304 microversion: 2.1 time: 0.172062 Oct 28 13:07:19.531195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-116c0ad1-e6bf-4c64-8c71-6a2858419d87 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 200 len: 1432 microversion: 2.1 time: 0.104434 Oct 28 13:07:19.543310 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 699/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:19 2022] GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 1432 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:19.550634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d97e9102-b893-44ac-8694-74144dbe210c req-b5b5b2b8-5e7b-4ca6-a8c9-2819aeba7d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f966e217-39e0-425f-8478-cc310191bfb5", "name": "network-vif-deleted", "tag": "b61fc208-0741-4a6f-ac24-2d7fbbbb8823"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:19.555113 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 702/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:19 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:19.561701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2296b173-b984-4032-b2e9-a0d8a60039b9 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2296b173-b984-4032-b2e9-a0d8a60039b9 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Request method failure captured: Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action HTTP/1.1 Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 34 Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Pihg5AAzFWmbACgBdB1lcsuTK-yDbqqqsUlU54ZlFHFVUtCX0mS2i8ib3PWW3Ng26CRRSJ7jrIZHq9DykA_4UTZR7o67RzTUm527i0Y6dZpLcyRnTy7bILaMTXW373kw7pv9M8GzOSG05-k-hMAnDHHmXKsNbIYh6P3oJDnSzNYi8 Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:19.572759 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e87eb708efd84b7cb25c366bb340b453", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ceafc4ec019349dba728a9b9d850da61 Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: {"addFloatingIp": {"address": ""}} Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:07:19.574450 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '56888387-b0fe-4b83-88b9-d4a2d57a95c4', 'body': {'addFloatingIp': {'address': ''}}} Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '' Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:19.576642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:07:19.578658 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:07:19.583664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 13:07:19.583664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.583664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2296b173-b984-4032-b2e9-a0d8a60039b9 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:19.583664 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2296b173-b984-4032-b2e9-a0d8a60039b9 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action" status: 400 len: 142 microversion: 2.1 time: 0.017939 Oct 28 13:07:19.584666 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 703/1402] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:19 2022] POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:07:19.603509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d97e9102-b893-44ac-8694-74144dbe210c req-b5b5b2b8-5e7b-4ca6-a8c9-2819aeba7d92 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.604023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d97e9102-b893-44ac-8694-74144dbe210c req-b5b5b2b8-5e7b-4ca6-a8c9-2819aeba7d92 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.604420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d97e9102-b893-44ac-8694-74144dbe210c req-b5b5b2b8-5e7b-4ca6-a8c9-2819aeba7d92 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.605218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:19.615053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:19.618083 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d97e9102-b893-44ac-8694-74144dbe210c req-b5b5b2b8-5e7b-4ca6-a8c9-2819aeba7d92 service nova] Creating event network-vif-deleted:b61fc208-0741-4a6f-ac24-2d7fbbbb8823 for instance f966e217-39e0-425f-8478-cc310191bfb5 on n-h2-862876-2 Oct 28 13:07:19.623121 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d97e9102-b893-44ac-8694-74144dbe210c req-b5b5b2b8-5e7b-4ca6-a8c9-2819aeba7d92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078266 Oct 28 13:07:19.624076 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 700/1403] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:19.632830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.633509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.634083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.635002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.635540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.636037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.667788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:07:19.668264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquired lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:07:19.764398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:19.765504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:19.777457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.778456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.779758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.782281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.783047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.783805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.937841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Releasing lock "refresh_cache-56888387-b0fe-4b83-88b9-d4a2d57a95c4" {{(pid=127794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:07:19.938475 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] HTTP exception thrown: floating IP not found Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Request method failure captured: Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action HTTP/1.1 Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 41 Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Pihg5AAzFWmbACgBdB1lcsuTK-yDbqqqsUlU54ZlFHFVUtCX0mS2i8ib3PWW3Ng26CRRSJ7jrIZHq9DykA_4UTZR7o67RzTUm527i0Y6dZpLcyRnTy7bILaMTXW373kw7pv9M8GzOSG05-k-hMAnDHHmXKsNbIYh6P3oJDnSzNYi8 Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:19.940241 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e87eb708efd84b7cb25c366bb340b453", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ceafc4ec019349dba728a9b9d850da61 Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:07:19.948658 n-d-862876-2 devstack@n-api.service[127794]: exception: floating IP not found Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '56888387-b0fe-4b83-88b9-d4a2d57a95c4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:19.949646 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 28 13:07:19.950960 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:19.952477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Returning 404 to user: floating IP not found {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:19.952477 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c32630f5-24a4-4bbd-b488-4a2455d51209 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action" status: 404 len: 67 microversion: 2.1 time: 0.356430 Oct 28 13:07:19.952477 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 704/1404] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:19 2022] POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action => generated 67 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:19.952477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b1755162-add4-40a4-9f7d-95b878c8d3a4 req-a4b3f88f-8472-4f75-9b94-59e4c18f849c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2fb646-8cf8-49a2-aada-1e938586b442", "name": "network-vif-deleted", "tag": "63a50445-fbbf-44d4-ae03-0a0354416325"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:19.967234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b1755162-add4-40a4-9f7d-95b878c8d3a4 req-a4b3f88f-8472-4f75-9b94-59e4c18f849c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:19.971514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b1755162-add4-40a4-9f7d-95b878c8d3a4 req-a4b3f88f-8472-4f75-9b94-59e4c18f849c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:19.972700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b1755162-add4-40a4-9f7d-95b878c8d3a4 req-a4b3f88f-8472-4f75-9b94-59e4c18f849c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:19.986506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:19.988070 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b1755162-add4-40a4-9f7d-95b878c8d3a4 req-a4b3f88f-8472-4f75-9b94-59e4c18f849c service nova] Creating event network-vif-deleted:63a50445-fbbf-44d4-ae03-0a0354416325 for instance 7b2fb646-8cf8-49a2-aada-1e938586b442 on n-h1-862876-2 Oct 28 13:07:19.993543 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b1755162-add4-40a4-9f7d-95b878c8d3a4 req-a4b3f88f-8472-4f75-9b94-59e4c18f849c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049954 Oct 28 13:07:19.994175 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 705/1405] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:19.996599 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c799c03a-1d54-413e-868c-f7a9a04f906e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.238813 Oct 28 13:07:19.999209 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 701/1406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:19 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:19.999360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c95a029-7887-4aac-91c4-ac77fee8d726 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:20.054728 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6c95a029-7887-4aac-91c4-ac77fee8d726 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c95a029-7887-4aac-91c4-ac77fee8d726 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Request method failure captured: Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action HTTP/1.1 Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 44 Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Pihg5AAzFWmbACgBdB1lcsuTK-yDbqqqsUlU54ZlFHFVUtCX0mS2i8ib3PWW3Ng26CRRSJ7jrIZHq9DykA_4UTZR7o67RzTUm527i0Y6dZpLcyRnTy7bILaMTXW373kw7pv9M8GzOSG05-k-hMAnDHHmXKsNbIYh6P3oJDnSzNYi8 Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:20.057427 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e87eb708efd84b7cb25c366bb340b453", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ceafc4ec019349dba728a9b9d850da61 Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:07:20.058827 n-d-862876-2 devstack@n-api.service[127794]: exception: Floating IP not found for address 0.0.0.0. Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '56888387-b0fe-4b83-88b9-d4a2d57a95c4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:20.059807 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 28 13:07:20.061273 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:20.062678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c95a029-7887-4aac-91c4-ac77fee8d726 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:20.062678 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6c95a029-7887-4aac-91c4-ac77fee8d726 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action" status: 404 len: 88 microversion: 2.1 time: 0.063692 Oct 28 13:07:20.062678 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 706/1407] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:07:19 2022] POST /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4/action => generated 88 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:20.070455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:20.071205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:20.075355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:20.080045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.081144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.081761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.083578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.085126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.085930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.117811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:20.370111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:20.370910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:20.378154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.378923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.379367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.380079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.380526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.380954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.596752 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-682f4b0d-4635-4820-8b83-4c5c53d53a72 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 204 len: 0 microversion: 2.1 time: 0.530322 Oct 28 13:07:20.597403 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 702/1408] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:20 2022] DELETE /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:20.600761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:20.608373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:20.609487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:20.610885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:20.611118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:20.612329 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1591cc81-c6c3-4b72-b1d4-2cfbaebee393 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.246840 Oct 28 13:07:20.612900 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 707/1409] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:20 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:07:20.622070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.623026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.623712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.625288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.625981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.626887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.642934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:20.643563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:20.660583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.664053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.664730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.665674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.666355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.671440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.711598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.712790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.713892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.714715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lazy-loading 'fault' on Instance uuid f966e217-39e0-425f-8478-cc310191bfb5 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:20.736390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.739111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.739574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.741113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lazy-loading 'fault' on Instance uuid 7b2fb646-8cf8-49a2-aada-1e938586b442 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:20.806128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:20.826951 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d34a871b-a9e1-4a93-ae04-a31390d954d1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1304 microversion: 2.1 time: 0.179586 Oct 28 13:07:20.826951 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 708/1410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:20 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:20.833636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:20.833636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:20.843190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.843532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.843893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.844607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.845095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.845503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.878428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.879202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.879645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.880107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid a144e04f-8c59-43a5-a4d8-7a493e31f260 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:20.936958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:20.937847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:20.947261 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b219a5cc-a92c-4847-98ee-4e0fd194a824 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 200 len: 1307 microversion: 2.1 time: 0.344300 Oct 28 13:07:20.947871 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 703/1411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:20 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:20.952478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-29e5da5b-aa5c-44f6-8abc-4c0827e52134 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 200 len: 1308 microversion: 2.1 time: 0.129410 Oct 28 13:07:20.953757 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 709/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:20 2022] GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:20.960334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:20.961434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:20.974259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.974765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.975729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:20.976487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:20.977105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:20.977534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.023893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:21.024517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:21.031954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.032442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.032875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.033648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.034125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.034553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.130151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:21.139762 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-219fa939-4e54-489a-912b-dd384151ed97 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1541 microversion: 2.1 time: 0.190820 Oct 28 13:07:21.151179 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 704/1413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:20 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1541 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:21.187984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:21.197697 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-795d6f17-bb45-43af-b7dd-e724e7130c9d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.176718 Oct 28 13:07:21.199787 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 710/1414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:21 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:21.642190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:21.642871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:21.650124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.650651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.651289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.652015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.652478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.652905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.680450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7cdcbeb3-2183-4170-b15b-fbb42014b637 req-eef4ea13-84b6-4e5a-b5d1-108237cf9c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a144e04f-8c59-43a5-a4d8-7a493e31f260", "name": "network-vif-deleted", "tag": "db4b6691-6a43-4df6-9cc6-b6ab6c752d6d"}, {"server_uuid": "9462cff6-308f-4b3a-a627-4508524824b4", "name": "network-vif-deleted", "tag": "1cde4ffc-c886-4795-841c-6193dd3fd963"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:21.691235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7cdcbeb3-2183-4170-b15b-fbb42014b637 req-eef4ea13-84b6-4e5a-b5d1-108237cf9c53 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.692215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7cdcbeb3-2183-4170-b15b-fbb42014b637 req-eef4ea13-84b6-4e5a-b5d1-108237cf9c53 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.692727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7cdcbeb3-2183-4170-b15b-fbb42014b637 req-eef4ea13-84b6-4e5a-b5d1-108237cf9c53 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.706072 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7cdcbeb3-2183-4170-b15b-fbb42014b637 req-eef4ea13-84b6-4e5a-b5d1-108237cf9c53 service nova] Creating event network-vif-deleted:db4b6691-6a43-4df6-9cc6-b6ab6c752d6d for instance a144e04f-8c59-43a5-a4d8-7a493e31f260 on n-h2-862876-2 Oct 28 13:07:21.706732 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7cdcbeb3-2183-4170-b15b-fbb42014b637 req-eef4ea13-84b6-4e5a-b5d1-108237cf9c53 service nova] Creating event network-vif-deleted:1cde4ffc-c886-4795-841c-6193dd3fd963 for instance 9462cff6-308f-4b3a-a627-4508524824b4 on n-h1-862876-2 Oct 28 13:07:21.730463 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7cdcbeb3-2183-4170-b15b-fbb42014b637 req-eef4ea13-84b6-4e5a-b5d1-108237cf9c53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053748 Oct 28 13:07:21.731764 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 711/1415] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:21.789780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:21.798767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:21.800207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:21.801583 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-006da715-6f65-4ffb-b26a-a63a8e57d60b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.163965 Oct 28 13:07:21.802138 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 705/1416] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:21 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:21.845260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:21.846228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:21.849305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:21.853652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.854138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.854573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.855305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.855759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.856186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.888206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.888689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.889121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.892215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lazy-loading 'fault' on Instance uuid 7b2fb646-8cf8-49a2-aada-1e938586b442 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:21.934683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:21.943397 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8da3f6f0-6a7e-4372-be5e-ce2235d03ae1 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 200 len: 1304 microversion: 2.1 time: 0.102470 Oct 28 13:07:21.944215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 712/1417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:21 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:21.969583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:21.970482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: f966e217-39e0-425f-8478-cc310191bfb5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:21.980644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.981139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.981832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.983028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.983740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.984392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.984792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:21.986536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: a144e04f-8c59-43a5-a4d8-7a493e31f260] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:21.996954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:21.997729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:21.998633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:21.999617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.000327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.000457 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] HTTP exception thrown: Instance f966e217-39e0-425f-8478-cc310191bfb5 could not be found. Oct 28 13:07:22.001035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Request method failure captured: Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 HTTP/1.1 Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NgLrvBo-JqDpRZVYz_ckLVq4Z4B5XCxbm2uUHdMx7XBurZF9K814lv5afYaF7oo71fQcYH3byytIWbSM5ECUjfmQmiZH8LKIChzu-HQZYabdT-UfMBXdFYAgJnRVyQ34z6LFm1xopiKgfAQZUjv8h1LjXRvES8tkskFt31jYD5S60 Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 95b7cf075cae49ae838a0f75ca04b41a Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesAdminNegativeTest-79351405 Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:22.002218 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95b7cf075cae49ae838a0f75ca04b41a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95b7cf075cae49ae838a0f75ca04b41a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95b7cf075cae49ae838a0f75ca04b41a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95b7cf075cae49ae838a0f75ca04b41a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesAdminNegativeTest-79351405 Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 95b7cf075cae49ae838a0f75ca04b41a Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-79351405 Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesAdminNegativeTest-79351405-project Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c9bf2f7d1cdc47ed83175f036a574ca0 Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesAdminNegativeTest-79351405-project Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance f966e217-39e0-425f-8478-cc310191bfb5 could not be found. Oct 28 13:07:22.003900 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f966e217-39e0-425f-8478-cc310191bfb5'} Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f966e217-39e0-425f-8478-cc310191bfb5 could not be found. Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:22.004724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f966e217-39e0-425f-8478-cc310191bfb5 could not be found. Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f966e217-39e0-425f-8478-cc310191bfb5 could not be found. Oct 28 13:07:22.006431 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.007841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Returning 404 to user: Instance f966e217-39e0-425f-8478-cc310191bfb5 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:22.007841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86c353e7-9969-411d-b010-5e7ee63439f1 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5" status: 404 len: 111 microversion: 2.1 time: 0.038108 Oct 28 13:07:22.019922 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance a144e04f-8c59-43a5-a4d8-7a493e31f260 could not be found. Oct 28 13:07:22.020154 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 706/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:21 2022] GET /compute/v2.1/servers/f966e217-39e0-425f-8478-cc310191bfb5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 HTTP/1.1 Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:22.021914 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance a144e04f-8c59-43a5-a4d8-7a493e31f260 could not be found. Oct 28 13:07:22.044342 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a144e04f-8c59-43a5-a4d8-7a493e31f260'} Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a144e04f-8c59-43a5-a4d8-7a493e31f260 could not be found. Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:22.045342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a144e04f-8c59-43a5-a4d8-7a493e31f260 could not be found. Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a144e04f-8c59-43a5-a4d8-7a493e31f260 could not be found. Oct 28 13:07:22.046659 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:22.047794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance a144e04f-8c59-43a5-a4d8-7a493e31f260 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:22.047794 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88876a92-6031-4ea1-bffc-3e62c14a0397 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260" status: 404 len: 111 microversion: 2.1 time: 0.047518 Oct 28 13:07:22.047794 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 713/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:21 2022] GET /compute/v2.1/servers/a144e04f-8c59-43a5-a4d8-7a493e31f260 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:22.054484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:22.056171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:22.065046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.065540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.065971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.066931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.067392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.067864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.138040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:22.147454 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ab48212-45a1-45de-b077-0f9b717c2928 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1303 microversion: 2.1 time: 0.096416 Oct 28 13:07:22.148278 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 707/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:22 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:22.166815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:22.167631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:22.174494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.175121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.175784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.176598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.177155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.177684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.300491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:22.301565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:22.313133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.318222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.319482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.321972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.325855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.325855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.389765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:22.402540 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c81aadbe-07d4-49d8-9371-f052d0f268c2 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1541 microversion: 2.1 time: 0.241953 Oct 28 13:07:22.404483 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 714/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:22 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1541 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:22.514369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:22.522568 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50e32df0-275f-4406-ab65-ae0873002e63 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.241074 Oct 28 13:07:22.549383 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 708/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:22 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:22.828658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:22.829277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:22.844662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.845526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.846260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.847467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.848321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.848958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.967283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:22.968506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 7b2fb646-8cf8-49a2-aada-1e938586b442] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:22.977487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.978103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.978725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.979654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:22.980280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:22.980872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:22.997774 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] HTTP exception thrown: Instance 7b2fb646-8cf8-49a2-aada-1e938586b442 could not be found. Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Request method failure captured: Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 HTTP/1.1 Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NyK7RGs0tvIYoHio571BsPsp50Wd_5_hrQ7vrc1WwMtT1kmc7eqVQnX6wDF0cVFTICCLFZlKex6bgpRMgV1kWpVE3Mj36ap0lDY57NTe1lU0PrmSOX8owsHIzuH_HoCOfbdBc_94bywwtiLZ5GPhtQkrGQmwOSIQ0mWFDmt_oS1R4 Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: ca58f2828860400da616cba8da1c1a8a Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:22.999393 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca58f2828860400da616cba8da1c1a8a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: ca58f2828860400da616cba8da1c1a8a Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersAdminTestJSON-1436333279-project Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e35d20fe60484d11982fd061614dbf54 Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersAdminTestJSON-1436333279-project Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7b2fb646-8cf8-49a2-aada-1e938586b442 could not be found. Oct 28 13:07:23.000803 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7b2fb646-8cf8-49a2-aada-1e938586b442'} Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2fb646-8cf8-49a2-aada-1e938586b442 could not be found. Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:23.002059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2fb646-8cf8-49a2-aada-1e938586b442 could not be found. Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2fb646-8cf8-49a2-aada-1e938586b442 could not be found. Oct 28 13:07:23.004050 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:23.005794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Returning 404 to user: Instance 7b2fb646-8cf8-49a2-aada-1e938586b442 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:23.005794 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a89b3283-9d87-43d6-bae3-85b3b6357970 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442" status: 404 len: 111 microversion: 2.1 time: 0.038462 Oct 28 13:07:23.005794 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 709/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:22 2022] GET /compute/v2.1/servers/7b2fb646-8cf8-49a2-aada-1e938586b442 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:23.027935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:23.028511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:23.036168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:23.038250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:23.038250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:23.038467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:23.039048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:23.039508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:23.122719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:23.217460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:23.227164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:23.238323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:23.259671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:23.264023 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb8b0083-a8a3-4a54-9ec7-623222ac88e0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.439634 Oct 28 13:07:23.267422 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 715/1424] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:22 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:23.276976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:23.279831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:23.326206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:23.326738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:23.327226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:23.334404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:23.334977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:23.336820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:23.390453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:23.397329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:23.398183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:23.399033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid 9462cff6-308f-4b3a-a627-4508524824b4 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:23.643969 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2216c52-d413-4922-9afa-dc9c12d6e72a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 204 len: 0 microversion: 2.1 time: 0.621966 Oct 28 13:07:23.647571 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 710/1425] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:23 2022] DELETE /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:23.658452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:23.660838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:23.672413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:23.679942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:23.680723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:23.681650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:23.683228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:23.685352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:23.962016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:23.974157 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe500646-e6e0-483d-a113-93db2f58ff94 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1541 microversion: 2.1 time: 0.324507 Oct 28 13:07:23.991498 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 711/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:23 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1541 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:24.002800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:24.003436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:24.020122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.024585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:24.024913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.025554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.026459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.027114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.028912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.041108 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-559a6b39-e3c4-4651-abe8-38af4d80f3f6 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1308 microversion: 2.1 time: 0.770750 Oct 28 13:07:24.044910 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 716/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:23 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1308 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:24.050837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:24.057464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:24.066645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.071342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.071925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.072782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.073694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.074239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.404314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:24.410071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:24.416585 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-90d0f5b2-7601-4217-b877-48b3538fc18a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.423107 Oct 28 13:07:24.429340 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6816a659-d3a6-431e-90c6-7a62a450bb1f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1468 microversion: 2.1 time: 0.383124 Oct 28 13:07:24.438834 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 717/1428] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:24 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1468 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:24.439067 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 712/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:23 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:24.439363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5bbf1c79-c827-44f2-b008-293fbb00fdfa req-3c0eefdb-9fdd-4941-80a5-68dcf8a35b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56888387-b0fe-4b83-88b9-d4a2d57a95c4", "name": "network-vif-deleted", "tag": "f7c834b9-7b6a-476d-b581-8e0d73b7f350"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:24.452482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5bbf1c79-c827-44f2-b008-293fbb00fdfa req-3c0eefdb-9fdd-4941-80a5-68dcf8a35b01 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.453175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5bbf1c79-c827-44f2-b008-293fbb00fdfa req-3c0eefdb-9fdd-4941-80a5-68dcf8a35b01 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.453829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5bbf1c79-c827-44f2-b008-293fbb00fdfa req-3c0eefdb-9fdd-4941-80a5-68dcf8a35b01 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.460786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:24.461733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:24.472323 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5bbf1c79-c827-44f2-b008-293fbb00fdfa req-3c0eefdb-9fdd-4941-80a5-68dcf8a35b01 service nova] Creating event network-vif-deleted:f7c834b9-7b6a-476d-b581-8e0d73b7f350 for instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 on n-h1-862876-2 Oct 28 13:07:24.477290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.478146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.478899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.482003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.483038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.483719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.488085 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5bbf1c79-c827-44f2-b008-293fbb00fdfa req-3c0eefdb-9fdd-4941-80a5-68dcf8a35b01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054557 Oct 28 13:07:24.490419 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 713/1430] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:24.566572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3e14b171-89e9-4ec3-895c-df3d19c0ee0c req-925c104d-fed2-4b1a-86ab-f9cbfec1f55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e873a2-b078-4190-9f83-0644b1075f4a", "name": "network-vif-unplugged", "status": "completed", "tag": "c40493ea-ef8b-4cf6-895b-5e07519f7ce3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:24.587156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3e14b171-89e9-4ec3-895c-df3d19c0ee0c req-925c104d-fed2-4b1a-86ab-f9cbfec1f55e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:24.587656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3e14b171-89e9-4ec3-895c-df3d19c0ee0c req-925c104d-fed2-4b1a-86ab-f9cbfec1f55e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:24.588096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3e14b171-89e9-4ec3-895c-df3d19c0ee0c req-925c104d-fed2-4b1a-86ab-f9cbfec1f55e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:24.602080 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3e14b171-89e9-4ec3-895c-df3d19c0ee0c req-925c104d-fed2-4b1a-86ab-f9cbfec1f55e service nova] Creating event network-vif-unplugged:c40493ea-ef8b-4cf6-895b-5e07519f7ce3 for instance 33e873a2-b078-4190-9f83-0644b1075f4a on n-h2-862876-2 Oct 28 13:07:24.611792 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3e14b171-89e9-4ec3-895c-df3d19c0ee0c req-925c104d-fed2-4b1a-86ab-f9cbfec1f55e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049513 Oct 28 13:07:24.612325 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 714/1431] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:24.914719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:24.918489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:24.925292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:24.926937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:24.928450 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfe5e8b1-d06a-4ff2-ad59-ae0a18270250 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.496070 Oct 28 13:07:24.929132 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 718/1432] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:24 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:24.998521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:25.000114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:25.007635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.008471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.009008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.009946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.010732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.011633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.068762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:25.069612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:25.077292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.078147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.083302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.084603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.085578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.086043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.104393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:25.121195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76b32750-647a-4a96-9ea5-6c22b86aaba6 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1499 microversion: 2.1 time: 0.126925 Oct 28 13:07:25.134851 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 715/1433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:24 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1499 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:25.148866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.149371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.149811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.150389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid 9462cff6-308f-4b3a-a627-4508524824b4 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:25.255438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:25.265202 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88135a1f-c9ca-4ffa-8253-487af5853f40 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 200 len: 1308 microversion: 2.1 time: 0.200236 Oct 28 13:07:25.265811 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 719/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:25 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:25.444972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:25.446188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:25.457183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:25.458297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:25.472077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.473025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.473793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.482876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.482876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.483437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.483437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.483637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.483637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.483637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.483890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.483890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.801618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:25.827389 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-008f0b6f-3921-403b-a7b1-4de68b4f061e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.387645 Oct 28 13:07:25.836373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:25.846924 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-966b07c0-81ed-4ea4-99c2-151a5ab2605a tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1468 microversion: 2.1 time: 0.392911 Oct 28 13:07:25.848441 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 720/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:25 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1468 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:25.848978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 716/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:25 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:25.958990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:25.960464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:25.967383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.974086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.977697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:25.978532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:25.979049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:25.979495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.152946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:26.155703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:26.186023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.189620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.190296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.192790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.194845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.196543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.278109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.278973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.279635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.280301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lazy-loading 'fault' on Instance uuid 56888387-b0fe-4b83-88b9-d4a2d57a95c4 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:26.315190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:26.328394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:26.329855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:26.337220 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-24b5006e-0ef1-41b2-9c6e-fac47e673845 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.377983 Oct 28 13:07:26.337220 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 717/1437] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:25 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:26.337400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:26.338089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9462cff6-308f-4b3a-a627-4508524824b4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:26.344576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.345192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.345859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.346481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.346976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.347464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.380838 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance 9462cff6-308f-4b3a-a627-4508524824b4 could not be found. Oct 28 13:07:26.383137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceafc4ec019349dba728a9b9d850da61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87eb708efd84b7cb25c366bb340b453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 HTTP/1.1 Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:26.383312 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 9462cff6-308f-4b3a-a627-4508524824b4 could not be found. Oct 28 13:07:26.384851 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '9462cff6-308f-4b3a-a627-4508524824b4'} Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9462cff6-308f-4b3a-a627-4508524824b4 could not be found. Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:26.385670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9462cff6-308f-4b3a-a627-4508524824b4 could not be found. Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9462cff6-308f-4b3a-a627-4508524824b4 could not be found. Oct 28 13:07:26.387123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:26.388638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance 9462cff6-308f-4b3a-a627-4508524824b4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:26.388638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8fab5a5-2615-4b7f-8f9f-400529f70fcf tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4" status: 404 len: 111 microversion: 2.1 time: 0.052752 Oct 28 13:07:26.393907 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 718/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:26 2022] GET /compute/v2.1/servers/9462cff6-308f-4b3a-a627-4508524824b4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:26.399987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f68ca62b-edfe-4a18-bef9-a423c596004b tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 200 len: 1321 microversion: 2.1 time: 0.258181 Oct 28 13:07:26.400143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-acb324b7-d251-4985-a5ac-b96b6257805f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:26.400325 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 721/1439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:26 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:26.514898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-73478ce0-7ef6-4973-b433-20d95dce1665 req-3e85d2cc-3a75-4436-9717-78ffdb36e352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db63d0f-2409-4753-a443-27f08d83707b", "name": "network-vif-deleted", "tag": "b86bf7b1-8d12-44d8-acd6-b9778ceb01db"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:26.548776 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-acb324b7-d251-4985-a5ac-b96b6257805f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/e7de2597-0c5f-49f6-8b4a-afad62b696dd" status: 204 len: 0 microversion: 2.1 time: 0.153255 Oct 28 13:07:26.550345 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 719/1440] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:07:26 2022] DELETE /compute/v2.1/os-server-groups/e7de2597-0c5f-49f6-8b4a-afad62b696dd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:26.558784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73478ce0-7ef6-4973-b433-20d95dce1665 req-3e85d2cc-3a75-4436-9717-78ffdb36e352 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.559279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73478ce0-7ef6-4973-b433-20d95dce1665 req-3e85d2cc-3a75-4436-9717-78ffdb36e352 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.559719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73478ce0-7ef6-4973-b433-20d95dce1665 req-3e85d2cc-3a75-4436-9717-78ffdb36e352 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.572590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:26.573395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:26.586893 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-73478ce0-7ef6-4973-b433-20d95dce1665 req-3e85d2cc-3a75-4436-9717-78ffdb36e352 service nova] Creating event network-vif-deleted:b86bf7b1-8d12-44d8-acd6-b9778ceb01db for instance 4db63d0f-2409-4753-a443-27f08d83707b on n-h1-862876-2 Oct 28 13:07:26.594455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.596319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.598296 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-73478ce0-7ef6-4973-b433-20d95dce1665 req-3e85d2cc-3a75-4436-9717-78ffdb36e352 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092518 Oct 28 13:07:26.601493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.601874 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 722/1441] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:26.602070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.602283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.602624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.660651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3ac8f3f3-f7ca-4e49-a36b-790e608507b0 req-9ffab7d8-6a10-40a5-a6d5-51113cef1292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e873a2-b078-4190-9f83-0644b1075f4a", "tag": "c40493ea-ef8b-4cf6-895b-5e07519f7ce3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:26.673327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:26.683834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3ac8f3f3-f7ca-4e49-a36b-790e608507b0 req-9ffab7d8-6a10-40a5-a6d5-51113cef1292 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.684330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3ac8f3f3-f7ca-4e49-a36b-790e608507b0 req-9ffab7d8-6a10-40a5-a6d5-51113cef1292 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.686735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3ac8f3f3-f7ca-4e49-a36b-790e608507b0 req-9ffab7d8-6a10-40a5-a6d5-51113cef1292 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.713129 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3ac8f3f3-f7ca-4e49-a36b-790e608507b0 req-9ffab7d8-6a10-40a5-a6d5-51113cef1292 service nova] Creating event network-changed:c40493ea-ef8b-4cf6-895b-5e07519f7ce3 for instance 33e873a2-b078-4190-9f83-0644b1075f4a on n-h2-862876-2 Oct 28 13:07:26.718309 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3ac8f3f3-f7ca-4e49-a36b-790e608507b0 req-9ffab7d8-6a10-40a5-a6d5-51113cef1292 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063395 Oct 28 13:07:26.719321 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 723/1442] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:26.726407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:26.727304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:26.734011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.734586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.735158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.735936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:26.736881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:26.737528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:26.807560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:27.036180 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc6cedd7-487c-4e88-8d5d-f95a61854520 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 204 len: 0 microversion: 2.1 time: 0.480774 Oct 28 13:07:27.037742 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 720/1443] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:26 2022] DELETE /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:27.053110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:27.054479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:27.065429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.066106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.075784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.078331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.079045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.079687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.297294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:27.310272 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78259f91-9e26-4486-bc2b-a3ce7f24a3ad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.271063 Oct 28 13:07:27.334020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6d847c64-cac8-43b7-a356-15b76a09e649 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 204 len: 0 microversion: 2.1 time: 0.612903 Oct 28 13:07:27.337711 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 724/1444] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:26 2022] DELETE /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:27.342949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 721/1445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:27 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:27.348933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:27.349494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:27.352385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:27.357151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:27.360589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.363264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.363264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.363264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.363264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.364225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.374947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.375766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.377071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.382958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.383635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.384535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.399423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:27.469817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.470367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.470846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.471304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lazy-loading 'fault' on Instance uuid 4db63d0f-2409-4753-a443-27f08d83707b {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:27.521022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:27.538378 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5748b110-91a0-4a13-bb42-61f019ec8a6b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 200 len: 1303 microversion: 2.1 time: 0.198323 Oct 28 13:07:27.551995 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 725/1446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:27 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 1303 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:27.562248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:27.562903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:27.586334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.586334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.586334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.587456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.588125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.588742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.813851 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c0c65d4-d143-445d-a9d7-685118ab56bc tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 204 len: 0 microversion: 2.1 time: 0.469548 Oct 28 13:07:27.818084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:27.822988 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 722/1447] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:27 2022] DELETE /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:27.839048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:27.841045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:27.843071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a1ea824-0901-4168-aa07-6af384598a3a tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1682 microversion: 2.1 time: 0.289102 Oct 28 13:07:27.846266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 726/1448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:27 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1682 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:27.857531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.859156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:27.859888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.860559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.861713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] [instance: 56888387-b0fe-4b83-88b9-d4a2d57a95c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:27.864484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.865271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.866289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.887405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.887935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.893706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.893706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.893706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.894012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.920077 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] HTTP exception thrown: Instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 could not be found. Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Request method failure captured: Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 HTTP/1.1 Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Pihg5AAzFWmbACgBdB1lcsuTK-yDbqqqsUlU54ZlFHFVUtCX0mS2i8ib3PWW3Ng26CRRSJ7jrIZHq9DykA_4UTZR7o67RzTUm527i0Y6dZpLcyRnTy7bILaMTXW373kw7pv9M8GzOSG05-k-hMAnDHHmXKsNbIYh6P3oJDnSzNYi8 Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:27.921785 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e87eb708efd84b7cb25c366bb340b453", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e87eb708efd84b7cb25c366bb340b453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e87eb708efd84b7cb25c366bb340b453 Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ceafc4ec019349dba728a9b9d850da61 Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:07:27.923421 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 could not be found. Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '56888387-b0fe-4b83-88b9-d4a2d57a95c4'} Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 could not be found. Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:27.924290 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 could not be found. Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 could not be found. Oct 28 13:07:27.925780 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:27.929962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] Returning 404 to user: Instance 56888387-b0fe-4b83-88b9-d4a2d57a95c4 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:27.929962 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0533a8d8-cf76-4767-ae51-6801ae3688df tempest-FloatingIPsAssociationNegativeTestJSON-1913847150 tempest-FloatingIPsAssociationNegativeTestJSON-1913847150-project] 10.222.0.25 "GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4" status: 404 len: 111 microversion: 2.1 time: 0.074921 Oct 28 13:07:27.929962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 727/1449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:27 2022] GET /compute/v2.1/servers/56888387-b0fe-4b83-88b9-d4a2d57a95c4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:27.932322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:27.932943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:27.940723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.941232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.941678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:27.942403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:27.942902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:27.943336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.074144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:28.086706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:28.089246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:28.091335 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a26653d9-b5fc-4c82-b327-0c0746dc1b98 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.266515 Oct 28 13:07:28.092478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 723/1450] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:27 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:28.333870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:28.342365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:28.343017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:28.355102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.355330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.355693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.356416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.356880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.359466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7bab4189-04c8-4f71-ab35-cfbfdb6cfaa2 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 200 len: 1475 microversion: 2.1 time: 0.430871 Oct 28 13:07:28.360073 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 728/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:27 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 1475 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:28.360560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.531713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:28.531713 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73f9adba-65dd-458a-af95-a7f14f5574b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.193599 Oct 28 13:07:28.532271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 724/1452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:28 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:28.565768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:28.566394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 4db63d0f-2409-4753-a443-27f08d83707b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:28.573496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.574006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.574446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.575387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.575883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.576317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.592357 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] HTTP exception thrown: Instance 4db63d0f-2409-4753-a443-27f08d83707b could not be found. Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Request method failure captured: Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b HTTP/1.1 Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9NyK7RGs0tvIYoHio571BsPsp50Wd_5_hrQ7vrc1WwMtT1kmc7eqVQnX6wDF0cVFTICCLFZlKex6bgpRMgV1kWpVE3Mj36ap0lDY57NTe1lU0PrmSOX8owsHIzuH_HoCOfbdBc_94bywwtiLZ5GPhtQkrGQmwOSIQ0mWFDmt_oS1R4 Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: ca58f2828860400da616cba8da1c1a8a Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:28.593999 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca58f2828860400da616cba8da1c1a8a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: ca58f2828860400da616cba8da1c1a8a Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminTestJSON-1436333279-project Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e35d20fe60484d11982fd061614dbf54 Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminTestJSON-1436333279-project Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 4db63d0f-2409-4753-a443-27f08d83707b could not be found. Oct 28 13:07:28.595511 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4db63d0f-2409-4753-a443-27f08d83707b'} Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db63d0f-2409-4753-a443-27f08d83707b could not be found. Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:28.596750 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db63d0f-2409-4753-a443-27f08d83707b could not be found. Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db63d0f-2409-4753-a443-27f08d83707b could not be found. Oct 28 13:07:28.598238 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:28.603802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Returning 404 to user: Instance 4db63d0f-2409-4753-a443-27f08d83707b could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:28.603802 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2913176e-a5cc-4030-87b5-757b229bc30e tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b" status: 404 len: 111 microversion: 2.1 time: 0.033754 Oct 28 13:07:28.603802 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 729/1453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:28 2022] GET /compute/v2.1/servers/4db63d0f-2409-4753-a443-27f08d83707b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:28.604412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:28.604907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:28.611331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.611836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.612270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.612970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.613423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.613844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.643494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:28.666662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:28.880481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:28.881045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:28.894093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.894874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.895317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:28.897836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:28.898307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:28.898737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.136897 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1fa5e921-c3c5-459b-9294-60a849ab7def tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 204 len: 0 microversion: 2.1 time: 0.535969 Oct 28 13:07:29.137425 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 725/1454] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:28 2022] DELETE /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:29.143335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:29.144031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:29.162659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.168584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.168584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.168584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.169064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.169726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.289926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:29.298665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1dea61ac-e35d-4177-9bb3-bde7901d4e65 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1682 microversion: 2.1 time: 0.429442 Oct 28 13:07:29.321079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 730/1455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:28 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:29.328579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:29.330123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:29.336941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.337708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.338299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.339582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.340523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.341119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.341873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:29.352195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:29.354560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:29.355974 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4248ac9-268b-4505-b381-24935f0d641b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.217286 Oct 28 13:07:29.356929 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 726/1456] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:29 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:29.393425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:29.394212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:29.401538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.402356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.403050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.403861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.404522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.405142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.589936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:29.606697 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2c5ae9f-d801-4176-8617-478f30ad7d82 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 200 len: 1475 microversion: 2.1 time: 0.217148 Oct 28 13:07:29.608082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 727/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:29 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 1475 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:29.615945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:29.616417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:29.616417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:29.622815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.623479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.624059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.624740 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba601056-79cc-449b-9d35-87092de7e425 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1468 microversion: 2.1 time: 0.301823 Oct 28 13:07:29.625487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:29.625790 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 731/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:29 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:29.632584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:29.633334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:29.749745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-73f391b8-9e33-4cb4-983a-56cb7afc0cd9 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Action: 'create', calling method: .version_select at 0x7f27b95de820>, body: {"pool": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:29.805536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:29.813195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-64c49b9f-c2ee-4e47-9328-78b470d2fdb3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.203940 Oct 28 13:07:29.813767 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 728/1459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:29 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:30.334144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:30.335266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:30.346602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.347423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.348322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:30.349253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.349872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.350484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:30.528736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:30.541338 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c1a3351-5da0-4430-a792-a8450b728f21 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1682 microversion: 2.1 time: 0.211579 Oct 28 13:07:30.556039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 729/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:30 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:30.556039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:30.556039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:30.556039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.557036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.557036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:30.557036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.557036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.557405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:30.705094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:30.724304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:30.724304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:30.724304 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc0b7488-4bc5-4efc-8e22-103df6eeb863 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.174506 Oct 28 13:07:30.724575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 730/1461] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:30 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:30.724575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:30.724575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:30.731933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.732558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.733004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:30.733840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.734305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.734733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:30.887636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:30.897627 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e27f83fd-1e5d-4a5e-a252-7096ace4e52f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 200 len: 1475 microversion: 2.1 time: 0.177765 Oct 28 13:07:30.898704 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 731/1462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:30 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:30.904318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:30.905179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:30.913108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.913803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.914467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:30.915741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:30.915887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:30.916481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:31.213142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:31.229587 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87fe6ed2-4199-4a87-a4ad-7d5903640128 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1468 microversion: 2.1 time: 0.329618 Oct 28 13:07:31.231618 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 732/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:30 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:31.239055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:31.239775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:31.258315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:DELETE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:31.267045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:31.267558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:31.268358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:31.269072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:31.269564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:31.276758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:32.036085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:32.044386 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a144532-e74f-46ca-9511-2a5a08ede82b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.811698 Oct 28 13:07:32.051516 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 733/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:31 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:32.058264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:32.062860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:32.084569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:32.085158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:32.085670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:32.088401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:32.092254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:32.099091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:32.787990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:32.803130 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6867deeb-1456-4c16-a4d7-9e5e3f995c68 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1682 microversion: 2.1 time: 0.754213 Oct 28 13:07:32.804438 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 734/1465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:32 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1682 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:32.815660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:32.816289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:32.839682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:32.840212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:32.840673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:32.841416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:32.841884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:32.842319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:33.554954 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-73f391b8-9e33-4cb4-983a-56cb7afc0cd9 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.880892 Oct 28 13:07:33.555572 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 732/1466] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:07:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:33.562387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:33.565930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:33.581294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:33.581791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:33.582233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:33.583703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:33.583703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:33.585531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:33.697417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:33.720053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5a34649-4654-437d-8eba-d7d0e20436f8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 200 len: 1433 microversion: 2.1 time: 0.160599 Oct 28 13:07:33.721554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 733/1467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:33 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 1433 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:33.728285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:33.729628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:33.737579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:33.738413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:33.739114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:33.740548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:33.741260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:33.741881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:33.843255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:33.853442 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ba751a2-4e4c-4e4e-873c-6b9108a27975 tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1426 microversion: 2.1 time: 0.130420 Oct 28 13:07:33.875002 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 734/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:33 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1426 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:33.880227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:33.881396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:33.888613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:33.889114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:33.889560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:33.890297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:33.892249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:33.892719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.129057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:34.142585 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc921945-0e63-4599-ae75-2a1f985d2083 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.273242 Oct 28 13:07:34.165043 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 735/1469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:33 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:34.170727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8e8c870-6659-496f-b534-f29a6beaea90 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Action: 'create', calling method: .version_select at 0x7f27b954e280>, body: {"pool": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:34.200117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:34.213489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:34.217174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:34.218674 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-447e5527-e29b-42b9-ac83-465a9d546666 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 1.411386 Oct 28 13:07:34.223571 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 735/1470] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:32 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:34.229244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a5723be7-6881-4c1c-ba7a-bfdd0039ce46 req-16394fd1-8600-459e-bfeb-9c480269999f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9256c7bc-6b0f-4ee2-8b7f-49e469b5127a", "name": "network-vif-deleted", "tag": "bef23a34-6bb3-4569-b8b4-40868b46c510"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:34.284135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5723be7-6881-4c1c-ba7a-bfdd0039ce46 req-16394fd1-8600-459e-bfeb-9c480269999f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:34.284792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5723be7-6881-4c1c-ba7a-bfdd0039ce46 req-16394fd1-8600-459e-bfeb-9c480269999f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:34.285482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5723be7-6881-4c1c-ba7a-bfdd0039ce46 req-16394fd1-8600-459e-bfeb-9c480269999f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.321538 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a5723be7-6881-4c1c-ba7a-bfdd0039ce46 req-16394fd1-8600-459e-bfeb-9c480269999f service nova] Creating event network-vif-deleted:bef23a34-6bb3-4569-b8b4-40868b46c510 for instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a on n-h2-862876-2 Oct 28 13:07:34.331408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a5723be7-6881-4c1c-ba7a-bfdd0039ce46 req-16394fd1-8600-459e-bfeb-9c480269999f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105306 Oct 28 13:07:34.332326 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 736/1471] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:34.341285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:34.342184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:34.359144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:34.360183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:34.361545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.362438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:34.363077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:34.363829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.723983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:34.753025 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-805daa4f-a0d2-4877-95f4-c35a45670003 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1682 microversion: 2.1 time: 0.418725 Oct 28 13:07:34.754252 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 737/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:34 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1682 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:34.762560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-71bd4228-37f2-4ce2-818f-9bf7e8aa20be req-baac82f0-190c-4ebb-a769-d921e2c4b380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58988fbd-d2e9-4ad1-94cc-f8e87e6def38", "name": "network-vif-deleted", "tag": "60b34799-ae4b-4324-a0ea-12c82b338812"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:34.778595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-71bd4228-37f2-4ce2-818f-9bf7e8aa20be req-baac82f0-190c-4ebb-a769-d921e2c4b380 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:34.778956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-71bd4228-37f2-4ce2-818f-9bf7e8aa20be req-baac82f0-190c-4ebb-a769-d921e2c4b380 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:34.779681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-71bd4228-37f2-4ce2-818f-9bf7e8aa20be req-baac82f0-190c-4ebb-a769-d921e2c4b380 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.799845 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-71bd4228-37f2-4ce2-818f-9bf7e8aa20be req-baac82f0-190c-4ebb-a769-d921e2c4b380 service nova] Creating event network-vif-deleted:60b34799-ae4b-4324-a0ea-12c82b338812 for instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 on n-h1-862876-2 Oct 28 13:07:34.808330 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-71bd4228-37f2-4ce2-818f-9bf7e8aa20be req-baac82f0-190c-4ebb-a769-d921e2c4b380 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051011 Oct 28 13:07:34.811850 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 738/1473] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:34.819109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:34.820099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:34.828665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:34.833835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:34.833835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.833835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:34.833835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:34.835092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.941070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:34.941864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:34.944454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:34.945117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:35.294346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:35.302136 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87c3f5c3-daeb-4088-a100-a0f3f9361306 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 200 len: 1309 microversion: 2.1 time: 0.488581 Oct 28 13:07:35.314274 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 739/1474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:34 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 1309 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:35.314274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:35.314274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:35.324495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:35.324495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:35.324495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:35.324495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:35.325125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:35.325125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:35.409360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:35.410560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:35.411107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:35.413320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lazy-loading 'fault' on Instance uuid 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:35.636839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35d20fe60484d11982fd061614dbf54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca58f2828860400da616cba8da1c1a8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:35.650713 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5f9be11-1cdf-4b29-89be-87aaeafcfc2b tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 200 len: 1303 microversion: 2.1 time: 0.338894 Oct 28 13:07:35.657538 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 740/1475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:35 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 1303 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:35.666247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:35.667096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:35.690434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:35.691448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:35.692083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:35.696650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:35.697351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:35.697949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.049417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:36.051727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:36.073428 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3a6498ef-eeaf-4167-aa4e-f25bbc27bc80 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.408027 Oct 28 13:07:36.090951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 741/1476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:35 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:36.110942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:36.112312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:36.123105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.124416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.127405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.127405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.127405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.127405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.417594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:36.433821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:36.438502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:36.438502 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-df0c31c2-d993-416b-8cd9-4c730c7ae36a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.344943 Oct 28 13:07:36.438968 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 742/1477] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:36 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:36.446313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:36.447682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:36.454898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.455649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.456368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.457227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.457786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.459559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.572807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9bf2f7d1cdc47ed83175f036a574ca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b7cf075cae49ae838a0f75ca04b41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:36.587963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e152957f-71df-40e4-8528-04b4832e6140 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 200 len: 1326 microversion: 2.1 time: 0.146368 Oct 28 13:07:36.592661 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 743/1478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:36 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:36.605027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:36.606290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:36.615914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.616717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.617343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.618265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.618932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.619752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.679858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:36.880186 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8e8c870-6659-496f-b534-f29a6beaea90 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.713626 Oct 28 13:07:36.882091 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 736/1479] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:07:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:36.887167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:36.887943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:36.905252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.905908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.907924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.908736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:36.910732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:36.912765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:36.965811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a could not be found. Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a HTTP/1.1 Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:36.968617 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a could not be found. Oct 28 13:07:36.970272 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '9256c7bc-6b0f-4ee2-8b7f-49e469b5127a'} Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a could not be found. Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:36.971249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a could not be found. Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a could not be found. Oct 28 13:07:36.972713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:36.974065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance 9256c7bc-6b0f-4ee2-8b7f-49e469b5127a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:36.974065 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fceaab3c-57d2-48ae-9a33-8b89188aa824 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a" status: 404 len: 111 microversion: 2.1 time: 0.086700 Oct 28 13:07:36.977959 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 737/1480] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:36 2022] GET /compute/v2.1/servers/9256c7bc-6b0f-4ee2-8b7f-49e469b5127a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:36.987942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:36.990698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] [instance: 58988fbd-d2e9-4ad1-94cc-f8e87e6def38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:37.002707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.003478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.004338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.005229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.006374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.006997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] HTTP exception thrown: Instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 could not be found. Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Request method failure captured: Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 HTTP/1.1 Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9NyK7RGs0tvIYoHio571BsPsp50Wd_5_hrQ7vrc1WwMtT1kmc7eqVQnX6wDF0cVFTICCLFZlKex6bgpRMgV1kWpVE3Mj36ap0lDY57NTe1lU0PrmSOX8owsHIzuH_HoCOfbdBc_94bywwtiLZ5GPhtQkrGQmwOSIQ0mWFDmt_oS1R4 Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: ca58f2828860400da616cba8da1c1a8a Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:37.027976 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ca58f2828860400da616cba8da1c1a8a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ca58f2828860400da616cba8da1c1a8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: ca58f2828860400da616cba8da1c1a8a Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminTestJSON-1436333279 Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminTestJSON-1436333279-project Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e35d20fe60484d11982fd061614dbf54 Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminTestJSON-1436333279-project Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 could not be found. Oct 28 13:07:37.029659 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '58988fbd-d2e9-4ad1-94cc-f8e87e6def38'} Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 could not be found. Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:37.030565 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 could not be found. Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 could not be found. Oct 28 13:07:37.032556 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.034132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] Returning 404 to user: Instance 58988fbd-d2e9-4ad1-94cc-f8e87e6def38 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:37.034132 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fafb864a-fa4f-43f1-a2d2-b060dacc5e6f tempest-ServersAdminTestJSON-1436333279 tempest-ServersAdminTestJSON-1436333279-project] 10.222.0.25 "GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38" status: 404 len: 111 microversion: 2.1 time: 0.049759 Oct 28 13:07:37.034132 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 738/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:36 2022] GET /compute/v2.1/servers/58988fbd-d2e9-4ad1-94cc-f8e87e6def38 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:37.037995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7b3b80a-97d8-43b7-a2d7-4f17598c3205 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Action: 'create', calling method: .version_select at 0x7f27b9418160>, body: {"pool": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:37.104533 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51b82424-4a12-44e6-9ff7-2f44352d9da0 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 204 len: 0 microversion: 2.1 time: 0.510310 Oct 28 13:07:37.108550 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 744/1482] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:36 2022] DELETE /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:37.116879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:37.121724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 28e87c31-9974-410f-9f71-0b6b1be84b79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:37.130855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.137180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.138007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.139045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.148257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.148257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.174568 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance 28e87c31-9974-410f-9f71-0b6b1be84b79 could not be found. Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 HTTP/1.1 Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:37.176649 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 28e87c31-9974-410f-9f71-0b6b1be84b79 could not be found. Oct 28 13:07:37.178544 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '28e87c31-9974-410f-9f71-0b6b1be84b79'} Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e87c31-9974-410f-9f71-0b6b1be84b79 could not be found. Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:37.179332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e87c31-9974-410f-9f71-0b6b1be84b79 could not be found. Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e87c31-9974-410f-9f71-0b6b1be84b79 could not be found. Oct 28 13:07:37.180554 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:37.183169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance 28e87c31-9974-410f-9f71-0b6b1be84b79 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:37.184453 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-873fd123-0572-4e73-9ba1-7ccaf2f25cec tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79" status: 404 len: 111 microversion: 2.1 time: 0.073979 Oct 28 13:07:37.187309 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 745/1483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:37 2022] GET /compute/v2.1/servers/28e87c31-9974-410f-9f71-0b6b1be84b79 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:37.200053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2d8c43ee-32f5-447e-b3d6-a6be637a81a7 req-3e585d2a-d12d-4763-b971-789c494f8144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e87c31-9974-410f-9f71-0b6b1be84b79", "name": "network-vif-deleted", "tag": "430649f6-ff29-40ac-a6de-de056f65aa53"}, {"server_uuid": "78e2255e-0110-43c2-aa75-2a244f709e61", "name": "network-vif-deleted", "tag": "56171582-952a-45f3-a22b-71387e72cd2b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:37.211343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2d8c43ee-32f5-447e-b3d6-a6be637a81a7 req-3e585d2a-d12d-4763-b971-789c494f8144 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.212168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2d8c43ee-32f5-447e-b3d6-a6be637a81a7 req-3e585d2a-d12d-4763-b971-789c494f8144 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.212784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2d8c43ee-32f5-447e-b3d6-a6be637a81a7 req-3e585d2a-d12d-4763-b971-789c494f8144 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.226971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2d8c43ee-32f5-447e-b3d6-a6be637a81a7 req-3e585d2a-d12d-4763-b971-789c494f8144 service nova] Creating event network-vif-deleted:430649f6-ff29-40ac-a6de-de056f65aa53 for instance 28e87c31-9974-410f-9f71-0b6b1be84b79 on n-h2-862876-2 Oct 28 13:07:37.228355 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2d8c43ee-32f5-447e-b3d6-a6be637a81a7 req-3e585d2a-d12d-4763-b971-789c494f8144 service nova] Creating event network-vif-deleted:56171582-952a-45f3-a22b-71387e72cd2b for instance 78e2255e-0110-43c2-aa75-2a244f709e61 on n-h2-862876-2 Oct 28 13:07:37.236127 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2d8c43ee-32f5-447e-b3d6-a6be637a81a7 req-3e585d2a-d12d-4763-b971-789c494f8144 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047365 Oct 28 13:07:37.237089 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 746/1484] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:37.249070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:37.251736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:37.262211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.263111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.263802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.264780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.265838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.266487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.547244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:37.582650 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fa2addea-43a9-42d2-8dc9-43205135dce9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.343826 Oct 28 13:07:37.595116 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 747/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:37 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:37.606594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:37.613682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:37.622121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.622630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.623320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.624066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:37.624528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:37.624952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:37.775881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:37.786527 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88e43a3e-41cb-44d9-bdb1-0af76ff4cd85 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1664 microversion: 2.1 time: 0.191011 Oct 28 13:07:37.788475 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 748/1486] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:37 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:37.793388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d7615a1c-06ab-4d15-bb02-2471cf1abac3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:38.231548 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d7615a1c-06ab-4d15-bb02-2471cf1abac3 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/233b0b5f-bf34-4784-bf4b-e2f2fdd54262" status: 204 len: 0 microversion: 2.1 time: 0.441713 Oct 28 13:07:38.232194 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 749/1487] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:07:37 2022] DELETE /compute/v2.1/os-server-groups/233b0b5f-bf34-4784-bf4b-e2f2fdd54262 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:38.237642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:38.238253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:38.244376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:38.244872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:38.245312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:38.246015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:38.246471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:38.246930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:38.651320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:38.665882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:38.669481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:38.671357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-96cb6618-c2e9-4541-a9c8-f5a1832ecc2e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.436809 Oct 28 13:07:38.685355 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 750/1488] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:38 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:38.697206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:38.698104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] [instance: 78e2255e-0110-43c2-aa75-2a244f709e61] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:38.705413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:38.706102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:38.706727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:38.707486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:38.708120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:38.708550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:38.723413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] HTTP exception thrown: Instance 78e2255e-0110-43c2-aa75-2a244f709e61 could not be found. Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Request method failure captured: Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 HTTP/1.1 Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NgLrvBo-JqDpRZVYz_ckLVq4Z4B5XCxbm2uUHdMx7XBurZF9K814lv5afYaF7oo71fQcYH3byytIWbSM5ECUjfmQmiZH8LKIChzu-HQZYabdT-UfMBXdFYAgJnRVyQ34z6LFm1xopiKgfAQZUjv8h1LjXRvES8tkskFt31jYD5S60 Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 95b7cf075cae49ae838a0f75ca04b41a Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesAdminNegativeTest-79351405 Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:38.725509 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95b7cf075cae49ae838a0f75ca04b41a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95b7cf075cae49ae838a0f75ca04b41a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95b7cf075cae49ae838a0f75ca04b41a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95b7cf075cae49ae838a0f75ca04b41a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesAdminNegativeTest-79351405 Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 95b7cf075cae49ae838a0f75ca04b41a Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-79351405 Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesAdminNegativeTest-79351405-project Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c9bf2f7d1cdc47ed83175f036a574ca0 Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesAdminNegativeTest-79351405-project Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 78e2255e-0110-43c2-aa75-2a244f709e61 could not be found. Oct 28 13:07:38.733976 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '78e2255e-0110-43c2-aa75-2a244f709e61'} Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e2255e-0110-43c2-aa75-2a244f709e61 could not be found. Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:38.735004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e2255e-0110-43c2-aa75-2a244f709e61 could not be found. Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e2255e-0110-43c2-aa75-2a244f709e61 could not be found. Oct 28 13:07:38.736618 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:38.738054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Returning 404 to user: Instance 78e2255e-0110-43c2-aa75-2a244f709e61 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:38.738054 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-050d9f08-73b6-422b-9b6a-ccac775b2120 tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61" status: 404 len: 111 microversion: 2.1 time: 0.040124 Oct 28 13:07:38.738054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 751/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:38 2022] GET /compute/v2.1/servers/78e2255e-0110-43c2-aa75-2a244f709e61 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:38.739559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:38.740595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:38.746954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:38.747454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:38.748093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:38.749256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:38.749885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:38.750472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:38.782403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:39.241983 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e66f961-a0e8-4f02-83f1-cc492d4858d8 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 204 len: 0 microversion: 2.1 time: 0.511798 Oct 28 13:07:39.243956 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 752/1490] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:38 2022] DELETE /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:39.251135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:39.259008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:39.270312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.271061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.271647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:39.274858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.282285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.283019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:39.550373 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7b3b80a-97d8-43b7-a2d7-4f17598c3205 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.516829 Oct 28 13:07:39.553032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:39.557214 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 739/1491] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:07:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:39.562212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3400c6f3-28b0-4216-8814-16b0893a5afe tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] Calling method '.version_select at 0x7f27b9418280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:39.566170 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9603888-59e3-4286-9644-da98192e85e5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.321458 Oct 28 13:07:39.568074 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 753/1492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:39 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:39.576440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:39.577304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:39.583679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.584906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.588337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:39.588337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.588337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.588337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:39.631502 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3400c6f3-28b0-4216-8814-16b0893a5afe tempest-VolumesAdminNegativeTest-79351405 tempest-VolumesAdminNegativeTest-79351405-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559877595" status: 202 len: 0 microversion: 2.1 time: 0.072897 Oct 28 13:07:39.636998 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 740/1493] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:07:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559877595 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:39.642483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:39.648052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:39.654355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.657356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.657356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:39.657356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.657356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.657751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:39.858754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:39.866649 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5314a3a-0f2b-4dff-901f-25ed51753e2f tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1664 microversion: 2.1 time: 0.297152 Oct 28 13:07:39.867570 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 754/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:39 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1664 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:39.879339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:39.882096 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b1561280-6d02-45cf-aa7a-b6b8b1afe660 tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1473 microversion: 2.1 time: 0.244214 Oct 28 13:07:39.889963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23d423ff-b755-4d00-827b-fbf96be621a2 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Action: 'create', calling method: .version_select at 0x7f27b9a79280>, body: {"pool": null} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:39.895857 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 741/1495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:39 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1473 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:39.919923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:39.919923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:39.919923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.919923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.920331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:39.920331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:39.920331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:39.920331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:40.221822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:40.230782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:40.232237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:40.233447 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c1ec1b0-bf94-4130-89f0-051a90759869 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1814 microversion: 2.25 time: 0.335593 Oct 28 13:07:40.234014 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 742/1496] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:39 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1814 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:40.412678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1fe986d0-f246-4d7f-8804-79583b6bb46a req-bd38c7cb-d909-452b-b00a-052b9edd51b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50ef387-14f5-40f0-9911-b97b6b862054", "name": "network-vif-deleted", "tag": "802e41ae-314e-4eea-beb0-e3d09a4e41df"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:40.433804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1fe986d0-f246-4d7f-8804-79583b6bb46a req-bd38c7cb-d909-452b-b00a-052b9edd51b2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:40.434303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1fe986d0-f246-4d7f-8804-79583b6bb46a req-bd38c7cb-d909-452b-b00a-052b9edd51b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:40.435023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1fe986d0-f246-4d7f-8804-79583b6bb46a req-bd38c7cb-d909-452b-b00a-052b9edd51b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:40.453871 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1fe986d0-f246-4d7f-8804-79583b6bb46a req-bd38c7cb-d909-452b-b00a-052b9edd51b2 service nova] Creating event network-vif-deleted:802e41ae-314e-4eea-beb0-e3d09a4e41df for instance d50ef387-14f5-40f0-9911-b97b6b862054 on n-h2-862876-2 Oct 28 13:07:40.459558 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1fe986d0-f246-4d7f-8804-79583b6bb46a req-bd38c7cb-d909-452b-b00a-052b9edd51b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050718 Oct 28 13:07:40.460470 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 743/1497] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:40.594011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:40.596600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:40.614983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:40.621196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:40.621196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:40.622395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:40.623138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:40.624811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:41.038666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:41.054104 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-67a2bdc9-de49-4058-8db8-e0ad6498b12b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.466440 Oct 28 13:07:41.075638 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 744/1498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:40 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:41.081830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:41.085242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:41.099166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:41.100148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:41.106787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:41.106787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:41.106787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:41.106787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:41.138331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:41.138860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:41.140967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:41.140967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lazy-loading 'fault' on Instance uuid d50ef387-14f5-40f0-9911-b97b6b862054 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:41.242897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae36e9615c454d9b914aeb585e172af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed3491e1ce043e3a27c05cd35dee95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:41.251276 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be0151a8-40fe-4600-b0de-1777780b0801 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 200 len: 1315 microversion: 2.1 time: 0.174291 Oct 28 13:07:41.252805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 745/1499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:41 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:41.265629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:41.266894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:41.277318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:41.279107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:41.279814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:41.282344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:41.283117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:41.283802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:41.663724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:41.674720 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d84dfdac-b6ac-4a97-8d71-e61dae28501d tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1473 microversion: 2.1 time: 0.417492 Oct 28 13:07:41.691509 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 746/1500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:41 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:41.825062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-476542e8-56a0-43e8-ac9e-07392fc14573 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Calling method '.version_select at 0x7f27b960b280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:41.846923 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-476542e8-56a0-43e8-ac9e-07392fc14573 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] HTTP exception thrown: Image not found. Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-476542e8-56a0-43e8-ac9e-07392fc14573 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Request method failure captured: Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/images/a4c5e781-c64e-47ae-972d-a5a6bdeb15ea/metadata/os_distro HTTP/1.1 Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9QcGePPCQNLBSKi23R0FVR_-BuC4w8AoGRYE9zcouXL_H9cx09fDHUR9SLxjsuD11CU7xxNu_cuaqPhjrOvcOJ-nh_rgP5gNLjUYjucTinP1TMB2DERTlw9I0G91A2TIWDU5y0Sy8MTm8t6vx7C9gQXS3zGJZtnc8RFEkN_PqUxL6I Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:41.852656 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d4be7e4beac4513a3855804a6026fde", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: c92f0f68260545768f613003c31351e6 Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: exception: Image not found. Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'image_id': 'a4c5e781-c64e-47ae-972d-a5a6bdeb15ea', 'id': 'os_distro'} Oct 28 13:07:41.854479 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:41.855539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a4c5e781-c64e-47ae-972d-a5a6bdeb15ea Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:41.856921 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4c5e781-c64e-47ae-972d-a5a6bdeb15ea could not be found. Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:41.859132 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:41.860697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-476542e8-56a0-43e8-ac9e-07392fc14573 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Returning 404 to user: Image not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:41.862332 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-476542e8-56a0-43e8-ac9e-07392fc14573 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] 10.222.0.25 "DELETE /compute/v2.1/images/a4c5e781-c64e-47ae-972d-a5a6bdeb15ea/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.160846 Oct 28 13:07:41.862332 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 747/1501] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Oct 28 13:07:41 2022] DELETE /compute/v2.1/images/a4c5e781-c64e-47ae-972d-a5a6bdeb15ea/metadata/os_distro => generated 62 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:41.924505 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f540cef-8ed7-4a8e-aa7b-ec597b5932a1 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.065737 Oct 28 13:07:41.925049 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 748/1502] 10.222.0.25 () {58 vars in 1128 bytes} [Fri Oct 28 13:07:41 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 13:07:41.935897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:41.936823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:41.945247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:41.946154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:41.946668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:41.947492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:41.948312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:41.948842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:42.454297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:42.468306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:42.471206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:42.472953 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b2940d9e-383f-4fd6-9598-055f37df5541 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1804 microversion: 2.25 time: 0.545271 Oct 28 13:07:42.487700 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 749/1503] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:41 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1804 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:42.497898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8126e145-4544-4581-8307-ac8720e25f03 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Calling method '.version_select at 0x7f27b9418670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.499531 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23d423ff-b755-4d00-827b-fbf96be621a2 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.618545 Oct 28 13:07:42.500282 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 755/1504] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:07:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:42.507079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c02f5e82-e172-48d1-b07d-4bcaacdee1c2 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Calling method '.version_select at 0x7f27b9eb2040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.525378 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8126e145-4544-4581-8307-ac8720e25f03 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] HTTP exception thrown: Image not found. Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8126e145-4544-4581-8307-ac8720e25f03 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Request method failure captured: Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/images/488a3ff1-6053-4b45-8e6b-848595dff6ff/metadata/os_version HTTP/1.1 Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9QcGePPCQNLBSKi23R0FVR_-BuC4w8AoGRYE9zcouXL_H9cx09fDHUR9SLxjsuD11CU7xxNu_cuaqPhjrOvcOJ-nh_rgP5gNLjUYjucTinP1TMB2DERTlw9I0G91A2TIWDU5y0Sy8MTm8t6vx7C9gQXS3zGJZtnc8RFEkN_PqUxL6I Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:07:42.528689 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d4be7e4beac4513a3855804a6026fde", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: c92f0f68260545768f613003c31351e6 Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: exception: Image not found. Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'image_id': '488a3ff1-6053-4b45-8e6b-848595dff6ff', 'id': 'os_version'} Oct 28 13:07:42.530581 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:42.531561 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 488a3ff1-6053-4b45-8e6b-848595dff6ff Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:42.532724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 488a3ff1-6053-4b45-8e6b-848595dff6ff could not be found. Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:42.534056 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.537318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8126e145-4544-4581-8307-ac8720e25f03 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Returning 404 to user: Image not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:42.545878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8126e145-4544-4581-8307-ac8720e25f03 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] 10.222.0.25 "GET /compute/v2.1/images/488a3ff1-6053-4b45-8e6b-848595dff6ff/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051537 Oct 28 13:07:42.546335 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 750/1505] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Oct 28 13:07:42 2022] GET /compute/v2.1/images/488a3ff1-6053-4b45-8e6b-848595dff6ff/metadata/os_version => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:42.553189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.554101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:42.563142 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-c02f5e82-e172-48d1-b07d-4bcaacdee1c2 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] HTTP exception thrown: Image not found. Oct 28 13:07:42.563495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:42.564275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:42.564892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c02f5e82-e172-48d1-b07d-4bcaacdee1c2 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Request method failure captured: Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcPFgvsJFtD17J336ZQg4GPBoej5uYsdfi7JszVq4G8OFjcjjBNxVhZ7-KiPzJWrSsWN-e0zuJ_cnBJH3p-wkMuM08gLkxE9xQUfPOX5VXD9Dr1076TYU4Vcq_ggo2Z9c3mYrSGnkuXRQvB5yxO1nsKUETTiuMAgTG22s6Hs7jDAc Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:42.565322 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d6d839b60724cd5aadc571a203dbd74", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6a245e6f56ed41f28f3bb1315e7afbe5 Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '-1'} Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:42.567013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.568139 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:42.569875 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c02f5e82-e172-48d1-b07d-4bcaacdee1c2 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c02f5e82-e172-48d1-b07d-4bcaacdee1c2 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.066591 Oct 28 13:07:42.571332 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 756/1506] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Oct 28 13:07:42 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:42.573235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:42.573877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:42.574485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:42.575708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.576342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] [instance: d50ef387-14f5-40f0-9911-b97b6b862054] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:42.583380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:42.584372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:42.584831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:42.585599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:42.586067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:42.586499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:42.602702 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] HTTP exception thrown: Instance d50ef387-14f5-40f0-9911-b97b6b862054 could not be found. Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Request method failure captured: Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 HTTP/1.1 Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9PS19Bfsax2N7u5f3XdnwMnIjtur5YRsMVmHSu1SqP5SxdZWzfh1Q6i1O4qSPRKUHuNdV5IyMMwGrRabZmCzIeEeEU5xvY6YUno3mcJW6vABvVFHvbceVEPHTxVysfVUriAx7p78WrAIeGzk8s5fvizKU4cGSOFGQk3J9kyPyWjc6M Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 1ed3491e1ce043e3a27c05cd35dee95c Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestFqdnHostnames-2132566623 Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:42.604541 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed3491e1ce043e3a27c05cd35dee95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ed3491e1ce043e3a27c05cd35dee95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ed3491e1ce043e3a27c05cd35dee95c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ed3491e1ce043e3a27c05cd35dee95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestFqdnHostnames-2132566623 Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 1ed3491e1ce043e3a27c05cd35dee95c Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2132566623 Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestFqdnHostnames-2132566623-project Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ae36e9615c454d9b914aeb585e172af6 Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestFqdnHostnames-2132566623-project Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance d50ef387-14f5-40f0-9911-b97b6b862054 could not be found. Oct 28 13:07:42.606251 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'd50ef387-14f5-40f0-9911-b97b6b862054'} Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50ef387-14f5-40f0-9911-b97b6b862054 could not be found. Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:42.607291 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50ef387-14f5-40f0-9911-b97b6b862054 could not be found. Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50ef387-14f5-40f0-9911-b97b6b862054 could not be found. Oct 28 13:07:42.608964 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.610924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Returning 404 to user: Instance d50ef387-14f5-40f0-9911-b97b6b862054 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:42.610924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-72eacbab-10e1-483c-a97e-a3744c800884 tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054" status: 404 len: 111 microversion: 2.1 time: 0.036000 Oct 28 13:07:42.610924 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 757/1507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:42 2022] GET /compute/v2.1/servers/d50ef387-14f5-40f0-9911-b97b6b862054 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:42.616147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-30379899-5854-4c4d-bae9-68883c1502ea tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '.version_select at 0x7f27b9f6adc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.619826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30379899-5854-4c4d-bae9-68883c1502ea tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:42.620320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30379899-5854-4c4d-bae9-68883c1502ea tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:42.620769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30379899-5854-4c4d-bae9-68883c1502ea tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:42.630140 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-30379899-5854-4c4d-bae9-68883c1502ea tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.018721 Oct 28 13:07:42.630829 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 758/1508] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Oct 28 13:07:42 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:42.635777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1444f08-59d8-428c-aaba-3b83dcd70560 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Calling method '.version_select at 0x7f27b9b62f70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.830019 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1444f08-59d8-428c-aaba-3b83dcd70560 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/0440966d-c2d1-4ad9-a59e-af2a29d356a8" status: 200 len: 141 microversion: 2.1 time: 0.198122 Oct 28 13:07:42.830683 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 759/1509] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:07:42 2022] GET /compute/v2.1/os-floating-ips/0440966d-c2d1-4ad9-a59e-af2a29d356a8 => generated 141 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:42.836154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c31266b-9c21-42cd-a5f8-25d2ee03551c tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Calling method '.version_select at 0x7f27b9fb4280>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.849203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:42.864300 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-4c31266b-9c21-42cd-a5f8-25d2ee03551c tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] HTTP exception thrown: Image not found. Oct 28 13:07:42.866229 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b857508d-f4e8-487f-bc93-b077dd8d015f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.318560 Oct 28 13:07:42.866826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 751/1510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:42 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c31266b-9c21-42cd-a5f8-25d2ee03551c tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Request method failure captured: Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/images/a9aecaf9-794e-4373-a908-b2d2b103cf4a/metadata HTTP/1.1 Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcGePPCQNLBSKi23R0FVR_-BuC4w8AoGRYE9zcouXL_H9cx09fDHUR9SLxjsuD11CU7xxNu_cuaqPhjrOvcOJ-nh_rgP5gNLjUYjucTinP1TMB2DERTlw9I0G91A2TIWDU5y0Sy8MTm8t6vx7C9gQXS3zGJZtnc8RFEkN_PqUxL6I Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:42.866981 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d4be7e4beac4513a3855804a6026fde", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c92f0f68260545768f613003c31351e6 Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'image_id': 'a9aecaf9-794e-4373-a908-b2d2b103cf4a'} Oct 28 13:07:42.868415 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:42.869383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a9aecaf9-794e-4373-a908-b2d2b103cf4a Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:42.870540 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9aecaf9-794e-4373-a908-b2d2b103cf4a could not be found. Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:42.871811 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.873041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c31266b-9c21-42cd-a5f8-25d2ee03551c tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:42.874143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c31266b-9c21-42cd-a5f8-25d2ee03551c tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] 10.222.0.25 "GET /compute/v2.1/images/a9aecaf9-794e-4373-a908-b2d2b103cf4a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037242 Oct 28 13:07:42.874143 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 760/1511] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:07:42 2022] GET /compute/v2.1/images/a9aecaf9-794e-4373-a908-b2d2b103cf4a/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:42.877980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23b5b43a-ac8e-4c66-8d4d-099e45c25ffb tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Calling method '.version_select at 0x7f27b9f6ae50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.892753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f573d978-c020-4438-9e9e-688e9259fe0c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] Calling method '.version_select at 0x7f27b95ff700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.915762 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-23b5b43a-ac8e-4c66-8d4d-099e45c25ffb tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] HTTP exception thrown: Image not found. Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23b5b43a-ac8e-4c66-8d4d-099e45c25ffb tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Request method failure captured: Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/debe47c8-202a-4703-8eac-aa9805f64e5j HTTP/1.1 Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcPFgvsJFtD17J336ZQg4GPBoej5uYsdfi7JszVq4G8OFjcjjBNxVhZ7-KiPzJWrSsWN-e0zuJ_cnBJH3p-wkMuM08gLkxE9xQUfPOX5VXD9Dr1076TYU4Vcq_ggo2Z9c3mYrSGnkuXRQvB5yxO1nsKUETTiuMAgTG22s6Hs7jDAc Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:42.921364 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d6d839b60724cd5aadc571a203dbd74", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6a245e6f56ed41f28f3bb1315e7afbe5 Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'debe47c8-202a-4703-8eac-aa9805f64e5j'} Oct 28 13:07:42.922998 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image debe47c8-202a-4703-8eac-aa9805f64e5j to delete Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.923884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image debe47c8-202a-4703-8eac-aa9805f64e5j could not be found. Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:42.925387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23b5b43a-ac8e-4c66-8d4d-099e45c25ffb tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:42.927017 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23b5b43a-ac8e-4c66-8d4d-099e45c25ffb tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] 10.222.0.25 "DELETE /compute/v2.1/images/debe47c8-202a-4703-8eac-aa9805f64e5j" status: 404 len: 62 microversion: 2.1 time: 0.049212 Oct 28 13:07:42.928269 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 761/1512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:42 2022] DELETE /compute/v2.1/images/debe47c8-202a-4703-8eac-aa9805f64e5j => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:42.937220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:42.937634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:42.945359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:42.945929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:42.946434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:42.947279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:42.947810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:42.948296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.020568 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f573d978-c020-4438-9e9e-688e9259fe0c tempest-ServersTestFqdnHostnames-2132566623 tempest-ServersTestFqdnHostnames-2132566623-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-729096927" status: 202 len: 0 microversion: 2.1 time: 0.140880 Oct 28 13:07:43.024819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 752/1513] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-729096927 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:43.151370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid 33e873a2-b078-4190-9f83-0644b1075f4a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:43.166095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1d8462ce-375e-47c6-8e77-0b76632ff1b1 req-04495fb7-8630-4f49-b2cf-d829853a05fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9de8fb-d31e-4f62-b8cb-cafb20df5769", "name": "network-vif-deleted", "tag": "a98862dc-d21d-470a-88e8-e37c85cda8ca"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:43.166289 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5019c972-e9bf-4b64-b905-c13a9a313f0c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 2423 microversion: 2.25 time: 0.234286 Oct 28 13:07:43.166901 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 762/1514] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:42 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 2423 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:43.171778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:43.172575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:43.182026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.187688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.188368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.189351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.189785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.190198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.198395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1d8462ce-375e-47c6-8e77-0b76632ff1b1 req-04495fb7-8630-4f49-b2cf-d829853a05fc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.198395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1d8462ce-375e-47c6-8e77-0b76632ff1b1 req-04495fb7-8630-4f49-b2cf-d829853a05fc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.198395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1d8462ce-375e-47c6-8e77-0b76632ff1b1 req-04495fb7-8630-4f49-b2cf-d829853a05fc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.207967 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1d8462ce-375e-47c6-8e77-0b76632ff1b1 req-04495fb7-8630-4f49-b2cf-d829853a05fc service nova] Creating event network-vif-deleted:a98862dc-d21d-470a-88e8-e37c85cda8ca for instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 on n-h1-862876-2 Oct 28 13:07:43.214249 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1d8462ce-375e-47c6-8e77-0b76632ff1b1 req-04495fb7-8630-4f49-b2cf-d829853a05fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188224 Oct 28 13:07:43.215556 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 753/1515] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:43.222410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ef406d8-aeeb-4e1f-8cb5-6d4f76c08434 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Calling method '.version_select at 0x7f27b945d8b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:43.232871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.233415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.233859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.234446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lazy-loading 'fault' on Instance uuid 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:43.287603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa79bf0f26a4ce6bf786026a76ce92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83f9bc35587c481ba2be5676f43c0672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:43.291233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:43.296598 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76cec0af-5502-49f6-8c25-560fc6ac1e6f tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 200 len: 1307 microversion: 2.1 time: 0.128561 Oct 28 13:07:43.297289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 763/1516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:43 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:43.305173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84425fe5-c69e-4020-b7f4-adac900c3c83 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Action: 'update_all', calling method: .version_select at 0x7f27b9b62ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:43.331812 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-84425fe5-c69e-4020-b7f4-adac900c3c83 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] HTTP exception thrown: Image not found. Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84425fe5-c69e-4020-b7f4-adac900c3c83 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Request method failure captured: Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/images/537a91cb-35be-4379-ab10-b935d4b166f4/metadata HTTP/1.1 Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 57 Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcGePPCQNLBSKi23R0FVR_-BuC4w8AoGRYE9zcouXL_H9cx09fDHUR9SLxjsuD11CU7xxNu_cuaqPhjrOvcOJ-nh_rgP5gNLjUYjucTinP1TMB2DERTlw9I0G91A2TIWDU5y0Sy8MTm8t6vx7C9gQXS3zGJZtnc8RFEkN_PqUxL6I Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:43.334650 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d4be7e4beac4513a3855804a6026fde", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c92f0f68260545768f613003c31351e6 Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:43.336258 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'image_id': '537a91cb-35be-4379-ab10-b935d4b166f4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.337186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 537a91cb-35be-4379-ab10-b935d4b166f4 Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:43.339862 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 537a91cb-35be-4379-ab10-b935d4b166f4 could not be found. Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:43.342285 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:43.344490 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.347395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84425fe5-c69e-4020-b7f4-adac900c3c83 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:43.347395 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84425fe5-c69e-4020-b7f4-adac900c3c83 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] 10.222.0.25 "PUT /compute/v2.1/images/537a91cb-35be-4379-ab10-b935d4b166f4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037872 Oct 28 13:07:43.347395 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 764/1517] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:07:43 2022] PUT /compute/v2.1/images/537a91cb-35be-4379-ab10-b935d4b166f4/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:43.347395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c19dd6b-8cab-4080-a6f7-5e923092df91 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Calling method '.version_select at 0x7f27b9f6ad30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:43.365935 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-8c19dd6b-8cab-4080-a6f7-5e923092df91 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] HTTP exception thrown: Image not found. Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c19dd6b-8cab-4080-a6f7-5e923092df91 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Request method failure captured: Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/92b264f1-aa7d-419d-90b6-68e55ddb5a231 HTTP/1.1 Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcPFgvsJFtD17J336ZQg4GPBoej5uYsdfi7JszVq4G8OFjcjjBNxVhZ7-KiPzJWrSsWN-e0zuJ_cnBJH3p-wkMuM08gLkxE9xQUfPOX5VXD9Dr1076TYU4Vcq_ggo2Z9c3mYrSGnkuXRQvB5yxO1nsKUETTiuMAgTG22s6Hs7jDAc Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:43.367757 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d6d839b60724cd5aadc571a203dbd74", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6a245e6f56ed41f28f3bb1315e7afbe5 Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '92b264f1-aa7d-419d-90b6-68e55ddb5a231'} Oct 28 13:07:43.369310 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 92b264f1-aa7d-419d-90b6-68e55ddb5a231 to delete Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.370147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92b264f1-aa7d-419d-90b6-68e55ddb5a231 could not be found. Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:43.372015 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c19dd6b-8cab-4080-a6f7-5e923092df91 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:43.373332 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c19dd6b-8cab-4080-a6f7-5e923092df91 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] 10.222.0.25 "DELETE /compute/v2.1/images/92b264f1-aa7d-419d-90b6-68e55ddb5a231" status: 404 len: 62 microversion: 2.1 time: 0.030732 Oct 28 13:07:43.375402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 765/1518] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:43 2022] DELETE /compute/v2.1/images/92b264f1-aa7d-419d-90b6-68e55ddb5a231 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:43.377705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:43.378353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:43.385337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.385845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.386335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.387047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.387509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.388662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.530698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid 33e873a2-b078-4190-9f83-0644b1075f4a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:43.553271 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-512597a4-93a2-43ab-a9d9-f6e296350b4c tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 2423 microversion: 2.25 time: 0.182384 Oct 28 13:07:43.554015 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 766/1519] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:43 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 2423 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:43.559109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca2be8ca-9249-45cf-b6e0-b2f86f794530 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Action: 'update', calling method: .version_select at 0x7f27b9ed5040>, body: {"meta": {"os_distro": "alt"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:43.582860 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ca2be8ca-9249-45cf-b6e0-b2f86f794530 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] HTTP exception thrown: Image not found. Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca2be8ca-9249-45cf-b6e0-b2f86f794530 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Request method failure captured: Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/images/231c77f5-b9e2-4df2-bced-4508e1bc7574/metadata/os_distro HTTP/1.1 Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 30 Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcGePPCQNLBSKi23R0FVR_-BuC4w8AoGRYE9zcouXL_H9cx09fDHUR9SLxjsuD11CU7xxNu_cuaqPhjrOvcOJ-nh_rgP5gNLjUYjucTinP1TMB2DERTlw9I0G91A2TIWDU5y0Sy8MTm8t6vx7C9gQXS3zGJZtnc8RFEkN_PqUxL6I Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:43.584990 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d4be7e4beac4513a3855804a6026fde", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c92f0f68260545768f613003c31351e6 Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: {"meta": {"os_distro": "alt"}} Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:43.586615 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'image_id': '231c77f5-b9e2-4df2-bced-4508e1bc7574', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.591559 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 231c77f5-b9e2-4df2-bced-4508e1bc7574 Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:43.592821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 231c77f5-b9e2-4df2-bced-4508e1bc7574 could not be found. Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:43.594321 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:43.596059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.598171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca2be8ca-9249-45cf-b6e0-b2f86f794530 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:43.598171 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ca2be8ca-9249-45cf-b6e0-b2f86f794530 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] 10.222.0.25 "PUT /compute/v2.1/images/231c77f5-b9e2-4df2-bced-4508e1bc7574/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.031585 Oct 28 13:07:43.598171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 767/1520] 10.222.0.25 () {60 vars in 1310 bytes} [Fri Oct 28 13:07:43 2022] PUT /compute/v2.1/images/231c77f5-b9e2-4df2-bced-4508e1bc7574/metadata/os_distro => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:43.598171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b42ed4-2bde-4f8a-96d9-d45287bd3923 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Calling method '.version_select at 0x7f27b9a451f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:43.614693 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-00b42ed4-2bde-4f8a-96d9-d45287bd3923 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] HTTP exception thrown: Image not found. Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b42ed4-2bde-4f8a-96d9-d45287bd3923 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Request method failure captured: Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/tempest-invalid-1946343853 HTTP/1.1 Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcPFgvsJFtD17J336ZQg4GPBoej5uYsdfi7JszVq4G8OFjcjjBNxVhZ7-KiPzJWrSsWN-e0zuJ_cnBJH3p-wkMuM08gLkxE9xQUfPOX5VXD9Dr1076TYU4Vcq_ggo2Z9c3mYrSGnkuXRQvB5yxO1nsKUETTiuMAgTG22s6Hs7jDAc Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:43.617401 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d6d839b60724cd5aadc571a203dbd74", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6a245e6f56ed41f28f3bb1315e7afbe5 Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'tempest-invalid-1946343853'} Oct 28 13:07:43.618899 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1946343853 to delete Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.619720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1946343853 could not be found. Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:43.620857 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:43.622396 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.627612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b42ed4-2bde-4f8a-96d9-d45287bd3923 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:43.628497 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00b42ed4-2bde-4f8a-96d9-d45287bd3923 tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-1946343853" status: 404 len: 62 microversion: 2.1 time: 0.040315 Oct 28 13:07:43.629341 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 768/1521] 10.222.0.25 () {58 vars in 1206 bytes} [Fri Oct 28 13:07:43 2022] DELETE /compute/v2.1/images/tempest-invalid-1946343853 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:43.634278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bd1de91-a4f0-4ea5-ab17-5d2fe71d16a8 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Action: 'create', calling method: .version_select at 0x7f27b9f6ab80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:43.658379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-3bd1de91-a4f0-4ea5-ab17-5d2fe71d16a8 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] HTTP exception thrown: Image not found. Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bd1de91-a4f0-4ea5-ab17-5d2fe71d16a8 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Request method failure captured: Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/images/7bb1bb9f-26d0-418e-9587-fdf9d3235bc0/metadata HTTP/1.1 Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 57 Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcGePPCQNLBSKi23R0FVR_-BuC4w8AoGRYE9zcouXL_H9cx09fDHUR9SLxjsuD11CU7xxNu_cuaqPhjrOvcOJ-nh_rgP5gNLjUYjucTinP1TMB2DERTlw9I0G91A2TIWDU5y0Sy8MTm8t6vx7C9gQXS3zGJZtnc8RFEkN_PqUxL6I Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:43.660775 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d4be7e4beac4513a3855804a6026fde", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d4be7e4beac4513a3855804a6026fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 3d4be7e4beac4513a3855804a6026fde Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-174046188 Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c92f0f68260545768f613003c31351e6 Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-174046188-project Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:43.662636 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'image_id': '7bb1bb9f-26d0-418e-9587-fdf9d3235bc0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.663827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7bb1bb9f-26d0-418e-9587-fdf9d3235bc0 Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:07:43.665061 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bb1bb9f-26d0-418e-9587-fdf9d3235bc0 could not be found. Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:43.666232 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:43.669100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.676263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bd1de91-a4f0-4ea5-ab17-5d2fe71d16a8 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:43.676263 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bd1de91-a4f0-4ea5-ab17-5d2fe71d16a8 tempest-ImagesMetadataNegativeTestJSON-174046188 tempest-ImagesMetadataNegativeTestJSON-174046188-project] 10.222.0.25 "POST /compute/v2.1/images/7bb1bb9f-26d0-418e-9587-fdf9d3235bc0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.038988 Oct 28 13:07:43.676263 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 769/1522] 10.222.0.25 () {60 vars in 1281 bytes} [Fri Oct 28 13:07:43 2022] POST /compute/v2.1/images/7bb1bb9f-26d0-418e-9587-fdf9d3235bc0/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:43.676731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dce0b404-9028-4988-8e3d-db7c060c326a tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Calling method '.version_select at 0x7f27b9f6ab80>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:43.700576 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-dce0b404-9028-4988-8e3d-db7c060c326a tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] HTTP exception thrown: Image not found. Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dce0b404-9028-4988-8e3d-db7c060c326a tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Request method failure captured: Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/ef5cf44f-30ca-4f63-90eb-a74c93fbce97 HTTP/1.1 Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QcPFgvsJFtD17J336ZQg4GPBoej5uYsdfi7JszVq4G8OFjcjjBNxVhZ7-KiPzJWrSsWN-e0zuJ_cnBJH3p-wkMuM08gLkxE9xQUfPOX5VXD9Dr1076TYU4Vcq_ggo2Z9c3mYrSGnkuXRQvB5yxO1nsKUETTiuMAgTG22s6Hs7jDAc Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:43.703430 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d6d839b60724cd5aadc571a203dbd74", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d6d839b60724cd5aadc571a203dbd74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d6d839b60724cd5aadc571a203dbd74 Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-560749531 Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6a245e6f56ed41f28f3bb1315e7afbe5 Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-560749531-project Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ef5cf44f-30ca-4f63-90eb-a74c93fbce97'} Oct 28 13:07:43.704883 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef5cf44f-30ca-4f63-90eb-a74c93fbce97 to delete Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.705726 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef5cf44f-30ca-4f63-90eb-a74c93fbce97 could not be found. Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:43.707648 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dce0b404-9028-4988-8e3d-db7c060c326a tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:43.709008 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dce0b404-9028-4988-8e3d-db7c060c326a tempest-ImagesDeleteNegativeTestJSON-560749531 tempest-ImagesDeleteNegativeTestJSON-560749531-project] 10.222.0.25 "DELETE /compute/v2.1/images/ef5cf44f-30ca-4f63-90eb-a74c93fbce97" status: 404 len: 62 microversion: 2.1 time: 0.033855 Oct 28 13:07:43.713613 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 770/1523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:43 2022] DELETE /compute/v2.1/images/ef5cf44f-30ca-4f63-90eb-a74c93fbce97 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:07:43.713613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:43.713613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:43.719863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.720563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.721219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.722288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:43.723019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:43.723746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:43.997796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lazy-loading 'services' on Instance uuid 33e873a2-b078-4190-9f83-0644b1075f4a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:07:44.386362 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8d54c48-0a17-498d-88f7-929dc07ef75e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments/22715f85-80ec-4960-898d-8f0fcd3cb8e8" status: 202 len: 0 microversion: 2.25 time: 0.679305 Oct 28 13:07:44.388705 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 771/1524] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Oct 28 13:07:43 2022] DELETE /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments/22715f85-80ec-4960-898d-8f0fcd3cb8e8 => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:44.418863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:44.420683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:44.438603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:44.442989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:44.446383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:44.451125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:44.451637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:44.452243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:44.756637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:44.772534 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4dc33db2-77f9-40ef-af47-b696c05ea4d0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.382207 Oct 28 13:07:44.773247 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 772/1525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:44 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:44.779153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:44.780077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] [instance: 7b9de8fb-d31e-4f62-b8cb-cafb20df5769] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:44.787519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:44.790879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:44.790879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:44.790879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:44.790879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:44.791241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:44.808843 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] HTTP exception thrown: Instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 could not be found. Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Request method failure captured: Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 HTTP/1.1 Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9NGcTNOpKsEuazq3rh8dIIwsEUvJrSFok1wZ4vFTJHDSB8B1tZmPgTRAjMLa9BsvAq4od8NnmvT7kZkQQrUUsNkUR6CgP703GilQ0zFMFXj-jO-5SXN-Zs1ldBoKFlCuWlxiiA_BNHC3zAcK3PncwUB6fpTBmYieS0iEDmopbUlO1I Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:07:44.812766 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83f9bc35587c481ba2be5676f43c0672", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83f9bc35587c481ba2be5676f43c0672"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 83f9bc35587c481ba2be5676f43c0672 Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-192525559 Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: afa79bf0f26a4ce6bf786026a76ce92a Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersOnMultiNodesTest-192525559-project Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 could not be found. Oct 28 13:07:44.820733 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7b9de8fb-d31e-4f62-b8cb-cafb20df5769'} Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 could not be found. Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:07:44.821815 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 could not be found. Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 could not be found. Oct 28 13:07:44.823292 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:07:44.824412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] Returning 404 to user: Instance 7b9de8fb-d31e-4f62-b8cb-cafb20df5769 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:07:44.824412 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-69b504ae-41b4-4201-a4a1-fc196b3d883b tempest-ServersOnMultiNodesTest-192525559 tempest-ServersOnMultiNodesTest-192525559-project] 10.222.0.25 "GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769" status: 404 len: 111 microversion: 2.1 time: 0.040035 Oct 28 13:07:44.824412 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 773/1526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:44 2022] GET /compute/v2.1/servers/7b9de8fb-d31e-4f62-b8cb-cafb20df5769 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:07:44.827353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:44.831549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:44.839000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:44.839876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:44.840563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:44.841775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:44.842465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:44.843155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:44.891506 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2efacd0-ffae-4301-a122-674a440cafd9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074926 Oct 28 13:07:44.892954 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 774/1527] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:44 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:07:45.042929 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ef406d8-aeeb-4e1f-8cb5-6d4f76c08434 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/0440966d-c2d1-4ad9-a59e-af2a29d356a8" status: 202 len: 0 microversion: 2.1 time: 1.825183 Oct 28 13:07:45.048497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 754/1528] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:07:43 2022] DELETE /compute/v2.1/os-floating-ips/0440966d-c2d1-4ad9-a59e-af2a29d356a8 => generated 0 bytes in 1832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:45.053493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18be73a3-f369-480c-9987-5127d49462dc tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Calling method '.version_select at 0x7f27b9f6adc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:45.799069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:45.802662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:45.815679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:45.816195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:45.816642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:45.817366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:45.817835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:45.819885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:45.949285 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-18be73a3-f369-480c-9987-5127d49462dc tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.899101 Oct 28 13:07:45.949875 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 775/1529] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Oct 28 13:07:45 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:07:45.956965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:45.960916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:45.967745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:45.968239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:45.968676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:45.969678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:45.970191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:45.970910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:46.007725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-856e053f-f0cf-4380-91bc-df27f849fab5 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056704 Oct 28 13:07:46.008332 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 776/1530] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:45 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:07:46.016972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a20b09b5-fabf-4fa8-ac99-f98842e4b701 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Calling method '.version_select at 0x7f27b9f6af70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:46.316344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:46.346519 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a20b09b5-fabf-4fa8-ac99-f98842e4b701 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.336590 Oct 28 13:07:46.346838 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9c218fe6-30a6-49f1-904f-b913c9a38724 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1514 microversion: 2.1 time: 0.551421 Oct 28 13:07:46.346980 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 777/1531] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:07:46 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:46.352514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 755/1532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:45 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1514 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:46.369893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69de5251-8a94-4f26-8687-ad531a1eec57 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Calling method '.version_select at 0x7f27b93ce4c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:47.024307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:47.027552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:47.048422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:47.049063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:47.052902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:47.054328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:47.057676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:47.058549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:47.110503 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cad3716e-ca75-4d6e-b667-0e1ba85493dc tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094620 Oct 28 13:07:47.111281 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 756/1533] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:47 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:07:47.391828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:47.399834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:47.429171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:47.431230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:47.433244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:47.437006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:47.438056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:47.443773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:47.904292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:47.912873 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6129cf0d-1273-4343-aa0a-b36c9f912f28 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1520 microversion: 2.1 time: 0.528423 Oct 28 13:07:47.913462 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 757/1534] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:47 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:48.125889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:48.128444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:48.135126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:48.139995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:48.141230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:48.141903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:48.142917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:48.144578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:48.146041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:48.185059 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28086011-533d-4926-9c71-f65bae45360d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064626 Oct 28 13:07:48.186204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 758/1535] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:48 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:07:48.320019 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-69de5251-8a94-4f26-8687-ad531a1eec57 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/41c82b3f-ef41-48dd-a110-3c5786e86fdc" status: 202 len: 0 microversion: 2.1 time: 1.954678 Oct 28 13:07:48.323969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 778/1536] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:07:46 2022] DELETE /compute/v2.1/os-floating-ips/41c82b3f-ef41-48dd-a110-3c5786e86fdc => generated 0 bytes in 1960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:48.329133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccfdb71e-1747-46e4-a0d8-54f468aa7fea tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Calling method '.version_select at 0x7f27b945d4c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:48.941422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:48.942046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:48.957531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:48.958038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:48.958484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:48.961804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:48.961804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:48.972068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:49.897154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:49.906254 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7fecea40-8548-49ed-9d37-2c3f8f29d2af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1520 microversion: 2.1 time: 0.969856 Oct 28 13:07:49.914587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 779/1537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:48 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1520 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:50.262852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1529230909", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:50.295246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ccfdb71e-1747-46e4-a0d8-54f468aa7fea tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/fe087a58-2d65-429e-8a88-2d641e5866e0" status: 202 len: 0 microversion: 2.1 time: 1.970049 Oct 28 13:07:50.303599 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 759/1538] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:07:48 2022] DELETE /compute/v2.1/os-floating-ips/fe087a58-2d65-429e-8a88-2d641e5866e0 => generated 0 bytes in 1972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:07:50.303599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:50.307408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:50.323864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:50.326117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:50.340184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:50.340184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:50.340184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:50.340184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:50.391430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:07:50.409186 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-90fc7441-0e18-46ad-b192-f253764947f3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111485 Oct 28 13:07:50.412824 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 760/1539] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:50 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:07:50.422760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3ba0ae1c-d094-49a9-aead-ece34a357101 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] Calling method '.version_select at 0x7f27b95de430>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:50.889432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:07:50.890074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:07:50.894008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:07:50.894008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:07:50.894008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:07:50.915606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:50.916897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:50.917490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:50.918923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:50.919550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:50.923139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:50.941528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Getting quotas for project 75778e6d89f94db58b139d1c9824675c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:07:50.949164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Getting quotas for user 7c30b88de36c4240b553ecb339831a28 and project 75778e6d89f94db58b139d1c9824675c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:07:50.979699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:07:50.982107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:07:51.015012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:51.190684 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2fbeec50-c6d7-4852-b9ae-02ef1b064987 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271091 Oct 28 13:07:51.198341 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 780/1540] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:07:51.215690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:51.215690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:51.215690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:51.215690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:51.216115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:51.216115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:51.216115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:51.216115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:51.692820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:51.702333 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c85d9c5-070b-48da-adba-b9ff1ed99b6b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1520 microversion: 2.1 time: 0.502526 Oct 28 13:07:51.712063 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 781/1541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:51 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1520 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:51.720558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e4c28f7-fb1a-4be4-88ba-22967fde254d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:51.724651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e4c28f7-fb1a-4be4-88ba-22967fde254d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:51.874717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e4c28f7-fb1a-4be4-88ba-22967fde254d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:51.883623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e4c28f7-fb1a-4be4-88ba-22967fde254d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1217 microversion: 2.1 time: 0.170321 Oct 28 13:07:51.889004 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 782/1542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:51 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:51.895296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:51.909888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:51.936719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:51.937287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:51.937747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:51.938329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:51.938804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:51.939231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:51.987925 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-57bf81cb-ccaf-48d7-b62b-50683b11116f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096425 Oct 28 13:07:51.988698 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 783/1543] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:51 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:07:52.213017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9e696c39-ae23-4a99-a888-8414879b15d6 req-eeb31601-c4a4-4ba9-9d9c-e9c224a63015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba1c3df-c727-4cdd-b65a-bfe984620b9a", "name": "network-vif-plugged", "status": "completed", "tag": "612a149a-9dba-4d19-8b87-7ef164f8e1a6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:52.223674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e696c39-ae23-4a99-a888-8414879b15d6 req-eeb31601-c4a4-4ba9-9d9c-e9c224a63015 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:52.225174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e696c39-ae23-4a99-a888-8414879b15d6 req-eeb31601-c4a4-4ba9-9d9c-e9c224a63015 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:52.225977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e696c39-ae23-4a99-a888-8414879b15d6 req-eeb31601-c4a4-4ba9-9d9c-e9c224a63015 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:52.245204 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9e696c39-ae23-4a99-a888-8414879b15d6 req-eeb31601-c4a4-4ba9-9d9c-e9c224a63015 service nova] Creating event network-vif-plugged:612a149a-9dba-4d19-8b87-7ef164f8e1a6 for instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a on n-h1-862876-2 Oct 28 13:07:52.250342 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9e696c39-ae23-4a99-a888-8414879b15d6 req-eeb31601-c4a4-4ba9-9d9c-e9c224a63015 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260258 Oct 28 13:07:52.254709 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 784/1544] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:07:52.385049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-383257994", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": "none"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:52.495948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:07:52.496370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:07:52.497194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:07:52.497770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:07:52.498374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:07:52.518929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:52.519424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:52.519864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:52.520710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:52.523460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:52.523971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:52.556160 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3ba0ae1c-d094-49a9-aead-ece34a357101 tempest-FloatingIPDetailsTestJSON-683876174 tempest-FloatingIPDetailsTestJSON-683876174-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/64753e26-a4bc-4e00-a163-89e9ad26d147" status: 202 len: 0 microversion: 2.1 time: 2.140466 Oct 28 13:07:52.557417 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 761/1545] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:07:50 2022] DELETE /compute/v2.1/os-floating-ips/64753e26-a4bc-4e00-a163-89e9ad26d147 => generated 0 bytes in 2143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:07:52.586026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Getting quotas for project 10cfb1afb585468e9a315fbe81e6e297. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:07:52.595458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Getting quotas for user c251a230ec584ef58e1bde3d67176080 and project 10cfb1afb585468e9a315fbe81e6e297. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:07:52.622481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:07:52.625027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:07:52.738536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:52.739448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:52.751109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:52.751592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:52.753606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:52.754659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:52.755162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:52.756115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:52.866524 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f75e2fb4-6875-4538-83ea-f582ca184cdb tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.610267 Oct 28 13:07:52.877848 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 785/1546] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:07:52.893578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-41839a4f-c85d-483e-8ba5-f909d634e470 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:52.897211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-41839a4f-c85d-483e-8ba5-f909d634e470 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:52.994353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:53.006510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fe149a88-6c1a-48f9-8151-88b1b6c99e03 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1520 microversion: 2.1 time: 0.270675 Oct 28 13:07:53.007593 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 762/1547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:52 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:53.018470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2165f3ac-1124-4a08-a36c-e0fd7597a56b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:53.020220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2165f3ac-1124-4a08-a36c-e0fd7597a56b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:53.089356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2165f3ac-1124-4a08-a36c-e0fd7597a56b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:53.101809 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2165f3ac-1124-4a08-a36c-e0fd7597a56b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1217 microversion: 2.1 time: 0.091978 Oct 28 13:07:53.106537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 763/1548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:53 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:53.119152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:53.122699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41839a4f-c85d-483e-8ba5-f909d634e470 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:53.132581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41839a4f-c85d-483e-8ba5-f909d634e470 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:53.135256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:53.139508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41839a4f-c85d-483e-8ba5-f909d634e470 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:53.155207 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-41839a4f-c85d-483e-8ba5-f909d634e470 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1452 microversion: 2.91 time: 0.275109 Oct 28 13:07:53.157361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:53.157869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:53.158326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:53.166972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 786/1549] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:52 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1452 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:53.176053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:53.181171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:53.181171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:53.271425 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-13826550-5005-4b3e-8435-2e5299b483e3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.166666 Oct 28 13:07:53.272154 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 764/1550] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:53 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:07:54.042226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:54.043267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:54.075710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:54.077950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:54.079640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:54.080405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:54.083863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:54.085886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:54.131147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:54.131770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:54.138134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:54.138676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:54.143330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:54.144122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:54.144598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:54.145035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:54.304414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:54.318631 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-695f8800-d1f8-487a-b519-cd24916905b2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1213 microversion: 2.1 time: 0.190546 Oct 28 13:07:54.335606 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 765/1551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:54 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:54.341919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0b2cafd-5cfe-4a8a-95ef-9b7090411eaa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:54.342843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0b2cafd-5cfe-4a8a-95ef-9b7090411eaa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:54.524424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a0b2cafd-5cfe-4a8a-95ef-9b7090411eaa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:54.526293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:54.531953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a0b2cafd-5cfe-4a8a-95ef-9b7090411eaa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:54.533704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a0b2cafd-5cfe-4a8a-95ef-9b7090411eaa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:54.539515 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a0b2cafd-5cfe-4a8a-95ef-9b7090411eaa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1452 microversion: 2.91 time: 0.202694 Oct 28 13:07:54.562489 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c7199332-a767-4a40-8682-688ca4ae14c1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1520 microversion: 2.1 time: 0.523141 Oct 28 13:07:54.562489 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 787/1552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:54 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:54.562489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:54.562489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:54.564545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:54.565032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:54.565470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:54.566159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:54.566721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:54.567188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:54.569856 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 766/1553] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:54 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1452 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:54.615740 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ecd04aa8-f132-432c-8602-660e649f0d56 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.063084 Oct 28 13:07:54.623005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 788/1554] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:07:54 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:55.353452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:55.355312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:55.376509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:55.377649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:55.385167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:55.388834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:55.393914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:55.397259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:55.443729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:55.573691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:55.573691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:55.582250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:55.588042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:55.589784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:55.592701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:55.594344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:55.595448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:55.597520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:55.600730 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92868b4d-429b-4b21-a292-5326646571d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1277 microversion: 2.1 time: 0.257005 Oct 28 13:07:55.603517 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 767/1555] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:55 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:55.614441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:55.617040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:55.625512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:55.626019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:55.626468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:55.627874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:55.628472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:55.628968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:55.908597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:55.926623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:55.928389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:55.972596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cc5733df-378f-4d32-a4ca-4448ccd6c5cd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1448 microversion: 2.91 time: 0.405949 Oct 28 13:07:55.998261 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 789/1556] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:55 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1448 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:07:56.104335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:56.117798 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-99f366e6-5648-4015-9b96-9383686c4736 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1505 microversion: 2.1 time: 0.512336 Oct 28 13:07:56.131554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 768/1557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:55 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:56.174422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:56.175078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:56.204052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:56.204595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:56.205049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:56.210050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:56.210584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:56.211056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:56.626363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:56.627032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:56.641696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:56.642201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:56.656003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:56.657024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:56.657528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:56.657983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:56.962349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:56.983473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bbe8ec78-e6cb-4a90-8000-2d0608dacb85 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1275 microversion: 2.1 time: 0.355778 Oct 28 13:07:56.999753 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 769/1558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:56 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1275 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:57.006633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:57.007687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:57.015864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:57.017103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:57.017966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:57.018894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:57.019821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:57.021232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:57.265984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:57.284394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:57.293681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:57.314110 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81d22fc7-544f-4ae4-af0a-3cc22f03162c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1512 microversion: 2.91 time: 0.313054 Oct 28 13:07:57.316996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 770/1559] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:56 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:57.430651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:57.445604 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ac1afd4-7e9a-400e-af81-360ec319fbc9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 200 len: 1505 microversion: 2.1 time: 1.275587 Oct 28 13:07:57.446211 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 790/1560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:56 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 1505 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:57.468943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:57.469609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:57.487047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:57.487594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:57.491335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:57.495452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:57.495452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:57.495452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:57.611317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:07:58.011882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:58.012943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:58.040394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:58.041618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:58.044530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:58.047621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:58.048923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:58.055765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:58.073518 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95aa405e-7e40-466e-a0fb-0eb4c744b40a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 204 len: 0 microversion: 2.1 time: 0.608694 Oct 28 13:07:58.074435 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 771/1561] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:07:57 2022] DELETE /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:07:58.281178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1050698996", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "5d811f6e-cc55-4a5f-85b2-3720ed1ab191"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:07:58.373080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:58.386788 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dbf5345a-83ed-4c33-9b4f-24ec12e09ac7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1275 microversion: 2.1 time: 0.380023 Oct 28 13:07:58.390925 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 791/1562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:58 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1275 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:07:58.410291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:58.414968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:58.441115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] validate_networks() for [('5d811f6e-cc55-4a5f-85b2-3720ed1ab191', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:07:58.441231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:58.441231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:58.441231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:58.441231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:58.441981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:58.441981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:58.735196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:58.750578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:58.752746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:58.765668 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc7d9e5d-6d95-42c2-a68b-1c751f70af20 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1510 microversion: 2.91 time: 0.372568 Oct 28 13:07:58.766071 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 792/1563] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:58 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:07:59.417149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:59.418036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:59.432264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:59.435579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:59.441516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:59.441516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:59.441516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:59.441516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:59.455163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:07:59.601236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:59.614170 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8467e188-e2cb-4d66-a9e9-4dd4fa7f6587 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1275 microversion: 2.1 time: 0.202695 Oct 28 13:07:59.616754 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 793/1564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:07:59 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:07:59.796558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:07:59.797186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:07:59.808074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:59.808581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:59.809026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:59.809747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:07:59.810207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:07:59.810639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:07:59.946199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:59.980574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:59.986793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:07:59.999448 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2cfaa2ab-4226-4a71-903f-12fd4cf20e5d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1510 microversion: 2.91 time: 0.207018 Oct 28 13:08:00.006105 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 794/1565] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:07:59 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:08:00.624188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:08:00.624723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:08:00.628542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:08:00.629022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:08:00.629737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:08:00.648268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:00.648763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:00.649207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:00.649951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:00.650407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:00.650866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:00.661134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:00.661828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:00.670395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:00.672245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:00.673283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:00.674498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:00.675156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:00.675750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:00.708177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Getting quotas for project 54902a27bc8e4736a3ea3e48c1c6924a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:00.715302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Getting quotas for user 6655019d4e204241b8f97a5d2cdbd0bf and project 54902a27bc8e4736a3ea3e48c1c6924a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:00.744168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:08:00.746676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:08:01.097676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:01.097676 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47c2d216-b4c0-4d80-8d23-a34b8dc82f1b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.402571 Oct 28 13:08:01.097676 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 795/1566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:00 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:01.097676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:01.098979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:01.098979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:01.098979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:01.098979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:01.099488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:01.099488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:01.099488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:01.199564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:01.199564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:01.200114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:01.203381 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a896f550-eb46-4f31-8c2e-0c15d3f5010c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1531 microversion: 2.91 time: 0.158710 Oct 28 13:08:01.206427 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 796/1567] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:01 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1531 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:01.344452 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-03644a59-f887-4873-bed0-71f00753bd81 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.067321 Oct 28 13:08:01.366648 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 772/1568] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:07:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:08:01.385493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2978928c-2151-4a6c-9db0-3784eae7ca60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:01.386163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2978928c-2151-4a6c-9db0-3784eae7ca60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:01.548842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:01.549774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:01.565231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:01.566013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:01.566551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:01.567882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:01.568915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:01.570443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:01.726998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lazy-loading 'services' on Instance uuid 604dad7e-a573-4bc6-b434-0ebe71a36c86 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:08:01.816289 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c909983f-d6fb-4e5e-b9db-13eb1a6ba5b5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1936 microversion: 2.91 time: 0.582354 Oct 28 13:08:01.818437 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 797/1569] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:01 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1936 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:08:01.834860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2978928c-2151-4a6c-9db0-3784eae7ca60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:01.845790 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2978928c-2151-4a6c-9db0-3784eae7ca60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1218 microversion: 2.1 time: 0.477929 Oct 28 13:08:01.859128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:01.859128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:01.859801 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 773/1570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:01 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1218 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:01.897164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:01.898410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:01.899432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:01.905745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:01.908789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:01.909492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.069396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:02.076287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:02.089698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lazy-loading 'services' on Instance uuid 604dad7e-a573-4bc6-b434-0ebe71a36c86 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:08:02.105843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:02.106375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:02.106888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.120584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:02.141740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:02.141740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.153989 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6bbed105-d7c2-43bd-a1b2-e3e493bb21d9 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1936 microversion: 2.91 time: 0.309782 Oct 28 13:08:02.159208 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 798/1571] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:01 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1936 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:02.191324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:02.198564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:02.199467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:02.202544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.203699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:02.206815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:02.209125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.283007 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c59859f0-0ed3-4ee3-8d57-9bffb80e077b tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.094878 Oct 28 13:08:02.288408 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 799/1572] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Oct 28 13:08:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:08:02.328904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-63ab95a5-4249-4ad7-9ae0-8c8b5ab853c5 req-6c2b84a4-e6be-4f60-b40b-5351217176f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba1c3df-c727-4cdd-b65a-bfe984620b9a", "name": "network-vif-deleted", "tag": "612a149a-9dba-4d19-8b87-7ef164f8e1a6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:02.353735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63ab95a5-4249-4ad7-9ae0-8c8b5ab853c5 req-6c2b84a4-e6be-4f60-b40b-5351217176f8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:02.356350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63ab95a5-4249-4ad7-9ae0-8c8b5ab853c5 req-6c2b84a4-e6be-4f60-b40b-5351217176f8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:02.356350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63ab95a5-4249-4ad7-9ae0-8c8b5ab853c5 req-6c2b84a4-e6be-4f60-b40b-5351217176f8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.390251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-63ab95a5-4249-4ad7-9ae0-8c8b5ab853c5 req-6c2b84a4-e6be-4f60-b40b-5351217176f8 service nova] Creating event network-vif-deleted:612a149a-9dba-4d19-8b87-7ef164f8e1a6 for instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a on n-h1-862876-2 Oct 28 13:08:02.407041 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-63ab95a5-4249-4ad7-9ae0-8c8b5ab853c5 req-6c2b84a4-e6be-4f60-b40b-5351217176f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114119 Oct 28 13:08:02.410214 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 800/1573] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:02.431082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:02.431188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:02.438533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:02.439099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:02.439795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.440529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:02.440994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:02.441479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:02.479427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lazy-loading 'flavor' on Instance uuid 604dad7e-a573-4bc6-b434-0ebe71a36c86 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:08:02.674411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:02.687353 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abedeb93-92f1-4a1b-8e01-32d1a8a3f9df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.624899 Oct 28 13:08:02.689360 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 774/1574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:02 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:02.876309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8353e042-4e3c-4ec1-9cee-afcfbb466a79 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:02.881165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8353e042-4e3c-4ec1-9cee-afcfbb466a79 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:02.968730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8353e042-4e3c-4ec1-9cee-afcfbb466a79 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:02.979091 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8353e042-4e3c-4ec1-9cee-afcfbb466a79 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1218 microversion: 2.1 time: 0.112844 Oct 28 13:08:02.994207 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 775/1575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:02 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:03.132969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:03.373491 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4d012b7e-2b0c-4a26-8673-3d1dc65fd1f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action" status: 202 len: 0 microversion: 2.91 time: 0.959564 Oct 28 13:08:03.389987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:03.389987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:03.391698 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 801/1576] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:08:02 2022] POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:08:03.396270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:03.397960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:03.398812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:03.399946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:03.400766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:03.401475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:03.510092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:03.521982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:03.523983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:03.530695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dadf9fd1-8b35-4465-8c4d-b5ee78c35f7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.150027 Oct 28 13:08:03.547872 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 776/1577] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:03 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:03.726014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:03.728370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:03.751923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:03.753815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:03.754625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:03.772031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:03.773222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:03.776970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:04.015638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:04.015638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:04.028903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:04.029742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:04.030738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:04.033020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:04.033683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:04.034537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:04.206880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:04.221317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0961966e-1dcb-40a4-974c-18d31ff73d50 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.509568 Oct 28 13:08:04.221906 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 802/1578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:03 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:04.319271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:04.330457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f84d058-ed35-47b7-a7a4-b1d86e7cd116 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1270 microversion: 2.1 time: 0.321620 Oct 28 13:08:04.343115 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 777/1579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:04 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1270 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:04.562651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:04.563546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:04.582186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:04.585841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:04.586469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:04.588912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:04.592424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:04.595188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:04.769300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-006c73d3-be24-424d-a8c8-ca84dd6c8a29 req-eff16c3e-3a9f-4797-a538-6b1d367ba77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16778c76-17c6-4a4a-bace-f54b6f7f4837", "tag": "315bda66-3f17-4ca5-9705-6dc6a59b5b67"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:04.787043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-006c73d3-be24-424d-a8c8-ca84dd6c8a29 req-eff16c3e-3a9f-4797-a538-6b1d367ba77e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:04.787494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-006c73d3-be24-424d-a8c8-ca84dd6c8a29 req-eff16c3e-3a9f-4797-a538-6b1d367ba77e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:04.787929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-006c73d3-be24-424d-a8c8-ca84dd6c8a29 req-eff16c3e-3a9f-4797-a538-6b1d367ba77e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:04.818144 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-006c73d3-be24-424d-a8c8-ca84dd6c8a29 req-eff16c3e-3a9f-4797-a538-6b1d367ba77e service nova] Creating event network-changed:315bda66-3f17-4ca5-9705-6dc6a59b5b67 for instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 on n-h2-862876-2 Oct 28 13:08:04.831567 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-006c73d3-be24-424d-a8c8-ca84dd6c8a29 req-eff16c3e-3a9f-4797-a538-6b1d367ba77e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.537396 Oct 28 13:08:04.832294 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 803/1580] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:08:04.850561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:04.865966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:04.873458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:04.886594 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ad43740-2657-49c2-9596-5683e7fae553 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.327031 Oct 28 13:08:04.887527 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 778/1581] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:04 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:05.253065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:05.253701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:05.269531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:05.270311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:05.272910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:05.274014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:05.278636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:05.279272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:05.355813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:05.356700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:05.378476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:05.382928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:05.383453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:05.385100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:05.385592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:05.386025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:05.570390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:05.579074 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36daf662-ad28-4f52-aaef-254c7d902d0a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1288 microversion: 2.1 time: 0.228158 Oct 28 13:08:05.605756 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 779/1582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:05 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1288 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:05.785161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:05.797259 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-950f0b6d-a2d8-4fb5-85bc-7dcfe00aa504 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.548550 Oct 28 13:08:05.797873 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 804/1583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:05 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:05.924171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:05.925312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:05.938238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:05.939372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:05.943653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:05.944760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:05.945909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:05.950511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:06.130815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:06.156320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:06.160948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:06.177148 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bede1ccd-5496-4d8a-8488-643d4574c19d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.252697 Oct 28 13:08:06.178116 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 780/1584] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:05 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:06.618491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:06.619228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:06.656139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:06.656642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:06.657103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:06.662310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:06.667525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:06.668145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:06.834823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:06.837229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:06.871958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:06.874119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:06.878214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:06.879970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:06.883171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:06.883787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:07.125992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:07.140338 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ead90d0f-4037-4a6f-aa58-2a0ff0765ea8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1276 microversion: 2.1 time: 0.529498 Oct 28 13:08:07.151035 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 805/1585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:06 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1276 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:07.230940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:07.230940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:07.249738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:07.250880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:07.253541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:07.255468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:07.267111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:07.276302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:07.541462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:07.549471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:07.563439 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42872a2d-75e8-461a-ac7c-1655a55cc70b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.741287 Oct 28 13:08:07.564626 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 781/1586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:06 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:07.570218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:07.571793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:07.609727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2990566d-223f-4f9f-9f7e-208ae7339e3b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.405371 Oct 28 13:08:07.623978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 806/1587] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:07 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:08.164785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:08.166722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:08.175760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:08.184886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:08.187714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:08.188712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:08.191070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:08.198965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:08.591643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:08.592567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:08.606622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:08.607389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:08.608135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:08.613000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:08.613741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:08.616866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:08.995098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:09.006951 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a04784f2-ee0a-48b7-9dd7-dc1c2b13b14e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.843638 Oct 28 13:08:09.010759 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 782/1588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:08 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:09.026925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:09.027552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:09.042244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:09.042817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:09.043236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:09.044368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:09.045135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:09.045584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:09.116893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:09.140993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-387bf965-9c8e-4211-ba7a-c422b5911cdc tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.556639 Oct 28 13:08:09.152754 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 807/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:08 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:09.214940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:09.248317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:09.264339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:09.273477 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-add84662-f8b6-4525-be4d-28b6d9a050a5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.260683 Oct 28 13:08:09.275225 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 783/1590] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:09 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:09.896797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1054664247", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "3adfc73c-a3a5-4339-805c-47638b10e19b"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:10.033596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:10.034491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:10.045815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:10.046595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:10.047303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:10.048203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:10.048826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:10.049514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:10.298967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:10.313134 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97c64c66-d911-4b25-8324-7ebc4bceb948 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.283427 Oct 28 13:08:10.328848 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 784/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:10 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:10.339296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:10.340136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:10.358966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:10.359728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:10.368201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:10.368201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:10.368201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:10.368201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:10.398065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:10.680495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:11.035102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:11.042669 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2a9c8dd0-095f-4297-ad23-ae56acbfe676 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.712344 Oct 28 13:08:11.045998 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 785/1592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:10 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:11.057615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:11.058924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:11.073494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:11.074283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:11.075225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:11.076280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:11.076916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:11.077782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:11.252856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:11.268457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:11.273282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:11.285838 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5a3874a-7b65-4374-b888-c6c0153a8564 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.236917 Oct 28 13:08:11.291228 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 786/1593] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:11 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:11.336510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:11.337891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:11.351761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:11.359028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:11.362320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:11.366171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:11.366882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:11.369911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:11.675297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] validate_networks() for [('3adfc73c-a3a5-4339-805c-47638b10e19b', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:08:12.223787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:12.226435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:12.237012 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd6eb029-02e0-48dd-a31e-2aa8daef7273 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.904422 Oct 28 13:08:12.239946 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 787/1594] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:11 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:12.254516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-99327fec-b323-40af-9c4a-cf5ad1384467 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27b94259d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:12.337561 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-99327fec-b323-40af-9c4a-cf5ad1384467 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486" status: 200 len: 636 microversion: 2.1 time: 0.088520 Oct 28 13:08:12.342194 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 788/1595] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:12 2022] GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486 => generated 636 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:12.352497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:12.353503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:12.361854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:12.366836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:12.366836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:12.366836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:12.366836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:12.367293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:12.758274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:12.758274 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-261fb402-5bf5-4dcb-a3bc-42105ed51145 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.412957 Oct 28 13:08:12.763115 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 789/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:12 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:12.770133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:12.771278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:12.777987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:12.780030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:12.780592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:12.781317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:12.788364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:12.788364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:12.788364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:12.796696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:08:12.797775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:08:12.798256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:08:12.798700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:08:12.799144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:08:12.820279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:12.825426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:12.825426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:12.825426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:12.826938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:12.829586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:12.887521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Getting quotas for project 621277d407e04230a72ef00c50195252. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:12.924307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:12.929153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Getting quotas for user 2b83dfecfa84403a9ecd8bddb75916fc and project 621277d407e04230a72ef00c50195252. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:12.975108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:12.977615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:12.982020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:08:12.995189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:12.996732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:13.001256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:08:13.032261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-01f6a5bb-3057-4df1-b37a-f196f0311aab tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.259077 Oct 28 13:08:13.032261 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 790/1597] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:12 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:13.042047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6632a344-e11e-4823-b5a2-20ca7a95d614 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update_all', calling method: .version_select at 0x7f27b9425a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:13.137134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6632a344-e11e-4823-b5a2-20ca7a95d614 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:13.149731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6632a344-e11e-4823-b5a2-20ca7a95d614 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:13.273863 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4dc553f-20b0-44f3-84e1-acd896d348f1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.871022 Oct 28 13:08:13.276031 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 808/1598] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:08:13.304254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8517b5d5-03e9-4cb7-932c-c20b45876136 req-97f39f65-e922-4896-8db6-f7040ba4dfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16778c76-17c6-4a4a-bace-f54b6f7f4837", "name": "network-vif-plugged", "status": "completed", "tag": "315bda66-3f17-4ca5-9705-6dc6a59b5b67"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:13.330444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8517b5d5-03e9-4cb7-932c-c20b45876136 req-97f39f65-e922-4896-8db6-f7040ba4dfdc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:13.331357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8517b5d5-03e9-4cb7-932c-c20b45876136 req-97f39f65-e922-4896-8db6-f7040ba4dfdc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:13.333532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8517b5d5-03e9-4cb7-932c-c20b45876136 req-97f39f65-e922-4896-8db6-f7040ba4dfdc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:13.352417 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8517b5d5-03e9-4cb7-932c-c20b45876136 req-97f39f65-e922-4896-8db6-f7040ba4dfdc service nova] Creating event network-vif-plugged:315bda66-3f17-4ca5-9705-6dc6a59b5b67 for instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 on n-h2-862876-2 Oct 28 13:08:13.360380 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8517b5d5-03e9-4cb7-932c-c20b45876136 req-97f39f65-e922-4896-8db6-f7040ba4dfdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080493 Oct 28 13:08:13.361258 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 809/1599] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:13.372883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9d90091e-5bda-4418-91d6-38e894fa8d80 req-6a2a4311-0bde-4584-b27b-5fa0f5cb341c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d02003-0d62-4f7b-b380-a8297dbd531c", "tag": "b046433f-6722-4055-8dd8-694492622aec"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:13.393377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9d90091e-5bda-4418-91d6-38e894fa8d80 req-6a2a4311-0bde-4584-b27b-5fa0f5cb341c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:13.393863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9d90091e-5bda-4418-91d6-38e894fa8d80 req-6a2a4311-0bde-4584-b27b-5fa0f5cb341c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:13.394291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9d90091e-5bda-4418-91d6-38e894fa8d80 req-6a2a4311-0bde-4584-b27b-5fa0f5cb341c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:13.437747 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9d90091e-5bda-4418-91d6-38e894fa8d80 req-6a2a4311-0bde-4584-b27b-5fa0f5cb341c service nova] Creating event network-changed:b046433f-6722-4055-8dd8-694492622aec for instance 09d02003-0d62-4f7b-b380-a8297dbd531c on n-h1-862876-2 Oct 28 13:08:13.453203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9d90091e-5bda-4418-91d6-38e894fa8d80 req-6a2a4311-0bde-4584-b27b-5fa0f5cb341c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089602 Oct 28 13:08:13.460521 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 810/1600] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:13.482373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:13.483162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:13.500073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:13.502685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:13.508052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:13.519146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:13.519558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:13.520001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:13.525734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:14.071975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:14.086550 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1e60c70f-4c96-4cde-a808-22c10c5fb7dc tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.614853 Oct 28 13:08:14.115648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 811/1601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:13 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:14.133751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4821ac9-eb4d-4c42-afa1-612d01ac1d3d tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:14.134383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4821ac9-eb4d-4c42-afa1-612d01ac1d3d tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:14.179391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6632a344-e11e-4823-b5a2-20ca7a95d614 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 61 microversion: 2.1 time: 1.152237 Oct 28 13:08:14.180629 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 791/1602] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:08:13 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 61 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:14.210861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:14.218069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:14.244309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:14.252887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:14.254635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:14.259683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:14.262884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:14.263677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:14.317278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4821ac9-eb4d-4c42-afa1-612d01ac1d3d tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:14.333722 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4821ac9-eb4d-4c42-afa1-612d01ac1d3d tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1216 microversion: 2.1 time: 0.216779 Oct 28 13:08:14.339227 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 812/1603] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:14 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:14.356522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:14.359982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:14.378521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:14.379764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:14.381050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:14.399354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:14.400414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:14.401064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:14.647539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:14.657662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:14.659098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:14.665784 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-484f8dc1-8c33-4b31-b383-57f58ec2a344 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.322748 Oct 28 13:08:14.666834 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 813/1604] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:14 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:14.671906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-828c40d9-7a4f-451a-a3b5-b362d16ad7cd tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27bda90160>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:14.881653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:14.901350 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27323321-1664-4c50-aa7f-84c0af2d52fa tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1317 microversion: 2.1 time: 0.718039 Oct 28 13:08:14.903227 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 792/1605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:14 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:15.114435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:15.115533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:15.133687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:15.136149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:15.141298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:15.143379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:15.143987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:15.144569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:15.462418 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-828c40d9-7a4f-451a-a3b5-b362d16ad7cd tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "DELETE /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.794503 Oct 28 13:08:15.463930 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 814/1606] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Oct 28 13:08:14 2022] DELETE /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata/os_version => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:08:15.483951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:15.490467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:15.512370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:15.527414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:15.527883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:15.528648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:15.529117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:15.534412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:15.748489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:15.760618 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0278fcf6-dde7-40b3-a796-c6769c072925 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1220 microversion: 2.1 time: 0.295297 Oct 28 13:08:15.761445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 815/1607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:15 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1220 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:15.767025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b7a5397-3005-4c4d-8f82-2a9bdeabacef tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27b94a4790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:15.860432 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b7a5397-3005-4c4d-8f82-2a9bdeabacef tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 37 microversion: 2.1 time: 0.096992 Oct 28 13:08:15.861432 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 816/1608] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:08:15 2022] GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 37 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:15.867837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:15.869188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:15.876555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:15.877254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:15.878724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:15.880911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:15.881536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:15.882323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:16.021707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:16.039064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:16.046884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:16.064661 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fdea856-6b18-488f-9ce8-02e690dd7570 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.201406 Oct 28 13:08:16.067747 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 817/1609] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:15 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:16.073490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20fcd404-7676-4578-afc0-a5d740066747 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update_all', calling method: .version_select at 0x7f27bda90f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:16.179668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:16.189071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-803c0869-2e87-4a17-9e1c-3a1e6faca950 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 1.079528 Oct 28 13:08:16.192714 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 793/1610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:15 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:16.201743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:16.205443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:16.235129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:16.235753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-20fcd404-7676-4578-afc0-a5d740066747 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:16.237946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:16.239830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:16.242089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:16.243510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:16.245354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:16.252733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-20fcd404-7676-4578-afc0-a5d740066747 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:16.697375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:16.706856 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41556fb3-110b-450a-b985-e199da536b1f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1467 microversion: 2.1 time: 0.512800 Oct 28 13:08:16.709402 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 794/1611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:16 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1467 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:16.737920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-956900632", "metadata": {"image_type": "test"}}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:16.743858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:16.793365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:16.803264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:16.803264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:16.803264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:16.803264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:16.803722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:16.872527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Getting quotas for project 75778e6d89f94db58b139d1c9824675c. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:16.878327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Getting quotas for user 7c30b88de36c4240b553ecb339831a28 and project 75778e6d89f94db58b139d1c9824675c. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:17.036044 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20fcd404-7676-4578-afc0-a5d740066747 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 61 microversion: 2.1 time: 0.967004 Oct 28 13:08:17.036796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 818/1612] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:08:16 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 61 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:17.044060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:17.045708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:17.059510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:17.060722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:17.061310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:17.062261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:17.063220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:17.063882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:17.190025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:17.201069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1a06cdbd-adb2-403b-8ff8-a6bd41a0b964 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1268 microversion: 2.1 time: 0.162986 Oct 28 13:08:17.207470 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 819/1613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:17 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:17.221582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2712baa3-323c-439b-908f-755d14f0b45c tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27bda51d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:17.315240 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2712baa3-323c-439b-908f-755d14f0b45c tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.110485 Oct 28 13:08:17.317022 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 820/1614] 10.222.0.25 () {58 vars in 1290 bytes} [Fri Oct 28 13:08:17 2022] GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata/os_distro => generated 33 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:17.326283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:17.327978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:17.347656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:17.348401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:17.349333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:17.350614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:17.351269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:17.351925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:17.553699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:17.569355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:17.570642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:17.595995 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c7c82c26-280c-46a6-a0b6-bb676af45b8d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.277050 Oct 28 13:08:17.596608 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 821/1615] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:17 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:17.674478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7754712-e6e1-47e4-9a4b-af156931b0d2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "POST /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837/action" status: 202 len: 0 microversion: 2.1 time: 0.942258 Oct 28 13:08:17.681539 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 795/1616] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:08:16 2022] POST /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837/action => generated 0 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:08:17.687736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:17.689161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:17.696827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:17.697575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:17.699293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:17.715659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:17.716924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:17.717786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:17.782398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1711091687", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "87fa62cb-bfb2-4330-ab92-44ac56e4f002"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:17.932632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] validate_networks() for [('87fa62cb-bfb2-4330-ab92-44ac56e4f002', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:08:18.107679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:18.122556 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7831dbc0-8f57-47b5-b109-faaccec2b3e2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.436504 Oct 28 13:08:18.143991 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 796/1617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:17 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:18.155475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83bb363e-fb1d-4c72-ac30-a6af9b5789f9 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update_all', calling method: .version_select at 0x7f27b94188b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:18.238604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-83bb363e-fb1d-4c72-ac30-a6af9b5789f9 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:18.251005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-83bb363e-fb1d-4c72-ac30-a6af9b5789f9 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:18.597220 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83bb363e-fb1d-4c72-ac30-a6af9b5789f9 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 61 microversion: 2.1 time: 0.451851 Oct 28 13:08:18.597868 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 797/1618] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:08:18 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 61 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:18.603573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57ec4484-0b75-4160-8ba4-253e7998ae2c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93f40d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:18.693992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57ec4484-0b75-4160-8ba4-253e7998ae2c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.094738 Oct 28 13:08:18.705190 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 798/1619] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:18 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:18.720155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:18.722196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:18.748850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:18.749362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:18.751268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:18.752749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:18.753235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:18.753678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:18.892428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:18.929885 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-485c7ce4-dd9b-46cb-a45d-eeb36738fffd tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1274 microversion: 2.1 time: 0.211416 Oct 28 13:08:18.950716 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 799/1620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:18 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:18.958235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91efd145-7d0c-4c7b-b66f-25e71ac23662 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27b95de670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:19.022292 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91efd145-7d0c-4c7b-b66f-25e71ac23662 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 61 microversion: 2.1 time: 0.075104 Oct 28 13:08:19.023574 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 800/1621] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:08:18 2022] GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 61 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:19.032069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:19.033980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:19.063656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:19.067756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:19.068558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:19.070059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:19.072429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:19.073729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:19.158966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:19.168611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:19.171607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:19.179207 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fef13406-5122-4bc6-9dcc-52cd75ae9135 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.153662 Oct 28 13:08:19.181338 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 801/1622] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:19 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:19.185359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e3b8f44-29c2-465d-ba15-3273df6aeaa6 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update_all', calling method: .version_select at 0x7f27b945db80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:19.250245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-8e3b8f44-29c2-465d-ba15-3273df6aeaa6 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:19.260309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-8e3b8f44-29c2-465d-ba15-3273df6aeaa6 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:19.685597 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e3b8f44-29c2-465d-ba15-3273df6aeaa6 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 61 microversion: 2.1 time: 0.293914 Oct 28 13:08:19.685597 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 802/1623] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:08:19 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 61 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:19.685597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:19.685597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:19.685597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:19.688957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:19.688957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:19.688957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:19.688957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:19.689745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:19.690257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:08:19.690257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:08:19.690257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:08:19.690257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:08:19.690257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:08:19.692053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:19.692053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:19.692053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:19.692053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:19.692896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:19.692896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:19.709256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Getting quotas for project 04f583781861469ca6a49de0f85673ce. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:19.735548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Getting quotas for user 4a235c2bf166411ab1d5eaf92f73e3ec and project 04f583781861469ca6a49de0f85673ce. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:19.743985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:19.754114 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97e40e69-4337-47ca-bd18-2cbba2bbbf10 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.275519 Oct 28 13:08:19.771150 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 803/1624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:19 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:19.777369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78ada6c7-da5d-4325-b3c9-6fb30e3289ad tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update_all', calling method: .version_select at 0x7f27b9494280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:19.783782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:08:19.786981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:08:19.885343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-78ada6c7-da5d-4325-b3c9-6fb30e3289ad tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:19.892469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-78ada6c7-da5d-4325-b3c9-6fb30e3289ad tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:20.032384 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4ee351f-3043-4c02-8ac8-77db9a355a27 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418175 Oct 28 13:08:20.033159 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 822/1625] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:08:20.073674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0b0e02dc-c373-4590-ad39-34d337b89507 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdabe670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:20.390362 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0b0e02dc-c373-4590-ad39-34d337b89507 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.341438 Oct 28 13:08:20.391301 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 823/1626] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:20 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:20.396749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:20.397878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:20.423172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:20.427322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:20.428791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:20.429565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:20.431027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:20.432292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:20.652994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:20.666379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea799f99-f469-48f4-9725-322840a34425 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1316 microversion: 2.1 time: 0.273995 Oct 28 13:08:20.682211 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 824/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:20 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:20.687368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dfda379c-41c0-4621-a216-e6843c513895 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:20.688521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfda379c-41c0-4621-a216-e6843c513895 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:20.792673 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-78ada6c7-da5d-4325-b3c9-6fb30e3289ad tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 64 microversion: 2.1 time: 1.019504 Oct 28 13:08:20.793672 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 804/1628] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:08:19 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 64 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:20.803506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:20.804585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:20.813505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:20.814217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:20.815396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:20.816631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:20.817335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:20.818598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:20.855610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dfda379c-41c0-4621-a216-e6843c513895 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:20.865789 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dfda379c-41c0-4621-a216-e6843c513895 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1217 microversion: 2.1 time: 0.182072 Oct 28 13:08:20.886207 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 825/1629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:20 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:20.898113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:20.901432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:20.942012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:20.949610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:20.950130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:20.955454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:20.956306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:20.956975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:21.073619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:21.073619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:21.074409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:21.079245 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ecc0f2b-2d3f-4cf3-b459-078ab04a1a25 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.284112 Oct 28 13:08:21.092766 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 805/1630] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:20 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:21.121256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6bc07b67-8d4e-43b6-b795-59e0294028a2 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27b945d940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:21.190105 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6bc07b67-8d4e-43b6-b795-59e0294028a2 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 64 microversion: 2.1 time: 0.080480 Oct 28 13:08:21.190105 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 806/1631] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:08:21 2022] GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 64 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:21.202223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef53cc09-4a13-49af-bc8e-92795fd12ce2 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update_all', calling method: .version_select at 0x7f27b93d4550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:21.269475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-ef53cc09-4a13-49af-bc8e-92795fd12ce2 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:21.280753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-ef53cc09-4a13-49af-bc8e-92795fd12ce2 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:21.493196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:21.511929 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d0cc24a-937d-47d9-ae98-447b1bf5a1b2 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.624249 Oct 28 13:08:21.513129 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 826/1632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:20 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:21.533880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3deb5df-fb04-44d4-898b-6cc5d42dede3 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdadb310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:21.623767 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3deb5df-fb04-44d4-898b-6cc5d42dede3 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.108568 Oct 28 13:08:21.624474 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 827/1633] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:21 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:21.689770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:21.690491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:21.698509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:21.709828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:21.710485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:21.711864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:21.714177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:21.715089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:21.989489 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef53cc09-4a13-49af-bc8e-92795fd12ce2 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 61 microversion: 2.1 time: 0.794976 Oct 28 13:08:21.990520 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 807/1634] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:08:21 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 61 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:21.995405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97f6bb57-7241-41c4-82e3-a1b1d5b00a70 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:21.999101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97f6bb57-7241-41c4-82e3-a1b1d5b00a70 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:22.227659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97f6bb57-7241-41c4-82e3-a1b1d5b00a70 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:22.245259 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97f6bb57-7241-41c4-82e3-a1b1d5b00a70 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1217 microversion: 2.1 time: 0.246793 Oct 28 13:08:22.247107 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 808/1635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:21 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:22.267553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce1c86e0-2711-49a3-a915-717420bfe742 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update', calling method: .version_select at 0x7f27b93b9dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:22.288949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:22.297570 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c75b8053-d21d-47dd-8272-818b096e5ac5 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1316 microversion: 2.1 time: 0.611762 Oct 28 13:08:22.300240 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 828/1636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:21 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:22.326135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:22.326836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:22.346108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:22.351025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:22.351608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:22.356682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:22.356682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:22.356682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:22.387785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-ce1c86e0-2711-49a3-a915-717420bfe742 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:22.421550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-ce1c86e0-2711-49a3-a915-717420bfe742 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:22.548245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:22.555693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:22.557156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:22.571790 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e553c6bb-3ad0-496d-842b-112064b95539 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.270446 Oct 28 13:08:22.572415 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 829/1637] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:22 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:22.587094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:22.587608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:22.608520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:22.609884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:22.611233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:22.613078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:22.615332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:22.617211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:22.891214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:22.901358 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4702bc24-b719-4abc-931c-d622f2351800 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.327871 Oct 28 13:08:22.902242 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 830/1638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:22 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:22.908178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76e75ac1-52f6-41d2-8091-b9f924b2e0e0 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bda515e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:23.102901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce1c86e0-2711-49a3-a915-717420bfe742 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.850637 Oct 28 13:08:23.102901 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 809/1639] 10.222.0.25 () {60 vars in 1313 bytes} [Fri Oct 28 13:08:22 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata/os_version => generated 31 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:23.111384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b6594bc2-dc36-4556-9647-fa03d61d3134 req-90e205d2-842f-4522-a447-4f7349725b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303fca24-8137-417f-b7eb-634050170311", "tag": "daa368d4-fe11-42a0-a1bd-6fb7802d3ed5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:23.133213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b6594bc2-dc36-4556-9647-fa03d61d3134 req-90e205d2-842f-4522-a447-4f7349725b70 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:23.134019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b6594bc2-dc36-4556-9647-fa03d61d3134 req-90e205d2-842f-4522-a447-4f7349725b70 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:23.134462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b6594bc2-dc36-4556-9647-fa03d61d3134 req-90e205d2-842f-4522-a447-4f7349725b70 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:23.148853 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b6594bc2-dc36-4556-9647-fa03d61d3134 req-90e205d2-842f-4522-a447-4f7349725b70 service nova] Creating event network-changed:daa368d4-fe11-42a0-a1bd-6fb7802d3ed5 for instance 303fca24-8137-417f-b7eb-634050170311 on n-h2-862876-2 Oct 28 13:08:23.154799 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b6594bc2-dc36-4556-9647-fa03d61d3134 req-90e205d2-842f-4522-a447-4f7349725b70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047265 Oct 28 13:08:23.155687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 810/1640] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:23.163178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-999db252-4ddb-4fef-9aa5-6fee39551613 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27b9425c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:23.384459 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76e75ac1-52f6-41d2-8091-b9f924b2e0e0 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.480772 Oct 28 13:08:23.385044 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 831/1641] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:22 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:23.398232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:23.398232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:23.430061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:23.437978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:23.437978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:23.437978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:23.441569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:23.442036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:23.474181 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-999db252-4ddb-4fef-9aa5-6fee39551613 tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 58 microversion: 2.1 time: 0.316268 Oct 28 13:08:23.480250 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 811/1642] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:08:23 2022] GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 58 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:23.487763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:23.490176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:23.518306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:23.519455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:23.521649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:23.522500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:23.523081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:23.524170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:23.561742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:23.774093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:23.802079 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e91672c2-a62e-4333-ac21-a62a5d3f00df tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1221 microversion: 2.1 time: 0.399684 Oct 28 13:08:23.802079 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 832/1643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:23 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1221 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:23.807973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54b7a342-a8ad-45e7-8dca-5d8e59ed64ed tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'update_all', calling method: .version_select at 0x7f27bda719d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:23.863216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:23.883366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-13322d30-fbea-4aee-a61e-fc2a04597620 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1316 microversion: 2.1 time: 0.406038 Oct 28 13:08:23.886359 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 812/1644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:23 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:23.894651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:23.898265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:23.914857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:23.915848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:23.916993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:23.919355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:23.922591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:23.923385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:23.928692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-54b7a342-a8ad-45e7-8dca-5d8e59ed64ed tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:23.954611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-54b7a342-a8ad-45e7-8dca-5d8e59ed64ed tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:24.202044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:24.215890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:24.217677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:24.229347 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-025ea2b3-a97e-4ce6-8ebf-775dccfa9294 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.341517 Oct 28 13:08:24.252472 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 813/1645] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:23 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:24.260329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:24.261633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:24.269903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:24.274543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:24.274543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:24.274543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:24.274543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:24.275159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:24.484691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:24.493695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f437e9d-96ff-4f1f-9c10-56085bd5d159 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.239972 Oct 28 13:08:24.495571 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 814/1646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:24 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:24.503228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08f1fa0f-4474-4696-97df-805eccf7c9ef tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b94289d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:24.612558 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54b7a342-a8ad-45e7-8dca-5d8e59ed64ed tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 61 microversion: 2.1 time: 0.820505 Oct 28 13:08:24.618848 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 833/1647] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:08:23 2022] PUT /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 61 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:24.638691 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08f1fa0f-4474-4696-97df-805eccf7c9ef tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.141015 Oct 28 13:08:24.640039 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 815/1648] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:24 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:24.646454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-40187478-fa6f-455f-800b-ced5f814898c tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Action: 'create', calling method: .version_select at 0x7f27b95de8b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:24.722153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-40187478-fa6f-455f-800b-ced5f814898c tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:24.727753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ded71923-9142-46ac-936d-47a01bf6ab5c tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Action: 'create', calling method: .version_select at 0x7f27bda71b80>, body: {"pool": null} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:24.745406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-40187478-fa6f-455f-800b-ced5f814898c tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Getting quotas for user 4474df5958a0423d913f63596c44624f and project b7737d7b3a3748e1aa983d8388622829. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:24.753924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:25.550092 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-40187478-fa6f-455f-800b-ced5f814898c tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "POST /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 85 microversion: 2.1 time: 0.908419 Oct 28 13:08:25.551644 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 816/1649] 10.222.0.25 () {60 vars in 1281 bytes} [Fri Oct 28 13:08:24 2022] POST /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 85 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:25.557028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:25.558563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:25.587485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:25.601560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:25.602432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:25.603419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:25.608333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:25.609072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:25.882997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:25.893397 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6dfdf554-5170-4ce4-874e-ba9d65887e8c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1277 microversion: 2.1 time: 0.340390 Oct 28 13:08:25.894293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 817/1650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:25 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1277 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:25.915887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:25.918301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:25.943927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:25.944436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:25.944882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:25.945612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:25.946200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:25.946505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:26.330129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:26.344428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-64b2644b-a679-48b7-961a-75d9f64464b1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1316 microversion: 2.1 time: 0.449122 Oct 28 13:08:26.355695 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 818/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:25 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:26.371623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f0f59194-82af-4860-a4ed-408b172e0a7d req-e01baea0-b9c5-4e32-80e3-9ceac27a53e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16778c76-17c6-4a4a-bace-f54b6f7f4837", "name": "network-vif-plugged", "status": "completed", "tag": "315bda66-3f17-4ca5-9705-6dc6a59b5b67"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:26.439077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f0f59194-82af-4860-a4ed-408b172e0a7d req-e01baea0-b9c5-4e32-80e3-9ceac27a53e7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:26.440484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f0f59194-82af-4860-a4ed-408b172e0a7d req-e01baea0-b9c5-4e32-80e3-9ceac27a53e7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:26.443302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f0f59194-82af-4860-a4ed-408b172e0a7d req-e01baea0-b9c5-4e32-80e3-9ceac27a53e7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:26.487338 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f0f59194-82af-4860-a4ed-408b172e0a7d req-e01baea0-b9c5-4e32-80e3-9ceac27a53e7 service nova] Creating event network-vif-plugged:315bda66-3f17-4ca5-9705-6dc6a59b5b67 for instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 on n-h2-862876-2 Oct 28 13:08:26.513333 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f0f59194-82af-4860-a4ed-408b172e0a7d req-e01baea0-b9c5-4e32-80e3-9ceac27a53e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154476 Oct 28 13:08:26.514570 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 819/1652] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:26.530739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:26.538585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:26.554502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:26.556754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:26.557445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:26.558556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:26.559263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:26.563520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:26.739669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:26.756631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:26.759290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:26.777913 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-72b5e8ba-6290-41f4-a5e3-421932726b54 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.260426 Oct 28 13:08:26.778546 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 820/1653] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:26 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:26.793400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:26.796503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:26.838395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:26.839054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:26.839526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:26.841916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:26.842392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:26.842854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:27.857780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:27.872833 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97afa7b0-56c9-4f68-8582-422becd98cf4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 1.087244 Oct 28 13:08:27.873818 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 821/1654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:26 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:27.890597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f577ff0-7749-435f-87e1-77dcd453c81d tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] Calling method '.version_select at 0x7f27b93d41f0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:27.959268 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f577ff0-7749-435f-87e1-77dcd453c81d tempest-ImagesMetadataTestJSON-1386353131 tempest-ImagesMetadataTestJSON-1386353131-project] 10.222.0.25 "GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata" status: 200 len: 85 microversion: 2.1 time: 0.080472 Oct 28 13:08:27.965824 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 822/1655] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:08:27 2022] GET /compute/v2.1/images/eb3fba57-8eb9-4480-a010-8cf7c0703486/metadata => generated 85 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:08:27.974097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae50f2fb-a542-4239-98ab-f90b329b137c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93860d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:28.742732 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ded71923-9142-46ac-936d-47a01bf6ab5c tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.122139 Oct 28 13:08:28.746409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 834/1656] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:08:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:28.752629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:28.753590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:28.770882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:28.771498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:28.771995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:28.772797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:28.773691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:28.773841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.029964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:29.038296 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2079e974-881b-4534-9a5a-55cf683eecc9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.290409 Oct 28 13:08:29.043656 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 835/1657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:28 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:29.050151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:29.050993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:29.059909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:29.060701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:29.061523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.062460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:29.063277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:29.063939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.247014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:29.263035 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-532b9d8a-183e-43b4-b343-2f8201086aa0 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1316 microversion: 2.1 time: 0.215946 Oct 28 13:08:29.265493 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 836/1658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:29 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:29.296922 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ae50f2fb-a542-4239-98ab-f90b329b137c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 1.329363 Oct 28 13:08:29.300635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:29.301869 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 823/1659] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:27 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:29.302774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:29.309861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-43ad4803-0155-4704-b35a-11f5e92335b4 req-ab64bdce-be70-460b-8d86-c7a91963c39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d02003-0d62-4f7b-b380-a8297dbd531c", "name": "network-vif-plugged", "status": "completed", "tag": "b046433f-6722-4055-8dd8-694492622aec"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:29.318648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:29.319508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:29.320323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.324327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:29.324327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:29.325097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.341051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43ad4803-0155-4704-b35a-11f5e92335b4 req-ab64bdce-be70-460b-8d86-c7a91963c39c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:29.341550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43ad4803-0155-4704-b35a-11f5e92335b4 req-ab64bdce-be70-460b-8d86-c7a91963c39c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:29.341986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43ad4803-0155-4704-b35a-11f5e92335b4 req-ab64bdce-be70-460b-8d86-c7a91963c39c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.382232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-43ad4803-0155-4704-b35a-11f5e92335b4 req-ab64bdce-be70-460b-8d86-c7a91963c39c service nova] Creating event network-vif-plugged:b046433f-6722-4055-8dd8-694492622aec for instance 09d02003-0d62-4f7b-b380-a8297dbd531c on n-h1-862876-2 Oct 28 13:08:29.387699 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-43ad4803-0155-4704-b35a-11f5e92335b4 req-ab64bdce-be70-460b-8d86-c7a91963c39c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084383 Oct 28 13:08:29.391678 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 824/1660] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:29.397344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2357227-d3ad-46ca-bf1d-4a95f1b023ed tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Calling method '.version_select at 0x7f27b9425f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:29.525701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:29.560811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:29.562265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:29.571618 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9511324e-9799-4a55-9f22-319b2f28aa6a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.303206 Oct 28 13:08:29.572887 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 837/1661] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:29 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:29.578731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:29.585839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:29.587474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:29.588142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:29.588800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.589678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:29.590292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:29.591215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:29.647607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:29.898327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:29.913112 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-af5f3849-aff7-4661-bc36-243ae416ee00 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1318 microversion: 2.1 time: 0.338177 Oct 28 13:08:29.915076 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 838/1662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:29 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:30.088288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:30.088878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:30.103867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:30.110867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:30.110867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:30.110867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:30.110867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:30.111261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:30.160607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:30.222801 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2357227-d3ad-46ca-bf1d-4a95f1b023ed tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/79129cf0-924a-42cf-92af-b21d6ace5422" status: 200 len: 142 microversion: 2.1 time: 0.829776 Oct 28 13:08:30.223926 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 825/1663] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:08:29 2022] GET /compute/v2.1/os-floating-ips/79129cf0-924a-42cf-92af-b21d6ace5422 => generated 142 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:30.237339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d39420fa-e9fd-443b-85e9-6821b8861ac6 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Calling method '.version_select at 0x7f27b93d4040>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:30.543186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:30.551920 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-31f12889-2f60-41a9-a7d9-a7cec2554e74 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.489747 Oct 28 13:08:30.569736 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 839/1664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:30 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:30.591243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:30.592501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:30.608541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:30.609558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:30.610190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:30.612288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:30.612979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:30.613413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:30.733331 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d39420fa-e9fd-443b-85e9-6821b8861ac6 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.499858 Oct 28 13:08:30.734512 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 826/1665] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:08:30 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:30.739958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e46a3512-b45c-4559-a0d3-463d440c5436 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93ec700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:30.810994 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e46a3512-b45c-4559-a0d3-463d440c5436 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.074950 Oct 28 13:08:30.811927 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 827/1666] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:30 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:30.829422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:30.830638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:30.837294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:30.839119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:30.840890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:30.841576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:30.842556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:30.848975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:30.849280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:30.849909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82a4bfc0-ae7a-4b1c-a64c-4b6ea56f3053 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1316 microversion: 2.1 time: 0.277563 Oct 28 13:08:30.859306 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 840/1667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:30 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:30.873342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e65e091a-4d31-47e3-8156-d3dbba419006 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Calling method '.version_select at 0x7f27bda2e940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:31.041453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:31.089472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:31.102471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:31.126308 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cccaf652-cd6a-4de8-babd-f679c754c217 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.310633 Oct 28 13:08:31.147208 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 828/1668] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:30 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:31.218410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b45c64f6-b98a-4d62-9767-15778c9edf57 req-c1905a3d-f3fd-4b88-9423-c546b0a61f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3", "tag": "a93f211e-7e42-4366-b982-2ac415c2e826"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:31.218410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b45c64f6-b98a-4d62-9767-15778c9edf57 req-c1905a3d-f3fd-4b88-9423-c546b0a61f5a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:31.218410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b45c64f6-b98a-4d62-9767-15778c9edf57 req-c1905a3d-f3fd-4b88-9423-c546b0a61f5a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:31.218410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b45c64f6-b98a-4d62-9767-15778c9edf57 req-c1905a3d-f3fd-4b88-9423-c546b0a61f5a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:31.219258 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b45c64f6-b98a-4d62-9767-15778c9edf57 req-c1905a3d-f3fd-4b88-9423-c546b0a61f5a service nova] Creating event network-changed:a93f211e-7e42-4366-b982-2ac415c2e826 for instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 on n-h1-862876-2 Oct 28 13:08:31.219258 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b45c64f6-b98a-4d62-9767-15778c9edf57 req-c1905a3d-f3fd-4b88-9423-c546b0a61f5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035948 Oct 28 13:08:31.219258 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 829/1669] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:31.219258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:31.219258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:31.219968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:31.219968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:31.219968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:31.219968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:31.220385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:31.220385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:31.526299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:31.526299 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf4c47a3-9fbf-461c-9d25-65e82f444ca5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1509 microversion: 2.1 time: 0.326511 Oct 28 13:08:31.526299 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 830/1670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:31 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:31.526642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9e0ec209-f405-48c7-bedd-b173ffa26983 req-168fdd84-aa42-4df2-89ea-d1865acab5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303fca24-8137-417f-b7eb-634050170311", "name": "network-vif-plugged", "status": "completed", "tag": "daa368d4-fe11-42a0-a1bd-6fb7802d3ed5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:31.552255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9e0ec209-f405-48c7-bedd-b173ffa26983 req-168fdd84-aa42-4df2-89ea-d1865acab5ae service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:31.554229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9e0ec209-f405-48c7-bedd-b173ffa26983 req-168fdd84-aa42-4df2-89ea-d1865acab5ae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:31.555368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9e0ec209-f405-48c7-bedd-b173ffa26983 req-168fdd84-aa42-4df2-89ea-d1865acab5ae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:31.572432 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9e0ec209-f405-48c7-bedd-b173ffa26983 req-168fdd84-aa42-4df2-89ea-d1865acab5ae service nova] Creating event network-vif-plugged:daa368d4-fe11-42a0-a1bd-6fb7802d3ed5 for instance 303fca24-8137-417f-b7eb-634050170311 on n-h2-862876-2 Oct 28 13:08:31.577831 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9e0ec209-f405-48c7-bedd-b173ffa26983 req-168fdd84-aa42-4df2-89ea-d1865acab5ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061207 Oct 28 13:08:31.579099 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 831/1671] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:31.585892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:31.587030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:31.593833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:31.594596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:31.595246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:31.596144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:31.596773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:31.597366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.068243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:32.106854 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-049e9037-df09-4890-95ac-2097c6c5c27d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1509 microversion: 2.1 time: 0.505366 Oct 28 13:08:32.106854 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 832/1672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:31 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1509 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:32.110661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:32.115652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:32.137456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.142349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.143462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.146592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.147161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.147608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.176247 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e65e091a-4d31-47e3-8156-d3dbba419006 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/79129cf0-924a-42cf-92af-b21d6ace5422" status: 202 len: 0 microversion: 2.1 time: 1.314763 Oct 28 13:08:32.177869 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 841/1673] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:08:30 2022] DELETE /compute/v2.1/os-floating-ips/79129cf0-924a-42cf-92af-b21d6ace5422 => generated 0 bytes in 1317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:08:32.182661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e34d4ec3-5d00-4cc2-a9ef-6b38454aa6b4 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bda519d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:32.263461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e34d4ec3-5d00-4cc2-a9ef-6b38454aa6b4 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.083725 Oct 28 13:08:32.264354 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 842/1674] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:32 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:32.278217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:32.278781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:32.281795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:32.286364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.287064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.287689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.288580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.289205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.289796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.371664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:32.387770 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a04f64cb-8c8a-4f25-9b2b-c09fbefed523 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.274798 Oct 28 13:08:32.408073 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 833/1675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:32 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:32.422968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:32.425929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:32.435900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.436392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.441292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.442573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.447426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.447876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.724698 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-088d14ea-494f-4eb0-9f5a-4acd88a8b135 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "PUT /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1081 microversion: 2.1 time: 0.315330 Oct 28 13:08:32.730826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 834/1676] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:08:32 2022] PUT /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1081 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:32.760048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:32.761585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:32.777987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.778784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.779404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.782097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:32.783316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:32.783948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:32.899989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:32.914155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:32.916124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:32.930927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c154847-b308-4666-85eb-36cbe7b73f93 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.198621 Oct 28 13:08:32.934408 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 835/1677] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:32 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:32.939375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69d0316d-e7b2-4410-bede-92eebcf9bdbd tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Action: 'create', calling method: .version_select at 0x7f27b9386700>, body: {"pool": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:32.975699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:32.991256 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-04f7b15b-e338-4618-8a6f-c709d4e50603 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1316 microversion: 2.1 time: 0.715485 Oct 28 13:08:32.991399 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 843/1678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:32 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:32.996260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:32.997194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:33.003380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.004187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.005624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:33.006582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.007329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.008121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:33.203844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:33.216459 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73a9d028-f174-43e8-98f4-3ebae91e465a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1507 microversion: 2.1 time: 0.223730 Oct 28 13:08:33.217464 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 844/1679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:32 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:33.251568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:33.252448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:33.265487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.266079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.266732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:33.267487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.271310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.271775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:33.569085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:33.578763 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46ca8800-1325-4542-a5a1-60cfbde8848a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1507 microversion: 2.1 time: 0.338580 Oct 28 13:08:33.598278 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 845/1680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:33 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:33.608129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c628587d-f481-4a20-9e60-1b5fc9046bf5 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bda71790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:33.684490 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c628587d-f481-4a20-9e60-1b5fc9046bf5 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.084475 Oct 28 13:08:33.685984 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 846/1681] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:33 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:33.691192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:33.692681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:33.700367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.701363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.702015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:33.704548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.705611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.706278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:33.939678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:33.952413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a295781-ecb8-4905-8a2b-2aaf4b76b140 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.265106 Oct 28 13:08:33.954082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 847/1682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:33 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:33.960787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:33.966886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:33.983595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=24 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:33.986983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.988556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.989763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:33.991775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:33.992867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:33.997337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:34.190647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:08:34.202480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:08:34.202480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:08:34.202480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:08:34.202480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:08:34.763929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=30 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:34.945446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:34.953632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:34.954520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:34.955150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:34.956197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:34.956813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:34.957429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:34.991812 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e6591f8c-1104-43d6-92f7-3b37e09f2bdd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "POST /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c/action" status: 202 len: 1113 microversion: 2.1 time: 1.036237 Oct 28 13:08:34.992483 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 848/1683] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:08:33 2022] POST /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c/action => generated 1113 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 13:08:35.010280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:35.011118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:35.017208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.017691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.018121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:35.018867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.019318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.019737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:35.095994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:35.109874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:35.117824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:35.117824 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3413380d-17e1-4ab3-9371-5b2aae978c66 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1558 microversion: 2.91 time: 0.123679 Oct 28 13:08:35.129897 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 849/1684] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:34 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1558 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:35.150425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:35.151652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:35.161388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.162171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.162711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:35.163601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.164155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.165691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:35.402904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:35.413443 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5374d9fb-67dc-4c10-ae1d-2b012a03bdef tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1504 microversion: 2.1 time: 0.282327 Oct 28 13:08:35.433383 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 850/1685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:35 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:35.439113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c30cdd3-c6a1-453f-94ad-7ca1550a83a6 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bda711f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:35.521354 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c30cdd3-c6a1-453f-94ad-7ca1550a83a6 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1423 microversion: 2.1 time: 0.084628 Oct 28 13:08:35.523957 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 851/1686] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:35 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:35.536158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:35.536702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:35.551148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.555451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.562126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:35.562126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.562126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.562126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:35.838974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:35.848204 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b54f69c-0f39-43bc-a47f-ba4d2d6a9f9f tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.322656 Oct 28 13:08:35.858823 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 852/1687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:35 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:35.867579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:35.867579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:35.889936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.889936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.889936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:35.890411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:35.893336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:35.893855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:36.137562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:36.154690 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-317611da-4120-424b-8c40-c45297894ac7 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.304486 Oct 28 13:08:36.158047 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 853/1688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:35 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:36.188660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:36.188660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:36.199061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:36.199322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:36.203726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:36.204664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:36.205615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:36.205615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:36.275980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:08:36.877984 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69d0316d-e7b2-4410-bede-92eebcf9bdbd tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.942277 Oct 28 13:08:36.878860 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 836/1689] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:08:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:36.890404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:36.891241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:36.897885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:36.898963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:36.905335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:36.905335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:36.905335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:36.905335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:36.996070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:37.008044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:37.009909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:37.017951 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4b558a9a-b2d2-4c3f-b1ce-9327de38f165 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.137108 Oct 28 13:08:37.019042 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 837/1690] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:36 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:37.024214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-544758ce-a5b4-4a41-960d-3f72ff5cb157 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b9428af0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:37.036193 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d499d9b1-df9d-47e6-9deb-ad8333e465a3 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "DELETE /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 204 len: 0 microversion: 2.1 time: 0.861714 Oct 28 13:08:37.039983 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 854/1691] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:08:36 2022] DELETE /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:08:37.048427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:37.049984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:37.057946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:37.059023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:37.059501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:37.060272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:37.060785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:37.061248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:37.286044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:37.307718 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0eeb5efa-6aec-4f52-9fe9-e4fac4ed5230 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.265637 Oct 28 13:08:37.308201 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 855/1692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:37 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:37.312894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-963c40c8-912f-45e7-b329-4ea848998227 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Calling method '.version_select at 0x7f27b94a4a60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:38.644146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-963c40c8-912f-45e7-b329-4ea848998227 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e" status: 202 len: 0 microversion: 2.1 time: 1.334798 Oct 28 13:08:38.644722 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 856/1693] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:08:37 2022] DELETE /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:08:38.650004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:38.654986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:38.673298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:38.675603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:38.677298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:38.678643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:38.683459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:38.686790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:38.713234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:39.203159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:39.224690 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d407e5fc-2688-4ae1-be32-026a2a4a2fc1 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1510 microversion: 2.1 time: 0.578805 Oct 28 13:08:39.225276 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 857/1694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:38 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:39.234540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:39.239589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:39.263820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:39.264485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:39.265032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:39.265848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:39.270163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:39.270780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:39.527282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:39.544376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c856bcda-2903-4b5e-b1e9-e2e9c5f6c28a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.313548 Oct 28 13:08:39.545517 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 858/1695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:39 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:39.568060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:39.568763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:39.584867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:39.586096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:39.588466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:39.591336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:39.591336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:39.591336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:39.776162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:39.776162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:39.777888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:39.777888 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00a1c2fd-4135-4181-932c-f1e9b362fc94 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.184371 Oct 28 13:08:39.777888 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 859/1696] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:39 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:39.777888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:39.778486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:39.785352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:39.795784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:39.802609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:39.824418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:39.825442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:39.826002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:40.289787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:40.307253 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ce6c077-5113-4c29-a854-fe2cce422b1e tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.572177 Oct 28 13:08:40.324600 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 860/1697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:39 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:40.328585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33f9711a-bd60-4585-9c01-f33cf0219d20 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Calling method '.version_select at 0x7f27bdaa55e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:40.401912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-33f9711a-bd60-4585-9c01-f33cf0219d20 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e0be87fd-e945-4e55-9d2c-7626290cb56e could not be found", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:08:40.402603 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-33f9711a-bd60-4585-9c01-f33cf0219d20 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] HTTP exception thrown: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33f9711a-bd60-4585-9c01-f33cf0219d20 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Request method failure captured: Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e HTTP/1.1 Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9RIdEampGBlQAAgUy5Y8OftV94dwDp4wtWLHYgRVUy-hON1CoJ9Q9OHmSdadqbdrE7CkAgkU4nu2G4u6rtgtWSnwp_Ox-7qY2YoCdM0hOc22k6_0hDR-DnOky2giMQilJmDvaZhnXvQsE6FCJ4lqk4arUfmxnIKxFkLc7bJme4mSn8 Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: ac4d77c4adee4dbbb01c44609032d4a1 Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FloatingIPsTestJSON-866748788 Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:40.404884 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac4d77c4adee4dbbb01c44609032d4a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac4d77c4adee4dbbb01c44609032d4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac4d77c4adee4dbbb01c44609032d4a1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac4d77c4adee4dbbb01c44609032d4a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FloatingIPsTestJSON-866748788 Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: ac4d77c4adee4dbbb01c44609032d4a1 Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FloatingIPsTestJSON-866748788 Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FloatingIPsTestJSON-866748788-project Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 686dc18daf0449d99733c5ef7cb92cc8 Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FloatingIPsTestJSON-866748788-project Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: exception: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'e0be87fd-e945-4e55-9d2c-7626290cb56e'} Oct 28 13:08:40.413282 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:08:40.414598 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e0be87fd-e945-4e55-9d2c-7626290cb56e could not be found Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ed754cd-3bf1-4fc5-bdf2-f5cadea76865'] Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e. Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:40.416200 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:40.417805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:40.419564 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.419564 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.419564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33f9711a-bd60-4585-9c01-f33cf0219d20 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Returning 404 to user: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:40.419564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-33f9711a-bd60-4585-9c01-f33cf0219d20 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e" status: 404 len: 111 microversion: 2.1 time: 0.096917 Oct 28 13:08:40.419564 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 861/1698] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:08:40 2022] GET /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:40.419564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5cbdd5c0-a3b2-48cc-b6e7-a61a9caf5f19 req-91d732ab-b655-4482-a979-407b6747e6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3", "name": "network-vif-plugged", "status": "completed", "tag": "a93f211e-7e42-4366-b982-2ac415c2e826"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:40.440981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5cbdd5c0-a3b2-48cc-b6e7-a61a9caf5f19 req-91d732ab-b655-4482-a979-407b6747e6ef service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:40.444802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5cbdd5c0-a3b2-48cc-b6e7-a61a9caf5f19 req-91d732ab-b655-4482-a979-407b6747e6ef service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:40.445290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5cbdd5c0-a3b2-48cc-b6e7-a61a9caf5f19 req-91d732ab-b655-4482-a979-407b6747e6ef service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:40.469273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5cbdd5c0-a3b2-48cc-b6e7-a61a9caf5f19 req-91d732ab-b655-4482-a979-407b6747e6ef service nova] Creating event network-vif-plugged:a93f211e-7e42-4366-b982-2ac415c2e826 for instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 on n-h1-862876-2 Oct 28 13:08:40.486550 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5cbdd5c0-a3b2-48cc-b6e7-a61a9caf5f19 req-91d732ab-b655-4482-a979-407b6747e6ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077842 Oct 28 13:08:40.487571 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 862/1699] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:40.498362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1b1cc2c0-4b7b-405c-ac89-06fea7a12db4 req-b05973e6-0727-4394-99e1-b3a459cd96e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303fca24-8137-417f-b7eb-634050170311", "name": "network-vif-deleted", "tag": "daa368d4-fe11-42a0-a1bd-6fb7802d3ed5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:40.518335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1b1cc2c0-4b7b-405c-ac89-06fea7a12db4 req-b05973e6-0727-4394-99e1-b3a459cd96e6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:40.523570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1b1cc2c0-4b7b-405c-ac89-06fea7a12db4 req-b05973e6-0727-4394-99e1-b3a459cd96e6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:40.527984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1b1cc2c0-4b7b-405c-ac89-06fea7a12db4 req-b05973e6-0727-4394-99e1-b3a459cd96e6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:40.579880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1b1cc2c0-4b7b-405c-ac89-06fea7a12db4 req-b05973e6-0727-4394-99e1-b3a459cd96e6 service nova] Creating event network-vif-deleted:daa368d4-fe11-42a0-a1bd-6fb7802d3ed5 for instance 303fca24-8137-417f-b7eb-634050170311 on n-h2-862876-2 Oct 28 13:08:40.589161 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1b1cc2c0-4b7b-405c-ac89-06fea7a12db4 req-b05973e6-0727-4394-99e1-b3a459cd96e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097488 Oct 28 13:08:40.591241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 863/1700] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:40.603294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:40.604013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:40.619682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:40.620185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:40.620625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:40.626938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:40.627456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:40.627899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:40.723974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b83dfecfa84403a9ecd8bddb75916fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621277d407e04230a72ef00c50195252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:40.736772 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e5dde66-4775-447f-a2eb-98393c0363d9 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 200 len: 1301 microversion: 2.1 time: 0.139475 Oct 28 13:08:40.738005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 864/1701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:40 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 1301 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:40.743270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40d9287e-cf5d-499c-8d7b-7f7ff83ae954 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Calling method '.version_select at 0x7f27b942eca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:40.830401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-40d9287e-cf5d-499c-8d7b-7f7ff83ae954 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e0be87fd-e945-4e55-9d2c-7626290cb56e could not be found", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:08:40.831930 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-40d9287e-cf5d-499c-8d7b-7f7ff83ae954 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] HTTP exception thrown: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40d9287e-cf5d-499c-8d7b-7f7ff83ae954 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Request method failure captured: Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e HTTP/1.1 Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9RIdEampGBlQAAgUy5Y8OftV94dwDp4wtWLHYgRVUy-hON1CoJ9Q9OHmSdadqbdrE7CkAgkU4nu2G4u6rtgtWSnwp_Ox-7qY2YoCdM0hOc22k6_0hDR-DnOky2giMQilJmDvaZhnXvQsE6FCJ4lqk4arUfmxnIKxFkLc7bJme4mSn8 Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: ac4d77c4adee4dbbb01c44609032d4a1 Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-FloatingIPsTestJSON-866748788 Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:40.837444 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac4d77c4adee4dbbb01c44609032d4a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac4d77c4adee4dbbb01c44609032d4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac4d77c4adee4dbbb01c44609032d4a1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac4d77c4adee4dbbb01c44609032d4a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-FloatingIPsTestJSON-866748788 Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: ac4d77c4adee4dbbb01c44609032d4a1 Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-FloatingIPsTestJSON-866748788 Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-FloatingIPsTestJSON-866748788-project Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 686dc18daf0449d99733c5ef7cb92cc8 Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-FloatingIPsTestJSON-866748788-project Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: exception: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'e0be87fd-e945-4e55-9d2c-7626290cb56e'} Oct 28 13:08:40.839177 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:08:40.840183 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e0be87fd-e945-4e55-9d2c-7626290cb56e could not be found Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4e035ae-b46f-4a0d-aa06-20fe5cac543e'] Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e. Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:40.842042 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:40.843732 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:40.845750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e Oct 28 13:08:40.845750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:40.847406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40d9287e-cf5d-499c-8d7b-7f7ff83ae954 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] Returning 404 to user: Floating IP not found for ID e0be87fd-e945-4e55-9d2c-7626290cb56e {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:40.849106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40d9287e-cf5d-499c-8d7b-7f7ff83ae954 tempest-FloatingIPsTestJSON-866748788 tempest-FloatingIPsTestJSON-866748788-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e" status: 404 len: 111 microversion: 2.1 time: 0.109098 Oct 28 13:08:40.850661 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 865/1702] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:08:40 2022] DELETE /compute/v2.1/os-floating-ips/e0be87fd-e945-4e55-9d2c-7626290cb56e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:40.875454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:40.876416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:40.900632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:40.903689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:40.904396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:40.909779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:40.916467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:40.918318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:41.588335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:41.604471 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e29fd266-f88d-46d6-bc31-f031d40be751 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.750303 Oct 28 13:08:41.605297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 866/1703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:40 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:41.634495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:41.635260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:41.670851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:41.672777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:41.673474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:41.675122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:41.677434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:41.681253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:41.997590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:42.009924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:42.012637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:42.025848 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3fba8f32-37a2-4663-a3dd-1a6273e97a0a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.418706 Oct 28 13:08:42.028497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 867/1704] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:41 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:42.038123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:42.039093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:42.045876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.046363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.047290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:42.051763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.065615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.066451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:42.365726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:42.376763 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9910cf2b-9f03-4090-be3d-1fa0bdffb8dd tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1317 microversion: 2.1 time: 0.346339 Oct 28 13:08:42.377367 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 868/1705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:42 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:42.411576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:42.412101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:42.425608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.428369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.428846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:42.431765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.432257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.432699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:42.465050 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] HTTP exception thrown: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Request method failure captured: Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 HTTP/1.1 Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Q4R8w6mJElqlwStyu5HTh72JONBKoOYquKX28u_4Ar-p-6YSn-BI9GFexNjALF56qJUSuHxf6cdaMX5yC77GQo6giZsKG4gQy-8A5Ts9rw1aFQHZyX2piJhy9nnWN5LTbxP1MRimx8J_cIwPkCPhjiCWwcMUzPHF8NnsUS0_soY6o Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:42.466622 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621277d407e04230a72ef00c50195252", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621277d407e04230a72ef00c50195252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2b83dfecfa84403a9ecd8bddb75916fc Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.468369 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '303fca24-8137-417f-b7eb-634050170311'} Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:42.469355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.470729 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.474267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Returning 404 to user: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:42.474267 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d7d264c9-e369-4ae2-ab78-518cce807995 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 404 len: 111 microversion: 2.1 time: 0.066226 Oct 28 13:08:42.486112 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 869/1706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:42 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:42.495622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1445974521", "metadata": {"image_type": "test"}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:42.521338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:42.562177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.563516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.563516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:42.575280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.576645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.577422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:42.665741 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] HTTP exception thrown: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Request method failure captured: Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311/action HTTP/1.1 Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 112 Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Q4R8w6mJElqlwStyu5HTh72JONBKoOYquKX28u_4Ar-p-6YSn-BI9GFexNjALF56qJUSuHxf6cdaMX5yC77GQo6giZsKG4gQy-8A5Ts9rw1aFQHZyX2piJhy9nnWN5LTbxP1MRimx8J_cIwPkCPhjiCWwcMUzPHF8NnsUS0_soY6o Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:42.678203 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621277d407e04230a72ef00c50195252", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621277d407e04230a72ef00c50195252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2b83dfecfa84403a9ecd8bddb75916fc Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1445974521", "metadata": {"image_type": "test"}}} Oct 28 13:08:42.680130 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '303fca24-8137-417f-b7eb-634050170311', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1445974521', 'metadata': {'image_type': 'test'}}}} Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:42.681128 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:42.682646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Returning 404 to user: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-264c598d-dc56-4bb1-80ec-3faa1feedc2a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "POST /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311/action" status: 404 len: 111 microversion: 2.1 time: 0.196392 Oct 28 13:08:42.689864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 870/1707] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Oct 28 13:08:42 2022] POST /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311/action => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:42.694812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:42.695448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:42.724656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.725541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.726207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:42.727189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:42.727844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:42.728476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.111185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:43.122064 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9134e494-ff22-457e-bb2d-c88bccdd5aea tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.431648 Oct 28 13:08:43.129178 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 871/1708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:42 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:43.147941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67f6ea5d-c3ba-4e15-bc23-86a0a0955caf tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-921290122", "metadata": {"image_type": "test"}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:43.155459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-67f6ea5d-c3ba-4e15-bc23-86a0a0955caf tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Failed to fetch instance by id tempest-invalid-137978584 {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 13:08:43.164462 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-67f6ea5d-c3ba-4e15-bc23-86a0a0955caf tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] HTTP exception thrown: Instance tempest-invalid-137978584 could not be found. Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67f6ea5d-c3ba-4e15-bc23-86a0a0955caf tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Request method failure captured: Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/tempest-invalid-137978584/action HTTP/1.1 Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 111 Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Q4R8w6mJElqlwStyu5HTh72JONBKoOYquKX28u_4Ar-p-6YSn-BI9GFexNjALF56qJUSuHxf6cdaMX5yC77GQo6giZsKG4gQy-8A5Ts9rw1aFQHZyX2piJhy9nnWN5LTbxP1MRimx8J_cIwPkCPhjiCWwcMUzPHF8NnsUS0_soY6o Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:43.175159 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621277d407e04230a72ef00c50195252", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621277d407e04230a72ef00c50195252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2b83dfecfa84403a9ecd8bddb75916fc Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-921290122", "metadata": {"image_type": "test"}}} Oct 28 13:08:43.177430 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance tempest-invalid-137978584 could not be found. Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'tempest-invalid-137978584', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-921290122', 'metadata': {'image_type': 'test'}}}} Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-137978584 could not be found. Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:43.178234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-137978584 could not be found. Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-137978584 could not be found. Oct 28 13:08:43.179597 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.181056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67f6ea5d-c3ba-4e15-bc23-86a0a0955caf tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Returning 404 to user: Instance tempest-invalid-137978584 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:43.181056 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-67f6ea5d-c3ba-4e15-bc23-86a0a0955caf tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-137978584/action" status: 404 len: 100 microversion: 2.1 time: 0.042079 Oct 28 13:08:43.181300 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 872/1709] 10.222.0.25 () {60 vars in 1246 bytes} [Fri Oct 28 13:08:43 2022] POST /compute/v2.1/servers/tempest-invalid-137978584/action => generated 100 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:43.186218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:43.186850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:43.211361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.212651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.213259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.214155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.220235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.221502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.445862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:43.467604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:43.469365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:43.478331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f5c29a39-3568-410f-926d-d5de06d21eca tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.295989 Oct 28 13:08:43.483573 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 873/1710] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:43 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:43.522581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f413816c-f7d6-461c-a35a-51c611ddb671 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-883820959"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:43.540317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f413816c-f7d6-461c-a35a-51c611ddb671 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 13:08:43.540880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f413816c-f7d6-461c-a35a-51c611ddb671 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f413816c-f7d6-461c-a35a-51c611ddb671 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Request method failure captured: Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 56 Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Q4R8w6mJElqlwStyu5HTh72JONBKoOYquKX28u_4Ar-p-6YSn-BI9GFexNjALF56qJUSuHxf6cdaMX5yC77GQo6giZsKG4gQy-8A5Ts9rw1aFQHZyX2piJhy9nnWN5LTbxP1MRimx8J_cIwPkCPhjiCWwcMUzPHF8NnsUS0_soY6o Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:43.542465 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621277d407e04230a72ef00c50195252", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621277d407e04230a72ef00c50195252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2b83dfecfa84403a9ecd8bddb75916fc Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: {"createImage": {"name": "tempest-test-snap-883820959"}} Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:08:43.544206 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-883820959'}}} Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:43.545192 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.546545 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.547874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f413816c-f7d6-461c-a35a-51c611ddb671 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:43.547874 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f413816c-f7d6-461c-a35a-51c611ddb671 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025871 Oct 28 13:08:43.547874 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 874/1711] 10.222.0.25 () {60 vars in 1275 bytes} [Fri Oct 28 13:08:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:43.577614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:43.578238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:43.593405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.593405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.597249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.597249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.597249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.597249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.793681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:43.804115 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2b3ad14-6975-40b0-9457-b513792dc62a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1506 microversion: 2.1 time: 0.239429 Oct 28 13:08:43.804743 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 875/1712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:43 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:43.813579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a79399af-f3ec-459d-b268-2bee719c1ea2 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2115282876"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:43.815984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a79399af-f3ec-459d-b268-2bee719c1ea2 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 13:08:43.816795 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-a79399af-f3ec-459d-b268-2bee719c1ea2 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a79399af-f3ec-459d-b268-2bee719c1ea2 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Request method failure captured: Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 57 Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Q4R8w6mJElqlwStyu5HTh72JONBKoOYquKX28u_4Ar-p-6YSn-BI9GFexNjALF56qJUSuHxf6cdaMX5yC77GQo6giZsKG4gQy-8A5Ts9rw1aFQHZyX2piJhy9nnWN5LTbxP1MRimx8J_cIwPkCPhjiCWwcMUzPHF8NnsUS0_soY6o Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:43.818409 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621277d407e04230a72ef00c50195252", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621277d407e04230a72ef00c50195252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2b83dfecfa84403a9ecd8bddb75916fc Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: {"createImage": {"name": "tempest-test-snap-2115282876"}} Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:08:43.820943 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2115282876'}}} Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:43.822309 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 13:08:43.824682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.827700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a79399af-f3ec-459d-b268-2bee719c1ea2 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:43.828745 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a79399af-f3ec-459d-b268-2bee719c1ea2 tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.023043 Oct 28 13:08:43.829857 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 876/1713] 10.222.0.25 () {60 vars in 1281 bytes} [Fri Oct 28 13:08:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:43.837637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:43.838248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:43.852647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.853238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.853742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.854512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.855314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.855808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.891657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:43.892742 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3403fcb-0227-4115-90ec-795972232206 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3/os-instance-actions/req-d4ee351f-3043-4c02-8ac8-77db9a355a27" status: 200 len: 313 microversion: 2.1 time: 0.061686 Oct 28 13:08:43.893537 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 877/1714] 10.222.0.25 () {58 vars in 1419 bytes} [Fri Oct 28 13:08:43 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3/os-instance-actions/req-d4ee351f-3043-4c02-8ac8-77db9a355a27 => generated 313 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:43.899021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:43.899512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:43.905969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.906462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.906932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.907657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.908283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.908710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.925089 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] HTTP exception thrown: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Request method failure captured: Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 HTTP/1.1 Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Q4R8w6mJElqlwStyu5HTh72JONBKoOYquKX28u_4Ar-p-6YSn-BI9GFexNjALF56qJUSuHxf6cdaMX5yC77GQo6giZsKG4gQy-8A5Ts9rw1aFQHZyX2piJhy9nnWN5LTbxP1MRimx8J_cIwPkCPhjiCWwcMUzPHF8NnsUS0_soY6o Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:43.926908 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621277d407e04230a72ef00c50195252", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621277d407e04230a72ef00c50195252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2b83dfecfa84403a9ecd8bddb75916fc Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:43.928454 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '303fca24-8137-417f-b7eb-634050170311'} Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:43.929404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:43.933424 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:43.935927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Returning 404 to user: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:43.935927 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef5264f9-9ace-4513-a87e-e73e9bfb7e1a tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "DELETE /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 404 len: 111 microversion: 2.1 time: 0.033472 Oct 28 13:08:43.935927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 878/1715] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:08:43 2022] DELETE /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:43.938131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:43.939686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:43.946217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.946711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.947171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:43.947874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:43.948332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:43.948754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:44.407162 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-157717fc-e288-4bfc-94bf-cbf365ab7d30 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "POST /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3/action" status: 202 len: 0 microversion: 2.1 time: 0.472814 Oct 28 13:08:44.409902 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 879/1716] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:08:43 2022] POST /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:08:44.421012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:44.422018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] [instance: 303fca24-8137-417f-b7eb-634050170311] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:44.441749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:44.442838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:44.443506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:44.444585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:44.445317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:44.447194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:44.485567 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] HTTP exception thrown: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Request method failure captured: Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 HTTP/1.1 Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Q4R8w6mJElqlwStyu5HTh72JONBKoOYquKX28u_4Ar-p-6YSn-BI9GFexNjALF56qJUSuHxf6cdaMX5yC77GQo6giZsKG4gQy-8A5Ts9rw1aFQHZyX2piJhy9nnWN5LTbxP1MRimx8J_cIwPkCPhjiCWwcMUzPHF8NnsUS0_soY6o Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:44.489399 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/621277d407e04230a72ef00c50195252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_621277d407e04230a72ef00c50195252", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/621277d407e04230a72ef00c50195252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 621277d407e04230a72ef00c50195252 Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975328516 Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2b83dfecfa84403a9ecd8bddb75916fc Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesNegativeTestJSON-1975328516-project Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:44.490965 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '303fca24-8137-417f-b7eb-634050170311'} Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:44.491868 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. Oct 28 13:08:44.493234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:44.498889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] Returning 404 to user: Instance 303fca24-8137-417f-b7eb-634050170311 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:44.503659 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d766029f-2150-494e-b724-21bd11c158ee tempest-ImagesNegativeTestJSON-1975328516 tempest-ImagesNegativeTestJSON-1975328516-project] 10.222.0.25 "GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311" status: 404 len: 111 microversion: 2.1 time: 0.092289 Oct 28 13:08:44.507851 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 880/1717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:44 2022] GET /compute/v2.1/servers/303fca24-8137-417f-b7eb-634050170311 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:44.519367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:44.521366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:44.537862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:44.538873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:44.540459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:44.543265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:44.545903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:44.546671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:44.575585 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-544758ce-a5b4-4a41-960d-3f72ff5cb157 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1432 microversion: 2.1 time: 7.555116 Oct 28 13:08:44.587348 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 838/1718] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:37 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1432 bytes in 7567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:44.601343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:44.602285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:44.620544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:44.621483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:44.622243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:44.623263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:44.623930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:44.624540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:45.098709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:45.119351 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6de67efa-c93f-40c7-827d-87ad1f9380ab tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1508 microversion: 2.1 time: 0.522870 Oct 28 13:08:45.124149 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 839/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:44 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:45.158319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:45.164428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:45.186907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:45.187470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:45.187909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:45.189013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:45.189660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:45.190935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:45.229986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:45.376974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:45.397407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:45.404703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:45.431134 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d814a14b-632c-4232-a0a1-b2540fc7244c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.305430 Oct 28 13:08:45.442937 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 840/1720] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:45 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:45.464062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6428dacb-f26f-4108-92e9-fd8f93effe06 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93f4160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:45.560655 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6428dacb-f26f-4108-92e9-fd8f93effe06 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 200 len: 1432 microversion: 2.1 time: 0.113443 Oct 28 13:08:45.561911 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 841/1721] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:45 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 1432 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:45.587030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:45.587030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:45.652269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:45.652269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:45.652914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:45.655511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:45.658152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:45.661185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:45.923310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:45.932230 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e201c1be-050e-41c3-bdab-04bb64216b35 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 1.422575 Oct 28 13:08:45.941044 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 881/1722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:44 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:46.112038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:46.125935 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5bbff6cc-2571-400c-b34e-5f5722b43f8c tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1467 microversion: 2.1 time: 0.553660 Oct 28 13:08:46.130684 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 842/1723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:45 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1467 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:46.159418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fe10b1b9-2541-4a14-94ca-92be4703ea1a tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93f40d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:46.181029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:46.182774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:46.224020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:46.225041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:46.225740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:46.227001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:46.228502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:46.231120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:46.294869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fe10b1b9-2541-4a14-94ca-92be4703ea1a tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/65e1a51d-1f44-4651-86a6-90233a26cd48" status: 200 len: 784 microversion: 2.1 time: 0.144430 Oct 28 13:08:46.304443 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 843/1724] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:46 2022] GET /compute/v2.1/images/65e1a51d-1f44-4651-86a6-90233a26cd48 => generated 784 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:46.317855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b636d34-5935-423e-9ecc-1ef35bf56379 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:46.331749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:46.350732 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b636d34-5935-423e-9ecc-1ef35bf56379 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044690 Oct 28 13:08:46.354609 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 844/1725] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:08:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:46.369856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3612449c-91f5-4559-9f05-e3f85a6a3117 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b94289d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:46.902427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:46.919213 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2b98c53-eaa0-423d-a9d2-041303e668ba tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1508 microversion: 2.1 time: 0.746260 Oct 28 13:08:46.968354 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 882/1726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:46 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1508 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:46.997600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:47.006568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:47.039125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:47.039715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:47.040176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:47.040923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:47.047752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:47.052403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:47.472614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:47.485859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:47.487805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:47.502915 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c478a6b5-3d28-4c8b-9007-69591c5b639a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.519168 Oct 28 13:08:47.523353 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 883/1727] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:46 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:47.529722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:47.535859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:47.556405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:47.558307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:47.559144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:47.560373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:47.560997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:47.561772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:48.069529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:48.092038 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d6fad7a-9139-4fdd-b834-6b2168a8f72e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.566108 Oct 28 13:08:48.094292 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 884/1728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:47 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:48.131391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:48.135881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:48.155189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:48.156874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:48.157546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:48.158475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:48.161944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:48.162643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:48.307457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3612449c-91f5-4559-9f05-e3f85a6a3117 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "DELETE /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 204 len: 0 microversion: 2.1 time: 1.942456 Oct 28 13:08:48.314807 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 845/1729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:46 2022] DELETE /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 0 bytes in 1945 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:08:48.318128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fca80ca6-e476-4866-8f01-64de9471e980 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93a9d30>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:48.351890 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-fca80ca6-e476-4866-8f01-64de9471e980 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] HTTP exception thrown: Image not found. Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fca80ca6-e476-4866-8f01-64de9471e980 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Request method failure captured: Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 HTTP/1.1 Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9QkDCRQlz7vB9iHgCe-v1jz2cl68D1_H6yjsPG4WMHwujDrbXdhQ7ZguU_X4hHUl4Fx_svdc2uF_EvgA21x-5PxzmqBhhaducoAQL_TYYbm796Z-mOgpP-ElrF28ocJqAniz3mjK47YE0T7VPW27zmYLfvDKDwDDajBzxdGB0jvK0Q Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 75778e6d89f94db58b139d1c9824675c Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:08:48.356785 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75778e6d89f94db58b139d1c9824675c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 75778e6d89f94db58b139d1c9824675c Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerTestJSON-1588672513-project Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7c30b88de36c4240b553ecb339831a28 Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerTestJSON-1588672513-project Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: exception: Image not found. Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '5a4a1473-9380-44bf-a643-bf4afd337e90'} Oct 28 13:08:48.358537 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:08:48.360122 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a4a1473-9380-44bf-a643-bf4afd337e90 Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:08:48.361632 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a4a1473-9380-44bf-a643-bf4afd337e90 could not be found. Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:08:48.363352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:48.364951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fca80ca6-e476-4866-8f01-64de9471e980 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Returning 404 to user: Image not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:48.366287 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fca80ca6-e476-4866-8f01-64de9471e980 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 404 len: 62 microversion: 2.1 time: 0.048158 Oct 28 13:08:48.370352 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 846/1730] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:48 2022] GET /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:08:48.395819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-425398283"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:48.399090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:48.406245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:48.407164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:48.407808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:48.408712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:48.409569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:48.410222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:48.607932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:48.620841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32d3fbd8-695d-40c3-805e-94d8112712b9 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1513 microversion: 2.1 time: 0.525006 Oct 28 13:08:48.622616 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 885/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:48 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:48.662969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:48.665745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:48.682605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:48.683127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:48.683566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:48.684270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:48.684729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:48.685154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:48.817875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:48.847373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:48.850105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:48.858024 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c56a6cca-402f-4a45-8275-7b0031e0d795 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.215959 Oct 28 13:08:48.880989 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 886/1732] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:48 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:49.136002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:49.138165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:49.165040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:49.166119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:49.167530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:49.179144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:49.179144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:49.179144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:49.223802 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3855c23f-9a65-4080-b787-85f9de4b47df tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "POST /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837/action" status: 202 len: 0 microversion: 2.1 time: 0.838696 Oct 28 13:08:49.230717 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 847/1733] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:08:48 2022] POST /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837/action => generated 0 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:08:49.260580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e6f1148-fae2-4f1f-aff1-57611e48db35 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93a5c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:49.381669 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e6f1148-fae2-4f1f-aff1-57611e48db35 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.149588 Oct 28 13:08:49.392969 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 848/1734] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:49 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:49.399744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1351125221", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1217f953-ad0c-48ca-a39a-bfdf8506b13b"}], "block_device_mapping_v2": [{"uuid": "32135d6d-5659-4cac-bfd9-22c7f88f8811", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:49.578350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] validate_networks() for [('1217f953-ad0c-48ca-a39a-bfdf8506b13b', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:08:49.746778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:49.759456 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68e5a1d3-7494-4372-b500-89b1a8296d7d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.645734 Oct 28 13:08:49.762564 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 887/1735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:49 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:50.021075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d9c67c9d-fa14-48c3-b215-3d9e32e113c8 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Calling method '.version_select at 0x7f27bda51e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:50.089263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-d9c67c9d-fa14-48c3-b215-3d9e32e113c8 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:08:50.089883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.security_group_api [None req-d9c67c9d-fa14-48c3-b215-3d9e32e113c8 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Neutron security group fbefbeb3-1480-479e-8cc0-09f604da712f not found {{(pid=127793) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:08:50.090464 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d9c67c9d-fa14-48c3-b215-3d9e32e113c8 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] HTTP exception thrown: Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist Oct 28 13:08:50.090464 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-e7f31002-c801-490b-981c-57fab8b04657'] Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d9c67c9d-fa14-48c3-b215-3d9e32e113c8 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Request method failure captured: Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-security-groups/fbefbeb3-1480-479e-8cc0-09f604da712f HTTP/1.1 Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Rh5RGbKtDDrCgtcrETRf6fy-BToiTQK6pN1qHh8sLOnHxi2B6Ey8xkof0-zqjXxWh4mlKAUWTntOY3OQlykuXF8kN9VBb4wywFsqaR8A3JRBq5UbR8SbkpD8qOKv0od7RX881Ak_pYP4JVD-5_-4NLE2S1AfIo9pm52lzViMKjMXo Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:50.110334 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59004ddf6c8c4f76a9bf1b24c09b3b82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 137149f8e63146e3a1a3ed58c52f72c8 Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: exception: Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-e7f31002-c801-490b-981c-57fab8b04657'] Oct 28 13:08:50.112429 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'fbefbeb3-1480-479e-8cc0-09f604da712f'} Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:50.114461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7f31002-c801-490b-981c-57fab8b04657'] Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:08:50.122213 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7f31002-c801-490b-981c-57fab8b04657'] Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7f31002-c801-490b-981c-57fab8b04657'] Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:50.123590 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7f31002-c801-490b-981c-57fab8b04657'] Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d9c67c9d-fa14-48c3-b215-3d9e32e113c8 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Returning 404 to user: Security group fbefbeb3-1480-479e-8cc0-09f604da712f does not exist Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-e7f31002-c801-490b-981c-57fab8b04657'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d9c67c9d-fa14-48c3-b215-3d9e32e113c8 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/fbefbeb3-1480-479e-8cc0-09f604da712f" status: 404 len: 194 microversion: 2.1 time: 0.353257 Oct 28 13:08:50.125108 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 888/1736] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:08:49 2022] DELETE /compute/v2.1/os-security-groups/fbefbeb3-1480-479e-8cc0-09f604da712f => generated 194 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:50.133917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:50.142851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:50.155217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:50.156035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:50.156804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:50.157861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:50.159069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:50.159742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:50.610387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:50.619425 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-073aaa93-cae2-4e08-9c2f-8552917f5384 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1506 microversion: 2.1 time: 0.499734 Oct 28 13:08:50.620007 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 889/1737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:50 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:50.627568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:50.635858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:08:50.636463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:08:50.637071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:08:50.637833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:50.637965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:08:50.638668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:08:50.654680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:50.655572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:50.655862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:50.656633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:50.657079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:50.658179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:50.658911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:50.659997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:50.660786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:50.661355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:50.661895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:50.663783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:50.687424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:08:50.696760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Getting quotas for user 17a50d2f7a154acbbf6bc218efb8b67d and project 7c310f7fe3104b3b8649ba13bd9c51ec. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:08:50.795727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:08:50.800322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32135d6d-5659-4cac-bfd9-22c7f88f8811',volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:08:50.808273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:50.817429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:50.818933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:50.849029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:50.853812 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-481db1b3-c23b-4582-a527-a5216bbb6a8b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.229803 Oct 28 13:08:50.855158 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 890/1738] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:50 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:50.864190 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6aa8ece2-36eb-4a15-a7db-86d726c7edd3 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007731 Oct 28 13:08:50.865713 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 891/1739] 10.222.0.25 () {58 vars in 1164 bytes} [Fri Oct 28 13:08:50 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 13:08:50.878606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-363d998f-e8e3-483b-a835-5c5d1e83ff5e tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdadbd30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:50.959115 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-363d998f-e8e3-483b-a835-5c5d1e83ff5e tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.092050 Oct 28 13:08:50.969880 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 892/1740] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:50 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:50.978324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '.version_select at 0x7f27bd9fa700>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:50.981080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:50.996289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:50.997327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:50.998665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:51.001872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:51.003113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:51.005101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:51.064987 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4d3c184a-0b8c-45bd-b989-58a2798ef726 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.093092 Oct 28 13:08:51.067468 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 893/1741] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Oct 28 13:08:50 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3/os-instance-actions => generated 611 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:51.075568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:51.076550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:51.084614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:51.085493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:51.086191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:51.087263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:51.088026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:51.088691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:51.412737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:51.422429 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3745d980-c1fe-4d39-ab8b-7a32238db6b1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.353742 Oct 28 13:08:51.446029 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 894/1742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:51 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:51.461878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b47f481-fd67-4ff2-aa77-93ce620defb2 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Calling method '.version_select at 0x7f27bd9fa4c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:51.588797 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36c052c0-c3c2-44c8-975a-9b5bd9108574 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.193787 Oct 28 13:08:51.588797 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 849/1743] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:08:51.603452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-55fb9b8c-4d7f-49bb-a154-84e4ca69d889 req-6e8718f2-1a90-4419-8b8d-4fb95bef879e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16778c76-17c6-4a4a-bace-f54b6f7f4837", "name": "network-vif-unplugged", "status": "completed", "tag": "315bda66-3f17-4ca5-9705-6dc6a59b5b67"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:51.615033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-55fb9b8c-4d7f-49bb-a154-84e4ca69d889 req-6e8718f2-1a90-4419-8b8d-4fb95bef879e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:51.615774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-55fb9b8c-4d7f-49bb-a154-84e4ca69d889 req-6e8718f2-1a90-4419-8b8d-4fb95bef879e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:51.624689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-55fb9b8c-4d7f-49bb-a154-84e4ca69d889 req-6e8718f2-1a90-4419-8b8d-4fb95bef879e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:51.686044 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-55fb9b8c-4d7f-49bb-a154-84e4ca69d889 req-6e8718f2-1a90-4419-8b8d-4fb95bef879e service nova] Creating event network-vif-unplugged:315bda66-3f17-4ca5-9705-6dc6a59b5b67 for instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 on n-h2-862876-2 Oct 28 13:08:51.700117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-55fb9b8c-4d7f-49bb-a154-84e4ca69d889 req-6e8718f2-1a90-4419-8b8d-4fb95bef879e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110236 Oct 28 13:08:51.700747 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 850/1744] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:51.723653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:51.724249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:51.752857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:51.753370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:51.753814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:51.755363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:51.755825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:51.756258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:51.853050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:08:51.885040 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b47f481-fd67-4ff2-aa77-93ce620defb2 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.437796 Oct 28 13:08:51.888399 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 895/1745] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:08:51 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:51.899547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-040ecd98-5f97-4655-81e7-721e23b60f45 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:51.901090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-040ecd98-5f97-4655-81e7-721e23b60f45 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:51.991923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-040ecd98-5f97-4655-81e7-721e23b60f45 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:51.999964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-040ecd98-5f97-4655-81e7-721e23b60f45 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:52.001416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-040ecd98-5f97-4655-81e7-721e23b60f45 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:52.002544 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-040ecd98-5f97-4655-81e7-721e23b60f45 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1104 microversion: 2.25 time: 0.112978 Oct 28 13:08:52.008765 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 896/1746] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:51 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1104 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:52.014646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:52.015447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:52.022046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:52.022782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:52.023411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:52.024282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:52.024899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:52.025481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:52.123628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:52.142004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:52.152710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:52.202532 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e9a29a1f-6172-4c31-8cd2-ffa9905fda2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.194654 Oct 28 13:08:52.203558 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 897/1747] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:52 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:52.209481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc554320-c1f2-413b-aaa1-8f5452d436c9 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Calling method '.version_select at 0x7f27bd9d3310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:52.413026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-bc554320-c1f2-413b-aaa1-8f5452d436c9 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:08:52.413709 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-bc554320-c1f2-413b-aaa1-8f5452d436c9 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 28 13:08:52.413709 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-f9b36845-5167-4da2-b929-bf36fbb7dc7d'] Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc554320-c1f2-413b-aaa1-8f5452d436c9 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Request method failure captured: Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-security-groups/6882683e-a311-4957-9bf9-1c40d3290c87 HTTP/1.1 Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Rh5RGbKtDDrCgtcrETRf6fy-BToiTQK6pN1qHh8sLOnHxi2B6Ey8xkof0-zqjXxWh4mlKAUWTntOY3OQlykuXF8kN9VBb4wywFsqaR8A3JRBq5UbR8SbkpD8qOKv0od7RX881Ak_pYP4JVD-5_-4NLE2S1AfIo9pm52lzViMKjMXo Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:52.416294 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59004ddf6c8c4f76a9bf1b24c09b3b82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 137149f8e63146e3a1a3ed58c52f72c8 Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: exception: Insufficient rights for removing default security group. Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-f9b36845-5167-4da2-b929-bf36fbb7dc7d'] Oct 28 13:08:52.417824 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6882683e-a311-4957-9bf9-1c40d3290c87'} Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.419555 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b36845-5167-4da2-b929-bf36fbb7dc7d'] Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 28 13:08:52.421382 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b36845-5167-4da2-b929-bf36fbb7dc7d'] Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b36845-5167-4da2-b929-bf36fbb7dc7d'] Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.422667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b36845-5167-4da2-b929-bf36fbb7dc7d'] Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc554320-c1f2-413b-aaa1-8f5452d436c9 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-f9b36845-5167-4da2-b929-bf36fbb7dc7d'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:52.424887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bc554320-c1f2-413b-aaa1-8f5452d436c9 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/6882683e-a311-4957-9bf9-1c40d3290c87" status: 400 len: 182 microversion: 2.1 time: 0.212795 Oct 28 13:08:52.427662 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 898/1748] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:08:52 2022] DELETE /compute/v2.1/os-security-groups/6882683e-a311-4957-9bf9-1c40d3290c87 => generated 182 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:08:52.440025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-427de3f8-22a6-4208-a467-6cf7e3979cac tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bd9fa4c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:52.516053 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-427de3f8-22a6-4208-a467-6cf7e3979cac tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.086769 Oct 28 13:08:52.516497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 899/1749] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:52 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:52.524583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e7c222d-06ce-4f3a-adf0-bfae74473f08 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Calling method '.version_select at 0x7f27bd9d3d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-6e7c222d-06ce-4f3a-adf0-bfae74473f08 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.security_group_api [None req-6e7c222d-06ce-4f3a-adf0-bfae74473f08 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Neutron security group a578cb8f-02a6-4285-a765-659652df6381 not found {{(pid=127793) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6e7c222d-06ce-4f3a-adf0-bfae74473f08 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] HTTP exception thrown: Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-ccbfa156-e2a3-45cc-800f-16a507402dd0'] Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e7c222d-06ce-4f3a-adf0-bfae74473f08 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Request method failure captured: Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-security-groups/a578cb8f-02a6-4285-a765-659652df6381 HTTP/1.1 Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:08:52.565508 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Rh5RGbKtDDrCgtcrETRf6fy-BToiTQK6pN1qHh8sLOnHxi2B6Ey8xkof0-zqjXxWh4mlKAUWTntOY3OQlykuXF8kN9VBb4wywFsqaR8A3JRBq5UbR8SbkpD8qOKv0od7RX881Ak_pYP4JVD-5_-4NLE2S1AfIo9pm52lzViMKjMXo Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59004ddf6c8c4f76a9bf1b24c09b3b82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:52.568520 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 137149f8e63146e3a1a3ed58c52f72c8 Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: exception: Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-ccbfa156-e2a3-45cc-800f-16a507402dd0'] Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'a578cb8f-02a6-4285-a765-659652df6381'} Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.569740 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccbfa156-e2a3-45cc-800f-16a507402dd0'] Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.572583 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccbfa156-e2a3-45cc-800f-16a507402dd0'] Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 13:08:52.574142 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccbfa156-e2a3-45cc-800f-16a507402dd0'] Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ccbfa156-e2a3-45cc-800f-16a507402dd0'] Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e7c222d-06ce-4f3a-adf0-bfae74473f08 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Returning 404 to user: Security group a578cb8f-02a6-4285-a765-659652df6381 does not exist Oct 28 13:08:52.575765 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-ccbfa156-e2a3-45cc-800f-16a507402dd0'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:52.576937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e7c222d-06ce-4f3a-adf0-bfae74473f08 tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/a578cb8f-02a6-4285-a765-659652df6381" status: 404 len: 194 microversion: 2.1 time: 0.041449 Oct 28 13:08:52.576937 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 900/1750] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:08:52 2022] GET /compute/v2.1/os-security-groups/a578cb8f-02a6-4285-a765-659652df6381 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:52.576937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:52.576937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:52.576937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:52.578606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:52.578606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:52.578948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:52.579257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:52.579682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:52.684956 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f47b2803-2967-40fe-85ae-cf338b56718a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 204 len: 0 microversion: 2.1 time: 0.969661 Oct 28 13:08:52.689843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 851/1751] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:08:51 2022] DELETE /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:08:52.711405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f5dd9fe-e189-4ca3-b6ea-aeac9a877b0e tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Action: 'update', calling method: .version_select at 0x7f27b93b5310>, body: {"security_group": {"name": "tempest-sg-827302208", "description": "tempest-description-2032463509"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:52.755608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:52.763693 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d510a3b4-474a-4b9f-9c35-371c906c526e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.203078 Oct 28 13:08:52.778927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 901/1752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:52 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:52.784697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:52.785842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:52.793502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:52.793989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:52.794573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:52.795290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:52.795740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:52.796176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:52.811723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-4f5dd9fe-e189-4ca3-b6ea-aeac9a877b0e tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:08:52.812203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-4f5dd9fe-e189-4ca3-b6ea-aeac9a877b0e tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Neutron security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:08:52.813069 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4f5dd9fe-e189-4ca3-b6ea-aeac9a877b0e tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] HTTP exception thrown: Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist Oct 28 13:08:52.813069 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-a1a01d69-b6a8-42f6-bc06-ac8258b22b54'] Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f5dd9fe-e189-4ca3-b6ea-aeac9a877b0e tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Request method failure captured: Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/os-security-groups/c62cd2b7-86ee-42d4-9d2a-a265aa60df8e HTTP/1.1 Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 101 Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Rh5RGbKtDDrCgtcrETRf6fy-BToiTQK6pN1qHh8sLOnHxi2B6Ey8xkof0-zqjXxWh4mlKAUWTntOY3OQlykuXF8kN9VBb4wywFsqaR8A3JRBq5UbR8SbkpD8qOKv0od7RX881Ak_pYP4JVD-5_-4NLE2S1AfIo9pm52lzViMKjMXo Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:08:52.815823 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_59004ddf6c8c4f76a9bf1b24c09b3b82", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/59004ddf6c8c4f76a9bf1b24c09b3b82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 59004ddf6c8c4f76a9bf1b24c09b3b82 Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-490713026 Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 137149f8e63146e3a1a3ed58c52f72c8 Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-490713026-project Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: {"security_group": {"name": "tempest-sg-827302208", "description": "tempest-description-2032463509"}} Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:08:52.817584 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-a1a01d69-b6a8-42f6-bc06-ac8258b22b54'] Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'c62cd2b7-86ee-42d4-9d2a-a265aa60df8e', 'body': {'security_group': {'name': 'tempest-sg-827302208', 'description': 'tempest-description-2032463509'}}} Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:08:52.818635 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a01d69-b6a8-42f6-bc06-ac8258b22b54'] Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:08:52.820091 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a01d69-b6a8-42f6-bc06-ac8258b22b54'] Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a01d69-b6a8-42f6-bc06-ac8258b22b54'] Oct 28 13:08:52.821642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1a01d69-b6a8-42f6-bc06-ac8258b22b54'] Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f5dd9fe-e189-4ca3-b6ea-aeac9a877b0e tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] Returning 404 to user: Security group c62cd2b7-86ee-42d4-9d2a-a265aa60df8e does not exist Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-a1a01d69-b6a8-42f6-bc06-ac8258b22b54'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:08:52.824008 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4f5dd9fe-e189-4ca3-b6ea-aeac9a877b0e tempest-SecurityGroupsNegativeTestJSON-490713026 tempest-SecurityGroupsNegativeTestJSON-490713026-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/c62cd2b7-86ee-42d4-9d2a-a265aa60df8e" status: 404 len: 194 microversion: 2.1 time: 0.125437 Oct 28 13:08:52.830637 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 852/1753] 10.222.0.25 () {60 vars in 1290 bytes} [Fri Oct 28 13:08:52 2022] PUT /compute/v2.1/os-security-groups/c62cd2b7-86ee-42d4-9d2a-a265aa60df8e => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:08:53.045192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6fa42581-1039-4e0e-88d0-541751c853d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:53.046373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6fa42581-1039-4e0e-88d0-541751c853d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:53.353435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:53.364208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6d590122-9c77-49e2-aaa0-5e77fc307350 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1512 microversion: 2.1 time: 0.583337 Oct 28 13:08:53.367615 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 902/1754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:52 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1512 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:53.376250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:53.383539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:53.395990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:53.396851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:53.401867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:53.403055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:53.404160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:53.405341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:53.663653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fa42581-1039-4e0e-88d0-541751c853d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:53.672103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fa42581-1039-4e0e-88d0-541751c853d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:53.695614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fa42581-1039-4e0e-88d0-541751c853d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:53.704128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6fa42581-1039-4e0e-88d0-541751c853d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1104 microversion: 2.25 time: 0.671101 Oct 28 13:08:53.734637 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 853/1755] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:53 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1104 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:53.756730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-336dfbc0-8402-468e-858b-c57aef7453c2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93a3f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:53.868350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:53.882122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:53.888253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:53.899998 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82bcd673-624b-4b20-9c26-7e79354905f8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.528537 Oct 28 13:08:53.919064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 903/1756] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:53 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:53.931371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:53.937932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:53.956093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:53.957172 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-336dfbc0-8402-468e-858b-c57aef7453c2 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.220301 Oct 28 13:08:53.960686 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 854/1757] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:53 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:53.961995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:53.962564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:53.971431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:53.973445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:53.975129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:54.393354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:54.394282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:54.416795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:54.417848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:54.418313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:54.420072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:54.420576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:54.422090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:54.728996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:54.747416 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60a27477-f338-462e-872d-c4612e431a1a tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1512 microversion: 2.1 time: 0.358999 Oct 28 13:08:54.750256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 855/1758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:54 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:54.768354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:54.770170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:54.777917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:54.782867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:54.784224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:54.784224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:54.786911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:54.787578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:54.788217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:54.789238 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-97e19527-545c-4327-88e2-aaa1d95c00e1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.869006 Oct 28 13:08:54.796782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 904/1759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:53 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:54.932489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:54.933874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:54.951772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:54.957896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:54.965479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:54.968795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:54.971127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:54.973493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:55.079172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:55.108983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:55.116538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:55.123241 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-239d7388-fe82-4bdf-a07e-10be6ece503b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1233 microversion: 2.25 time: 0.368687 Oct 28 13:08:55.128273 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 856/1760] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:54 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1233 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:55.148460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb0aa074-bdf5-4e8b-a649-2a72178479b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdb08160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:55.409096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:55.434136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:55.435756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:55.456322 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b8694d55-2a26-433a-b64a-4b872f3f33fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.528455 Oct 28 13:08:55.462924 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 905/1761] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:54 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:08:55.777389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:55.778155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:55.794813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:55.797732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:55.805417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:55.806332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:55.810664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:55.811911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:57.637714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a235c2bf166411ab1d5eaf92f73e3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f583781861469ca6a49de0f85673ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:57.662326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:08:57.687819 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c30fc02-4a48-46d7-947e-8e2b157217f8 tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 200 len: 1512 microversion: 2.1 time: 1.914228 Oct 28 13:08:57.694558 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 906/1762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:55 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 1512 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:08:57.724367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:57.725339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:57.758084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:57.759281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:57.767623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:57.771946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:57.773100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:57.774500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:59.348423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:59.361077 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b54c6bc0-59a5-4f4e-97c2-8478a5411d4f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 1.656638 Oct 28 13:08:59.361948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 907/1763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:08:57 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:08:59.371981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f8a2f670-f98a-4c84-a02d-f22c0d66ed8c req-15960736-7424-4b5c-911c-f7e7ec458a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16778c76-17c6-4a4a-bace-f54b6f7f4837", "name": "network-vif-plugged", "status": "completed", "tag": "315bda66-3f17-4ca5-9705-6dc6a59b5b67"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:08:59.422542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f8a2f670-f98a-4c84-a02d-f22c0d66ed8c req-15960736-7424-4b5c-911c-f7e7ec458a97 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:59.432834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f8a2f670-f98a-4c84-a02d-f22c0d66ed8c req-15960736-7424-4b5c-911c-f7e7ec458a97 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:59.439428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f8a2f670-f98a-4c84-a02d-f22c0d66ed8c req-15960736-7424-4b5c-911c-f7e7ec458a97 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:59.490201 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f8a2f670-f98a-4c84-a02d-f22c0d66ed8c req-15960736-7424-4b5c-911c-f7e7ec458a97 service nova] Creating event network-vif-plugged:315bda66-3f17-4ca5-9705-6dc6a59b5b67 for instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 on n-h2-862876-2 Oct 28 13:08:59.530901 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f8a2f670-f98a-4c84-a02d-f22c0d66ed8c req-15960736-7424-4b5c-911c-f7e7ec458a97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164643 Oct 28 13:08:59.544644 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 908/1764] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:08:59.560448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:59.573532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:08:59.606323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:59.611643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:59.612110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:59.615331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:08:59.615824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:08:59.616266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:08:59.942606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:59.962294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:59.964041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:08:59.970308 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a0511802-8fe7-485c-a092-ad6919814167 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1293 microversion: 2.25 time: 0.420746 Oct 28 13:08:59.971233 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 909/1765] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:59 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1293 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:08:59.983385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:08:59.987180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:00.010385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:00.010385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:00.011696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:00.014516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:00.017825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:00.018711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:00.677366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:00.883423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:00.896220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:00.900198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:00.938027 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4366875e-2011-4811-bd6c-5806aae47ce3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.965379 Oct 28 13:09:00.941072 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 910/1766] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:08:59 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:00.955399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4e538ebc-a021-4ae7-bd79-18e84fb7eeb9 req-7cf12aa8-79fa-4af2-9706-52afa348a103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3", "name": "network-vif-deleted", "tag": "a93f211e-7e42-4366-b982-2ac415c2e826"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:00.994234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4e538ebc-a021-4ae7-bd79-18e84fb7eeb9 req-7cf12aa8-79fa-4af2-9706-52afa348a103 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:01.001828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4e538ebc-a021-4ae7-bd79-18e84fb7eeb9 req-7cf12aa8-79fa-4af2-9706-52afa348a103 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:01.005575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4e538ebc-a021-4ae7-bd79-18e84fb7eeb9 req-7cf12aa8-79fa-4af2-9706-52afa348a103 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:01.048156 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4e538ebc-a021-4ae7-bd79-18e84fb7eeb9 req-7cf12aa8-79fa-4af2-9706-52afa348a103 service nova] Creating event network-vif-deleted:a93f211e-7e42-4366-b982-2ac415c2e826 for instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 on n-h1-862876-2 Oct 28 13:09:01.071622 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4e538ebc-a021-4ae7-bd79-18e84fb7eeb9 req-7cf12aa8-79fa-4af2-9706-52afa348a103 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118276 Oct 28 13:09:01.073721 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 911/1767] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:01.084120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:01.094181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] [instance: 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:01.115787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:01.116189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:01.116634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:01.117411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:01.117870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:01.123163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:01.186727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] HTTP exception thrown: Instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 could not be found. Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Request method failure captured: Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 HTTP/1.1 Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9RA98jf4H0xb7ZGezNrfh5JmjBO9y6oWNpENb_KHiUz2Eb-6w46iJPdDPNUAnojsIqbeAIBCGw69Tx-ItHPkWJH4kmI_ldTXqMz4D7VhwE_3QV2I9AoZTr_RJLQSFuqj9gYZpc9hPf1UDjewUcuMEYXqlz7YsR17nreVC7uepjqmMs Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 04f583781861469ca6a49de0f85673ce Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-InstanceActionsTestJSON-1077309250 Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:01.188748 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04f583781861469ca6a49de0f85673ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04f583781861469ca6a49de0f85673ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_04f583781861469ca6a49de0f85673ce", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/04f583781861469ca6a49de0f85673ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-InstanceActionsTestJSON-1077309250 Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 04f583781861469ca6a49de0f85673ce Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1077309250 Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-InstanceActionsTestJSON-1077309250-project Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4a235c2bf166411ab1d5eaf92f73e3ec Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-InstanceActionsTestJSON-1077309250-project Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 could not be found. Oct 28 13:09:01.190470 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3'} Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 could not be found. Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:01.192051 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 could not be found. Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 could not be found. Oct 28 13:09:01.193879 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:01.200665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] Returning 404 to user: Instance 8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:01.202138 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-383f702b-51de-40eb-b809-5ebd3320866c tempest-InstanceActionsTestJSON-1077309250 tempest-InstanceActionsTestJSON-1077309250-project] 10.222.0.25 "GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3" status: 404 len: 111 microversion: 2.1 time: 0.127277 Oct 28 13:09:01.204393 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 912/1768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:01 2022] GET /compute/v2.1/servers/8f8ab4d2-e9c1-468d-8eb7-7f7d45ab90e3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:09:01.222481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:01.223305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:01.245954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:01.248502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:01.248894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:01.249624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:01.250086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:01.250513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:01.998729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:02.587931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:02.600557 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fda11e09-83b4-470b-a1d3-08303c290d3d tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 1.394774 Oct 28 13:09:02.601156 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 913/1769] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:01 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:02.627724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:02.631576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:02.642856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:02.645725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:02.646359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:02.648199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:02.652229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:02.652938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:03.164483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:03.177313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:03.185087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:03.188016 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cb51ce8d-3022-4e0b-ae73-c3475fe71a9a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1293 microversion: 2.25 time: 0.581673 Oct 28 13:09:03.192694 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 914/1770] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:02 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1293 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:03.211862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:03.212837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:03.245067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:03.249720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:03.253118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:03.254480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:03.255241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:03.263847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:03.671550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:03.917553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:03.945977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:03.953501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:03.966893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-297360e4-2a5e-4d1e-b5b2-f7dcd6f66478 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.772768 Oct 28 13:09:03.979709 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 915/1771] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:03 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:04.191612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Calling method '.version_select at 0x7f27bd9a2d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:04.203689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:04.204178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:04.204604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:04.211258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:04.212575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:04.213237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:04.236994 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0b2a36db-2cf5-45f1-92c9-886a6f56d948 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.255676 Oct 28 13:09:04.252963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 916/1772] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Oct 28 13:09:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:04.261696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:04.262501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:04.270222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:04.271101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:04.271698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:04.272578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:04.273189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:04.273767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:04.779072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:04.824408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:04.837313 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-709e7d8a-53f2-4e14-8c6f-7661b11b3167 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 0.582407 Oct 28 13:09:04.865243 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 917/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:04 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:04.886920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8969f2f3-6496-429c-a939-fe6a6e8e4a76 req-5dcfe7ae-b1d7-4e38-b9db-c2989e7f6fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8bc2afd-f819-4e20-b648-10b391be298b", "tag": "480f1c45-173b-4c88-9850-e79388dc2e83"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:04.893805 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb0aa074-bdf5-4e8b-a649-2a72178479b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 9.763902 Oct 28 13:09:04.896481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 857/1774] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:08:55 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 9767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:04.915631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:04.925529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:04.935688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8969f2f3-6496-429c-a939-fe6a6e8e4a76 req-5dcfe7ae-b1d7-4e38-b9db-c2989e7f6fc6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:04.941895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:04.942785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:04.943392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8969f2f3-6496-429c-a939-fe6a6e8e4a76 req-5dcfe7ae-b1d7-4e38-b9db-c2989e7f6fc6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:04.943605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:04.943846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8969f2f3-6496-429c-a939-fe6a6e8e4a76 req-5dcfe7ae-b1d7-4e38-b9db-c2989e7f6fc6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:04.944670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:04.945398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:04.946009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:04.987247 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8969f2f3-6496-429c-a939-fe6a6e8e4a76 req-5dcfe7ae-b1d7-4e38-b9db-c2989e7f6fc6 service nova] Creating event network-changed:480f1c45-173b-4c88-9850-e79388dc2e83 for instance e8bc2afd-f819-4e20-b648-10b391be298b on n-h2-862876-2 Oct 28 13:09:04.993085 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8969f2f3-6496-429c-a939-fe6a6e8e4a76 req-5dcfe7ae-b1d7-4e38-b9db-c2989e7f6fc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125589 Oct 28 13:09:04.994039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 918/1775] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:05.002804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1057590306", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:05.122010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:09:05.377573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:05.396070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:05.400392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:05.403156 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87aa1bbb-6d43-41e0-afeb-6c8736d4bc2b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1293 microversion: 2.25 time: 0.504544 Oct 28 13:09:05.405487 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 858/1776] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:04 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1293 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:05.415746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:05.424367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:05.441205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:05.446416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:05.447214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:05.452334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:05.453213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:05.454994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:05.678097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:05.694364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:05.699755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Getting quotas for project bca33fa843c04ddf908d5aaf074014ee. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:05.700407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:05.714708 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-16871659-76db-4e7c-a386-2c564e8948e3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1535 microversion: 2.91 time: 0.307832 Oct 28 13:09:05.715297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Getting quotas for user 2c39cd75a2dd443c8c5f69987c9b3f53 and project bca33fa843c04ddf908d5aaf074014ee. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:05.718707 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 859/1777] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:05 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1535 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:05.754416 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Request method failure captured: Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 1752 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9RtaXBciazrU6MPGU6uJPoKZV3yrT_f9z0S3UyrRVdbYmw_Rx3szgQQLo-q8ivaIRGCbMCnjw9qjZ2LoKR2p8zcamcwA78Qdry1RoQbVrkd2rsr725Xu3gRSc3cToM5twXb7LJ9pNxkTfKuCrvxXnadTvxNJyd_xcMeSkGg8RYSIoc Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: bca33fa843c04ddf908d5aaf074014ee Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-852590175 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bca33fa843c04ddf908d5aaf074014ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bca33fa843c04ddf908d5aaf074014ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bca33fa843c04ddf908d5aaf074014ee", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bca33fa843c04ddf908d5aaf074014ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-852590175 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: bca33fa843c04ddf908d5aaf074014ee Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-852590175 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-852590175-project Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2c39cd75a2dd443c8c5f69987c9b3f53 Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-852590175-project Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1057590306", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:05.758267 n-d-862876-2 devstack@n-api.service[127793]: exception: Maximum number of metadata items exceeds 128 Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1057590306', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:05.761466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:05.765201 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7258a6a2-5324-47aa-b89d-2cf50dd5ff73 tempest-AbsoluteLimitsNegativeTestJSON-852590175 tempest-AbsoluteLimitsNegativeTestJSON-852590175-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.763321 Oct 28 13:09:05.766515 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 919/1778] 10.222.0.25 () {60 vars in 1148 bytes} [Fri Oct 28 13:09:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 771 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:09:05.878199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:05.879048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:05.892629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:05.893139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:05.897680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:05.910875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f35ff17-0293-41a9-8c44-a6fdb3100b72 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b98609d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:05.917532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:05.924148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:05.924713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:06.032931 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f35ff17-0293-41a9-8c44-a6fdb3100b72 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.127075 Oct 28 13:09:06.033939 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 920/1779] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:05 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:09:06.434987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:06.435745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:06.459594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:06.471599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:06.481455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:06.488427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:06.490196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:06.494896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:06.980472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:06.997276 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62303268-1dde-4540-9063-ff6c28aa1795 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1518 microversion: 2.1 time: 1.124078 Oct 28 13:09:06.998687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 860/1780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:05 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1518 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:07.006442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:07.007549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:07.016052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:07.017084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:07.018332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:07.019484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:07.021416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:07.022247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:07.227814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:07.245918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:07.249825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:07.255928 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-918d3e1c-b541-43ef-bd39-ca9436f363d1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1293 microversion: 2.25 time: 0.822791 Oct 28 13:09:07.257111 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 921/1781] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:06 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1293 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:07.264642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cda71bb2-4cbb-4acb-bff5-ffe26a81e740 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bd99a280>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:07.364534 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cda71bb2-4cbb-4acb-bff5-ffe26a81e740 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.103563 Oct 28 13:09:07.367461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 922/1782] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:07 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:07.447973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:07.476013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:07.479216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:07.499771 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d5feaf30-a6d4-4297-bf62-28fef7e06675 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1535 microversion: 2.91 time: 0.497217 Oct 28 13:09:07.501149 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 861/1783] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:06 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1535 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:08.028232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:08.030033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:08.050611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:08.051404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:08.051962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:08.054868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:08.055481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:08.057811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:08.285814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:08.286634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:08.312229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:08.313173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:08.313875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:08.318812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:08.319734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:08.320456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:08.610582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:08.624442 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4bd3253d-f257-4875-8552-b574d166f2b0 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1524 microversion: 2.1 time: 0.596103 Oct 28 13:09:08.626915 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 923/1784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:08 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1524 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:08.645795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e187c59a-8506-46f6-8d75-a158804b942b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bd9faee0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:08.784511 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e187c59a-8506-46f6-8d75-a158804b942b tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.156317 Oct 28 13:09:08.792991 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 924/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:08 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:08.792991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:08.792991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:08.828846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:08.829448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:08.829901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:08.830639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:08.831316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:08.831741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:09.072747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:09.085179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:09.086663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:09.093101 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-839ac3aa-8c7f-4285-bb26-06930517b516 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1293 microversion: 2.25 time: 0.812545 Oct 28 13:09:09.095641 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 862/1786] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:08 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1293 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:09:09.124290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:09.133758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:09.135170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:09.144720 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-daf96bcb-652d-4862-8d11-88cfa0d693df tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1538 microversion: 2.91 time: 0.356803 Oct 28 13:09:09.145926 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 925/1787] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:08 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1538 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:09.206369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:09.291974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:09.349955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:09.352258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:09.357914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:09.363050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:09.366408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:09.367616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:09.657183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:09.657791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:09.674151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:09.684869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:09.684869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:09.684869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:09.684869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:09.684869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:10.143304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862876-2". {{(pid=127794) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 13:09:10.376946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:10.388500 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58cc24bf-e046-4a93-a484-95670a42b224 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1524 microversion: 2.1 time: 0.739225 Oct 28 13:09:10.389077 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 926/1788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:09 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1524 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:09:10.398289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5d96075-197a-4db8-bc4e-b33ea1a90dbb tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bd99a3a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:10.477692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:10.506876 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5d96075-197a-4db8-bc4e-b33ea1a90dbb tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.116522 Oct 28 13:09:10.508655 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 927/1789] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:10 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:10.517076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:10.525904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:10.544960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:10.546519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:10.547366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:10.549543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:10.559979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:10.559979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:11.021426 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-68e971c1-ddb0-42c8-a58f-1612dbaeafc5 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action" status: 202 len: 0 microversion: 2.91 time: 1.843434 Oct 28 13:09:11.026479 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 863/1790] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:09:09 2022] POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action => generated 0 bytes in 1853 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:11.037064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:11.052304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:11.088929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:11.089958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:11.095059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:11.100684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:11.101410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:11.102028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:11.129465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:11.146292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:11.147988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:11.149147 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-392301fb-55f9-41b5-9b5b-e08710b3a619 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1281 microversion: 2.25 time: 0.637578 Oct 28 13:09:11.160100 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 928/1791] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:10 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1281 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:11.427865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:11.427865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:11.442058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:11.443014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:11.444229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:11.445718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:11.448436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:11.449784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:11.510898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:11.537159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:11.548002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:11.568286 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4f73122-04e4-4386-9b6b-a8bedc70be7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1486 microversion: 2.91 time: 0.537468 Oct 28 13:09:11.571820 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 864/1792] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:11 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1486 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:11.577231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76976357-88ed-401b-ac29-2ad48b672318 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdb24dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:11.880762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76976357-88ed-401b-ac29-2ad48b672318 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.307574 Oct 28 13:09:11.885150 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 865/1793] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:11 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:12.205110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:12.205728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:12.225085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:12.225593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:12.226072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:12.226905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:12.227263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:12.227693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:12.656736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:12.669270 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bbc9c21a-0633-4486-ad86-f43e53dacc24 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1524 microversion: 2.1 time: 1.255445 Oct 28 13:09:12.685440 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 929/1794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:11 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1524 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:09:12.685440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:12.685440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:12.697581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:12.698075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:12.701538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:12.703452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:12.707051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:12.707779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:12.711100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:12.730081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:12.735322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:12.741195 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8f29ddb-ae2a-4cc0-b0b1-4e46084ca475 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1281 microversion: 2.25 time: 0.540687 Oct 28 13:09:12.743311 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 866/1795] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:12 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1281 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:09:12.901070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7fca5397-9fe5-4d3b-8df9-3778bb555493 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93a5820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:12.903576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:12.916247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:12.921096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:12.932656 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c1d82c8-ff5a-4236-a7eb-34459fbeb2db tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1486 microversion: 2.91 time: 0.256211 Oct 28 13:09:12.934648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 930/1796] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:12 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1486 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:12.992353 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7fca5397-9fe5-4d3b-8df9-3778bb555493 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.095525 Oct 28 13:09:12.993901 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 867/1797] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:12 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:13.699246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:13.699877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:13.708580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:13.709022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:13.709456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:13.711752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:13.712241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:13.712666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:13.772797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:13.773548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:13.780848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:13.781903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:13.782370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:13.783132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:13.783730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:13.784357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:13.857754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:13.860415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:13.866779 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a76bcc11-bc6d-4767-8ab4-70720ee02c46 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1524 microversion: 2.1 time: 0.171664 Oct 28 13:09:13.867612 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 931/1798] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:13 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1524 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:13.963966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:13.964490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:13.993237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:14.008546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:14.009993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:14.014055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:14.020914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:14.020914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:14.105722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:14.123701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:14.125370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:14.139705 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c945153d-5647-4e80-a9e8-530318d8292c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1281 microversion: 2.25 time: 0.358198 Oct 28 13:09:14.154792 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 868/1799] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:13 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:09:14.156778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-503c6b6f-75c9-4757-bdee-64676bce16ee tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdb240d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:14.227201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:14.248988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-503c6b6f-75c9-4757-bdee-64676bce16ee tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.106791 Oct 28 13:09:14.249583 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 869/1800] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:14 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:14.272281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:14.323531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:14.338370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:14.363745 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fa246cb-0e43-4f18-a31d-10e7ec6e425a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1486 microversion: 2.91 time: 0.403599 Oct 28 13:09:14.370826 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 932/1801] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:13 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1486 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:14.527780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a708a21b-79fe-421f-86ba-2317605b2c1f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1222409962", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a708a21b-79fe-421f-86ba-2317605b2c1f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] HTTP exception thrown: min_count must be <= max_count Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a708a21b-79fe-421f-86ba-2317605b2c1f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Request method failure captured: Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 184 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9R54kHRX8cTxyxu0Miysaw_hp_Y5DTSqE5dxLYvZBSeCC3rew8ABOTTztyKtn-qov_F7rQjOMtuTdZXpTYg-lVaEddos6SNkBW4yUbnDiufQpQ_An4pnKlSW2dmpmGe7OAwqjBTjiw2utuZcokTleezCDJv_MlotFh1sHevF8eFnJ0 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ddc21553c8364d7da31f2d6f6e2a417e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 66cc7ee31e154bda9f34f737f4375eea Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1222409962", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: exception: min_count must be <= max_count Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1222409962', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:09:14.537683 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:09:14.542187 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 28 13:09:14.542187 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.542187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a708a21b-79fe-421f-86ba-2317605b2c1f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Returning 400 to user: min_count must be <= max_count {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:14.547016 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a708a21b-79fe-421f-86ba-2317605b2c1f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.261683 Oct 28 13:09:14.556889 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 870/1802] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:14 2022] POST /compute/v2.1/servers => generated 74 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 28 13:09:14.645507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7f2e688-a595-400f-81fb-629cccf6889f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-355770683", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "max_count": 0}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7f2e688-a595-400f-81fb-629cccf6889f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Request method failure captured: Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 167 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9R54kHRX8cTxyxu0Miysaw_hp_Y5DTSqE5dxLYvZBSeCC3rew8ABOTTztyKtn-qov_F7rQjOMtuTdZXpTYg-lVaEddos6SNkBW4yUbnDiufQpQ_An4pnKlSW2dmpmGe7OAwqjBTjiw2utuZcokTleezCDJv_MlotFh1sHevF8eFnJ0 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ddc21553c8364d7da31f2d6f6e2a417e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 66cc7ee31e154bda9f34f737f4375eea Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-355770683", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "max_count": 0}} Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-355770683', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'max_count': 0}}} Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 0 Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:14.652153 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 13:09:14.657390 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.660133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7f2e688-a595-400f-81fb-629cccf6889f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:14.666441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7f2e688-a595-400f-81fb-629cccf6889f tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027218 Oct 28 13:09:14.680596 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 933/1803] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:09:14.742091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-073f5d98-fedf-483c-9919-e1e51b8d9294 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-623732740", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "max_count": 2.5}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-073f5d98-fedf-483c-9919-e1e51b8d9294 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Request method failure captured: Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 169 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9R54kHRX8cTxyxu0Miysaw_hp_Y5DTSqE5dxLYvZBSeCC3rew8ABOTTztyKtn-qov_F7rQjOMtuTdZXpTYg-lVaEddos6SNkBW4yUbnDiufQpQ_An4pnKlSW2dmpmGe7OAwqjBTjiw2utuZcokTleezCDJv_MlotFh1sHevF8eFnJ0 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ddc21553c8364d7da31f2d6f6e2a417e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 66cc7ee31e154bda9f34f737f4375eea Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-623732740", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "max_count": 2.5}} Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-623732740', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'max_count': 2.5}}} Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:14.747460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 13:09:14.752501 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.754704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-073f5d98-fedf-483c-9919-e1e51b8d9294 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:14.756127 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-073f5d98-fedf-483c-9919-e1e51b8d9294 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020145 Oct 28 13:09:14.756978 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 871/1804] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:09:14.873490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9f4eb94-db94-4397-9eb9-b22f5291a6ce tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-984047123", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 0}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9f4eb94-db94-4397-9eb9-b22f5291a6ce tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Request method failure captured: Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 167 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9R54kHRX8cTxyxu0Miysaw_hp_Y5DTSqE5dxLYvZBSeCC3rew8ABOTTztyKtn-qov_F7rQjOMtuTdZXpTYg-lVaEddos6SNkBW4yUbnDiufQpQ_An4pnKlSW2dmpmGe7OAwqjBTjiw2utuZcokTleezCDJv_MlotFh1sHevF8eFnJ0 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ddc21553c8364d7da31f2d6f6e2a417e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 66cc7ee31e154bda9f34f737f4375eea Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-984047123", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 0}} Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-984047123', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'min_count': 0}}} Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 0 Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:14.881867 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:14.896511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9f4eb94-db94-4397-9eb9-b22f5291a6ce tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:14.911436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:14.912748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:14.917276 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9f4eb94-db94-4397-9eb9-b22f5291a6ce tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.051059 Oct 28 13:09:14.920343 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 934/1805] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:14 2022] POST /compute/v2.1/servers => generated 130 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:09:14.943011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:14.944186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:14.946612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:14.947552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:14.948657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:14.950295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:15.037958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-292be04a-eaa1-49e7-afd3-940604d3cfc7 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2056007642", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 2.5}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-292be04a-eaa1-49e7-afd3-940604d3cfc7 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Request method failure captured: Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 170 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9R54kHRX8cTxyxu0Miysaw_hp_Y5DTSqE5dxLYvZBSeCC3rew8ABOTTztyKtn-qov_F7rQjOMtuTdZXpTYg-lVaEddos6SNkBW4yUbnDiufQpQ_An4pnKlSW2dmpmGe7OAwqjBTjiw2utuZcokTleezCDJv_MlotFh1sHevF8eFnJ0 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ddc21553c8364d7da31f2d6f6e2a417e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ddc21553c8364d7da31f2d6f6e2a417e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: ddc21553c8364d7da31f2d6f6e2a417e Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1858688228 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 66cc7ee31e154bda9f34f737f4375eea Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1858688228-project Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2056007642", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 2.5}} Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2056007642', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'min_count': 2.5}}} Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:15.045644 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-292be04a-eaa1-49e7-afd3-940604d3cfc7 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-292be04a-eaa1-49e7-afd3-940604d3cfc7 tempest-MultipleCreateNegativeTestJSON-1858688228 tempest-MultipleCreateNegativeTestJSON-1858688228-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020625 Oct 28 13:09:15.050720 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 935/1806] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:15 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:09:15.175230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:15.176226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:15.192724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:15.193505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:15.194128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:15.196955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:15.197666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:15.198354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:15.466539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:15.480352 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-665f7adc-819d-433f-bf02-f312c20f709e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1524 microversion: 2.1 time: 0.577533 Oct 28 13:09:15.481478 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 872/1807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:14 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1524 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:15.492131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-613359d7-3264-4061-bd40-72afdd0bf32f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdb08f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:15.573144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:15.587706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:15.590054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:15.591738 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9927ebe4-3c0b-4091-aac4-8bde4a537911 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1281 microversion: 2.25 time: 0.422209 Oct 28 13:09:15.592619 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 936/1808] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:15 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:15.597887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:15.598510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:15.606169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:15.606908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:15.618150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:15.618150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:15.618150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:15.618150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:15.627570 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-613359d7-3264-4061-bd40-72afdd0bf32f tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.144780 Oct 28 13:09:15.649913 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 873/1809] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:15 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:15.658213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-dc623f66-757b-4f2e-a52f-c1bb9d40fcd0 req-0b56d880-b186-495d-a069-cf9ef7e4d6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d02003-0d62-4f7b-b380-a8297dbd531c", "name": "network-vif-plugged", "status": "completed", "tag": "b046433f-6722-4055-8dd8-694492622aec"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:15.684736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dc623f66-757b-4f2e-a52f-c1bb9d40fcd0 req-0b56d880-b186-495d-a069-cf9ef7e4d6d2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:15.686116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dc623f66-757b-4f2e-a52f-c1bb9d40fcd0 req-0b56d880-b186-495d-a069-cf9ef7e4d6d2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:15.686803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dc623f66-757b-4f2e-a52f-c1bb9d40fcd0 req-0b56d880-b186-495d-a069-cf9ef7e4d6d2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:15.706284 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-dc623f66-757b-4f2e-a52f-c1bb9d40fcd0 req-0b56d880-b186-495d-a069-cf9ef7e4d6d2 service nova] Creating event network-vif-plugged:b046433f-6722-4055-8dd8-694492622aec for instance 09d02003-0d62-4f7b-b380-a8297dbd531c on n-h1-862876-2 Oct 28 13:09:15.716122 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-dc623f66-757b-4f2e-a52f-c1bb9d40fcd0 req-0b56d880-b186-495d-a069-cf9ef7e4d6d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063444 Oct 28 13:09:15.717446 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 874/1810] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:15.740650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:15.845937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:15.858456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:15.873664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:15.880614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:15.908057 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f204a11-2966-4568-9f65-4ec1d6fa89e5 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.309849 Oct 28 13:09:15.925300 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 937/1811] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:15 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:16.506999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:16.507984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:16.515207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:16.522991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:16.522991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:16.522991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:16.522991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:16.522991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:16.618085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:16.619284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:16.646646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:16.647478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:16.650048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:16.653478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:16.654434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:16.655242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:16.977460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:16.994243 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f313c7bf-3713-481b-a99d-a34896bf78b4 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1524 microversion: 2.1 time: 0.493151 Oct 28 13:09:16.995623 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 875/1812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:16 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1524 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:17.006042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f201a61-251a-4bf3-a495-cd8f9cea5821 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93a5820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:17.082217 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f201a61-251a-4bf3-a495-cd8f9cea5821 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1428 microversion: 2.1 time: 0.084919 Oct 28 13:09:17.102661 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 876/1813] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:16 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:17.118824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:17.126244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:17.156174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:17.156714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:17.157171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:17.165680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:17.166571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:17.168485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:17.322581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:17.329070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:17.338250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:17.384976 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b587af60-10a6-4f55-8fb6-4621007fde68 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.278338 Oct 28 13:09:17.388877 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 877/1814] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:17 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:17.412009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:17.423621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:17.426461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:17.429334 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb40689c-9d65-4e28-99f2-4cc36ff7fa44 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1281 microversion: 2.25 time: 0.816254 Oct 28 13:09:17.437550 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 938/1815] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:16 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1281 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:18.027231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:18.028362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:18.066153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:18.085719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:18.086276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:18.091274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:18.094253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:18.096190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:18.110467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40174350-3479-4189-b2a8-2b4ac102b708 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bd9914c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:19.774380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:19.791505 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-85c7cbed-c756-4cdf-8924-2a71d5a166d1 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1509 microversion: 2.1 time: 1.777473 Oct 28 13:09:19.793807 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 878/1816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:18 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1509 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:19.823512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:19.823512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:19.848914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:19.852616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:19.855498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:19.857290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:19.869514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:19.870352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:20.375669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:20.397860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:20.406411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:20.436478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88dd1bb4-a959-4343-aa01-8d6a80b165bd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.640737 Oct 28 13:09:20.442344 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 879/1817] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:19 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:20.456585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:20.457530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:20.492494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:20.499047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:20.499762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:20.500399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:20.500883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:20.508059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:21.115819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:21.129849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:21.134694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:21.141094 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cc650da4-934f-444a-99c5-babb9ff177a9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1281 microversion: 2.25 time: 0.696234 Oct 28 13:09:21.142400 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 880/1818] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:20 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1281 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:21.152207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:21.155813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:21.171544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:21.173806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:21.174516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:21.178269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:21.180282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:21.181904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:21.931559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:21.942730 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c30ebf31-dd9b-4978-b3eb-cca8739d0492 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 200 len: 1509 microversion: 2.1 time: 0.798645 Oct 28 13:09:21.944482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 881/1819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:21 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 1509 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:21.950977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:21.952332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:21.958961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:21.959727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:21.960377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:21.961396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:21.962057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:21.962685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:22.084854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:22.105012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:22.120951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:22.120951 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9cc68fdc-bdf0-4c17-b369-e562d4e6339e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.166548 Oct 28 13:09:22.120951 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 882/1820] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:21 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:22.398417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1710270647", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "09db6954-888a-48c6-adf5-d40098ae89d9"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:25.482497 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40174350-3479-4189-b2a8-2b4ac102b708 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1437 microversion: 2.1 time: 7.378581 Oct 28 13:09:25.507419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] validate_networks() for [('09db6954-888a-48c6-adf5-d40098ae89d9', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:09:25.511415 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 939/1821] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:18 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1437 bytes in 7405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:25.523925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:25.524878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:25.533217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:25.533973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:25.535155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:25.536225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:25.537380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:25.537988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:25.611197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:09:26.043266 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bee8e41-da47-4735-bee8-e74b39eb4e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 204 len: 0 microversion: 2.1 time: 0.533113 Oct 28 13:09:26.049417 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 940/1822] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:09:25 2022] DELETE /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:26.056136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:26.058907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:26.091810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:26.096928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:26.098139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:26.104978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:26.106401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:26.107538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:26.487067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:26.496763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:26.498338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:26.499615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a815723-6004-433e-aef1-8740626cd5d2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1281 microversion: 2.25 time: 0.448479 Oct 28 13:09:26.500265 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 941/1823] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:26 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1281 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:26.514991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:26.516012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:26.529359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:26.550897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:26.551492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:26.552140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:26.552612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:26.553034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:26.871329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:26.885513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:26.892748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:26.916746 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-03be6f27-c2bb-4284-807f-9aeba7cca776 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.415120 Oct 28 13:09:26.933542 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 942/1824] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:26 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:26.957587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-13195477-3f99-4609-b191-2909308d2cf0 req-2349baff-cd29-45de-96f8-b28bd4b3abd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bc2afd-f819-4e20-b648-10b391be298b", "name": "network-vif-plugged", "status": "completed", "tag": "480f1c45-173b-4c88-9850-e79388dc2e83"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:26.976109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-13195477-3f99-4609-b191-2909308d2cf0 req-2349baff-cd29-45de-96f8-b28bd4b3abd2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:26.976728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-13195477-3f99-4609-b191-2909308d2cf0 req-2349baff-cd29-45de-96f8-b28bd4b3abd2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:26.977264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-13195477-3f99-4609-b191-2909308d2cf0 req-2349baff-cd29-45de-96f8-b28bd4b3abd2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:27.004228 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-13195477-3f99-4609-b191-2909308d2cf0 req-2349baff-cd29-45de-96f8-b28bd4b3abd2 service nova] Creating event network-vif-plugged:480f1c45-173b-4c88-9850-e79388dc2e83 for instance e8bc2afd-f819-4e20-b648-10b391be298b on n-h2-862876-2 Oct 28 13:09:27.022972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-13195477-3f99-4609-b191-2909308d2cf0 req-2349baff-cd29-45de-96f8-b28bd4b3abd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087165 Oct 28 13:09:27.024032 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 943/1825] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:27.041742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eff62848-7730-48cc-9c7e-36382026385e tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bd978e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:27.177367 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eff62848-7730-48cc-9c7e-36382026385e tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 200 len: 1437 microversion: 2.1 time: 0.149899 Oct 28 13:09:27.209962 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 944/1826] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:27 2022] GET /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 1437 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:27.238829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1635600225", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "5d811f6e-cc55-4a5f-85b2-3720ed1ab191"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:27.476610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] validate_networks() for [('5d811f6e-cc55-4a5f-85b2-3720ed1ab191', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:09:28.847130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:09:28.848368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:09:28.849291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:09:28.850356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:09:28.852283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:09:28.888983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:28.891116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:28.892990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:28.895694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:28.901280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:28.903242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:29.022230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:29.060812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for user a43aa3346a70490d9c5e489c8e39d91d and project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:29.103648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:09:29.130800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:09:29.309827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:09:29.311931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:09:29.313256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:09:29.317119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:09:29.318397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:09:29.344532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:29.346221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:29.348960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:29.350842 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bc86ecf9-cf7d-488e-81a6-b014c3dea88f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.233715 Oct 28 13:09:29.351118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:29.352592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:29.353231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:29.353666 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 883/1827] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 7240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:09:29.369629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:29.373640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:29.408210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:29.410416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:29.411553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:29.415550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:29.417676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:29.420688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:29.449507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Getting quotas for project 54902a27bc8e4736a3ea3e48c1c6924a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:29.471054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Getting quotas for user 6655019d4e204241b8f97a5d2cdbd0bf and project 54902a27bc8e4736a3ea3e48c1c6924a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:29.504778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:09:29.512658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:09:29.724812 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c927333a-1842-4d6a-8f84-34650b2df267 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.513221 Oct 28 13:09:29.739344 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 945/1828] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:09:29.753606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:29.762593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:29.773374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:29.774181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:29.775057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:29.781204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:29.781204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:29.781204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:30.385074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:30.413994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:30.420510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:30.420510 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35bdbd48-701b-4b9f-8e59-817083eec668 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1477 microversion: 2.25 time: 0.676214 Oct 28 13:09:30.420510 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 946/1829] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:29 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1477 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:30.438695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:30.443045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:30.467989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:30.471495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:30.473250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:30.474238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:30.479559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:30.481820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:30.835880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:30.875037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:30.884783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:30.925638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f9c48a1a-d5d3-4927-874e-28420db8514a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.506799 Oct 28 13:09:30.928819 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 947/1830] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:30 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:30.938677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c72fb2c-9bf2-4ac7-9a17-f8c6c2a03d59 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:30.965429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c72fb2c-9bf2-4ac7-9a17-f8c6c2a03d59 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:31.218204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:31.249768 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32ae6afd-49c9-4fe8-884a-326da343b691 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1467 microversion: 2.1 time: 1.890785 Oct 28 13:09:31.263440 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 884/1831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:29 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1467 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:31.275868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8860f65a-5392-4634-850f-934d4e5a8419 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:31.277062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8860f65a-5392-4634-850f-934d4e5a8419 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:31.528772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c72fb2c-9bf2-4ac7-9a17-f8c6c2a03d59 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:31.563898 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c72fb2c-9bf2-4ac7-9a17-f8c6c2a03d59 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1208 microversion: 2.1 time: 0.628519 Oct 28 13:09:31.565301 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 948/1832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:30 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1208 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:31.899528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8860f65a-5392-4634-850f-934d4e5a8419 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:31.935635 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8860f65a-5392-4634-850f-934d4e5a8419 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1218 microversion: 2.1 time: 0.654391 Oct 28 13:09:31.935635 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 885/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:31 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1218 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:31.935635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3fd92b32-8aec-466f-8846-418963e918f5 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27b93a3430>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:32.047042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:32.047936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:32.096660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:32.107412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:32.107412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:32.107412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:32.107412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:32.107412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.364689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid e8bc2afd-f819-4e20-b648-10b391be298b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:33.382336 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7be6e0b-fc31-4ef2-b9c8-4cfac559a5db tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1970 microversion: 2.25 time: 1.813599 Oct 28 13:09:33.383324 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 949/1834] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:31 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1970 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:33.395693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-22ff43e1-8499-4e08-9bc8-b960ebf29a95 req-2baa8635-5053-4030-9d84-5e93f88b0c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d02003-0d62-4f7b-b380-a8297dbd531c", "name": "network-vif-deleted", "tag": "b046433f-6722-4055-8dd8-694492622aec"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:33.418801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-22ff43e1-8499-4e08-9bc8-b960ebf29a95 req-2baa8635-5053-4030-9d84-5e93f88b0c5e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.421939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-22ff43e1-8499-4e08-9bc8-b960ebf29a95 req-2baa8635-5053-4030-9d84-5e93f88b0c5e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.422570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-22ff43e1-8499-4e08-9bc8-b960ebf29a95 req-2baa8635-5053-4030-9d84-5e93f88b0c5e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.438804 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-22ff43e1-8499-4e08-9bc8-b960ebf29a95 req-2baa8635-5053-4030-9d84-5e93f88b0c5e service nova] Creating event network-vif-deleted:b046433f-6722-4055-8dd8-694492622aec for instance 09d02003-0d62-4f7b-b380-a8297dbd531c on n-h1-862876-2 Oct 28 13:09:33.446288 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-22ff43e1-8499-4e08-9bc8-b960ebf29a95 req-2baa8635-5053-4030-9d84-5e93f88b0c5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057935 Oct 28 13:09:33.446923 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 950/1835] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:33.453512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:33.454201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:33.461251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.461757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.462189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.462929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.463382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.463999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.560557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:33.572833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:33.574455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:33.581547 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06ae3933-0d60-442c-8c0e-a71178e5975d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.131404 Oct 28 13:09:33.582736 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 951/1836] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:33 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:33.589047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:33.590150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:33.597091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.598146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.598775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.599648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.600262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.600843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.674932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:33.683554 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-308d82cc-fce5-4291-a09c-eb733728b24d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1204 microversion: 2.1 time: 0.098955 Oct 28 13:09:33.684136 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 952/1837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:33 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:33.689290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:33.689952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:33.696613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.697369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.697811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.698561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.699089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.699525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.768228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:33.776359 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1bfd6a4e-c6de-4f4a-a422-e1b63eafbaad tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1214 microversion: 2.1 time: 0.090943 Oct 28 13:09:33.777087 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 953/1838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:33 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:33.781910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d79871dd-a727-4ec6-ba02-fcfa47ffa966 req-927e8c48-cf70-4140-b8ba-2782adf70342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16778c76-17c6-4a4a-bace-f54b6f7f4837", "name": "network-vif-unplugged", "status": "completed", "tag": "315bda66-3f17-4ca5-9705-6dc6a59b5b67"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:33.792412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d79871dd-a727-4ec6-ba02-fcfa47ffa966 req-927e8c48-cf70-4140-b8ba-2782adf70342 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.793557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d79871dd-a727-4ec6-ba02-fcfa47ffa966 req-927e8c48-cf70-4140-b8ba-2782adf70342 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.794174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d79871dd-a727-4ec6-ba02-fcfa47ffa966 req-927e8c48-cf70-4140-b8ba-2782adf70342 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.814800 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d79871dd-a727-4ec6-ba02-fcfa47ffa966 req-927e8c48-cf70-4140-b8ba-2782adf70342 service nova] Creating event network-vif-unplugged:315bda66-3f17-4ca5-9705-6dc6a59b5b67 for instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 on n-h2-862876-2 Oct 28 13:09:33.835904 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d79871dd-a727-4ec6-ba02-fcfa47ffa966 req-927e8c48-cf70-4140-b8ba-2782adf70342 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057365 Oct 28 13:09:33.841052 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 954/1839] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:33.850178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:33.851199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:33.859900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.860684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.861479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.862403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:33.879034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:33.879034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:33.879034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:34.438856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid e8bc2afd-f819-4e20-b648-10b391be298b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:34.492280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae1c942d-ef40-4824-bc6e-3fd52450de70 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1970 microversion: 2.25 time: 0.647105 Oct 28 13:09:34.495580 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 955/1840] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:33 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1970 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:34.540667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:34.547364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:34.550991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:34.550991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:34.553342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:34.553342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:34.576176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:34.761176 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0612a9e-153e-4f1e-a924-b959fb1eaf48 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.236317 Oct 28 13:09:34.784596 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 956/1841] 10.222.0.25 () {60 vars in 1217 bytes} [Fri Oct 28 13:09:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:09:34.838735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:34.846504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:34.886608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:34.888738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:34.888738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:34.888738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:34.893433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:34.895300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:35.211425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:35.224056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:35.232045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:35.250489 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-545fb530-018d-4dd3-b106-e21b3d4f9aa4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.462825 Oct 28 13:09:35.253227 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 957/1842] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:34 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:35.261264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:35.262395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:35.272967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:35.273853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:35.274504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:35.277513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:35.290518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:35.293001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:35.460200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:35.476803 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-110ff27a-b81f-4a96-b08f-fa5b74c281d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1268 microversion: 2.1 time: 0.222240 Oct 28 13:09:35.483091 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 958/1843] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:35 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1268 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:35.491368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862876-2", "block_migration": "auto"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:35.496896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:35.513096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:35.515225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:35.519604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:35.527073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:35.527073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:35.527073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:35.577805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'flavor' on Instance uuid e8bc2afd-f819-4e20-b648-10b391be298b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:35.618934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Going to try to live migrate instance to n-h1-862876-2 {{(pid=127793) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:09:36.596494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3fd92b32-8aec-466f-8846-418963e918f5 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "DELETE /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e" status: 204 len: 0 microversion: 2.1 time: 4.672822 Oct 28 13:09:36.600793 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 886/1844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:31 2022] DELETE /compute/v2.1/images/be811977-639e-420a-8e8b-5c4785c4359e => generated 0 bytes in 4674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:36.620929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:36.621564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:36.644996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:36.651424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:36.651999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:36.652452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:36.656611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:36.657641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:36.660215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:36.879504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:36.897899 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c6a5842-fed0-493e-b7c2-2668f294e071 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1288 microversion: 2.1 time: 0.295085 Oct 28 13:09:36.910812 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 887/1845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:36 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1288 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:36.990178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2095490551", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:37.133589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] validate_networks() for [('58a84705-f126-4a30-92b1-9a1cdcc86f2f', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:09:38.060411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:09:38.061576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:09:38.062288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:09:38.063753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:09:38.071345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:09:38.103905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:38.104414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:38.107854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:38.109852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:38.110350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:38.110847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:38.173980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Getting quotas for project a36f045243404255bcdf56bcca144d0c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:38.193719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Getting quotas for user 9432c5ea932342b5abb26ea1d0091118 and project a36f045243404255bcdf56bcca144d0c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:38.233086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:09:38.238687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:09:38.503111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23b6d9da-4e37-471d-8e67-cc5e10c33b72 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601869 Oct 28 13:09:38.504106 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 888/1846] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:09:38.527273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:38.529422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:38.588106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:38.591069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:38.591695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:38.595130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:38.615543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:38.616950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:38.951072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:38.971157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:38.975914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:38.999685 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6fba30d-a9ea-43f4-a798-2ebe5112867e tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.494316 Oct 28 13:09:39.000401 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 889/1847] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:38 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:39.015551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:39.021328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:39.038309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:39.039055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:39.042521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:39.043546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:39.044275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:39.045075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:39.712255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:39.736013 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71775429-82ef-41d8-aee1-e9c2264a723a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1308 microversion: 2.1 time: 0.722488 Oct 28 13:09:39.737091 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 890/1848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:39 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:39.752873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ad9c973-ec96-4315-a214-1d694c55c4dd tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '.version_select at 0x7f27bdb05af0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:39.791038 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8ad9c973-ec96-4315-a214-1d694c55c4dd tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] HTTP exception thrown: Image not found. Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ad9c973-ec96-4315-a214-1d694c55c4dd tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Request method failure captured: Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 HTTP/1.1 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9QkDCRQlz7vB9iHgCe-v1jz2cl68D1_H6yjsPG4WMHwujDrbXdhQ7ZguU_X4hHUl4Fx_svdc2uF_EvgA21x-5PxzmqBhhaducoAQL_TYYbm796Z-mOgpP-ElrF28ocJqAniz3mjK47YE0T7VPW27zmYLfvDKDwDDajBzxdGB0jvK0Q Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 75778e6d89f94db58b139d1c9824675c Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75778e6d89f94db58b139d1c9824675c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 75778e6d89f94db58b139d1c9824675c Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerTestJSON-1588672513-project Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7c30b88de36c4240b553ecb339831a28 Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerTestJSON-1588672513-project Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: exception: Image not found. Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '5a4a1473-9380-44bf-a643-bf4afd337e90'} Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5a4a1473-9380-44bf-a643-bf4afd337e90 to delete Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a4a1473-9380-44bf-a643-bf4afd337e90 could not be found. Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:39.793475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ad9c973-ec96-4315-a214-1d694c55c4dd tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Returning 404 to user: Image not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:39.799017 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ad9c973-ec96-4315-a214-1d694c55c4dd tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "DELETE /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90" status: 404 len: 62 microversion: 2.1 time: 0.055697 Oct 28 13:09:39.800918 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 891/1849] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:39 2022] DELETE /compute/v2.1/images/5a4a1473-9380-44bf-a643-bf4afd337e90 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:09:39.903658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-252374de-efe1-4d0e-950a-3ca3cef7e37c tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Action: 'create', calling method: .version_select at 0x7f27bdaf2160>, body: {"keypair": {"name": "tempest-keypair-1706072753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmgS43lhz5zIfOnmmnHSBCdO5Gt0NOnjfG03JQOdyVjJ+9YSnFeejaVajMAfngPY6dpxFZaLWl8ZC2NHXMuG0vUadclKSaYx3o+y5jUE0zK16NsNen08iW4vJxuAa9DAw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:39.976941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-252374de-efe1-4d0e-950a-3ca3cef7e37c tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Getting quotas for project abdee9308d024b64ba68208c2af24f5c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:39.994253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-252374de-efe1-4d0e-950a-3ca3cef7e37c tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Getting quotas for user 965e776d25ba42b79b89996c2f396135 and project abdee9308d024b64ba68208c2af24f5c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:40.139182 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-252374de-efe1-4d0e-950a-3ca3cef7e37c tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328974 Oct 28 13:09:40.140468 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 892/1850] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:40.149314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:40.150100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:40.168938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:40.173258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:40.173889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:40.174775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:40.176856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:40.177973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:40.247549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:40.591341 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1a0e68a-0ead-44ab-addb-2395c5711e92 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b/action" status: 202 len: 0 microversion: 2.25 time: 5.106796 Oct 28 13:09:40.592091 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 959/1851] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:09:35 2022] POST /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b/action => generated 0 bytes in 5108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:40.601299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea993817-fae2-4dc4-9dbf-058fe2e0f338 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:40.601929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea993817-fae2-4dc4-9dbf-058fe2e0f338 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:40.794288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea993817-fae2-4dc4-9dbf-058fe2e0f338 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:40.805628 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea993817-fae2-4dc4-9dbf-058fe2e0f338 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1224 microversion: 2.1 time: 0.208443 Oct 28 13:09:40.807615 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 960/1852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:40 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1224 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:40.818122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:40.818919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:40.829310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:40.830273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:40.830970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:40.832193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:40.832861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:40.833490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:40.903197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:09:41.015683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:41.031669 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0afdad35-61eb-478f-a6e5-978fff56ba73 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1318 microversion: 2.1 time: 0.890100 Oct 28 13:09:41.043180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 893/1853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:40 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1318 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:41.066237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:41.066237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:41.069847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.070351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.079145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.080088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.083625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.084170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.201423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:41.211035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:41.212985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:41.222432 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-20573ea0-cd16-4be9-8b2a-ed2b5dca9b72 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.176240 Oct 28 13:09:41.238035 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 894/1854] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:41 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:41.238603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-70cc303e-4f17-41eb-82f4-e68dac0e0648 req-bfa9c338-2198-405f-9ddf-f3db58a7020d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fb8542-e326-4e0a-a3cc-87ea0513f10c", "tag": "fb562b6e-eb21-433c-834b-b5358f4ce022"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:41.252509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-70cc303e-4f17-41eb-82f4-e68dac0e0648 req-bfa9c338-2198-405f-9ddf-f3db58a7020d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.253049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-70cc303e-4f17-41eb-82f4-e68dac0e0648 req-bfa9c338-2198-405f-9ddf-f3db58a7020d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.254658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-70cc303e-4f17-41eb-82f4-e68dac0e0648 req-bfa9c338-2198-405f-9ddf-f3db58a7020d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.304606 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-70cc303e-4f17-41eb-82f4-e68dac0e0648 req-bfa9c338-2198-405f-9ddf-f3db58a7020d service nova] Creating event network-changed:fb562b6e-eb21-433c-834b-b5358f4ce022 for instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c on n-h1-862876-2 Oct 28 13:09:41.313328 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-70cc303e-4f17-41eb-82f4-e68dac0e0648 req-bfa9c338-2198-405f-9ddf-f3db58a7020d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080439 Oct 28 13:09:41.313939 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 895/1855] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:41.321447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:41.322594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:41.329396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.330092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.330559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.331340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.331803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.332237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.740828 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78bae5d2-2f2f-4fbe-9ba7-ccdb6ddd3e30 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "DELETE /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 204 len: 0 microversion: 2.1 time: 0.929738 Oct 28 13:09:41.743544 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 961/1856] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:09:40 2022] DELETE /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:41.762627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:41.764581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:41.765302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:41.775468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:41.783054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:41.788757 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-170ab663-cdf4-48a4-89ac-9a62b1b21be9 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.472370 Oct 28 13:09:41.788757 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 896/1857] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:41 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:41.793429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:41.794068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:41.826175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.826690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.829211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.829752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.831011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.831681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.832006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.832143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.832493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:41.832745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:41.842804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:41.843628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.132588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:42.147493 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ffc9ffa-614d-4765-ac1f-8c65ff2f9f1f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1308 microversion: 2.1 time: 0.399970 Oct 28 13:09:42.147493 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 962/1858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:41 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:42.164721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:42.165460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:42.180719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.181327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.181793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.183631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.184103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.192723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.360071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:42.373291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-323480cc-e6be-4c56-a804-d4ddfe29cb57 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1276 microversion: 2.1 time: 0.226589 Oct 28 13:09:42.373959 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 963/1859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:42 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:42.385310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:42.386206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:42.406381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.407035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.407554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.408482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.409016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.409617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.881130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:42.897083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:42.900110 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9258948-8bc9-4d60-b182-7f499cca1144 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1473 microversion: 2.1 time: 1.108877 Oct 28 13:09:42.901265 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 897/1860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:41 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1473 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:42.907026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:42.907757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:42.917140 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d223742a-1816-4a91-b4ad-bf303b0b015b tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1318 microversion: 2.1 time: 0.540992 Oct 28 13:09:42.920696 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 964/1861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:42 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:42.928244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.929957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.932409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.933281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.933868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.935580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:42.936208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:42.936371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.945990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.946488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.950239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:42.952880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:42.955402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:42.957320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:43.156838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:43.168364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:43.170476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:43.177901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-80a24233-4990-4e34-ac32-7d9588be09ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.275463 Oct 28 13:09:43.180342 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 898/1862] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:42 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:43.185796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8bf34b1b-d8d4-4942-b7a9-6a2c9827a5e8 req-dfed60de-2439-41e0-bf96-0b3ce95127f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "151c2d94-029f-4353-8f82-06ac9f8d4fa4", "tag": "80c77538-cbcb-4c3c-9134-29ff9f7e31b3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:43.197646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8bf34b1b-d8d4-4942-b7a9-6a2c9827a5e8 req-dfed60de-2439-41e0-bf96-0b3ce95127f9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:43.205324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8bf34b1b-d8d4-4942-b7a9-6a2c9827a5e8 req-dfed60de-2439-41e0-bf96-0b3ce95127f9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:43.205324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8bf34b1b-d8d4-4942-b7a9-6a2c9827a5e8 req-dfed60de-2439-41e0-bf96-0b3ce95127f9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:43.231138 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8bf34b1b-d8d4-4942-b7a9-6a2c9827a5e8 req-dfed60de-2439-41e0-bf96-0b3ce95127f9 service nova] Creating event network-changed:80c77538-cbcb-4c3c-9134-29ff9f7e31b3 for instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 on n-h1-862876-2 Oct 28 13:09:43.236905 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8bf34b1b-d8d4-4942-b7a9-6a2c9827a5e8 req-dfed60de-2439-41e0-bf96-0b3ce95127f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055095 Oct 28 13:09:43.238232 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 899/1863] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:43.327717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74746b55-e02e-4f5e-bc1c-549ba9fcae06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'create', calling method: .version_select at 0x7f27b94225e0>, body: {"keypair": {"name": "tempest-keypair-767193991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW78ODqVN+RHhhAxqyCsspL2naiIj/aDivsgc7cuwpO4l1YSD+ZYPVUYeveicQhfy4HiZfx94qZfD+qguElQb2W7S577a2ycHUVGr4HPTy2wYRa4j9UchUiIRe9UpGh7A=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:43.355009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-74746b55-e02e-4f5e-bc1c-549ba9fcae06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for project 524832a11bb148639788f80ef22b2865. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:43.367055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-74746b55-e02e-4f5e-bc1c-549ba9fcae06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for user d70178138d974c20bb9598de42bd3294 and project 524832a11bb148639788f80ef22b2865. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:43.562157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74746b55-e02e-4f5e-bc1c-549ba9fcae06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.322479 Oct 28 13:09:43.563775 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 900/1864] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:43.569762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:43.573257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:43.590537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:43.603054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:43.606831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:43.607861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:43.611453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:43.613426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:43.677316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:43.691206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:43.693092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:43.695582 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2724f944-8758-4c54-8acb-9adbbe345bf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.773838 Oct 28 13:09:43.698908 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 965/1865] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:42 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:43.705708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:43.711494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:43.738492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:43.746551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:43.747498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:43.748462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:43.751102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:43.751932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.222249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:44.235032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d071dfd-2037-4214-9ba9-e70eb7689e55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1308 microversion: 2.1 time: 0.666928 Oct 28 13:09:44.252741 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 901/1866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:43 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1308 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:44.270545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:44.274739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:44.302241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.302776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.303215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.303942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.304404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.309228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.574767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:44.576254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:44.592695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06031ff0-a725-47ad-a940-6c370e3d2d74 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1473 microversion: 2.1 time: 0.337155 Oct 28 13:09:44.593403 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 902/1867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:44 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1473 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:44.599566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:44.600432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:44.600700 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28ed70a7-8c91-4d26-9e5b-66a8349d8794 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1276 microversion: 2.1 time: 0.899150 Oct 28 13:09:44.608567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.609775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.611334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.613233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.613916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.614701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.619694 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 966/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:43 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1276 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:44.629135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:44.632554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:44.638387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:44.641312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.642256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.642973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.643915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.644656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.645345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.807931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:44.828938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:44.830927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:44.834663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:44.840673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:44.841174 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ffda7dca-8c11-4f7c-a8b5-034cf1b7ef26 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1531 microversion: 2.91 time: 0.217298 Oct 28 13:09:44.842477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 967/1869] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:44 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1531 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:44.850921 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-183c2bc0-fe4a-4d1b-b12a-b752a45cb29e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1318 microversion: 2.1 time: 0.255486 Oct 28 13:09:44.851837 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 903/1870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:44 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:44.858325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:44.860078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:44.868383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.871336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.871336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.871336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.871336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.871336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.884907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:44.885804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:44.899328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.905735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.905735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.905735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:44.905735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:44.905735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:44.997733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lazy-loading 'services' on Instance uuid 604dad7e-a573-4bc6-b434-0ebe71a36c86 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:45.044208 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f1019553-2a1c-4df1-9893-90b67ba92304 tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1936 microversion: 2.91 time: 0.165076 Oct 28 13:09:45.045244 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 904/1871] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:44 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1936 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:45.083233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:45.112012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:45.112012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:45.112012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:45.112012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:45.112012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:45.112012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:45.112012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:45.124287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lazy-loading 'flavor' on Instance uuid 604dad7e-a573-4bc6-b434-0ebe71a36c86 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:45.577416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:45.587289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:45.600693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:45.600693 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-faaa4cfe-762d-48fd-a641-a5ebee1e1a8f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.754850 Oct 28 13:09:45.600693 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 968/1872] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:44 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:45.632660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:45.633730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:45.646464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:45.651484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:45.651484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:45.651484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:45.651484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:45.651484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:45.673869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:46.041997 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-05ab8bd8-8ba9-4857-8e6f-9c9355779eb9 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action" status: 202 len: 0 microversion: 2.91 time: 0.971631 Oct 28 13:09:46.048800 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 905/1873] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:09:45 2022] POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:46.060727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:46.060727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:46.067537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.068791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.069461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.070593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.071322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.072128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.172004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:46.177943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:46.197898 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5a5b1a0-be9e-499e-9a13-3783f03076e4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1308 microversion: 2.1 time: 0.596862 Oct 28 13:09:46.198497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 969/1874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:45 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:46.228433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:46.229459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:46.230036 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d35fa2fd-2625-47ea-9ae1-ea3809af0f19 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1431 microversion: 2.1 time: 0.178475 Oct 28 13:09:46.250936 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 906/1875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:46 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1431 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:46.251147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.251147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.251147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.251147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.251147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.251147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.252009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:46.254143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:46.264985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.265483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.265913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.266869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.267495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.268215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.490728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:46.506811 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e844904-c6ae-43b8-89a7-81574a2cbb55 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1282 microversion: 2.1 time: 0.283751 Oct 28 13:09:46.525509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 970/1876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:46 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1282 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:46.537309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:46.545181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:46.565743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.567807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.568519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.569492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.573826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.578304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.620007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:46.630126 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6274c899-caf5-48ee-8331-c299de19f1af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1318 microversion: 2.1 time: 0.388458 Oct 28 13:09:46.635922 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 907/1877] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:46 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:46.673179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-73afefbd-75ba-469e-abc2-4f72aafd2017 req-a67e1b4e-4700-4932-b076-76f3726b4d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16778c76-17c6-4a4a-bace-f54b6f7f4837", "name": "network-vif-deleted", "tag": "315bda66-3f17-4ca5-9705-6dc6a59b5b67"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:46.705219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73afefbd-75ba-469e-abc2-4f72aafd2017 req-a67e1b4e-4700-4932-b076-76f3726b4d87 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.705747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73afefbd-75ba-469e-abc2-4f72aafd2017 req-a67e1b4e-4700-4932-b076-76f3726b4d87 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.712198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73afefbd-75ba-469e-abc2-4f72aafd2017 req-a67e1b4e-4700-4932-b076-76f3726b4d87 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.730605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-73afefbd-75ba-469e-abc2-4f72aafd2017 req-a67e1b4e-4700-4932-b076-76f3726b4d87 service nova] Creating event network-vif-deleted:315bda66-3f17-4ca5-9705-6dc6a59b5b67 for instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 on n-h2-862876-2 Oct 28 13:09:46.738358 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-73afefbd-75ba-469e-abc2-4f72aafd2017 req-a67e1b4e-4700-4932-b076-76f3726b4d87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081912 Oct 28 13:09:46.739976 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 908/1878] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:46.756031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:46.769417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:46.769591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:46.771727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:46.776742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:46.792684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.793603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.794481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.795457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:46.795586 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a46e626d-9a46-42bf-9b2d-e28c6ba16b7c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.268615 Oct 28 13:09:46.796288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:46.798602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:46.802256 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 971/1879] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:46 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:46.982536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0abd2dfc-aace-459d-bb7d-0126fa049cb2 req-2badd245-eadd-4140-957e-0c36d776e89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fb8542-e326-4e0a-a3cc-87ea0513f10c", "name": "network-vif-plugged", "status": "completed", "tag": "fb562b6e-eb21-433c-834b-b5358f4ce022"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:47.001217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0abd2dfc-aace-459d-bb7d-0126fa049cb2 req-2badd245-eadd-4140-957e-0c36d776e89b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.006117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0abd2dfc-aace-459d-bb7d-0126fa049cb2 req-2badd245-eadd-4140-957e-0c36d776e89b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.006117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0abd2dfc-aace-459d-bb7d-0126fa049cb2 req-2badd245-eadd-4140-957e-0c36d776e89b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.048725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0abd2dfc-aace-459d-bb7d-0126fa049cb2 req-2badd245-eadd-4140-957e-0c36d776e89b service nova] Creating event network-vif-plugged:fb562b6e-eb21-433c-834b-b5358f4ce022 for instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c on n-h1-862876-2 Oct 28 13:09:47.059533 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0abd2dfc-aace-459d-bb7d-0126fa049cb2 req-2badd245-eadd-4140-957e-0c36d776e89b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080668 Oct 28 13:09:47.071423 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 972/1880] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:09:47.224074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:47.225144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:47.232415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.242557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.244419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.246672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.247356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.249127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.337720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:47.365972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:47.368744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:47.375183 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5f95e96-b0d8-4720-b87a-3121bb2e972c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.633570 Oct 28 13:09:47.375881 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 909/1881] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:46 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:47.420991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:47.426620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:47.450356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.459228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.459989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.461015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.461737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.462396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.545009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.546282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.546987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.547518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lazy-loading 'fault' on Instance uuid 16778c76-17c6-4a4a-bace-f54b6f7f4837 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:47.556215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:47.625144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c30b88de36c4240b553ecb339831a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75778e6d89f94db58b139d1c9824675c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:47.641255 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c4e5504-033b-4419-b28b-5681775117b7 tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 200 len: 1307 microversion: 2.1 time: 0.245753 Oct 28 13:09:47.642224 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 910/1882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:47 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:47.649368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:47.654354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:47.683804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.684718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.685749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.686898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:47.689362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:47.690004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:47.951486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:47.972185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:47.977621 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85cc1787-4662-479d-980b-d3478c514563 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1308 microversion: 2.1 time: 0.755815 Oct 28 13:09:47.978464 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 973/1883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:47 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1308 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:47.985665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d05489de-da57-4328-aeb7-5f55916289f3 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1324 microversion: 2.1 time: 0.342109 Oct 28 13:09:47.995339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:47.996391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:47.998696 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 911/1884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:47 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:48.006246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.008777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.012451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.013267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:48.013878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.014807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.015464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.016530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:48.030213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.030738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.031210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.033712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.034219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.034665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.136930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:48.192813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:48.217427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:48.221882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:48.232581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8e9d869-6ec2-4b61-a7cd-c85174d990d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.225265 Oct 28 13:09:48.253579 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 912/1885] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:47 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:48.270384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1032496264", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0de17904-bcec-4084-acbb-87c648605aab"}], "security_groups": [{"name": "tempest-securitygroup--1995741803"}], "key_name": "tempest-keypair-1706072753", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:48.441236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:48.441236 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51e40a0d-854a-4ed4-b3b6-b789fc53918c tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1318 microversion: 2.1 time: 0.456998 Oct 28 13:09:48.441236 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 974/1886] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:47 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:48.454414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:48.455413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:48.468667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.472158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.473013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.483338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.484186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.484720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.715107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] validate_networks() for [('0de17904-bcec-4084-acbb-87c648605aab', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:09:48.726582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:48.737165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:48.740031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:48.741906 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fa395a7-3d4b-43cb-9d35-b4e51a103345 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.302144 Oct 28 13:09:48.745698 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 975/1887] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:48 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:48.757917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:48.762230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] [instance: 16778c76-17c6-4a4a-bace-f54b6f7f4837] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:48.766067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.766777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.767413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.768108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:48.769163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:48.769582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:48.784216 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] HTTP exception thrown: Instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 could not be found. Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Request method failure captured: Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 HTTP/1.1 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9QkDCRQlz7vB9iHgCe-v1jz2cl68D1_H6yjsPG4WMHwujDrbXdhQ7ZguU_X4hHUl4Fx_svdc2uF_EvgA21x-5PxzmqBhhaducoAQL_TYYbm796Z-mOgpP-ElrF28ocJqAniz3mjK47YE0T7VPW27zmYLfvDKDwDDajBzxdGB0jvK0Q Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 75778e6d89f94db58b139d1c9824675c Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_75778e6d89f94db58b139d1c9824675c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/75778e6d89f94db58b139d1c9824675c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 75778e6d89f94db58b139d1c9824675c Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1588672513 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesOneServerTestJSON-1588672513-project Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 7c30b88de36c4240b553ecb339831a28 Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesOneServerTestJSON-1588672513-project Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 could not be found. Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '16778c76-17c6-4a4a-bace-f54b6f7f4837'} Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 could not be found. Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 could not be found. Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:48.786385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:48.792085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:48.792085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:48.792085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:48.792085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:09:48.792085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:09:48.792085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 could not be found. Oct 28 13:09:48.792085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:48.792961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] Returning 404 to user: Instance 16778c76-17c6-4a4a-bace-f54b6f7f4837 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:48.793926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-558020b0-7d12-4750-bc14-6ca0d5187c0d tempest-ImagesOneServerTestJSON-1588672513 tempest-ImagesOneServerTestJSON-1588672513-project] 10.222.0.25 "GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837" status: 404 len: 111 microversion: 2.1 time: 0.046167 Oct 28 13:09:48.798552 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 976/1888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:48 2022] GET /compute/v2.1/servers/16778c76-17c6-4a4a-bace-f54b6f7f4837 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:09:49.007366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:49.012574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:49.028462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.028462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.028462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.028462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.028462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.028462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.250882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:49.263958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1521ab2c-51b7-4e2f-a33d-2cc3d9a2f590 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1308 microversion: 2.1 time: 0.261192 Oct 28 13:09:49.265201 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 977/1889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:49 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:09:49.284534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:49.284534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:49.290633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.316035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.321427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.323611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.324608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.327148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.352287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:49.374449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Getting quotas for project abdee9308d024b64ba68208c2af24f5c. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:49.388190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Getting quotas for user 965e776d25ba42b79b89996c2f396135 and project abdee9308d024b64ba68208c2af24f5c. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:49.418049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:09:49.419003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:09:49.419866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:09:49.420667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:09:49.421999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:09:49.434191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.435003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.435624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.437579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.438297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.439028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.475193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Getting quotas for project abdee9308d024b64ba68208c2af24f5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:49.483163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Getting quotas for user 965e776d25ba42b79b89996c2f396135 and project abdee9308d024b64ba68208c2af24f5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:49.502528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:09:49.506786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:09:49.847928 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-94ab40c4-8512-4775-a8d5-a18146362a0d tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.586594 Oct 28 13:09:49.849721 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 913/1890] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:09:49.882857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-19c3bb3a-f37e-4284-8aad-5730f59522bd req-cc0e1a2c-bad8-45c5-92f5-f468ebb95353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151c2d94-029f-4353-8f82-06ac9f8d4fa4", "name": "network-vif-plugged", "status": "completed", "tag": "80c77538-cbcb-4c3c-9134-29ff9f7e31b3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:49.905915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-19c3bb3a-f37e-4284-8aad-5730f59522bd req-cc0e1a2c-bad8-45c5-92f5-f468ebb95353 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.906955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-19c3bb3a-f37e-4284-8aad-5730f59522bd req-cc0e1a2c-bad8-45c5-92f5-f468ebb95353 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.908202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-19c3bb3a-f37e-4284-8aad-5730f59522bd req-cc0e1a2c-bad8-45c5-92f5-f468ebb95353 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.929329 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-19c3bb3a-f37e-4284-8aad-5730f59522bd req-cc0e1a2c-bad8-45c5-92f5-f468ebb95353 service nova] Creating event network-vif-plugged:80c77538-cbcb-4c3c-9134-29ff9f7e31b3 for instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 on n-h1-862876-2 Oct 28 13:09:49.939156 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-19c3bb3a-f37e-4284-8aad-5730f59522bd req-cc0e1a2c-bad8-45c5-92f5-f468ebb95353 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087290 Oct 28 13:09:49.945492 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 914/1891] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:49.951179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:49.952669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:49.965471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.966336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.967244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:49.969191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:49.969947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:49.970601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.058626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.070070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-faa73260-4cbe-4560-a048-e701bc43e8ba tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1324 microversion: 2.1 time: 0.803326 Oct 28 13:09:50.087241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 978/1892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:49 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1324 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:50.097635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8b17e647-2e15-4613-a8c8-8e5ae1836def req-168820ea-1eb8-44a2-bb5b-adfe6df05b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c608246-972a-4230-bbcb-b63f69f29b62", "tag": "d610d928-9a98-4aec-9c9e-9ed06af8d9bd"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:50.118608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8b17e647-2e15-4613-a8c8-8e5ae1836def req-168820ea-1eb8-44a2-bb5b-adfe6df05b4b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.118803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.119216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8b17e647-2e15-4613-a8c8-8e5ae1836def req-168820ea-1eb8-44a2-bb5b-adfe6df05b4b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.119551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8b17e647-2e15-4613-a8c8-8e5ae1836def req-168820ea-1eb8-44a2-bb5b-adfe6df05b4b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.127664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.147188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8b17e647-2e15-4613-a8c8-8e5ae1836def req-168820ea-1eb8-44a2-bb5b-adfe6df05b4b service nova] Creating event network-changed:d610d928-9a98-4aec-9c9e-9ed06af8d9bd for instance 2c608246-972a-4230-bbcb-b63f69f29b62 on n-h2-862876-2 Oct 28 13:09:50.148517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.148825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8b17e647-2e15-4613-a8c8-8e5ae1836def req-168820ea-1eb8-44a2-bb5b-adfe6df05b4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053757 Oct 28 13:09:50.148825 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 979/1893] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:50.149076 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce72df24-ae4f-4874-9d78-da494930970f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.203182 Oct 28 13:09:50.149076 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 915/1894] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:49 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:50.163939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:50.165069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:50.171024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1931708010", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6d79be4-5785-49f8-a61c-931d9498eb9a"}], "security_groups": [{"name": "tempest-securitygroup--831844052"}], "key_name": "tempest-keypair-767193991", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:50.175938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.176748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.178147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.179825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.181282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.181955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.336678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] validate_networks() for [('a6d79be4-5785-49f8-a61c-931d9498eb9a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:09:50.519636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.547494 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10f78997-4a7e-4fde-98a5-a35ba23731af tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1508 microversion: 2.1 time: 0.399986 Oct 28 13:09:50.548359 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 980/1895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:50 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:50.553704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:50.557205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:50.562854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.563576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.564205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.565975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.566604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.567235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.794614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.805438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.807650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.809274 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-93e3a295-748f-4dd0-9e2e-440df61b1312 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.259782 Oct 28 13:09:50.810499 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 981/1896] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:50 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:50.816037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20e8e5ae-3009-454b-8d9c-ab97bbdab4ba tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:50.817063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20e8e5ae-3009-454b-8d9c-ab97bbdab4ba tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:50.830505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:50.882654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20e8e5ae-3009-454b-8d9c-ab97bbdab4ba tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:50.891967 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20e8e5ae-3009-454b-8d9c-ab97bbdab4ba tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1278 microversion: 2.1 time: 0.078123 Oct 28 13:09:50.891967 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 982/1897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:50 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:50.898284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:50.898915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:50.905349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.906039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.906659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.907535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.908216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.908575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.979146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:09:50.979651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:09:50.980085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:09:50.980495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:09:50.981047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:09:50.990947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.991633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.992179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:50.993091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:50.993653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:50.994375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.015166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:51.021544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for user d70178138d974c20bb9598de42bd3294 and project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:51.046394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:09:51.051079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:09:51.073405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:51.082497 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b40ed8af-ece3-4e05-b83a-38446d4174bf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1308 microversion: 2.1 time: 0.189385 Oct 28 13:09:51.083830 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 983/1898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:50 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:51.090337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:51.094366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:51.099207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.099941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.100558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.101290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.101747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.102171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.243758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:51.245728 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa4fbc07-8a9e-4651-99e5-b616d103b213 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.095323 Oct 28 13:09:51.246793 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 916/1899] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:09:51.252195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:51.253140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:51.260104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.260694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.260849 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb460cbc-7c7a-4205-9996-fac693c9cacb tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1508 microversion: 2.1 time: 0.175542 Oct 28 13:09:51.261559 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 984/1900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:51 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:51.262503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.263392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.263934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.264519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.282483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:51.283269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:51.294986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.295704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.299203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.299203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.299203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.299203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.403259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:51.413405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:51.417148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:51.437817 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-edfd5b0e-795e-49d9-94fc-a47467773bf0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.160586 Oct 28 13:09:51.437817 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 985/1901] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:51 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:51.437817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-467ce329-937f-40c6-bfdf-2e0c2264d30b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:51.437817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-467ce329-937f-40c6-bfdf-2e0c2264d30b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:51.498643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:51.506600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-467ce329-937f-40c6-bfdf-2e0c2264d30b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:51.507241 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9f0aa1f-454e-4da3-baa5-1b684e6856b1 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1324 microversion: 2.1 time: 0.258869 Oct 28 13:09:51.508209 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 917/1902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:51 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:51.512698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:51.514449 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-467ce329-937f-40c6-bfdf-2e0c2264d30b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1238 microversion: 2.1 time: 0.089651 Oct 28 13:09:51.515445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 986/1903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:51 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:51.516877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:51.529537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.529537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.529537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.529537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.529537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.529537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.759471 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f21a92dd-d011-4e5a-8f0a-6b3fb168246e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "PUT /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1080 microversion: 2.1 time: 0.248410 Oct 28 13:09:51.773142 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 918/1904] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:09:51 2022] PUT /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1080 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:51.780438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:51.781447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:51.792245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.793058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.793503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.794216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:51.794681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:51.795371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:51.999373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70726b76-5e65-424e-9be9-1a7fe8c0eabf tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Action: 'create', calling method: .version_select at 0x7f27bdade940>, body: {"keypair": {"name": "tempest-keypair-1146784109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDaR3q3K8YfDGh/eXalDJJ47DHg1h4vSt0CTOeRaCcLfWWCePBcAapourCUXdVi36lz5xVmu+i6COLATt231QAYTlIUHByRl1GmzrB7d6Avx91OiEqk2Si1alPwXsIFtg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:52.017725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-70726b76-5e65-424e-9be9-1a7fe8c0eabf tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:52.023735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-70726b76-5e65-424e-9be9-1a7fe8c0eabf tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for user fda1fd5fd8864bf2990ec11c367404e8 and project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:52.039557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.048310 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-04a4068a-ff02-46bb-9a06-0842960cd577 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1506 microversion: 2.1 time: 0.272084 Oct 28 13:09:52.048987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 987/1905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:51 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:52.065355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.066441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:52.088375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.089716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.090715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.091910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.094376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.095150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.143501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-70726b76-5e65-424e-9be9-1a7fe8c0eabf tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.320639 Oct 28 13:09:52.150428 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 919/1906] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:09:52.155892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.156523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:52.164369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.165172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.166848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.166848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.166848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.167195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.238556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.247407 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c9ed58cc-362d-42d2-b58d-9ad178d29304 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1282 microversion: 2.1 time: 0.095448 Oct 28 13:09:52.248605 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 920/1907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:52.253685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.254389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:52.269078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.270435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.272800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.274408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.275906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.276980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.387723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.401817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.404438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.406119 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1a231401-913b-472e-879b-f3eb7661f830 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.355145 Oct 28 13:09:52.407045 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 988/1908] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:52.427279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.429361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:52.438778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.439663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.440347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.441292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.445080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.445843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.457431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.475417 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-336b14a4-abcd-4168-a365-abbba757962e tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1506 microversion: 2.1 time: 0.226240 Oct 28 13:09:52.476068 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 921/1909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:52.495397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-616e1904-129c-4dd4-b200-1f03525dcd14 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bdb29ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.509181 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-616e1904-129c-4dd4-b200-1f03525dcd14 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1146784109" status: 200 len: 498 microversion: 2.1 time: 0.031389 Oct 28 13:09:52.513740 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 922/1910] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1146784109 => generated 498 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:52.551517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.552096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:52.560318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.560986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.561594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.562515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.564437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.565038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.641349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.655879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.655879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.658542 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9490b795-e5db-461a-a7b3-bb5a083c5bc4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.142324 Oct 28 13:09:52.660267 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 923/1911] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:52.671195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:52.677543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:52.701732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:52.704514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.704997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.707289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.715202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.715922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.716533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.716748 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-908830ec-440c-46d0-9c01-412c2236d790 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1487 microversion: 2.1 time: 0.308385 Oct 28 13:09:52.717949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 989/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1487 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:52.727551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-703e6ce2-7b1c-402c-b1b4-6b5c2ca661e4 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bd925ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.853405 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-703e6ce2-7b1c-402c-b1b4-6b5c2ca661e4 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146784109" status: 202 len: 0 microversion: 2.1 time: 0.133983 Oct 28 13:09:52.854119 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 990/1913] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146784109 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:09:52.859153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.859881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:52.868093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.868671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.869182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.869979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:52.870716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:52.871198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:52.875574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:52.922462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba31f4b5-53d4-4180-951f-300bbfc915dd tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "PUT /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1082 microversion: 2.1 time: 0.260786 Oct 28 13:09:52.923521 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 924/1914] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:09:52 2022] PUT /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1082 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:52.942189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5c497a9-afe7-4e9d-a432-7cb3845d4692 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:52.943019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5c497a9-afe7-4e9d-a432-7cb3845d4692 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:53.054811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5c497a9-afe7-4e9d-a432-7cb3845d4692 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.070381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.074391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5c497a9-afe7-4e9d-a432-7cb3845d4692 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1238 microversion: 2.1 time: 0.139613 Oct 28 13:09:53.077322 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 925/1915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1238 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:53.082365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:53.083108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:53.094554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.097486 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b915ff1c-068d-41b9-9da4-265885302d41 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1324 microversion: 2.1 time: 0.242242 Oct 28 13:09:53.099024 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 991/1916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:52 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:53.105431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6723f0ff-cd87-4e51-95cc-077a7584d0a5 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Action: 'create', calling method: .version_select at 0x7f27bdadbee0>, body: {"keypair": {"name": "tempest-keypair-503965551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9j498v9qxrcK9Z1eP3DOkZUrc0nVcDHK8moVOLbkpkrSyB2yNecBaWPuEUd0cahbGWdBM9OKqP0tBfbSLUzWcS/or4XqI3+FKOoU4SzFJWK+loaesj8PYVFWhZ1JfPpw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:53.106244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.109546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.110329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.110845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.113985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.136656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6723f0ff-cd87-4e51-95cc-077a7584d0a5 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:53.142345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6723f0ff-cd87-4e51-95cc-077a7584d0a5 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for user fda1fd5fd8864bf2990ec11c367404e8 and project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:53.297875 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6723f0ff-cd87-4e51-95cc-077a7584d0a5 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196892 Oct 28 13:09:53.298847 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 992/1917] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:53.307222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:53.308094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:53.314592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.315120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.316114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.317004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.317581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.318163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.459333 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d741ecc-d81f-4afd-843e-ad5476369850 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.381151 Oct 28 13:09:53.463047 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 926/1918] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:09:53 2022] POST /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:09:53.465423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:53.466141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:53.472780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.473361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.473851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.474291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.475221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.475523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.476008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.494797 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-97fa8c03-f207-4e5d-9c33-616c32a5c2fe tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1508 microversion: 2.1 time: 0.193498 Oct 28 13:09:53.495451 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 993/1919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:53 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:53.514682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a236b61-b365-4638-b3c2-715dfdb00b42 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bd9289d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:53.559935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.567697 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6648995-0358-45f9-8ca2-0dab1eff2a1a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1330 microversion: 2.1 time: 0.106533 Oct 28 13:09:53.568269 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 927/1920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:53 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:53.572807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:53.573611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:53.578954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.579441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.579880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.580569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.581565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.581993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.617415 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a236b61-b365-4638-b3c2-715dfdb00b42 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503965551" status: 202 len: 0 microversion: 2.1 time: 0.120737 Oct 28 13:09:53.618473 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 994/1921] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:09:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503965551 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:09:53.623563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:53.624277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:53.631260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.631757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.632195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.632925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.633391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.634293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.774366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.785142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.786782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.788625 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0e88b5c-f693-42d3-817e-dcc0c845b5e1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.219320 Oct 28 13:09:53.789204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 928/1922] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:53 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:53.794384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:53.795022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:53.801394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.802071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.802513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.803267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:53.803911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:53.804528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:53.872966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.897851 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf01766f-8087-4404-8848-bab28f28b549 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1492 microversion: 2.1 time: 0.277970 Oct 28 13:09:53.900801 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 995/1923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:53 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1492 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:53.907958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b72cf8f9-d2ff-4b6a-8165-7cf92d046afc tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Action: 'create', calling method: .version_select at 0x7f27bd925040>, body: {"keypair": {"name": "tempest-keypair-1823353058", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:53.927550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-b72cf8f9-d2ff-4b6a-8165-7cf92d046afc tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:53.935692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-b72cf8f9-d2ff-4b6a-8165-7cf92d046afc tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for user fda1fd5fd8864bf2990ec11c367404e8 and project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:53.976721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:53.979606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:53.986333 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-728ea012-34f4-40c8-8e3f-836a98536329 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1508 microversion: 2.1 time: 0.195869 Oct 28 13:09:53.988637 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 929/1924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:53 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:53.992874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:53.993559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:54.000120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.000804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.001429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.002310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.003485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.004080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.077727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:54.086882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b72cf8f9-d2ff-4b6a-8165-7cf92d046afc tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.185121 Oct 28 13:09:54.087703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:54.089538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:54.095044 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 996/1925] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:53 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:54.095987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e564438-d236-4421-9eb3-28002f6a32c8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.107361 Oct 28 13:09:54.096940 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 930/1926] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:53 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:54.109057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:54.111503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aff991df-1d70-4ee4-a511-40e97203a0fb tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bda6c8b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:54.113615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:54.129842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.130641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.134435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.135411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.135961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.136538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.169195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:09:54.286341 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aff991df-1d70-4ee4-a511-40e97203a0fb tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823353058" status: 202 len: 0 microversion: 2.1 time: 0.185115 Oct 28 13:09:54.294280 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 931/1927] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:09:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823353058 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:09:54.304215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:54.304840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:54.315586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.322203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.322203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.322203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.322203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.322203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.382437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:54.390265 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f6bef678-66ae-44e6-b411-010596919c85 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1290 microversion: 2.1 time: 0.101970 Oct 28 13:09:54.390831 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 932/1928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:54 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:54.396000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:54.401938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:54.402931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.403421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.403855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.404551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.405009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.405433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.551210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:54.559594 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-99611d81-72ed-49e6-b78e-e979d80b5e09 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1324 microversion: 2.1 time: 0.167680 Oct 28 13:09:54.560173 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 933/1929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:54 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:54.564963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2cb2ba40-dde0-4c6f-bcd3-91b92cb6151c tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Action: 'create', calling method: .version_select at 0x7f27bdb051f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1584967829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIVukL4ceWp+5MfYE//R6T1xOnAJQuUPjchK1R4cTK97Im+eWbw67CTwocO6EMtQFZyb+4qaXThzESMRUHKKH/olR2cJEoasaH4UnbPSFc/ZgLDV4ZYkffHVQkVQCJZyg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:54.574935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:54.583244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=45 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:54.584230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-2cb2ba40-dde0-4c6f-bcd3-91b92cb6151c tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:54.587843 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-469d3be4-3096-43be-9f25-98743f4f0630 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 204 len: 0 microversion: 2.1 time: 0.490225 Oct 28 13:09:54.588821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 997/1930] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:09:54 2022] DELETE /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:54.597644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-2cb2ba40-dde0-4c6f-bcd3-91b92cb6151c tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for user fda1fd5fd8864bf2990ec11c367404e8 and project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:54.598545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:54.599288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:54.606023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:54.610930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.611559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.614971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.619124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.619715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.620260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.691545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:54.700371 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ed2a74e-46a9-40f1-960e-92095effc823 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1336 microversion: 2.1 time: 0.106376 Oct 28 13:09:54.702555 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 998/1931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:54 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:54.704683 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2cb2ba40-dde0-4c6f-bcd3-91b92cb6151c tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.143155 Oct 28 13:09:54.710142 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 934/1932] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:54 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:54.710291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:54.710291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:54.718487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.719087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.719588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.720340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.720857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.721299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.722068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ac5ce43-ba9d-460a-87b0-ea0abb5da7b2 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Action: 'create', calling method: .version_select at 0x7f27bda1a8b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-87448913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSDUMXlz71vjbqPBeMGW8lC9OOE4ezvSgY83XqtnPTJ4pyPR/wijb/cp18iWNs0mTXRpjKMw2sVAckSA301AH1tCtpkhKXTvTCCZHwVZ+u3gfTuVe7yM9Z6IoZYS1X8Hw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:54.738309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6ac5ce43-ba9d-460a-87b0-ea0abb5da7b2 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:54.745206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6ac5ce43-ba9d-460a-87b0-ea0abb5da7b2 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for user fda1fd5fd8864bf2990ec11c367404e8 and project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:54.754844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:09:54.891811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ac5ce43-ba9d-460a-87b0-ea0abb5da7b2 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.173478 Oct 28 13:09:54.892353 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 935/1933] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:09:54.897665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:54.898284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:54.906310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.906893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.907342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.908056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.908524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.909021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.930924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.api [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Instance is already in deleting state, ignoring this request Oct 28 13:09:54.942826 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b46a0d2-8954-4057-b082-a359141a43f3 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 204 len: 0 microversion: 2.1 time: 0.229569 Oct 28 13:09:54.946644 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 999/1934] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:09:54 2022] DELETE /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:54.953449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-440663e8-9eab-4b01-bd2a-5a1857352b72 req-39659352-b52c-47a7-968f-22af45776b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c608246-972a-4230-bbcb-b63f69f29b62", "name": "network-vif-plugged", "status": "completed", "tag": "d610d928-9a98-4aec-9c9e-9ed06af8d9bd"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:54.968450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-440663e8-9eab-4b01-bd2a-5a1857352b72 req-39659352-b52c-47a7-968f-22af45776b1c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:54.969031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-440663e8-9eab-4b01-bd2a-5a1857352b72 req-39659352-b52c-47a7-968f-22af45776b1c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:54.969733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-440663e8-9eab-4b01-bd2a-5a1857352b72 req-39659352-b52c-47a7-968f-22af45776b1c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:54.984404 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-440663e8-9eab-4b01-bd2a-5a1857352b72 req-39659352-b52c-47a7-968f-22af45776b1c service nova] Creating event network-vif-plugged:d610d928-9a98-4aec-9c9e-9ed06af8d9bd for instance 2c608246-972a-4230-bbcb-b63f69f29b62 on n-h2-862876-2 Oct 28 13:09:54.991499 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-440663e8-9eab-4b01-bd2a-5a1857352b72 req-39659352-b52c-47a7-968f-22af45776b1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043371 Oct 28 13:09:54.996148 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1000/1935] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:55.001889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3547cd7-1b02-4bc6-a64d-c76ba610367b tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Action: 'create', calling method: .version_select at 0x7f27bd937d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1248637161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrDDioQLFFSeFmALpiXRM8nyrRTfQ8+RgUoWF1I1iw4VNPrWWM5XjoQY4AouqoNjQCh/8VvhGDY1GTYC4R9HCmoUp7De+Qujyj7Y+Qt41wMJYugddLuXZ7hlMKe6Ky0iw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:55.053432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a3547cd7-1b02-4bc6-a64d-c76ba610367b tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:09:55.069090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a3547cd7-1b02-4bc6-a64d-c76ba610367b tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Getting quotas for user fda1fd5fd8864bf2990ec11c367404e8 and project b08ff53f821f4dd2b6b44e0270201d38. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:09:55.150830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.162935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.165450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.167132 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75cabaf2-af8f-4188-8b94-a7eb0a011625 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.273391 Oct 28 13:09:55.167900 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 936/1936] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:54 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:55.182979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:55.183870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:55.190885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.191421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.191863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.192580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.193035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.193464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.229009 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3547cd7-1b02-4bc6-a64d-c76ba610367b tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.231494 Oct 28 13:09:55.235209 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1001/1937] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:09:54 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:55.243123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:55.243123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:55.247514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.248117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.248616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.249375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.249924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.250460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.339478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.349033 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e6908bf-7f71-43a8-a209-aa43040aa05e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 200 len: 1472 microversion: 2.1 time: 0.170069 Oct 28 13:09:55.349627 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 937/1938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:55 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:55.354359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:55.354901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:55.360719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.361199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.361637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.363003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.363466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.364910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.431265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.439649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.441141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.446781 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5f475c9-a018-476a-a198-3b76837f8c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.095845 Oct 28 13:09:55.454827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 938/1939] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:55 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:55.468652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9ece5151-b1fd-4bf2-8be1-8673631049af tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bda1ab80>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:55.473689 n-d-862876-2 devstack@n-api.service[127794]: WARNING oslo_db.sqlalchemy.utils [None req-9ece5151-b1fd-4bf2-8be1-8673631049af tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 13:09:55.479350 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9ece5151-b1fd-4bf2-8be1-8673631049af tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.023196 Oct 28 13:09:55.479924 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 939/1940] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:09:55 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:55.484487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1308859836"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:55.487764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:55.494467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.495010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.495555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.496256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.496707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.497124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.572251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.582342 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-838bf97a-b3f7-4345-adfd-a5e003917644 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1514 microversion: 2.1 time: 0.351278 Oct 28 13:09:55.583338 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1002/1941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:55 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1514 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:55.590724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:55.591562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:55.598408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.599239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.600165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.601056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.601673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.602265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.702479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:55.710247 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d70452a1-3c18-4deb-8dc9-3d911aef4dc7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1296 microversion: 2.1 time: 0.125647 Oct 28 13:09:55.719963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1003/1942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:55 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1296 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:55.719963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17b193b2-1f4d-45af-8bce-db99471ca9fd tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bd908e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:55.886875 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17b193b2-1f4d-45af-8bce-db99471ca9fd tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1248637161" status: 202 len: 0 microversion: 2.1 time: 0.174792 Oct 28 13:09:55.887751 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1004/1943] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Oct 28 13:09:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1248637161 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:09:55.896184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:55.897089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:55.903959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.904577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.904961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:55.905668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:55.906122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:55.906575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.046291 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab16003c-5341-483e-a789-09c795a01303 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.565056 Oct 28 13:09:56.047355 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 940/1944] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:09:55 2022] POST /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:09:56.059225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.060243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:56.067897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.076259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.076259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.076259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.076259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.076259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.232746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.241145 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57a33a1a-a9f8-4d47-aceb-eac5f042522f tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1404 microversion: 2.1 time: 0.186084 Oct 28 13:09:56.241932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 941/1945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:56 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:56.251763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9df2b945-44fd-454c-9233-424ab5e51065 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bda6c9d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.424780 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9df2b945-44fd-454c-9233-424ab5e51065 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-87448913" status: 202 len: 0 microversion: 2.1 time: 0.176244 Oct 28 13:09:56.430591 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 942/1946] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-87448913 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:09:56.437622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a86194b3-ab5d-4494-a1a8-73e8fecbd36e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bda1ac10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.457435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.486152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a838d778-f23f-4618-9f59-69891160317d tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1324 microversion: 2.1 time: 0.594193 Oct 28 13:09:56.486798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1005/1947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:55 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1324 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:56.511730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.512553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:56.520526 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a86194b3-ab5d-4494-a1a8-73e8fecbd36e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1412 microversion: 2.1 time: 0.088349 Oct 28 13:09:56.520782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.521610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.522246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.523147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.530461 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 943/1948] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:56 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:56.530622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.530622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.540603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-511f11e1-abf5-4d80-a5b1-1751dee90685 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] Calling method '.version_select at 0x7f27bda1a8b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.680416 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-511f11e1-abf5-4d80-a5b1-1751dee90685 tempest-KeyPairsV2TestJSON-582852556 tempest-KeyPairsV2TestJSON-582852556-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1584967829" status: 202 len: 0 microversion: 2.1 time: 0.155446 Oct 28 13:09:56.681150 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 944/1949] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Oct 28 13:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1584967829 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:09:56.686688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.688217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:56.695671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.696760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.697432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.698365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.699367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.701981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.816296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.839823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.841646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.848793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-567ab75e-7acd-411d-8943-7730787c1594 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.166321 Oct 28 13:09:56.858926 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 945/1950] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:56 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:56.858926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.858926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:56.872268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.877236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.877236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.877236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:56.877236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:56.877236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:56.964337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.973207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.974910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:56.976868 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f039e8f-0246-421f-b2a2-64be30189747 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.488952 Oct 28 13:09:56.977533 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1006/1951] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:56 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:56.995156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:56.996222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:57.003398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.003978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.004476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.005266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.006175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.006738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.066652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:57.066652 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-78ad7fe9-f010-40e0-8a63-1c9825fe1109 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1514 microversion: 2.1 time: 0.192811 Oct 28 13:09:57.066652 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 946/1952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:56 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:57.071998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:57.080780 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2459c7cd-b5d4-4138-b8b3-f4036678f857 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1296 microversion: 2.1 time: 0.101919 Oct 28 13:09:57.081416 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1007/1953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:56 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:57.269726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:57.270358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:57.276910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.277396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.277831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.278516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.279004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.279433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.385045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4b18748b-24f2-49ed-9e25-3152fd4daa29 req-9f0975d9-be55-4e9f-a244-6e3fb1817699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2", "tag": "e54c77d7-35b1-4e6d-beeb-225da8df30ba"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:57.411810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4b18748b-24f2-49ed-9e25-3152fd4daa29 req-9f0975d9-be55-4e9f-a244-6e3fb1817699 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.412614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4b18748b-24f2-49ed-9e25-3152fd4daa29 req-9f0975d9-be55-4e9f-a244-6e3fb1817699 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.413835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4b18748b-24f2-49ed-9e25-3152fd4daa29 req-9f0975d9-be55-4e9f-a244-6e3fb1817699 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.432153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4b18748b-24f2-49ed-9e25-3152fd4daa29 req-9f0975d9-be55-4e9f-a244-6e3fb1817699 service nova] Creating event network-changed:e54c77d7-35b1-4e6d-beeb-225da8df30ba for instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 on n-h2-862876-2 Oct 28 13:09:57.442644 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4b18748b-24f2-49ed-9e25-3152fd4daa29 req-9f0975d9-be55-4e9f-a244-6e3fb1817699 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067415 Oct 28 13:09:57.444017 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1008/1954] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:57.458093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:57.469673 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06802a79-11fa-466a-ad4f-3b1ea75d42d8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1404 microversion: 2.1 time: 0.203692 Oct 28 13:09:57.475413 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 947/1955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:57 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1404 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:57.513106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:57.513951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:57.522017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.533836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.533836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.533836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.533836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.533836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.550283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c40d467-c73d-4f4f-92fa-334f4295e69e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93a5280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:57.633510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c40d467-c73d-4f4f-92fa-334f4295e69e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1412 microversion: 2.1 time: 0.093201 Oct 28 13:09:57.634768 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 948/1956] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:57 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:57.879294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:57.880942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:57.891938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.892719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.894005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.895557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:57.896365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:57.896972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:57.970098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:57.987349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:57.988802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:57.994358 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a8f44a1-9160-4f47-88c1-cc235b35ecd0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.121283 Oct 28 13:09:57.994966 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 949/1957] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:57 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:09:58.005259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:58.006488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:58.015874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.016712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.017306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.018800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.019463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.019898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.246597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:58.259941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:58.261120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:58.269916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-12f95ef6-660d-410c-8d5e-62cb204acbd0 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1520 microversion: 2.1 time: 0.764610 Oct 28 13:09:58.282099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:58.283503 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37cbac9b-c9f1-4b5c-bfb8-f1874b73763c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.282437 Oct 28 13:09:58.284396 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 950/1958] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:58 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:58.298192 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1009/1959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:57 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1520 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:58.304263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:58.308225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:58.309051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:58.310379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:58.324129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.324635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.325082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.325809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.327977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.328484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.329100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.329843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.330289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.330769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.331072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.331570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.405291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.408153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.408686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.409845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lazy-loading 'fault' on Instance uuid 97fb8542-e326-4e0a-a3cc-87ea0513f10c {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:58.459117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:58.468025 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-775e19ab-93ad-4941-ad9e-f650b458b9b9 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1308 microversion: 2.1 time: 0.182767 Oct 28 13:09:58.469654 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 951/1960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:58 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:58.483221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98471a41-6171-4248-9918-3a3d436b83fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1509092047", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98471a41-6171-4248-9918-3a3d436b83fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 243 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1509092047", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1509092047', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '58a84705-f126-4a30-92b1-9a1cdcc86f2f'}]}}} Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:58.488472 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98471a41-6171-4248-9918-3a3d436b83fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:58.493888 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-98471a41-6171-4248-9918-3a3d436b83fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012136 Oct 28 13:09:58.500565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 952/1961] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:58 2022] POST /compute/v2.1/servers => generated 175 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:09:58.524147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:58.524147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:58.548752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.549377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.550603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.551470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:58.553047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:58.553613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:58.717703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:58.728166 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7284f70d-0848-445c-9a93-23372cd67a3e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1404 microversion: 2.1 time: 0.226343 Oct 28 13:09:58.729769 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 953/1962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:58 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:58.735309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3182f912-a6eb-4701-b0b4-11091ca62f93 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:58.737412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3182f912-a6eb-4701-b0b4-11091ca62f93 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 8cc8d925-7726-4a0a-b3c3-c661173439c0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:58.744598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-3182f912-a6eb-4701-b0b4-11091ca62f93 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] HTTP exception thrown: Instance 8cc8d925-7726-4a0a-b3c3-c661173439c0 could not be found. Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3182f912-a6eb-4701-b0b4-11091ca62f93 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/8cc8d925-7726-4a0a-b3c3-c661173439c0/metadata HTTP/1.1 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 8cc8d925-7726-4a0a-b3c3-c661173439c0 could not be found. Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '8cc8d925-7726-4a0a-b3c3-c661173439c0'} Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc8d925-7726-4a0a-b3c3-c661173439c0 could not be found. Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc8d925-7726-4a0a-b3c3-c661173439c0 could not be found. Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:58.752314 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:58.758302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:09:58.758302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:09:58.758302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc8d925-7726-4a0a-b3c3-c661173439c0 could not be found. Oct 28 13:09:58.758302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.758302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3182f912-a6eb-4701-b0b4-11091ca62f93 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 404 to user: Instance 8cc8d925-7726-4a0a-b3c3-c661173439c0 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:58.758670 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3182f912-a6eb-4701-b0b4-11091ca62f93 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8d925-7726-4a0a-b3c3-c661173439c0/metadata" status: 404 len: 111 microversion: 2.1 time: 0.027485 Oct 28 13:09:58.764864 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 954/1963] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:09:58 2022] GET /compute/v2.1/servers/8cc8d925-7726-4a0a-b3c3-c661173439c0/metadata => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:09:58.770056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-061131c5-bf64-4bc1-a7c9-97f4285d3f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bda43310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:58.777325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:58.836296 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-061131c5-bf64-4bc1-a7c9-97f4285d3f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1412 microversion: 2.1 time: 0.071531 Oct 28 13:09:58.837609 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 955/1964] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:58 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:58.873868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:58.886562 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2d38b83-1cc4-4d87-bbe5-58cc63e6b48a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1363 microversion: 2.1 time: 0.587022 Oct 28 13:09:58.893430 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1010/1965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:58 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:58.922273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28828f33-3449-479c-8e94-8544747258b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1102702429", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28828f33-3449-479c-8e94-8544747258b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 499 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1102702429", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1102702429', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '58a84705-f126-4a30-92b1-9a1cdcc86f2f'}]}}} Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:09:58.927686 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28828f33-3449-479c-8e94-8544747258b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:58.931938 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28828f33-3449-479c-8e94-8544747258b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012480 Oct 28 13:09:58.938874 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 956/1966] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:58 2022] POST /compute/v2.1/servers => generated 687 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:09:59.004458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-047095a9-9e27-4347-9bd1-92815329fd43 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1977724504", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-047095a9-9e27-4347-9bd1-92815329fd43 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 500 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1977724504", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1977724504', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '58a84705-f126-4a30-92b1-9a1cdcc86f2f'}]}}} Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:09:59.009678 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.013762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-047095a9-9e27-4347-9bd1-92815329fd43 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:59.020248 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-047095a9-9e27-4347-9bd1-92815329fd43 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.020120 Oct 28 13:09:59.024350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:59.025315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:59.030029 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1011/1967] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:09:59.035578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.036084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.036502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.037735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.038366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.038806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.083688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a4b825fe-1694-464a-b17a-eeb4734751fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-597140507", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a4b825fe-1694-464a-b17a-eeb4734751fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 753 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-597140507", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-597140507', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '58a84705-f126-4a30-92b1-9a1cdcc86f2f'}]}}} Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:59.091197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:59.094068 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:59.099721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.099721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.099721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a4b825fe-1694-464a-b17a-eeb4734751fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:59.099721 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a4b825fe-1694-464a-b17a-eeb4734751fe tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.013790 Oct 28 13:09:59.104068 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1012/1968] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:09:59 2022] POST /compute/v2.1/servers => generated 1197 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 13:09:59.121301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.134039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.134039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.140000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-65ebe636-b6b0-460d-88bc-c30ad7da2eb1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.119724 Oct 28 13:09:59.151985 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 957/1969] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:59 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:09:59.175627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bab9bac3-fef2-4534-b9b7-a90f9d45c547 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-737454743", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bab9bac3-fef2-4534-b9b7-a90f9d45c547 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 1265 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-737454743", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "58a84705-f126-4a30-92b1-9a1cdcc86f2f"}]}} Oct 28 13:09:59.181508 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-737454743', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '58a84705-f126-4a30-92b1-9a1cdcc86f2f'}]}}} Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.185378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:09:59.189418 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:09:59.201623 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:09:59.201623 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.201623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bab9bac3-fef2-4534-b9b7-a90f9d45c547 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:59.201623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bab9bac3-fef2-4534-b9b7-a90f9d45c547 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013020 Oct 28 13:09:59.201623 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1013/1970] 10.222.0.25 () {60 vars in 1148 bytes} [Fri Oct 28 13:09:59 2022] POST /compute/v2.1/servers => generated 2221 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 13:09:59.208615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80f5d4ee-57aa-4aac-bd4f-c70bb422fb2c tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:59.209537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-80f5d4ee-57aa-4aac-bd4f-c70bb422fb2c tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: c73f661f-386d-4147-942f-02de8a5f5581] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:59.215285 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-80f5d4ee-57aa-4aac-bd4f-c70bb422fb2c tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] HTTP exception thrown: Instance c73f661f-386d-4147-942f-02de8a5f5581 could not be found. Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80f5d4ee-57aa-4aac-bd4f-c70bb422fb2c tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/c73f661f-386d-4147-942f-02de8a5f5581/metadata/test2 HTTP/1.1 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance c73f661f-386d-4147-942f-02de8a5f5581 could not be found. Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': 'c73f661f-386d-4147-942f-02de8a5f5581', 'id': 'test2'} Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73f661f-386d-4147-942f-02de8a5f5581 could not be found. Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73f661f-386d-4147-942f-02de8a5f5581 could not be found. Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:09:59.216783 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:09:59.224599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:09:59.224599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:09:59.224599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73f661f-386d-4147-942f-02de8a5f5581 could not be found. Oct 28 13:09:59.224599 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:09:59.224599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80f5d4ee-57aa-4aac-bd4f-c70bb422fb2c tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 404 to user: Instance c73f661f-386d-4147-942f-02de8a5f5581 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:09:59.224599 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-80f5d4ee-57aa-4aac-bd4f-c70bb422fb2c tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/c73f661f-386d-4147-942f-02de8a5f5581/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.013736 Oct 28 13:09:59.224599 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 958/1971] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Oct 28 13:09:59 2022] GET /compute/v2.1/servers/c73f661f-386d-4147-942f-02de8a5f5581/metadata/test2 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:09:59.240401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:59.240401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:59.247947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.248770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.249392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.250590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.251354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.252100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.275400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:09:59.282286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:09:59.320037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:59.321598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:59.342677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.343552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.344729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.347852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.348834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.349645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.523672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.531460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.532932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.534614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-558f908b-8e8a-4d3b-a19c-8ce9edb7a44b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.218591 Oct 28 13:09:59.535207 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 959/1972] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:09:59 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:09:59.540190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ac0f864c-b054-44e6-8faa-28e66e84c284 req-cd3f5b83-4801-42f8-9987-b4db13e670c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fb8542-e326-4e0a-a3cc-87ea0513f10c", "name": "network-vif-deleted", "tag": "fb562b6e-eb21-433c-834b-b5358f4ce022"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:09:59.552022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ac0f864c-b054-44e6-8faa-28e66e84c284 req-cd3f5b83-4801-42f8-9987-b4db13e670c2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.552625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ac0f864c-b054-44e6-8faa-28e66e84c284 req-cd3f5b83-4801-42f8-9987-b4db13e670c2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.554357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ac0f864c-b054-44e6-8faa-28e66e84c284 req-cd3f5b83-4801-42f8-9987-b4db13e670c2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.570975 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ac0f864c-b054-44e6-8faa-28e66e84c284 req-cd3f5b83-4801-42f8-9987-b4db13e670c2 service nova] Creating event network-vif-deleted:fb562b6e-eb21-433c-834b-b5358f4ce022 for instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c on n-h1-862876-2 Oct 28 13:09:59.575792 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ac0f864c-b054-44e6-8faa-28e66e84c284 req-cd3f5b83-4801-42f8-9987-b4db13e670c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039193 Oct 28 13:09:59.576393 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 960/1973] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:09:59.584773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:59.585807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:59.592114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.592843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.593285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.597888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.597888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.597888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.634131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.634610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.635306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.647459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lazy-loading 'fault' on Instance uuid 97fb8542-e326-4e0a-a3cc-87ea0513f10c {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:09:59.688256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6655019d4e204241b8f97a5d2cdbd0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54902a27bc8e4736a3ea3e48c1c6924a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.695834 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3ce53616-dd8b-4fd2-a14b-bf6ce69fbc60 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 200 len: 1308 microversion: 2.1 time: 0.118231 Oct 28 13:09:59.696407 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 961/1974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:59 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:09:59.752211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0dd8c7ea-4e50-42a4-9eab-8a8fe960c5b6 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 204 len: 0 microversion: 2.1 time: 0.519222 Oct 28 13:09:59.752821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1014/1975] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:09:59 2022] DELETE /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:09:59.754978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:59.755862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:59.762107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:09:59.762316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.762645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.762847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:09:59.763109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.763805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.764423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.764670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.769307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.769790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.773317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.773317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:09:59.773317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:09:59.773317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:09:59.979441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.980042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:09:59.993366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b27c08d-95dc-48ee-91c3-07f068209143 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1404 microversion: 2.1 time: 0.242307 Oct 28 13:09:59.994245 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 962/1976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:59 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:00.010624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5dcde784-2e47-47d0-b85f-09158c9f0172 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93a5c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.012921 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f3a0fc4-aa88-4794-b615-14455b0d9f9f tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1526 microversion: 2.1 time: 0.255318 Oct 28 13:10:00.013499 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1015/1977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:09:59 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1526 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:00.029563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.030712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.050698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.050698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.050698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.050698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.050698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.050698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.066598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5dcde784-2e47-47d0-b85f-09158c9f0172 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1412 microversion: 2.1 time: 0.070992 Oct 28 13:10:00.067203 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 963/1978] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:09:59 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:00.171573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.172696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.179847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.191042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.191042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.191042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.191042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.191042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.258191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:00.267415 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a6c6d07f-0035-4275-a407-01411a48f498 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1363 microversion: 2.1 time: 0.243404 Oct 28 13:10:00.269144 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1016/1979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:00 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:00.286917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:00.295753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:00.297310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:00.303777 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb6f0f7e-6866-4d4a-ac33-cc36930ad6d1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.136930 Oct 28 13:10:00.304651 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 964/1980] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:00 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:00.474396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-35aedddd-f52b-4abf-a0d3-f0487d795865 req-8f4b8c01-953f-4ce8-8659-7200f0079401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151c2d94-029f-4353-8f82-06ac9f8d4fa4", "name": "network-vif-plugged", "status": "completed", "tag": "80c77538-cbcb-4c3c-9134-29ff9f7e31b3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:00.483900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-35aedddd-f52b-4abf-a0d3-f0487d795865 req-8f4b8c01-953f-4ce8-8659-7200f0079401 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.484376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-35aedddd-f52b-4abf-a0d3-f0487d795865 req-8f4b8c01-953f-4ce8-8659-7200f0079401 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.484795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-35aedddd-f52b-4abf-a0d3-f0487d795865 req-8f4b8c01-953f-4ce8-8659-7200f0079401 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.496398 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-35aedddd-f52b-4abf-a0d3-f0487d795865 req-8f4b8c01-953f-4ce8-8659-7200f0079401 service nova] Creating event network-vif-plugged:80c77538-cbcb-4c3c-9134-29ff9f7e31b3 for instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 on n-h1-862876-2 Oct 28 13:10:00.501602 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-35aedddd-f52b-4abf-a0d3-f0487d795865 req-8f4b8c01-953f-4ce8-8659-7200f0079401 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033139 Oct 28 13:10:00.502164 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1017/1981] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:00.561546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.564405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.569082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.569578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.570018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.570717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.571209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.571639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.724857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.724857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 97fb8542-e326-4e0a-a3cc-87ea0513f10c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.733897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.736431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.739081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.740525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.743165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.743466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.748432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:00.765450 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] HTTP exception thrown: Instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c could not be found. Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Request method failure captured: Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c HTTP/1.1 Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9PrivHWrNN7qoFp-ToPG_BIK1q8kKwMe1YdDXdOYqsX6WHzY9ynxpqTj1iV5Zk8AuPvC0oaslD4NXe2tOzTVjg27WuEy0iyrG2UXxZch2l3Ayr5nCowCv_3AhljF84z4m6DlJ6MM-Pm5_TeDxg01qOzrBN7Pwwq2MG7Fw5sIB9YMeM Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54902a27bc8e4736a3ea3e48c1c6924a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6655019d4e204241b8f97a5d2cdbd0bf Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c could not be found. Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '97fb8542-e326-4e0a-a3cc-87ea0513f10c'} Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c could not be found. Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c could not be found. Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.767147 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c could not be found. Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Returning 404 to user: Instance 97fb8542-e326-4e0a-a3cc-87ea0513f10c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-df3ce735-cce8-492a-a3fb-84f6b97449d8 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c" status: 404 len: 111 microversion: 2.1 time: 0.051632 Oct 28 13:10:00.773123 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1018/1982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:00 2022] GET /compute/v2.1/servers/97fb8542-e326-4e0a-a3cc-87ea0513f10c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:10:00.779490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:00.781591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.782905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.783017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:00.784504 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52f95c3d-b826-47b2-bb3a-6fe385a06faa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.226721 Oct 28 13:10:00.785438 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 965/1983] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:00 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:00.793105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.793693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.794189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.794984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.795556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.796325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.820484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] HTTP exception thrown: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Request method failure captured: Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c HTTP/1.1 Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9PrivHWrNN7qoFp-ToPG_BIK1q8kKwMe1YdDXdOYqsX6WHzY9ynxpqTj1iV5Zk8AuPvC0oaslD4NXe2tOzTVjg27WuEy0iyrG2UXxZch2l3Ayr5nCowCv_3AhljF84z4m6DlJ6MM-Pm5_TeDxg01qOzrBN7Pwwq2MG7Fw5sIB9YMeM Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54902a27bc8e4736a3ea3e48c1c6924a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6655019d4e204241b8f97a5d2cdbd0bf Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '09d02003-0d62-4f7b-b380-a8297dbd531c'} Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:00.822511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.828327 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.830028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Returning 404 to user: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:00.831672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ebabaefb-79a6-41c0-98f3-6cdec4830af5 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 404 len: 111 microversion: 2.1 time: 0.055227 Oct 28 13:10:00.833003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1019/1984] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:10:00 2022] DELETE /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:10:00.845249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.846445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 09d02003-0d62-4f7b-b380-a8297dbd531c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.855510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.856045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.856491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.857388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.857860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.858292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.887727 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] HTTP exception thrown: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Request method failure captured: Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c HTTP/1.1 Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9PrivHWrNN7qoFp-ToPG_BIK1q8kKwMe1YdDXdOYqsX6WHzY9ynxpqTj1iV5Zk8AuPvC0oaslD4NXe2tOzTVjg27WuEy0iyrG2UXxZch2l3Ayr5nCowCv_3AhljF84z4m6DlJ6MM-Pm5_TeDxg01qOzrBN7Pwwq2MG7Fw5sIB9YMeM Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54902a27bc8e4736a3ea3e48c1c6924a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6655019d4e204241b8f97a5d2cdbd0bf Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '09d02003-0d62-4f7b-b380-a8297dbd531c'} Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.890115 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Returning 404 to user: Instance 09d02003-0d62-4f7b-b380-a8297dbd531c could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f6d976cf-fb4a-4186-881c-928ab16ae56a tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c" status: 404 len: 111 microversion: 2.1 time: 0.054649 Oct 28 13:10:00.896459 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 966/1985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:00 2022] GET /compute/v2.1/servers/09d02003-0d62-4f7b-b380-a8297dbd531c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:10:00.902289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.902804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.911091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.912016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.912500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.913339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.913800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.914439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.932099 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] HTTP exception thrown: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Request method failure captured: Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a HTTP/1.1 Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9PrivHWrNN7qoFp-ToPG_BIK1q8kKwMe1YdDXdOYqsX6WHzY9ynxpqTj1iV5Zk8AuPvC0oaslD4NXe2tOzTVjg27WuEy0iyrG2UXxZch2l3Ayr5nCowCv_3AhljF84z4m6DlJ6MM-Pm5_TeDxg01qOzrBN7Pwwq2MG7Fw5sIB9YMeM Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54902a27bc8e4736a3ea3e48c1c6924a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6655019d4e204241b8f97a5d2cdbd0bf Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '3ba1c3df-c727-4cdd-b65a-bfe984620b9a'} Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:00.933667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Returning 404 to user: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c971d10-8898-48af-9191-7e6ea770060f tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 404 len: 111 microversion: 2.1 time: 0.037860 Oct 28 13:10:00.939274 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1020/1986] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:10:00 2022] DELETE /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:10:00.944310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:00.944928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] [instance: 3ba1c3df-c727-4cdd-b65a-bfe984620b9a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:00.950816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.951301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.951941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.952640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:00.953089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:00.953508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:00.972161 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] HTTP exception thrown: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Request method failure captured: Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a HTTP/1.1 Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9PrivHWrNN7qoFp-ToPG_BIK1q8kKwMe1YdDXdOYqsX6WHzY9ynxpqTj1iV5Zk8AuPvC0oaslD4NXe2tOzTVjg27WuEy0iyrG2UXxZch2l3Ayr5nCowCv_3AhljF84z4m6DlJ6MM-Pm5_TeDxg01qOzrBN7Pwwq2MG7Fw5sIB9YMeM Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54902a27bc8e4736a3ea3e48c1c6924a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54902a27bc8e4736a3ea3e48c1c6924a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 54902a27bc8e4736a3ea3e48c1c6924a Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1558291289 Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6655019d4e204241b8f97a5d2cdbd0bf Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerDiskConfigTestJSON-1558291289-project Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '3ba1c3df-c727-4cdd-b65a-bfe984620b9a'} Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:00.973706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] Returning 404 to user: Instance 3ba1c3df-c727-4cdd-b65a-bfe984620b9a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2480d997-366b-4e39-a75c-f3895c4b6e91 tempest-ServerDiskConfigTestJSON-1558291289 tempest-ServerDiskConfigTestJSON-1558291289-project] 10.222.0.25 "GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a" status: 404 len: 111 microversion: 2.1 time: 0.035160 Oct 28 13:10:00.980230 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 967/1987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:00 2022] GET /compute/v2.1/servers/3ba1c3df-c727-4cdd-b65a-bfe984620b9a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:10:01.034133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:01.036875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:01.043440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:01.046875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.047554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.047727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:01.048398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.049292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.050448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.051253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.056178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:01.064302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.065640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.071070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.071904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.072453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.072948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.349156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:01.362508 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06fcec08-60f8-4cb6-b10d-051af1f2c00a tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1526 microversion: 2.1 time: 0.321994 Oct 28 13:10:01.378774 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 968/1988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:01 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1526 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:01.390253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-16c092bd-d959-4992-bbdc-a891c9275f37 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bda43f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:01.448793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-16c092bd-d959-4992-bbdc-a891c9275f37 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1412 microversion: 2.1 time: 0.082983 Oct 28 13:10:01.458495 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 969/1989] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:10:01 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:01.475244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:01.476006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:01.482911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.489950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.489950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.490685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.491251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.491765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.526842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:01.536851 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef265aad-8640-4b49-a17f-23d5fa403a96 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1404 microversion: 2.1 time: 0.506519 Oct 28 13:10:01.561734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1021/1990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:01 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:01.567994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:01.576383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:01.590918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.592069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.594778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.595605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.596222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.597168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.769314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:01.771416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:01.780674 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f31375d7-ed3c-463d-a634-ff8395cd9be0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1363 microversion: 2.1 time: 0.320295 Oct 28 13:10:01.781304 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 970/1991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:01 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:01.782961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:01.786677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ec361ba7-f6f0-4e21-b932-c2f72ee7ef44 req-0e9a56d9-e7ca-4125-9316-11c868e4e308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}, {"server_uuid": "e8bc2afd-f819-4e20-b648-10b391be298b", "name": "network-vif-unplugged", "status": "completed", "tag": "480f1c45-173b-4c88-9850-e79388dc2e83"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:01.788478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:01.797645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ec361ba7-f6f0-4e21-b932-c2f72ee7ef44 req-0e9a56d9-e7ca-4125-9316-11c868e4e308 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.798128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ec361ba7-f6f0-4e21-b932-c2f72ee7ef44 req-0e9a56d9-e7ca-4125-9316-11c868e4e308 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.798562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ec361ba7-f6f0-4e21-b932-c2f72ee7ef44 req-0e9a56d9-e7ca-4125-9316-11c868e4e308 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.802063 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54b98d8f-e5e1-4704-9a43-0c1114527cec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.238871 Oct 28 13:10:01.811737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ec361ba7-f6f0-4e21-b932-c2f72ee7ef44 req-0e9a56d9-e7ca-4125-9316-11c868e4e308 service nova] Creating event network-changed:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:10:01.812493 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ec361ba7-f6f0-4e21-b932-c2f72ee7ef44 req-0e9a56d9-e7ca-4125-9316-11c868e4e308 service nova] Creating event network-vif-unplugged:480f1c45-173b-4c88-9850-e79388dc2e83 for instance e8bc2afd-f819-4e20-b648-10b391be298b on n-h2-862876-2 Oct 28 13:10:01.815228 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1022/1992] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:01 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:01.822689 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ec361ba7-f6f0-4e21-b932-c2f72ee7ef44 req-0e9a56d9-e7ca-4125-9316-11c868e4e308 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037286 Oct 28 13:10:01.822689 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 971/1993] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:01.827825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:01.828529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:01.835887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.836474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.836977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:01.837764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:01.838285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:01.838792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:02.340886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:02.350606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:02.352077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:02.373416 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2c1531b-da9e-45ce-9f4d-c3749ef2550e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.551925 Oct 28 13:10:02.373416 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1023/1994] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:01 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:02.389156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:02.390287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:02.403010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:02.414260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:02.414260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:02.414260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:02.414260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:02.414260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:02.465564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4281d72a-0843-4877-aa4d-a0e7617cad21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd9a21f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:02.564136 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4281d72a-0843-4877-aa4d-a0e7617cad21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1412 microversion: 2.1 time: 0.102555 Oct 28 13:10:02.564734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1024/1995] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:10:02 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:02.574136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:02.574857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:02.598191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:02.602545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:02.602545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:02.602545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:02.602545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:02.604471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:02.694389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:02.703769 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c06a88c-2fa2-4b95-9aae-30ada492d028 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1526 microversion: 2.1 time: 0.320164 Oct 28 13:10:02.705273 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 972/1996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:02 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1526 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:02.811280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:02.813574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:02.815877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:02.840062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:02.840062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:02.840062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:02.840062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:02.840062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:02.840062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:03.078635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:03.092817 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e181ff48-1e59-4d08-91ee-648dd12908a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1363 microversion: 2.1 time: 0.287021 Oct 28 13:10:03.093321 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 973/1997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:02 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:03.100543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:03.101215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:03.108501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:03.109006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:03.109503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:03.110269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:03.110765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:03.111210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:03.221759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:03.234134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:03.235814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:03.243117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-55f40a55-bd74-4afb-bb88-00536ad3a4ba tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1558 microversion: 2.91 time: 0.148305 Oct 28 13:10:03.244414 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 974/1998] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:03 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:03.249791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-fcb181ee-59b1-42d2-8417-35709a95b31f req-31dc2ad4-8a39-44fe-aff3-463f4f2bad02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2", "name": "network-vif-plugged", "status": "completed", "tag": "e54c77d7-35b1-4e6d-beeb-225da8df30ba"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:03.263139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fcb181ee-59b1-42d2-8417-35709a95b31f req-31dc2ad4-8a39-44fe-aff3-463f4f2bad02 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:03.266490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fcb181ee-59b1-42d2-8417-35709a95b31f req-31dc2ad4-8a39-44fe-aff3-463f4f2bad02 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:03.266490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fcb181ee-59b1-42d2-8417-35709a95b31f req-31dc2ad4-8a39-44fe-aff3-463f4f2bad02 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:03.282518 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fcb181ee-59b1-42d2-8417-35709a95b31f req-31dc2ad4-8a39-44fe-aff3-463f4f2bad02 service nova] Creating event network-vif-plugged:e54c77d7-35b1-4e6d-beeb-225da8df30ba for instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 on n-h2-862876-2 Oct 28 13:10:03.288156 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-fcb181ee-59b1-42d2-8417-35709a95b31f req-31dc2ad4-8a39-44fe-aff3-463f4f2bad02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042143 Oct 28 13:10:03.289029 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 975/1999] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:03.491949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:03.500451 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f975c358-c063-4819-8928-2abd8a3670c2 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1404 microversion: 2.1 time: 0.934618 Oct 28 13:10:03.519316 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1025/2000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:02 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1404 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:03.525708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:03.527032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:03.551181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:03.551969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:03.552595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:03.553852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:03.554470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:03.555098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:03.616799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-965898666", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "459498fc-6efd-4e78-a769-dd0c54b8b64a"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:03.718359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] validate_networks() for [('459498fc-6efd-4e78-a769-dd0c54b8b64a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:10:04.070726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:04.088537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:04.090207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:04.091580 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8079758d-fc41-4abc-a429-3772fb10df6c tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.570898 Oct 28 13:10:04.092617 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1026/2001] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:03 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:04.100372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-560728b1-007d-4549-a90d-1e655eb9954e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd8ee550>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:04.278533 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-560728b1-007d-4549-a90d-1e655eb9954e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1412 microversion: 2.1 time: 0.184651 Oct 28 13:10:04.279159 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1027/2002] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:10:04 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1412 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:04.288163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:04.337250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:04.401034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.405716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.407788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.410104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.411758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.413080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.548784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9432c5ea932342b5abb26ea1d0091118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36f045243404255bcdf56bcca144d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:04.561937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9310b4ce-b74b-4526-9de5-cbaab4a833ec tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 200 len: 1484 microversion: 2.1 time: 0.280028 Oct 28 13:10:04.579072 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1028/2003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:04 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 1484 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:04.584958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3ae21920-a3ec-48bf-9cae-4ecca8222dd2 req-6e10c5d6-c85d-4d8f-bc1a-0d9a0b7c8f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8bc2afd-f819-4e20-b648-10b391be298b", "tag": "480f1c45-173b-4c88-9850-e79388dc2e83"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:04.595509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ae21920-a3ec-48bf-9cae-4ecca8222dd2 req-6e10c5d6-c85d-4d8f-bc1a-0d9a0b7c8f6c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.596302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ae21920-a3ec-48bf-9cae-4ecca8222dd2 req-6e10c5d6-c85d-4d8f-bc1a-0d9a0b7c8f6c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.596904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ae21920-a3ec-48bf-9cae-4ecca8222dd2 req-6e10c5d6-c85d-4d8f-bc1a-0d9a0b7c8f6c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.620853 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3ae21920-a3ec-48bf-9cae-4ecca8222dd2 req-6e10c5d6-c85d-4d8f-bc1a-0d9a0b7c8f6c service nova] Creating event network-changed:480f1c45-173b-4c88-9850-e79388dc2e83 for instance e8bc2afd-f819-4e20-b648-10b391be298b on n-h2-862876-2 Oct 28 13:10:04.627343 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3ae21920-a3ec-48bf-9cae-4ecca8222dd2 req-6e10c5d6-c85d-4d8f-bc1a-0d9a0b7c8f6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044541 Oct 28 13:10:04.629202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1029/2004] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:04.636155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:04.641794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:10:04.642731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:10:04.644227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:10:04.644520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:04.645386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:10:04.646303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:10:04.651557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.652061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.652503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.654612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.654612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.654612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.676579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.677075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.677509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.678503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.678661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.679157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.702603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Getting quotas for project 52536665a18b4117a13fdecef7e39748. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:04.710609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Getting quotas for user e82fcb731fff4e84b6259a686b170d72 and project 52536665a18b4117a13fdecef7e39748. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:04.729814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:10:04.736148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:10:04.882804 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59d0b414-b110-4699-b011-8a4e53c6e8fc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.592296 Oct 28 13:10:04.887121 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 976/2005] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:10:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:10:04.900640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:04.903479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:04.920003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.920761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.933971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:04.941431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:04.943077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:04.943764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:05.057758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.078235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.080582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:05.085939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.091187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-340d8d44-0d6e-470d-b5b3-bb442dc90c60 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.202592 Oct 28 13:10:05.092534 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 977/2006] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:04 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:05.097818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:05.098985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:05.108243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:05.110681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:05.110975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:05.113504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:05.114459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:05.115145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:05.472377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.484687 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e649290-699e-4893-9f2e-44ba26519bda tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1363 microversion: 2.1 time: 0.854018 Oct 28 13:10:05.495735 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1030/2007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:04 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1363 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:05.508955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-400624723", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "459498fc-6efd-4e78-a769-dd0c54b8b64a"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:05.592734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.608663 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0eb6c03a-b377-492a-ae9d-f42e34cb43a8 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1404 microversion: 2.1 time: 0.514626 Oct 28 13:10:05.609636 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 978/2008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:05 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:05.617751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:05.618400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:05.628079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:05.632100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:05.632590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:05.633334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:05.633798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:05.634230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:05.945067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.968687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.980812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:05.986211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd84f4ae-a370-4003-aa24-00df9c5a237a tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1487 microversion: 2.25 time: 0.375550 Oct 28 13:10:05.995302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 979/2009] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:05 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1487 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:06.018352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d1d8e68-8d59-4153-9c46-570afc014932 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bda26940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:14.693367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:14.719279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=13 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:15.477513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:15.555130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:15.959302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:16.386944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:19.972681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] validate_networks() for [('459498fc-6efd-4e78-a769-dd0c54b8b64a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:10:19.984400 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d1d8e68-8d59-4153-9c46-570afc014932 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1421 microversion: 2.1 time: 13.987610 Oct 28 13:10:19.987172 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 980/2010] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:10:05 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1421 bytes in 13991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:19.996727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:19.999322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] [instance: 2c608246-972a-4230-bbcb-b63f69f29b62] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:20.007620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.008136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.008580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.009302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.009941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.010662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.026572 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] HTTP exception thrown: Instance 2c608246-972a-4230-bbcb-b63f69f29b62 could not be found. Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Request method failure captured: Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 HTTP/1.1 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SPa-19oziqKGCUr-5RZ2QQhn5uPaRA-BRBB9R9lU3l5I845axplQnkCuIaNScp_KsZC3f-eah-7krMY7F6kDqYlyI3qt6DpKlbmPKYEEBmdLH-Oy9dE4_1Jz0YBaFILqDJAL7Wqx1-u8aQhcV2grQjj70rgaoz-Y6NIY3zsk5ez1A Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a36f045243404255bcdf56bcca144d0c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a36f045243404255bcdf56bcca144d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a36f045243404255bcdf56bcca144d0c Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231162968 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 9432c5ea932342b5abb26ea1d0091118 Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231162968-project Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 2c608246-972a-4230-bbcb-b63f69f29b62 could not be found. Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2c608246-972a-4230-bbcb-b63f69f29b62'} Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c608246-972a-4230-bbcb-b63f69f29b62 could not be found. Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c608246-972a-4230-bbcb-b63f69f29b62 could not be found. Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:20.028827 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c608246-972a-4230-bbcb-b63f69f29b62 could not be found. Oct 28 13:10:20.034337 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:20.036136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] Returning 404 to user: Instance 2c608246-972a-4230-bbcb-b63f69f29b62 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:20.037393 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8132f7e-56b1-4875-89b7-25c0c22960a2 tempest-ServerMetadataNegativeTestJSON-231162968 tempest-ServerMetadataNegativeTestJSON-231162968-project] 10.222.0.25 "GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62" status: 404 len: 111 microversion: 2.1 time: 0.049029 Oct 28 13:10:20.041496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 981/2011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:19 2022] GET /compute/v2.1/servers/2c608246-972a-4230-bbcb-b63f69f29b62 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:10:20.043183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:20.049663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:20.051613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.052115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.052553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.053507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.054253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.055124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.141369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:20.149096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:20.151144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:20.157689 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f6b73fc-2704-4bba-bff0-cf0063730cf8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.118261 Oct 28 13:10:20.179680 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 982/2012] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:20 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:20.186580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:20.187603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:20.195353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.196173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.196859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.197817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.198505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.199207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.491393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:20.500560 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1572fa1f-cd69-4347-a23f-f496fbc16618 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1363 microversion: 2.1 time: 0.319010 Oct 28 13:10:20.501454 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 983/2013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:20 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:20.507585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:10:20.508181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:10:20.508967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:10:20.509548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:10:20.510127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:10:20.520311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:20.520924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:20.529310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.530079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.535820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.536672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.537156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.539864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.540166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.543606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.544203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.544988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.545461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.548343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.573749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Getting quotas for project 52536665a18b4117a13fdecef7e39748. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:20.581425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Getting quotas for user e82fcb731fff4e84b6259a686b170d72 and project 52536665a18b4117a13fdecef7e39748. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:20.597797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:10:20.600670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:10:20.800539 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-33217736-2432-481e-b882-f6cbdd6896dc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.303636 Oct 28 13:10:20.804544 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1031/2014] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 15308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:10:20.815840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c51f25b2-3085-4bcb-ba91-52013f656af0 req-65aca402-842f-4952-a997-7a59d0d80d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c608246-972a-4230-bbcb-b63f69f29b62", "name": "network-vif-deleted", "tag": "d610d928-9a98-4aec-9c9e-9ed06af8d9bd"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:20.842379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c51f25b2-3085-4bcb-ba91-52013f656af0 req-65aca402-842f-4952-a997-7a59d0d80d7d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.843240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c51f25b2-3085-4bcb-ba91-52013f656af0 req-65aca402-842f-4952-a997-7a59d0d80d7d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.843879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c51f25b2-3085-4bcb-ba91-52013f656af0 req-65aca402-842f-4952-a997-7a59d0d80d7d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.878998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:20.886548 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c51f25b2-3085-4bcb-ba91-52013f656af0 req-65aca402-842f-4952-a997-7a59d0d80d7d service nova] Creating event network-vif-deleted:d610d928-9a98-4aec-9c9e-9ed06af8d9bd for instance 2c608246-972a-4230-bbcb-b63f69f29b62 on n-h2-862876-2 Oct 28 13:10:20.891706 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd82e6ce-0878-4f8f-bc9e-436acb95438e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1590 microversion: 2.1 time: 0.388975 Oct 28 13:10:20.895420 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 984/2015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:20 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1590 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:20.898946 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c51f25b2-3085-4bcb-ba91-52013f656af0 req-65aca402-842f-4952-a997-7a59d0d80d7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088996 Oct 28 13:10:20.902610 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1032/2016] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:20.912891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-87ed2ae5-5bd2-499f-9c56-5cc6c07c9cf6 req-8b8b459c-9006-4370-a985-f1f2494410ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "name": "network-vif-plugged", "status": "completed", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:20.923267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:20.924211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:20.931043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.932047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.940431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-87ed2ae5-5bd2-499f-9c56-5cc6c07c9cf6 req-8b8b459c-9006-4370-a985-f1f2494410ae service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.940431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-87ed2ae5-5bd2-499f-9c56-5cc6c07c9cf6 req-8b8b459c-9006-4370-a985-f1f2494410ae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.940687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.941486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:20.942965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-87ed2ae5-5bd2-499f-9c56-5cc6c07c9cf6 req-8b8b459c-9006-4370-a985-f1f2494410ae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.945706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:20.947378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:20.980273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-87ed2ae5-5bd2-499f-9c56-5cc6c07c9cf6 req-8b8b459c-9006-4370-a985-f1f2494410ae service nova] Creating event network-vif-plugged:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:10:20.985255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-87ed2ae5-5bd2-499f-9c56-5cc6c07c9cf6 req-8b8b459c-9006-4370-a985-f1f2494410ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080463 Oct 28 13:10:20.987284 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1033/2017] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:20.996139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-63db3d6b-7394-43f0-bbda-13e43315588d req-f07d172b-0aef-44dc-8712-03c5b8397f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cafde05-1d32-4513-afdf-c07cb41999cb", "tag": "20295591-dab2-49ae-aa38-d95add1f7a58"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:21.009358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63db3d6b-7394-43f0-bbda-13e43315588d req-f07d172b-0aef-44dc-8712-03c5b8397f13 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:21.010099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63db3d6b-7394-43f0-bbda-13e43315588d req-f07d172b-0aef-44dc-8712-03c5b8397f13 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:21.013100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63db3d6b-7394-43f0-bbda-13e43315588d req-f07d172b-0aef-44dc-8712-03c5b8397f13 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:21.027305 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-63db3d6b-7394-43f0-bbda-13e43315588d req-f07d172b-0aef-44dc-8712-03c5b8397f13 service nova] Creating event network-changed:20295591-dab2-49ae-aa38-d95add1f7a58 for instance 2cafde05-1d32-4513-afdf-c07cb41999cb on n-h1-862876-2 Oct 28 13:10:21.036209 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-63db3d6b-7394-43f0-bbda-13e43315588d req-f07d172b-0aef-44dc-8712-03c5b8397f13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044639 Oct 28 13:10:21.036209 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1034/2018] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:21.278129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1816315984", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": "none"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:21.348553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:10:21.349961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:10:21.350632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:10:21.351264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:10:21.351847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:10:21.362458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:21.363031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:21.363762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:21.364987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:21.365689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:21.366296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:21.420363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Getting quotas for project f30512b9387f4095a1c5e704965bba50. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:21.430955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:21.431560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Getting quotas for user 35341e4340e445558f346f9487ee73b1 and project f30512b9387f4095a1c5e704965bba50. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:21.445918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:21.447487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:21.448665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dab80774-181d-4315-b7bf-b3412dc31679 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1477 microversion: 2.25 time: 0.534677 Oct 28 13:10:21.459848 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 985/2019] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:20 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1477 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:21.465021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cc7085b6-6d68-487d-af91-c5232d599e51 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9428940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:21.466446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:10:21.469013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:10:21.540250 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cc7085b6-6d68-487d-af91-c5232d599e51 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 200 len: 1421 microversion: 2.1 time: 0.078887 Oct 28 13:10:21.541170 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 986/2020] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:10:21 2022] GET /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:21.553605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:21.554327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:21.573201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:21.573201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:21.573201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:21.573201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:21.573201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:21.573201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:21.763706 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3846082-6e7c-4e47-be66-284d383b5f3a tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217619 Oct 28 13:10:21.776696 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 987/2021] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:10:21 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:21.779079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-9918274", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "451", "networks": [{"uuid": "459498fc-6efd-4e78-a769-dd0c54b8b64a"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:21.858330 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7be3b185-7336-442f-9024-8bcbaeb49e61 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.821399 Oct 28 13:10:21.862304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] validate_networks() for [('459498fc-6efd-4e78-a769-dd0c54b8b64a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:10:21.868503 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1035/2022] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:10:21.879923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:21.884925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:21.895436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:21.896391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:21.897214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:21.898397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:21.899122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:21.900130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:22.006729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:22.016572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:22.018568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:22.026441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8834816d-9c3a-4878-a739-40865eee59fd tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1553 microversion: 2.91 time: 0.158792 Oct 28 13:10:22.027707 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1036/2023] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:21 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:22.031682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dcc1f17f-480d-4082-b81f-57e2814532e8 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '.version_select at 0x7f27bd916ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:22.035210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcc1f17f-480d-4082-b81f-57e2814532e8 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:22.035706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcc1f17f-480d-4082-b81f-57e2814532e8 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:22.036153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcc1f17f-480d-4082-b81f-57e2814532e8 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:22.046468 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dcc1f17f-480d-4082-b81f-57e2814532e8 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.018259 Oct 28 13:10:22.057039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1037/2024] 10.222.0.25 () {60 vars in 1184 bytes} [Fri Oct 28 13:10:22 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:22.063508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:22.064154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:22.074938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:22.075492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:22.075942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:22.076718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:22.077184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:22.077613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:22.231842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:22.240700 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-386017c7-7fc0-446f-a1a4-4a1965242a27 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1363 microversion: 2.1 time: 0.191867 Oct 28 13:10:22.241408 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1038/2025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:22 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:22.246413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e816480-a061-43f7-b796-1a128ff1b2eb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd9c3ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:23.865515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:10:23.867175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:10:23.867626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:10:23.868035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:10:23.868444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:10:23.878862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:23.879643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:23.880262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:23.881681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:23.882378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:23.883009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:23.936345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Getting quotas for project 52536665a18b4117a13fdecef7e39748. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:23.948291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Getting quotas for user e82fcb731fff4e84b6259a686b170d72 and project 52536665a18b4117a13fdecef7e39748. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:23.967987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:10:23.970519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:10:24.210878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9ef87ddb-035b-4e28-8251-efcebb1aa085 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.437964 Oct 28 13:10:24.212115 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 988/2026] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:10:24.243733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:24.247514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:24.265780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:24.269030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:24.270020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:24.271016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:24.272997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:24.273643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:24.443354 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e816480-a061-43f7-b796-1a128ff1b2eb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 204 len: 0 microversion: 2.1 time: 2.200445 Oct 28 13:10:24.447324 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1039/2027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:22 2022] DELETE /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 0 bytes in 2202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:10:24.471179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:24.471754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:24.509698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:24.509698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:24.509698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:24.509698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:24.509698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:24.509698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:24.786202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:24.803720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:24.806938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:24.810328 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d510323-b12a-4ae1-b589-4e446f1b2ebf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1282 microversion: 2.54 time: 0.592643 Oct 28 13:10:24.812516 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 989/2028] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:24 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1282 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:24.824781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2061f793-88df-41d6-a968-0512c964de8e req-59e3b0ad-f5cf-4cb7-af5b-98cec67d8897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cafde05-1d32-4513-afdf-c07cb41999cb", "name": "network-vif-plugged", "status": "completed", "tag": "20295591-dab2-49ae-aa38-d95add1f7a58"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:24.844534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2061f793-88df-41d6-a968-0512c964de8e req-59e3b0ad-f5cf-4cb7-af5b-98cec67d8897 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:24.845403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2061f793-88df-41d6-a968-0512c964de8e req-59e3b0ad-f5cf-4cb7-af5b-98cec67d8897 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:24.847498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2061f793-88df-41d6-a968-0512c964de8e req-59e3b0ad-f5cf-4cb7-af5b-98cec67d8897 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:24.871864 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2061f793-88df-41d6-a968-0512c964de8e req-59e3b0ad-f5cf-4cb7-af5b-98cec67d8897 service nova] Creating event network-vif-plugged:20295591-dab2-49ae-aa38-d95add1f7a58 for instance 2cafde05-1d32-4513-afdf-c07cb41999cb on n-h1-862876-2 Oct 28 13:10:24.893222 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2061f793-88df-41d6-a968-0512c964de8e req-59e3b0ad-f5cf-4cb7-af5b-98cec67d8897 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077193 Oct 28 13:10:24.900102 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 990/2029] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:24.906804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:24.907779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:24.922260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:24.922828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:24.923278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:24.928037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:24.928037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:24.928037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:25.140723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:25.156780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:25.158638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:25.171280 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-595744f3-4ee4-48e3-abcb-ad98264d3237 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1535 microversion: 2.91 time: 0.268676 Oct 28 13:10:25.174788 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 991/2030] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:24 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:25.200718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:25.201336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:25.244038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:25.244964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:25.246537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:25.247343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:25.249456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:25.249906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:25.421484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:25.436746 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ed83e318-2050-4571-b469-bfeecd648e22 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1549 microversion: 2.1 time: 0.255813 Oct 28 13:10:25.438009 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 992/2031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:25 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1549 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:25.444509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17d8f350-1242-401d-86a4-3d0404289a88 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:25.445671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17d8f350-1242-401d-86a4-3d0404289a88 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:25.514051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-17d8f350-1242-401d-86a4-3d0404289a88 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:25.524591 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17d8f350-1242-401d-86a4-3d0404289a88 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1218 microversion: 2.1 time: 0.085112 Oct 28 13:10:25.526123 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 993/2032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:25 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:25.543466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:25.544960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:25.580748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:25.583101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:25.584341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:25.585715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:25.587549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:25.589594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:25.627189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:10:25.841068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] Lazy-loading 'services' on Instance uuid e8bc2afd-f819-4e20-b648-10b391be298b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:10:25.862177 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c5df5f7-87d1-4fe2-9fba-98a56c5eaa78 tempest-LiveAutoBlockMigrationV225Test-978720851 tempest-LiveAutoBlockMigrationV225Test-978720851-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1970 microversion: 2.25 time: 1.406496 Oct 28 13:10:25.863407 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1040/2033] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:24 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1970 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:25.874847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:25.876359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:25.884855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:25.894508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:25.894508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:25.896731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:25.910908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:25.910908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.095466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-214919c7-aaea-40f5-97ac-cfe998ca0349 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 204 len: 0 microversion: 2.1 time: 0.567667 Oct 28 13:10:26.107850 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 994/2034] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:10:25 2022] DELETE /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:10:26.107850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c43dc25a-d1e1-4cd1-a88d-ee23e221b242 req-e2da1a3c-68c8-4d9d-af7a-22d37fa98c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2", "tag": "e54c77d7-35b1-4e6d-beeb-225da8df30ba"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:26.133825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c43dc25a-d1e1-4cd1-a88d-ee23e221b242 req-e2da1a3c-68c8-4d9d-af7a-22d37fa98c3b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.134409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c43dc25a-d1e1-4cd1-a88d-ee23e221b242 req-e2da1a3c-68c8-4d9d-af7a-22d37fa98c3b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.134775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c43dc25a-d1e1-4cd1-a88d-ee23e221b242 req-e2da1a3c-68c8-4d9d-af7a-22d37fa98c3b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.161361 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c43dc25a-d1e1-4cd1-a88d-ee23e221b242 req-e2da1a3c-68c8-4d9d-af7a-22d37fa98c3b service nova] Creating event network-changed:e54c77d7-35b1-4e6d-beeb-225da8df30ba for instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 on n-h2-862876-2 Oct 28 13:10:26.170003 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c43dc25a-d1e1-4cd1-a88d-ee23e221b242 req-e2da1a3c-68c8-4d9d-af7a-22d37fa98c3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067913 Oct 28 13:10:26.172668 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 995/2035] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:26.178591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:26.179301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:26.185677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.186178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.186618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.187493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.187954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.188383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.292985 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8142dd31-7579-4db3-9f1c-e85badd495f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118923 Oct 28 13:10:26.294142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:26.295166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 996/2036] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:10:26 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:26.308526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-75d9c4d4-a44e-4bcc-8d65-677507899811 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1590 microversion: 2.1 time: 0.438429 Oct 28 13:10:26.308679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:26.308790 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1041/2037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:25 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1590 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:26.309323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:26.318943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:26.319809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:26.331570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.332526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.332967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.333896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.334392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.334859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.336326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.337264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.338846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.340414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.342941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.343688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.415072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:10:26.515068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:26.557756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:26.559602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:26.564776 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75ce845f-8e47-4461-8979-a2a35ac90fe5 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1338 microversion: 2.54 time: 0.264914 Oct 28 13:10:26.566847 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 997/2038] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:26 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1338 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:26.574165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:26.574863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:26.586065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.587001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.593338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.593338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.593338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.593338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.731223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:26.744637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:26.750632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:26.763754 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd5f3803-11d5-4738-bbf2-0507dec19c90 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1535 microversion: 2.91 time: 0.195777 Oct 28 13:10:26.766386 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 998/2039] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:26 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1535 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:26.778909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-231533595", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "09db6954-888a-48c6-adf5-d40098ae89d9"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:26.862027 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d91100f-6f44-40aa-a922-368ff5cd2d95 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 204 len: 0 microversion: 2.25 time: 0.546280 Oct 28 13:10:26.864474 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1042/2040] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:10:26 2022] DELETE /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:10:26.871716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:26.874224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:26.890156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.901906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] validate_networks() for [('09db6954-888a-48c6-adf5-d40098ae89d9', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:10:26.904568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.905070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:26.905828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:26.911828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:26.914341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.030502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:27.040930 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d86a238-0557-488c-9769-e1213f40f21b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1214 microversion: 2.1 time: 0.174160 Oct 28 13:10:27.054782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1043/2041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:26 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:27.054782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:27.054782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:27.060272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.060272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.060272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.060272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.060272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.060272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.333434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:27.343401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:27.345377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:27.346801 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9a0f3fc-28d3-4f59-a846-248446af3e7d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1483 microversion: 2.25 time: 0.301795 Oct 28 13:10:27.348141 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1044/2042] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:27 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1483 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:27.354618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-efeeac71-9507-4c96-b5af-26ed190f49a4 req-29f043c4-af8b-4d65-bc09-0ed62cdbc81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151c2d94-029f-4353-8f82-06ac9f8d4fa4", "name": "network-vif-unplugged", "status": "completed", "tag": "80c77538-cbcb-4c3c-9134-29ff9f7e31b3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:27.368114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efeeac71-9507-4c96-b5af-26ed190f49a4 req-29f043c4-af8b-4d65-bc09-0ed62cdbc81a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.373611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efeeac71-9507-4c96-b5af-26ed190f49a4 req-29f043c4-af8b-4d65-bc09-0ed62cdbc81a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.373611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efeeac71-9507-4c96-b5af-26ed190f49a4 req-29f043c4-af8b-4d65-bc09-0ed62cdbc81a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.392556 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-efeeac71-9507-4c96-b5af-26ed190f49a4 req-29f043c4-af8b-4d65-bc09-0ed62cdbc81a service nova] Creating event network-vif-unplugged:80c77538-cbcb-4c3c-9134-29ff9f7e31b3 for instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 on n-h1-862876-2 Oct 28 13:10:27.416455 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-efeeac71-9507-4c96-b5af-26ed190f49a4 req-29f043c4-af8b-4d65-bc09-0ed62cdbc81a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066588 Oct 28 13:10:27.417332 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1045/2043] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:27.595788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:27.597226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:27.619893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.619893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.619893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.623155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.624088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.624840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.825895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-92300f09-2eff-4bac-ab9b-70ee954d80b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1338 microversion: 2.54 time: 0.253751 Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1046/2044] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:27 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1338 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.861864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.901827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:10:27.903004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:10:27.903734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:10:27.905301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:10:27.906159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:10:27.918115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.919356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.920171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.921180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:27.921891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:27.922609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:27.947456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:27.956375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for user a43aa3346a70490d9c5e489c8e39d91d and project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:27.972747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:10:27.976528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:10:28.072096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.084206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.086359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.103459 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea0c3119-1cb5-4496-b8a8-f2bae05100a2 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1535 microversion: 2.91 time: 0.258380 Oct 28 13:10:28.125028 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1047/2045] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:27 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1535 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:28.130210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:28.131211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:28.137907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:28.138395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:28.139119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:28.140922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:28.143329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:28.143329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:28.179592 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bf0aaa91-8615-420b-9f04-c125c3c272c4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409066 Oct 28 13:10:28.197842 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 999/2046] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:10:28.210182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ebb6ff28-98d8-4f1e-8499-328d07b59841 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:28.214924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ebb6ff28-98d8-4f1e-8499-328d07b59841 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:28.503985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ebb6ff28-98d8-4f1e-8499-328d07b59841 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.513465 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ebb6ff28-98d8-4f1e-8499-328d07b59841 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1207 microversion: 2.1 time: 0.308082 Oct 28 13:10:28.514053 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1000/2047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:28 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1207 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:28.528308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:28.528308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:28.534811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:28.535603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:28.536294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:28.537328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:28.538431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:28.539109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:28.732379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.742901 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff495dd9-3df4-4541-a9d2-7a8339aed63f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1270 microversion: 2.1 time: 0.616515 Oct 28 13:10:28.743830 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1048/2048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:28 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1270 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:28.901930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:28.901930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:28.909023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:28.909741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:28.911048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:28.912033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:28.912663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:28.913244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:28.922954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.937497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.946552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:28.948442 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c47fc2ed-bf50-4c8d-8cce-fe538698c148 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1483 microversion: 2.25 time: 0.432654 Oct 28 13:10:28.949361 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1001/2049] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:28 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1483 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:28.972789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-063d22d6-50e8-414f-b2f1-93d7af1e59c8 req-5f87bb0a-3f68-4d90-a17e-6034274a3904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:28.983008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-063d22d6-50e8-414f-b2f1-93d7af1e59c8 req-5f87bb0a-3f68-4d90-a17e-6034274a3904 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:28.983848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-063d22d6-50e8-414f-b2f1-93d7af1e59c8 req-5f87bb0a-3f68-4d90-a17e-6034274a3904 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:28.984528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-063d22d6-50e8-414f-b2f1-93d7af1e59c8 req-5f87bb0a-3f68-4d90-a17e-6034274a3904 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:28.998674 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-063d22d6-50e8-414f-b2f1-93d7af1e59c8 req-5f87bb0a-3f68-4d90-a17e-6034274a3904 service nova] Creating event network-changed:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:10:29.005214 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-063d22d6-50e8-414f-b2f1-93d7af1e59c8 req-5f87bb0a-3f68-4d90-a17e-6034274a3904 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040229 Oct 28 13:10:29.006919 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1002/2050] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:29.072070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:29.088243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:29.093584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:29.106441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5223895-affb-4fba-b17e-fb694ab03d20 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1336 microversion: 2.54 time: 0.211658 Oct 28 13:10:29.127910 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1049/2051] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:28 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1336 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:29.134157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:29.135545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:29.143365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.144817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.145588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.146492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.147194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.147819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.173275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:29.358092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:29.369983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:29.378673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:29.394142 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f33781e-572b-4ffd-9a7d-159105577603 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1538 microversion: 2.91 time: 0.264438 Oct 28 13:10:29.395380 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1003/2052] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:29 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1538 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:29.429136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:29.432233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:29.441507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.446521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.446521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.446521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.446521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.446521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.538008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:29.539068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:29.553472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.555640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.557714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.562901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.563897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.565892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.749933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:29.758862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-485ed9a6-9c06-40d1-ab4e-c1e28d860dfa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1211 microversion: 2.1 time: 0.224893 Oct 28 13:10:29.786922 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1004/2053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:29 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1211 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:29.792152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:29.793060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:29.808054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.808968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.809645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.810577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:29.811258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:29.811913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:29.913394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862876-2". {{(pid=127793) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 13:10:29.951555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:30.076437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.093067 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f032dc56-26d9-462c-8f29-898687ea0ade tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1288 microversion: 2.1 time: 0.296160 Oct 28 13:10:30.099191 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1005/2054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:29 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1288 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:30.106251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:30.107286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:30.115216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.116134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.116930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.117966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.118956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.119763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.259209 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa4f3760-823a-40e0-96c1-9a5e306313ac tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action" status: 202 len: 0 microversion: 2.91 time: 0.837045 Oct 28 13:10:30.260439 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1050/2055] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:10:29 2022] POST /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86/action => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:10:30.266269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:30.268353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:30.274914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.276118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.276786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.278378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.279187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.279957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.413709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.422951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.424796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.425968 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10e420d0-0e63-4f8d-a91d-2d48da306d88 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1336 microversion: 2.54 time: 0.164373 Oct 28 13:10:30.431944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.432883 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1051/2056] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:30 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1336 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:30.452545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.453390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.455454 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf00e9e2-08e8-4736-b968-acec534b6499 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1483 microversion: 2.25 time: 0.354364 Oct 28 13:10:30.455593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:30.456210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:30.460083 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1006/2057] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:30 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1483 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:30.463566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.464249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.464864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.465740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.466566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.467190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.619490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.631196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.633248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:30.639742 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1b848a4-e361-4f74-9fa9-a11494de3063 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1486 microversion: 2.91 time: 0.191674 Oct 28 13:10:30.668261 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1052/2058] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:30 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:30.792511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:30.793243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:30.805992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.806508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.809124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.811540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.813109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.818118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.864015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-77207649-2ea6-42e8-8f56-fb61887f612b req-b1d85b59-232a-4210-b28f-650dd13504dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b896e9-2972-4486-903e-01ca7c62aa34", "tag": "9c6ddce2-47c8-43a9-8ef1-2270420ae4ad"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:30.892128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-77207649-2ea6-42e8-8f56-fb61887f612b req-b1d85b59-232a-4210-b28f-650dd13504dc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:30.906152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-77207649-2ea6-42e8-8f56-fb61887f612b req-b1d85b59-232a-4210-b28f-650dd13504dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:30.906724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-77207649-2ea6-42e8-8f56-fb61887f612b req-b1d85b59-232a-4210-b28f-650dd13504dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:30.949597 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-77207649-2ea6-42e8-8f56-fb61887f612b req-b1d85b59-232a-4210-b28f-650dd13504dc service nova] Creating event network-changed:9c6ddce2-47c8-43a9-8ef1-2270420ae4ad for instance b0b896e9-2972-4486-903e-01ca7c62aa34 on n-h2-862876-2 Oct 28 13:10:30.960670 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-77207649-2ea6-42e8-8f56-fb61887f612b req-b1d85b59-232a-4210-b28f-650dd13504dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105808 Oct 28 13:10:30.965850 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1053/2059] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:10:31.115801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:31.117133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:31.133049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.133802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.134537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.136062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.136701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.137335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.169268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.179674 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f691036f-a9e2-46dd-97fb-c897ddb86f1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1203 microversion: 2.1 time: 0.393807 Oct 28 13:10:31.180271 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1007/2060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:30 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1203 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:31.215807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-75a3faab-43b8-42f3-a23c-99bd8c1c16df req-3d8a6645-6f6d-4668-992d-3c0c27be1a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151c2d94-029f-4353-8f82-06ac9f8d4fa4", "name": "network-vif-deleted", "tag": "80c77538-cbcb-4c3c-9134-29ff9f7e31b3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:31.239153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:31.251626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-75a3faab-43b8-42f3-a23c-99bd8c1c16df req-3d8a6645-6f6d-4668-992d-3c0c27be1a2d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.251626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-75a3faab-43b8-42f3-a23c-99bd8c1c16df req-3d8a6645-6f6d-4668-992d-3c0c27be1a2d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.251626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-75a3faab-43b8-42f3-a23c-99bd8c1c16df req-3d8a6645-6f6d-4668-992d-3c0c27be1a2d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.287050 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-75a3faab-43b8-42f3-a23c-99bd8c1c16df req-3d8a6645-6f6d-4668-992d-3c0c27be1a2d service nova] Creating event network-vif-deleted:80c77538-cbcb-4c3c-9134-29ff9f7e31b3 for instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 on n-h1-862876-2 Oct 28 13:10:31.301053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-75a3faab-43b8-42f3-a23c-99bd8c1c16df req-3d8a6645-6f6d-4668-992d-3c0c27be1a2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119550 Oct 28 13:10:31.302719 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1008/2061] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:31.403575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.405992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:31.415126 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8fd979a6-df8b-4eeb-80b4-7157f796780d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1276 microversion: 2.1 time: 0.308519 Oct 28 13:10:31.415715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1054/2062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:31 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:31.462179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:31.464975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:31.481565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.487396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.487928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.488753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.489173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.489612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.490863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:31.491483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:31.503682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:31.505326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.509616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.510545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.515950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.520805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.520805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.640296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.666637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.668159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.669359 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5cc77a1-40f3-4001-aa36-e1ad1a6f297a tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1357 microversion: 2.54 time: 0.211591 Oct 28 13:10:31.675731 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1009/2063] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:31 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:31.680958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:31.681574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:31.687530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.688239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.688884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.689821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.690455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.691189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.700726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.709635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.711023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.712179 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-222da80e-8d59-408d-ae4c-29c61862fae8 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1266 microversion: 2.25 time: 0.227264 Oct 28 13:10:31.712933 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1055/2064] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:31 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:31.726513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ac0369a-e534-4ac0-a778-483dc3d04312 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Action: 'create', calling method: .version_select at 0x7f27bd8d0ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1917505097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHL7dCGbVv/zBm1hvmBphJHzYncrfLgXdAz8uRjW291GpiJe2CmByMzIx8Zu+o0WmC2zho8rpfLAekwX8Q8hNmsFpnta7B5XWoRW0dRSWMVLOGEUF/btUrrOIKUp28Zzuw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:31.761427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1ac0369a-e534-4ac0-a778-483dc3d04312 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Getting quotas for project f30512b9387f4095a1c5e704965bba50. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:31.768629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1ac0369a-e534-4ac0-a778-483dc3d04312 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Getting quotas for user 35341e4340e445558f346f9487ee73b1 and project f30512b9387f4095a1c5e704965bba50. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:31.796987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.804668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:31.806011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.811993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:31.832475 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-859c5610-0598-4881-a075-4bc7837908a6 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1486 microversion: 2.91 time: 0.155314 Oct 28 13:10:31.833086 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1010/2065] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:31 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1486 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:31.936838 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ac0369a-e534-4ac0-a778-483dc3d04312 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.222633 Oct 28 13:10:31.938186 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1056/2066] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:10:31 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 224 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 13:10:31.953230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1917505097", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:31.959961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:31.981809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.984348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.988928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:31.990029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:31.990757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:31.991470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.164816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:10:32.165521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:10:32.166002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:10:32.167314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:10:32.167763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:10:32.207978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:32.208599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:32.217018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.217767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.218394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.223572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.224273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.224884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.349445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:32.379305 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63514686-8ab5-4896-b8db-8cc4371932a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1259 microversion: 2.1 time: 0.175681 Oct 28 13:10:32.385951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1057/2067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:32 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:32.443743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:32.444356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:32.457100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.457588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.458019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.458711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.463821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.469344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.745683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:32.755541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.756891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.757498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.758911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.760416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.761053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.801996 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d9b2e560-78e6-4dc4-b164-b9330508f08c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "POST /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411/action" status: 202 len: 1140 microversion: 2.54 time: 0.856150 Oct 28 13:10:32.815050 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1011/2068] 10.222.0.25 () {62 vars in 1320 bytes} [Fri Oct 28 13:10:31 2022] POST /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411/action => generated 1140 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 13:10:32.815050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:32.815050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:32.816939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.817886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.818508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.819449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.820080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.820679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.933969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:32.948112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:32.950901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:32.952085 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6eeb9c59-c5f4-4cd3-8f3b-cdee1f548432 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1266 microversion: 2.25 time: 0.147817 Oct 28 13:10:32.960649 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1012/2069] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:32 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:32.966612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:32.968681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:32.979335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.979923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.980424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:32.981254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:32.981797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:32.982242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:33.077397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.088929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.090483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.091759 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ba9b114-d95b-4924-9be4-52b14ff36c22 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.129591 Oct 28 13:10:33.092620 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1013/2070] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:32 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:33.110702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:33.112059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:33.120116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:33.120883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:33.121767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:33.123114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:33.123795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:33.124301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:33.248736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.260210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.262310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.270422 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-253cfc2a-a97b-4427-97da-095a76074e9a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.176291 Oct 28 13:10:33.271640 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1014/2071] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:33 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:33.280570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0329e890-cf3e-4115-a64f-d80579de7345 req-ed6aff78-8071-439a-87bf-b051d888feb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bc2afd-f819-4e20-b648-10b391be298b", "name": "network-vif-deleted", "tag": "480f1c45-173b-4c88-9850-e79388dc2e83"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:33.292449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0329e890-cf3e-4115-a64f-d80579de7345 req-ed6aff78-8071-439a-87bf-b051d888feb1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:33.292987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0329e890-cf3e-4115-a64f-d80579de7345 req-ed6aff78-8071-439a-87bf-b051d888feb1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:33.293427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0329e890-cf3e-4115-a64f-d80579de7345 req-ed6aff78-8071-439a-87bf-b051d888feb1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:33.311019 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0329e890-cf3e-4115-a64f-d80579de7345 req-ed6aff78-8071-439a-87bf-b051d888feb1 service nova] Creating event network-vif-deleted:480f1c45-173b-4c88-9850-e79388dc2e83 for instance e8bc2afd-f819-4e20-b648-10b391be298b on n-h1-862876-2 Oct 28 13:10:33.312127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.321777 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-679f34d8-017f-4c27-a85e-1c124b4c6ea2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.882364 Oct 28 13:10:33.322686 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1058/2072] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:32 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:33.326533 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0329e890-cf3e-4115-a64f-d80579de7345 req-ed6aff78-8071-439a-87bf-b051d888feb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053354 Oct 28 13:10:33.327842 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1015/2073] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:33.409901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:33.411574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:33.422656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:33.423177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:33.423634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:33.424354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:33.424804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:33.427394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:33.549510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:33.558393 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b26eaf39-f42c-4467-96f8-36d3e3d8d1fa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1265 microversion: 2.1 time: 0.153721 Oct 28 13:10:33.559495 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1059/2074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:33 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:33.982006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:33.983781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:33.993074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:33.993836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:33.995036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:33.996938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:33.997593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:33.998279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.370443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.372238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.372238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.372238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.372238 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5701a3a1-8e05-4355-9db5-dc0b4620a306 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1266 microversion: 2.25 time: 0.189549 Oct 28 13:10:34.372238 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1016/2075] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:33 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:34.373132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.373132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.373132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.373132 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4dd7fc0-c7d0-480c-bc70-6a69bd2120b2 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.153424 Oct 28 13:10:34.373132 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1060/2076] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:34 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.373861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.375296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:34.375296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:34.402383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.412187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.413634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:34.421008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.423098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.428658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.431528 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bfbd875b-01d2-4d4e-817c-586a46db752a tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.133513 Oct 28 13:10:34.432432 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1017/2077] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:34 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:34.432631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.433318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.436123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.583139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:34.584079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:34.598134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.607366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.611717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:34.613027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:34.617372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:34.618068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.224546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.246792 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ece8e8ba-d280-4275-a0c3-df4b69b238e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.905436 Oct 28 13:10:35.248048 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1061/2078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:34 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:35.268127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:35.268834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:35.287262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:35.290067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:35.292967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.294044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:35.295929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:35.296597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.549954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.566638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.568494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.573559 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9ca7417-c00c-49fa-b935-6a1c24b05a4f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1266 microversion: 2.25 time: 0.323113 Oct 28 13:10:35.574399 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1062/2079] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:35 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:35.588804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.603610 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8bfe9403-5c29-4a43-a739-34c474c5118d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 1.024582 Oct 28 13:10:35.607358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:35.612263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:35.626302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:35.628961 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1018/2080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:34 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:35.629667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:35.630377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.633693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:35.634403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:35.635041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c7107546-6dfc-4360-a27d-f23f71d17eb3 req-a981050b-0655-43b7-9f99-667d709e5349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7734075b-5bc5-43fb-b737-57e65a155610", "tag": "97183e28-9057-488a-94a3-3d41f272aedb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:35.639677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.659743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c7107546-6dfc-4360-a27d-f23f71d17eb3 req-a981050b-0655-43b7-9f99-667d709e5349 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:35.659743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c7107546-6dfc-4360-a27d-f23f71d17eb3 req-a981050b-0655-43b7-9f99-667d709e5349 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:35.660639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c7107546-6dfc-4360-a27d-f23f71d17eb3 req-a981050b-0655-43b7-9f99-667d709e5349 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.675263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:35.693252 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c7107546-6dfc-4360-a27d-f23f71d17eb3 req-a981050b-0655-43b7-9f99-667d709e5349 service nova] Creating event network-changed:97183e28-9057-488a-94a3-3d41f272aedb for instance 7734075b-5bc5-43fb-b737-57e65a155610 on n-h1-862876-2 Oct 28 13:10:35.704297 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c7107546-6dfc-4360-a27d-f23f71d17eb3 req-a981050b-0655-43b7-9f99-667d709e5349 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073489 Oct 28 13:10:35.706971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1019/2081] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:35.718786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:35.722706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:35.739786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:35.740300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:35.741008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.741748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:35.743861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:35.744323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:35.916139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.925972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.927902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:35.937429 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d7d1fa48-cde7-4dea-9e93-cfa6101221d4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.228545 Oct 28 13:10:35.939166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1020/2082] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:35 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:36.287778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:36.288347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:36.319548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:36.320056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:36.331256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:36.332027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:36.335199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:36.336571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:36.514140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:36.529317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:36.531170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:36.537943 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37af74d2-3cb3-406c-bfe5-00d879c6deb1 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.945284 Oct 28 13:10:36.557631 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1063/2083] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:35 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:36.604280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:36.605231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:36.632990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:36.633777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:36.634390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:36.635296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:36.635918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:36.636490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:36.876597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:36.893133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:36.897815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:36.902359 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28ea22d8-968f-4385-8062-0d3e3e41410f tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1266 microversion: 2.25 time: 0.299448 Oct 28 13:10:36.903355 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1064/2084] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:36 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:36.920373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:36.921224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:36.936277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:36.939553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:36.941117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:36.943423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:36.945575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:36.946265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:36.965664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:36.981125 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b2734a9-1437-4ac2-89ae-529b8269c6bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.704504 Oct 28 13:10:36.986814 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1021/2085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:36 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:37.001974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:37.009800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:37.017668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:37.020053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:37.020393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:37.023093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:37.023688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:37.024169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:37.104319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:37.117012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:37.122016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:37.131306 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e50c63d8-c45e-4e8c-9b1f-44dbce8d8c14 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.139450 Oct 28 13:10:37.132215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1022/2086] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:36 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:37.252291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:37.262611 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76d2848f-ec96-4624-af76-e6bc8825ba3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.354617 Oct 28 13:10:37.287701 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1065/2087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:36 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:37.563960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:37.565323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:37.572768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:37.573259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:37.573692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:37.574391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:37.575041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:37.575464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:37.605035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-459d9975-dc03-4331-8e09-fe3e72c76bde req-000f90e2-698f-4307-afc8-6b12b9b1b5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b896e9-2972-4486-903e-01ca7c62aa34", "name": "network-vif-plugged", "status": "completed", "tag": "9c6ddce2-47c8-43a9-8ef1-2270420ae4ad"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:37.622278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-459d9975-dc03-4331-8e09-fe3e72c76bde req-000f90e2-698f-4307-afc8-6b12b9b1b5b0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:37.627808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-459d9975-dc03-4331-8e09-fe3e72c76bde req-000f90e2-698f-4307-afc8-6b12b9b1b5b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:37.628414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-459d9975-dc03-4331-8e09-fe3e72c76bde req-000f90e2-698f-4307-afc8-6b12b9b1b5b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:37.653277 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-459d9975-dc03-4331-8e09-fe3e72c76bde req-000f90e2-698f-4307-afc8-6b12b9b1b5b0 service nova] Creating event network-vif-plugged:9c6ddce2-47c8-43a9-8ef1-2270420ae4ad for instance b0b896e9-2972-4486-903e-01ca7c62aa34 on n-h2-862876-2 Oct 28 13:10:37.659331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-459d9975-dc03-4331-8e09-fe3e72c76bde req-000f90e2-698f-4307-afc8-6b12b9b1b5b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058425 Oct 28 13:10:37.671558 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1066/2088] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:10:37.740717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:37.751719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:37.753699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:37.755364 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a527a0cf-0a87-444f-9d45-c65e3aa16a2f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.195279 Oct 28 13:10:37.757475 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1023/2089] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:37 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:37.933383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:37.934260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:37.940874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:37.941509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:37.944086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:37.944086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:37.944086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:37.944086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.021599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:38.022218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:38.024393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.047552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.048221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:38.050551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.050811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.053495 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1689de09-0b90-4e71-9940-08888040aca0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1266 microversion: 2.25 time: 0.124747 Oct 28 13:10:38.055316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.057849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.059031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.059649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.060793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.090048 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1067/2090] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:37 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:38.164456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:38.165256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:38.186114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.187466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.188149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.191050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.191761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.206003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.436836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.443594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:38.451865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.455577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.471295 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9c0cba8-cec4-4e51-807b-e3eb5a151b19 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.307498 Oct 28 13:10:38.474650 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1068/2091] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:38 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:38.481937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.483114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:38.484652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:38.492676 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ee1a9c5-8c4b-40f7-9652-534b8b5f460d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.474977 Oct 28 13:10:38.498240 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1024/2092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:38 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:38.498463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.510850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.510850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.511434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.512087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.512753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.621373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-92fcad50-b2bc-4418-aab0-2cac8570a6eb req-3dae71eb-e82f-434f-94ac-e1d1e8a346f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1d7297-bb28-443a-b7fe-c8c4d0c3e517", "tag": "35017ab1-39a8-4290-b61f-bed07e59cd63"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:38.633765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=16 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:38.639516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-92fcad50-b2bc-4418-aab0-2cac8570a6eb req-3dae71eb-e82f-434f-94ac-e1d1e8a346f1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.640007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-92fcad50-b2bc-4418-aab0-2cac8570a6eb req-3dae71eb-e82f-434f-94ac-e1d1e8a346f1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.640418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-92fcad50-b2bc-4418-aab0-2cac8570a6eb req-3dae71eb-e82f-434f-94ac-e1d1e8a346f1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.677747 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-92fcad50-b2bc-4418-aab0-2cac8570a6eb req-3dae71eb-e82f-434f-94ac-e1d1e8a346f1 service nova] Creating event network-changed:35017ab1-39a8-4290-b61f-bed07e59cd63 for instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 on n-h1-862876-2 Oct 28 13:10:38.685683 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-92fcad50-b2bc-4418-aab0-2cac8570a6eb req-3dae71eb-e82f-434f-94ac-e1d1e8a346f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067943 Oct 28 13:10:38.686580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1025/2093] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:38.790793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:38.791744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:38.806400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.817420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:38.823898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.824419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.825171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:38.825638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:38.826068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:38.827935 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4277636-2af4-491e-9932-61a2a00bf054 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.351962 Oct 28 13:10:38.828613 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1069/2094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:38 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:38.986439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.004345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.006176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.010972 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7b30cc2-962f-4628-9230-910f6a89753f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.229646 Oct 28 13:10:39.010972 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1026/2095] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:38 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:39.086834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:39.087545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:39.102334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.106254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.107392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.114975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.115608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.116260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.241548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.256551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.259224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.260983 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-16e6381f-73ba-4df2-a419-4f973f557d74 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1266 microversion: 2.25 time: 0.178316 Oct 28 13:10:39.261857 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1070/2096] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:39 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:39.513722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:39.514337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:39.525146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:39.525766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:39.537786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.538279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.543271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.543271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.543271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.543271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.551523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.552502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.553119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.553669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.555033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.555722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.820393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.834861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.836991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.852876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59f3442f-ff10-4d89-b36b-661f02774c2c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.347144 Oct 28 13:10:39.853983 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1027/2097] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:39 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:39.859068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:39.862687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:39.877447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.883004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.887780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.888738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:39.889866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:39.892959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:39.956858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:39.970056 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-720fef75-d583-479a-8ac1-52a9be37fe68 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.448972 Oct 28 13:10:39.977185 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1071/2098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:39 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:40.036776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:40.043143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:40.046553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:40.064874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:40.071138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:40.071138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:40.071138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:40.071138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:40.230233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:40.290658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:40.292643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:40.294160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b16fef8-1023-4a25-ba86-6f8ef67693cf tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.262294 Oct 28 13:10:40.308285 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1072/2099] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:40 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:40.322951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:40.323971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:40.332070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:40.332841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:40.333469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:40.334434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:40.335167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:40.335777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:40.377654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:40.378495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:40.379587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:40.380513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lazy-loading 'fault' on Instance uuid e8bc2afd-f819-4e20-b648-10b391be298b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:10:40.591706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:40.609933 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-33426fa1-213e-4155-ac40-99b984f7b618 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.752764 Oct 28 13:10:40.613721 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1028/2100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:39 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:40.770304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:40.783736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:40.785774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:40.787196 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20095045-d334-4561-99e8-3695aee3e190 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 200 len: 1271 microversion: 2.25 time: 0.477212 Oct 28 13:10:40.788509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1073/2101] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:40 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 1271 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:40.890248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:40.891398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:40.912981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:40.917828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:40.919786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:40.922846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:40.925380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:40.926321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.002459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:41.003233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:41.035265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.036065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.038445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.039777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.042266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.042909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.195560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.211280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.212943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.229863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3f149438-3591-4551-99c1-e8106e5bda97 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.346806 Oct 28 13:10:41.236652 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1029/2102] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:40 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:41.302387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.311193 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9798a56-b2a2-4e42-b86f-b5444eb4144a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.313402 Oct 28 13:10:41.311825 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1074/2103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:40 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:41.326636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:41.327345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:41.337414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.338544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.339386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.339903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.340494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.340925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.427264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.437264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.440759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.441156 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e30b97bc-b12e-4b1f-a3bb-0269534545cc tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.118277 Oct 28 13:10:41.452667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1030/2104] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:41 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:41.636312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:41.637132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:41.643730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.644302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.644810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.645568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.646097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.646612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.822030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:41.839111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:41.840556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: e8bc2afd-f819-4e20-b648-10b391be298b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:41.850619 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0293c4bb-4da0-4182-bde6-c1f993b5392a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.218159 Oct 28 13:10:41.866392 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1075/2105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:41 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:41.866576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.866576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.866576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.866576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:41.866576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:41.866576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:41.879133 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] HTTP exception thrown: Instance e8bc2afd-f819-4e20-b648-10b391be298b could not be found. Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Request method failure captured: Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b HTTP/1.1 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MHyNdJYM314gkQphCFN80CvpK1uViP5snzksm1KI8rXm2ulJR8-yMpXB546OVqV2Jan9C5ZQlCCiXHDqrCi3q-D4ieH1boFTbI4e9rmcKWIzdwKghNe4E31EfSfR_qMu8J0PguC-q1coLfFVoW2_b9pL1_zNMk_8U89pqQj2z6ldk Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c310f7fe3104b3b8649ba13bd9c51ec", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 17a50d2f7a154acbbf6bc218efb8b67d Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance e8bc2afd-f819-4e20-b648-10b391be298b could not be found. Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'e8bc2afd-f819-4e20-b648-10b391be298b'} Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8bc2afd-f819-4e20-b648-10b391be298b could not be found. Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8bc2afd-f819-4e20-b648-10b391be298b could not be found. Oct 28 13:10:41.881182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8bc2afd-f819-4e20-b648-10b391be298b could not be found. Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Returning 404 to user: Instance e8bc2afd-f819-4e20-b648-10b391be298b could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:41.884462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b20af1dd-c5f7-4faa-a1bd-00cf9367a8d0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b" status: 404 len: 111 microversion: 2.25 time: 0.050459 Oct 28 13:10:41.886580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1031/2106] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:41 2022] GET /compute/v2.1/servers/e8bc2afd-f819-4e20-b648-10b391be298b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:10:42.188389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:42.230800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:42.236182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Searching by: {'deleted': False, 'project_id': 'abdee9308d024b64ba68208c2af24f5c'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:42.249592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.251023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.252750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.254872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.255811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.261455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.269378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:42.270195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:42.297594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.298349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.305432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.309121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.310598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.311248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.322538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:42.404814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c32db65f-2d03-4023-86ae-984823a9dfbc tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.220482 Oct 28 13:10:42.412064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1076/2107] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:10:42 2022] GET /compute/v2.1/servers => generated 340 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:42.417137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:42.421701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:42.438547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.443125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.443748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.444654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.445281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.445854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.484172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:42.497682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:42.499584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:42.512429 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b79f9cdb-89c6-49df-bf90-345460cb7c50 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.247468 Oct 28 13:10:42.516241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1032/2108] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:42 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:42.523487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:42.539266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:42.540521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Searching by: {'deleted': False, 'project_id': 'abdee9308d024b64ba68208c2af24f5c'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:42.553268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.553983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.555045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.555930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.560417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.561032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:42.627996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:42.729624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:42.745918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:42.772297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:42.775393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:42.776311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:43.061091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.096205 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8aa607bb-441b-4053-a8c0-1a61b0aa0f37 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.674702 Oct 28 13:10:43.106847 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1077/2109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:42 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:43.111783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:43.113545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:43.128855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:43.133229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:43.133883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:43.134660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:43.141808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:43.145580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:43.299662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.309236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.316016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.320903 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d1f6e6f-aa39-4f83-be9c-05a07c299ec7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.218111 Oct 28 13:10:43.334005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1078/2110] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:43 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:43.349143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:43.352091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:43.360132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:43.360754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:43.361839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:43.362801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:43.363200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:43.363636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:43.432865 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8d42438-7b27-4a5d-9086-e83e27ef8803 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.913016 Oct 28 13:10:43.434649 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1033/2111] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:10:42 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:43.465901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bff971f8-ee4c-49d5-9429-96363f627a23 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:43.480998 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bff971f8-ee4c-49d5-9429-96363f627a23 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019927 Oct 28 13:10:43.483537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1034/2112] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:10:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:10:43.551316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:43.552120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:43.566250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:43.567351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:43.569492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:43.570379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:43.577564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:43.578197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:43.742413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.756512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.757978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.786278 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9d164f9a-0108-443e-bf8e-6746dd8439fa tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.240393 Oct 28 13:10:43.804788 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1035/2113] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:43 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:43.944661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:43.954853 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c80a4a5e-69a4-48be-bf5e-1346b44cdf6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.619505 Oct 28 13:10:43.966845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1079/2114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:43 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:44.119668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:44.120279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:44.130847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.131664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.132145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.147174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.148626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.152580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.350821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:44.352376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:44.367782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.368569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.369276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.370304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.372710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.384056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.523859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:44.538527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:44.550388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:44.551923 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85e2a5fc-50a7-4b27-b217-f8d2275428b6 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.205087 Oct 28 13:10:44.553054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1080/2115] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:44 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:44.577069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-24290e86-4de7-4428-a984-e95fdfd0636d req-46c9cf88-9b4e-4dfb-b51b-a411e1b4ffc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7734075b-5bc5-43fb-b737-57e65a155610", "name": "network-vif-plugged", "status": "completed", "tag": "97183e28-9057-488a-94a3-3d41f272aedb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:44.598463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-24290e86-4de7-4428-a984-e95fdfd0636d req-46c9cf88-9b4e-4dfb-b51b-a411e1b4ffc7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.599196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-24290e86-4de7-4428-a984-e95fdfd0636d req-46c9cf88-9b4e-4dfb-b51b-a411e1b4ffc7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.599933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-24290e86-4de7-4428-a984-e95fdfd0636d req-46c9cf88-9b4e-4dfb-b51b-a411e1b4ffc7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.634996 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-24290e86-4de7-4428-a984-e95fdfd0636d req-46c9cf88-9b4e-4dfb-b51b-a411e1b4ffc7 service nova] Creating event network-vif-plugged:97183e28-9057-488a-94a3-3d41f272aedb for instance 7734075b-5bc5-43fb-b737-57e65a155610 on n-h1-862876-2 Oct 28 13:10:44.645588 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-24290e86-4de7-4428-a984-e95fdfd0636d req-46c9cf88-9b4e-4dfb-b51b-a411e1b4ffc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090990 Oct 28 13:10:44.646973 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1081/2116] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:44.653413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:44.676692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:44.690942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.691833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.693001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.694637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.695376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.696925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.757588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:44.762435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:10:44.771282 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cefd39ba-1918-4f0c-9442-a380b557fcbc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.655517 Oct 28 13:10:44.780012 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1036/2117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:44 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:44.825969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:44.827061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:44.858220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.859070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.859788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:44.863857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:44.864619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:44.871932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.359302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.374905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.379753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.433151 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b118cb85-10bf-456c-b1b5-748259bea9b1 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.611316 Oct 28 13:10:45.433805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1037/2118] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:44 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:45.433805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:45.433805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:45.460149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.460149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.460149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.460149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.460149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.460149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.465462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:45.490538 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f0183c8-33d8-4719-a600-9f3fe67b6a36 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 204 len: 0 microversion: 2.1 time: 0.841523 Oct 28 13:10:45.492139 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1082/2119] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:10:44 2022] DELETE /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:10:45.502227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:45.503427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:45.520868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.522098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.522828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.523861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.524668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.525226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.717395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.718874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.722681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:45.731667 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b545c3a3-5053-4555-b00f-1e34da6a8ba3 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1715 microversion: 2.1 time: 0.232173 Oct 28 13:10:45.731889 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1083/2120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:45 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1715 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:45.733414 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-463bb29c-700b-41ae-b3d1-4285d56d546d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.296655 Oct 28 13:10:45.734735 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1038/2121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:45 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:45.739226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:45.740121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:45.747492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.748366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.752051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.753146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.753962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.754534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.805211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:45.812572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:45.835337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.842907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.847294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.848935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:45.853150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:45.853875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:45.958716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.969990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.977788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:45.979486 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b019b04a-c9e9-4cad-8024-c7ed0016f723 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.246171 Oct 28 13:10:45.991096 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1084/2122] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:45 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:46.161647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:46.171392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ddfdacaf-6e03-43f7-87cb-3f3079267751 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1318 microversion: 2.1 time: 0.371548 Oct 28 13:10:46.177267 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1039/2123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:45 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:46.468653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:46.469359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:46.488280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:46.488778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:46.503467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:46.505485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:46.506422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:46.515681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:46.656925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:46.674394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:46.690265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:46.724501 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ca0150f8-6544-4b99-a334-d9d40acdd1b3 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.260043 Oct 28 13:10:46.739461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1085/2124] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:46 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:46.769002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:46.769847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:46.780378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:46.785025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:46.800021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:46.800990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:46.803751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:46.805039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:46.805828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:46.806648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:46.807849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:46.808444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:46.812142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:46.815038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:46.817915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:46.818559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:47.194002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:47.211925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4be63940-2aa7-41a6-922a-7092f3e260fb tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1715 microversion: 2.1 time: 0.458035 Oct 28 13:10:47.244990 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1040/2125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:46 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1715 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:47.259625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:47.260269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:47.282982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:47.284014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:47.290089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:47.291405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:47.292371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:47.293163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:47.369572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:47.380371 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a356e7fc-bae1-41a3-8c1e-cd5e071f6651 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.626228 Oct 28 13:10:47.391571 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1086/2126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:46 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:47.395549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:47.396531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:47.410161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:47.410777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:47.416946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:47.427710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:47.428228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:47.428758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:47.487765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:47.503385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:47.503385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:47.511326 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37f2b114-e713-40e8-b682-cf6d9c77e8ad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.268121 Oct 28 13:10:47.515926 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1041/2127] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:47 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:47.897848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:47.914373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bbe606b7-5f6d-4f6a-ace2-89a73b66daf6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1509 microversion: 2.1 time: 0.523497 Oct 28 13:10:47.929614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0593cea-c77e-4fbb-8106-61b4268eb47c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: .version_select at 0x7f27bd8c49d0>, body: {"keypair": {"name": "tempest-keypair-1544071105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl1V3e2egUf6C4pYNMKmlXFdg4dr4SvdUtg4/IDPMXYO+WQBWy88Auhnct3BEqKlD/ITvM5lLE+IyqlIV0lcSm5eVUn+vzpurwA4YyjXXkVPAoy6NSiNu86/34Ywwav6g=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:47.931160 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1087/2128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:47 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:47.952410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e48ce8e7-bd4e-4e70-86dc-029f6ba1e572 req-d93a2441-7f7b-4cdc-b5da-5e5eaa315de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d7297-bb28-443a-b7fe-c8c4d0c3e517", "name": "network-vif-plugged", "status": "completed", "tag": "35017ab1-39a8-4290-b61f-bed07e59cd63"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:47.976097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e48ce8e7-bd4e-4e70-86dc-029f6ba1e572 req-d93a2441-7f7b-4cdc-b5da-5e5eaa315de8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:47.976587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e48ce8e7-bd4e-4e70-86dc-029f6ba1e572 req-d93a2441-7f7b-4cdc-b5da-5e5eaa315de8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:47.977014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e48ce8e7-bd4e-4e70-86dc-029f6ba1e572 req-d93a2441-7f7b-4cdc-b5da-5e5eaa315de8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:47.984263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d0593cea-c77e-4fbb-8106-61b4268eb47c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:47.997710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:48.003751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d0593cea-c77e-4fbb-8106-61b4268eb47c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:48.012724 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e48ce8e7-bd4e-4e70-86dc-029f6ba1e572 req-d93a2441-7f7b-4cdc-b5da-5e5eaa315de8 service nova] Creating event network-vif-plugged:35017ab1-39a8-4290-b61f-bed07e59cd63 for instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 on n-h1-862876-2 Oct 28 13:10:48.025390 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e48ce8e7-bd4e-4e70-86dc-029f6ba1e572 req-d93a2441-7f7b-4cdc-b5da-5e5eaa315de8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083011 Oct 28 13:10:48.027045 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1088/2129] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:48.041543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:48.042456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:48.059379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.059897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.060332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.061028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.061580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.067532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.132286 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0593cea-c77e-4fbb-8106-61b4268eb47c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.615057 Oct 28 13:10:48.133153 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1042/2130] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:10:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:48.138635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:48.141063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:48.165105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.168067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.168639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.173442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.175218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.176361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.331511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:48.352745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:48.357540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:48.377246 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-952ab86f-5524-4f37-8939-81553186669b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.348366 Oct 28 13:10:48.384031 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1089/2131] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:48 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:48.402802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:48.403430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:48.417258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.417753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.418403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.448260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.448763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.449584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.643900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:48.659441 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6fe32556-37d4-4c75-87f8-12825d26045d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1512 microversion: 2.1 time: 0.524916 Oct 28 13:10:48.660291 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1043/2132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:48 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:48.674497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:48.675717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:48.684913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.685460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.686050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.687077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.687681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.688618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.896872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:48.918002 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ab7dc15-2f73-4353-8e92-f5fd3a9e551e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1715 microversion: 2.1 time: 0.534671 Oct 28 13:10:48.920951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1090/2133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:48 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1715 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:48.926305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:48.927203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:48.933922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.934864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.935553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:48.936482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:48.937380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:48.938003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.084311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.093156 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ae145875-0c66-4c6b-9501-3004d46fcd44 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.431678 Oct 28 13:10:49.094009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.107495 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1044/2134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:48 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:49.111474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.114473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.115096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:49.115738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:49.118384 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb9adf09-00ad-4426-b47c-bbec5545c19b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.196018 Oct 28 13:10:49.124462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.127978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.128610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.129502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.132084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.132711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.134674 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1091/2135] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:48 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:49.302472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.315410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62bf01bb-e13c-43b9-87a8-6583c4c0103e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 200 len: 1511 microversion: 2.1 time: 0.203847 Oct 28 13:10:49.316302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1045/2136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:49 2022] GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:49.342346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:49.357182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.357961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:49.372586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.373070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.373500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.374225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.374677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.375275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.408330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:49.409230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:49.422570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.423169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.427309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.428062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.431376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.431376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.492833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:49.580926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.591149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.592616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.648866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:49.652369 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49f90c14-bfb1-45f2-96b4-281ef7a2a3f4 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.248258 Oct 28 13:10:49.655998 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1046/2137] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:49 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:49.703877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.704385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.710135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.947602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:49.948552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:49.967629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.971448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.971448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:49.971448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:49.971448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:49.971448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.167066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:50.213605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff296304-4562-4caf-947e-717a6a318068 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1647 microversion: 2.1 time: 0.268605 Oct 28 13:10:50.215139 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1047/2138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:49 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1647 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:50.229829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:50.237719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:50.261855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.263216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.278826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.280211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.285006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.285729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.636526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4ccfc0ca-c681-4a49-8a52-c60fc9ad2783 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1512 microversion: 2.1 time: 1.299637 Oct 28 13:10:50.637363 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1092/2139] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Oct 28 13:10:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1512 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:50.643020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:50.643830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:50.650402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.651759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.653262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.654201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.655138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.662031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:50.672066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.684703 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f224744-004f-4841-b3fd-1a7aa0b881af tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1307 microversion: 2.1 time: 0.468147 Oct 28 13:10:50.692932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1048/2140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:50 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1307 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:50.714682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:50.715357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:50.723475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.724031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.724585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.725316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.725777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.726214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.777621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:10:50.835800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:50.847635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:50.849120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:50.855322 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3cd96061-18ca-42b4-b4e9-419b5539ca8e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.156629 Oct 28 13:10:50.855975 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1049/2141] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:50 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:50.870699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f24bdea9-f777-4ff3-b3ad-f1b46ea7dd41 req-1425a530-cb82-4732-ba17-dded0f313470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2", "name": "network-vif-deleted", "tag": "e54c77d7-35b1-4e6d-beeb-225da8df30ba"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:50.882688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f24bdea9-f777-4ff3-b3ad-f1b46ea7dd41 req-1425a530-cb82-4732-ba17-dded0f313470 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.883419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f24bdea9-f777-4ff3-b3ad-f1b46ea7dd41 req-1425a530-cb82-4732-ba17-dded0f313470 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.883999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f24bdea9-f777-4ff3-b3ad-f1b46ea7dd41 req-1425a530-cb82-4732-ba17-dded0f313470 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.915252 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f24bdea9-f777-4ff3-b3ad-f1b46ea7dd41 req-1425a530-cb82-4732-ba17-dded0f313470 service nova] Creating event network-vif-deleted:e54c77d7-35b1-4e6d-beeb-225da8df30ba for instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 on n-h2-862876-2 Oct 28 13:10:50.921878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f24bdea9-f777-4ff3-b3ad-f1b46ea7dd41 req-1425a530-cb82-4732-ba17-dded0f313470 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060263 Oct 28 13:10:50.922482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1050/2142] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:50.927838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:50.933205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:50.934277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-965898666', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:50.941745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.943492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.944312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:50.945270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:50.945888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:50.946525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.078241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:51.161982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.171303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.171303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.171303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.335953 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08032e85-6b28-45a4-a451-3670eebdf554 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-965898666" status: 200 len: 1515 microversion: 2.1 time: 0.411939 Oct 28 13:10:51.354326 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1051/2143] 10.222.0.25 () {58 vars in 1261 bytes} [Fri Oct 28 13:10:50 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-965898666 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:51.354951 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f196e2cd-213e-4415-87f4-777ab35511d7 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "DELETE /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 204 len: 0 microversion: 2.25 time: 0.708663 Oct 28 13:10:51.354951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1093/2144] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:10:50 2022] DELETE /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 0 bytes in 710 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:10:51.367209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:51.368236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:51.370813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:51.371878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:51.374959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.375914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.377024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.378042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.378726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.379392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.395878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:51.397831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.398336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.398826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.404315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.404864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.408013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.468382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.478105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.479594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.486313 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32633ef0-482d-40bc-96af-3eb3619a86ec tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.147834 Oct 28 13:10:51.486855 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1052/2145] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:51 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:51.506893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.506893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.506893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.506893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lazy-loading 'fault' on Instance uuid 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:10:51.521757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:51.524730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:51.540716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.541468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.542054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.550572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.551108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.551542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.595692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965e776d25ba42b79b89996c2f396135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abdee9308d024b64ba68208c2af24f5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.607037 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78c3ada9-c2dc-43c5-a6c2-7c8290d4b457 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 200 len: 1368 microversion: 2.1 time: 0.257708 Oct 28 13:10:51.616722 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1094/2146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:51 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:51.622331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:51.630273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.631507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:51.636964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.638072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.638840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.639748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.640373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.640947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.775011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.788493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.790341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.791790 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca3fabbc-2bcf-4742-a623-223cdaa3c15b tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1732 microversion: 2.25 time: 0.281341 Oct 28 13:10:51.793037 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1053/2147] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:51 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1732 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:51.797807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:51.799013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:51.805427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.806061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.806645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.807514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.808115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.808682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:51.836611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:51.921665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:51.929820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:51.930515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:51.931150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.005168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.014105 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d615ad68-793e-43ec-a826-43b2d8214cef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1486 microversion: 2.1 time: 0.219736 Oct 28 13:10:52.014811 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1054/2148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:51 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1486 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:52.020383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.021091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:52.027226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.027809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.028321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.029094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.029631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.030286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.113675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.117760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:52.124239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.125966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.127419 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a38f39f5-934d-4634-bdc5-c3d42710d4d7 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.111441 Oct 28 13:10:52.132324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6402669-1afc-45e8-ae6d-8d1626b201cb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.514416 Oct 28 13:10:52.133005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1095/2149] 10.222.0.25 () {58 vars in 1173 bytes} [Fri Oct 28 13:10:51 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:52.137694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-03e03989-9637-4cc8-827e-e049591360e8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:52.138601 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1055/2150] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:52.144792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e03989-9637-4cc8-827e-e049591360e8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.145441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e03989-9637-4cc8-827e-e049591360e8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.145996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e03989-9637-4cc8-827e-e049591360e8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.162427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.167518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.167986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.servers [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Removing options 'limit' from query {{(pid=127794) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 13:10:52.168739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:52.174604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.175356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.175552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.176282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.176740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.177343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.209060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-03e03989-9637-4cc8-827e-e049591360e8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:10:52.213116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.219297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.219866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.220955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.356591 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4330deb4-590c-40cf-bba0-65947b19754f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1658 microversion: 2.1 time: 0.199360 Oct 28 13:10:52.360418 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1056/2151] 10.222.0.25 () {58 vars in 1161 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1658 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:52.369712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:52.383963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.390249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.391246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:52.397458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.397951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.398387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.399164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.399621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.400222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.430880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:52.446352 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-03e03989-9637-4cc8-827e-e049591360e8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517/action" status: 202 len: 0 microversion: 2.1 time: 0.311578 Oct 28 13:10:52.447206 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1096/2152] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:10:52 2022] POST /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:10:52.456764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.457471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:52.465734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.469655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.469655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.469655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.469655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.469655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.471950 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76a54532-7c53-4cea-b7d0-928faafa270b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1007 microversion: 2.1 time: 0.092304 Oct 28 13:10:52.472738 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1057/2153] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers?status=active => generated 1007 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:52.486475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.510595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.511230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.servers [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Removing options 'limit' from query {{(pid=127794) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 13:10:52.511996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:52.518007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.518615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.519223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.520026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.520567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.521066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.619198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:52.733674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.749620 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-650af226-5d12-4a60-a76c-8038092ae6e1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.297508 Oct 28 13:10:52.752605 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1097/2154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:52.758573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.759576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:52.767883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.768622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.769342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.770631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.771307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.771922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.853489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.863709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.865189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:52.871646 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c7dec04c-040c-4c52-a56c-98e0a676d20f tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.117785 Oct 28 13:10:52.872247 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1098/2155] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:52.878927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.879791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] [instance: 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:52.901439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.906466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.907180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.908531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.909174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.909715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.933269 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] HTTP exception thrown: Instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 could not be found. Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Request method failure captured: Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 HTTP/1.1 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SREBJo12BGbOTXLdAjPlKEr3_VXOaXKRiBn1Pywp4NXHgK3eWKDvhrc_aU5YWHsEYzFNIcaIcwlOIM3C8ArwkhlW6cM2GkFzTkR7AspQH95uKbr_1TEpAJ9bPBSwJdsy-grEAg3Tl1OR3kVVuMbg1Xc3-eaAEQGZ9IUa4QPZQE_QI Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: abdee9308d024b64ba68208c2af24f5c Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestManualDisk-1756554900 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abdee9308d024b64ba68208c2af24f5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/abdee9308d024b64ba68208c2af24f5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_abdee9308d024b64ba68208c2af24f5c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/abdee9308d024b64ba68208c2af24f5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestManualDisk-1756554900 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: abdee9308d024b64ba68208c2af24f5c Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestManualDisk-1756554900 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestManualDisk-1756554900-project Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 965e776d25ba42b79b89996c2f396135 Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestManualDisk-1756554900-project Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 could not be found. Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2'} Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 could not be found. Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 could not be found. Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:52.935297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:52.939593 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:52.939593 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:52.939593 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:52.939593 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:52.939593 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:52.939593 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 could not be found. Oct 28 13:10:52.939593 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:52.940793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Returning 404 to user: Instance 7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:52.941768 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aecf7274-0055-4a18-949f-56b545907a1e tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2" status: 404 len: 111 microversion: 2.1 time: 0.068410 Oct 28 13:10:52.946065 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1099/2156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers/7f438d57-e824-4ff8-bf5a-c0f5cc8d37f2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:10:52.948612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.948733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c431399a-b7c1-4713-a392-d0bdf687483b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1007 microversion: 2.1 time: 0.465959 Oct 28 13:10:52.949315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:52.949555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1058/2157] 10.222.0.25 () {58 vars in 1150 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers?limit=100000 => generated 1007 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:52.954164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb443485-02fc-44bf-a238-54c8e6e4c6e6 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] Calling method '.version_select at 0x7f27b95548b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:52.962461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.963088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.963522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:52.964276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:52.964727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:52.965350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.064626 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb443485-02fc-44bf-a238-54c8e6e4c6e6 tempest-ServersTestManualDisk-1756554900 tempest-ServersTestManualDisk-1756554900-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706072753" status: 202 len: 0 microversion: 2.1 time: 0.100959 Oct 28 13:10:53.064626 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1059/2158] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706072753 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:10:53.064626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:53.073410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.074315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:53.093560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.104792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.104792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.104792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.104792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.104792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.139303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:53.174032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.179381 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ff4d383-fe0b-456b-aa11-fbc278a0cfe9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1007 microversion: 2.1 time: 0.125408 Oct 28 13:10:53.180283 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1060/2159] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:10:53 2022] GET /compute/v2.1/servers => generated 1007 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:53.185292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:53.185483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.185918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:53.187314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.189001 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-061f4b84-2161-4fec-973a-588b5ffaca71 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1732 microversion: 2.25 time: 0.245205 Oct 28 13:10:53.190623 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1100/2160] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:52 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1732 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:53.192272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.192885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.195799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.195799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.195799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.195799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.197646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:53.206914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.206914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:53.218599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.218599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.218599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.219003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.219456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.219889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.279130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.288012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.289444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.290610 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-270c8263-a3c8-4305-9f20-91150b507f7c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.109260 Oct 28 13:10:53.291187 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1061/2161] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:53 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:53.296179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377759166", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53d6a3ea-bd12-4a26-b93d-1b74de68c817"}], "security_groups": [{"name": "tempest-securitygroup--1064661751"}], "key_name": "tempest-keypair-1544071105", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:53.311028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:53.383490 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48f412b5-d490-407c-a212-007ff3c4a1f5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 343 microversion: 2.1 time: 0.191438 Oct 28 13:10:53.384421 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1101/2162] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:10:53 2022] GET /compute/v2.1/servers?flavor=451 => generated 343 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:53.406436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:53.412836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.413415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.servers [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Removing options 'limit' from query {{(pid=127793) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 13:10:53.414430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:53.420350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.421072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.421745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.422997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.424183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.424594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.450879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] validate_networks() for [('53d6a3ea-bd12-4a26-b93d-1b74de68c817', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:10:53.466769 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2608f530-edd1-4579-9f3b-5b2103cb4a42 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 482 microversion: 2.1 time: 0.064682 Oct 28 13:10:53.472817 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1102/2163] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Oct 28 13:10:53 2022] GET /compute/v2.1/servers?limit=1 => generated 482 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:53.488709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:53.494178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:53.494881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-965898666', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:10:53.501641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.503023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.503473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.504402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.504863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.505283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.601954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:10:53.672450 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-313ec345-6cfe-4139-a505-d68f3861692b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-965898666" status: 200 len: 345 microversion: 2.1 time: 0.189443 Oct 28 13:10:53.673866 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1103/2164] 10.222.0.25 () {58 vars in 1240 bytes} [Fri Oct 28 13:10:53 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-965898666 => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:53.687625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9aba840-c17b-4fd1-abf1-53d8a1307848 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:53.694347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9aba840-c17b-4fd1-abf1-53d8a1307848 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.695068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9aba840-c17b-4fd1-abf1-53d8a1307848 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.695652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9aba840-c17b-4fd1-abf1-53d8a1307848 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.737284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9aba840-c17b-4fd1-abf1-53d8a1307848 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:10:53.977420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:10:53.978075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:10:53.978710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:10:53.979193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:10:53.984264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:10:53.989197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.989690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.990136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:53.991543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:53.992020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:53.992454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.011627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:10:54.014304 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9aba840-c17b-4fd1-abf1-53d8a1307848 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "POST /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb/action" status: 202 len: 0 microversion: 2.1 time: 0.330215 Oct 28 13:10:54.019353 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1104/2165] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:10:53 2022] POST /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:10:54.021629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:10:54.026583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:54.029608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:54.036309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:10:54.038980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:10:54.043733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.044432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.044875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.045874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.046399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.046860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.236728 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a14f7ddb-4644-4f41-aa66-b642e1a0bf3f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.944394 Oct 28 13:10:54.243867 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1062/2166] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:10:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:10:54.248901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.260049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:54.260662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:54.263661 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f08a32e1-3108-4c2d-87ec-c7a2e0c892ad tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.244026 Oct 28 13:10:54.276409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1105/2167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:54 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:54.285770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:54.287568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:54.296323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.297383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.297809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.299261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.299879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.300486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.305978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.306434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.306945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.307648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.308210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.308497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.404696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.412972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.414316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.419410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6ed5bb2-779d-4010-8aac-04ac4606f5a0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.174458 Oct 28 13:10:54.420120 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1063/2168] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:54 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:54.426079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:54.426896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:54.432935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.434607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.444458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.444458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.444458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.446839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.568817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.583674 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32797ba8-43b2-4dca-bc64-71e4601f62a2 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.306058 Oct 28 13:10:54.597119 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1106/2169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:54 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:54.597119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bb19394-ca57-4489-9e4f-dcf44501a421 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:54.597119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bb19394-ca57-4489-9e4f-dcf44501a421 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:54.627421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.636715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.638573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.639922 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-29213fe9-99fe-4ca1-85d0-bc10b8c7feaa tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1665 microversion: 2.25 time: 0.218457 Oct 28 13:10:54.640969 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1064/2170] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:54 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1665 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:54.645911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:54.646546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:54.652807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.653298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.653741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.654611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.655113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.655543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.664816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bb19394-ca57-4489-9e4f-dcf44501a421 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.673255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bb19394-ca57-4489-9e4f-dcf44501a421 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1241 microversion: 2.1 time: 0.087215 Oct 28 13:10:54.675443 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1107/2171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:54 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:54.744759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.753150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.754739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:54.756471 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e02bfbcf-d5f7-4128-b868-b4610c9bef62 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.114121 Oct 28 13:10:54.757113 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1065/2172] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:54 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:54.906599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d2e8a368-97be-48ba-976a-2790002a6609 req-3f0fefd1-f79f-4d99-bb3e-39a797c2c152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e873a2-b078-4190-9f83-0644b1075f4a", "name": "network-vif-deleted", "tag": "c40493ea-ef8b-4cf6-895b-5e07519f7ce3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:10:54.916801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d2e8a368-97be-48ba-976a-2790002a6609 req-3f0fefd1-f79f-4d99-bb3e-39a797c2c152 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:54.917214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d2e8a368-97be-48ba-976a-2790002a6609 req-3f0fefd1-f79f-4d99-bb3e-39a797c2c152 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:54.917641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d2e8a368-97be-48ba-976a-2790002a6609 req-3f0fefd1-f79f-4d99-bb3e-39a797c2c152 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:54.930342 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d2e8a368-97be-48ba-976a-2790002a6609 req-3f0fefd1-f79f-4d99-bb3e-39a797c2c152 service nova] Creating event network-vif-deleted:c40493ea-ef8b-4cf6-895b-5e07519f7ce3 for instance 33e873a2-b078-4190-9f83-0644b1075f4a on n-h1-862876-2 Oct 28 13:10:54.935434 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d2e8a368-97be-48ba-976a-2790002a6609 req-3f0fefd1-f79f-4d99-bb3e-39a797c2c152 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032379 Oct 28 13:10:54.936048 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1108/2173] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:10:55.290516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:55.291576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:55.298851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.299478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.300079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.301223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.301920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.302790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.453537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:55.454242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:55.465221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.467779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.468483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.469622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.470797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.471830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.548564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.564852 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f79f1fb0-5fdd-46d5-9279-bafb8efab61b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.277711 Oct 28 13:10:55.578771 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1066/2174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:55 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:55.579023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.581892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.583422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.589618 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f7048ae0-d114-4c08-8c2c-c2b815ecf4e0 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.140776 Oct 28 13:10:55.590645 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1109/2175] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:55 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:55.620266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:55.620971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:55.627815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.628311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.628752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.629465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.629931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.630357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.667313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:55.668077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:55.674120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.674685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.676268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.677191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.677898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.678498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.756981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.767375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.773281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.773281 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-95089724-4057-43a3-a1dc-ff7b8c82266e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1371 microversion: 2.25 time: 0.110765 Oct 28 13:10:55.773281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1110/2176] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:55 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:55.785878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d84997fc-0a5b-4445-bee1-979f7e3aadd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:55.786684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d84997fc-0a5b-4445-bee1-979f7e3aadd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:55.819567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.827713 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17f00e96-8440-42fa-84f8-3b5515f987f1 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.211434 Oct 28 13:10:55.844149 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1067/2177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:55 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:55.844149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:55.844149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:55.861561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.864180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.864180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.871821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:55.872326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:55.873393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:55.878110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d84997fc-0a5b-4445-bee1-979f7e3aadd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:55.887653 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d84997fc-0a5b-4445-bee1-979f7e3aadd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1241 microversion: 2.1 time: 0.106087 Oct 28 13:10:55.889761 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1111/2178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:55 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:56.082086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:56.097598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:56.102184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:56.106830 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0d83966a-ba83-499a-82e3-573a1cfa1d3f tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.276966 Oct 28 13:10:56.123555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1068/2179] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:55 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:56.590698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:56.592068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:56.611125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:56.611787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:56.612608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:56.613573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:56.617676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:56.618164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:56.618292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:56.618644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:56.628082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:56.630877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:56.633006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:56.633941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:56.636491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:56.637158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:56.819654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:56.830254 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-955e4a0b-3a7e-4b46-8333-ac0ddf5bb239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.243680 Oct 28 13:10:56.831249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1112/2180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:56 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:56.841836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:56.842461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:56.864939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:56.865677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:56.866293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:56.867210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:56.867815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:56.868648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:56.965669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:56.966163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:56.966602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:56.967303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lazy-loading 'fault' on Instance uuid 33e873a2-b078-4190-9f83-0644b1075f4a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:10:57.019805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.037983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.040308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.042239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.043681 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79d45826-0fb0-4002-926f-f24565727a75 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 200 len: 1376 microversion: 2.25 time: 0.211073 Oct 28 13:10:57.050533 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1113/2181] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:56 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 1376 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:57.053020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.054811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.073177 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ed37b3ec-21b3-455e-928b-723ce6d8695c tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1544 microversion: 2.91 time: 0.459358 Oct 28 13:10:57.077115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:57.080286 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1069/2182] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:56 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1544 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:57.080566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:57.097993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.098772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.099339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:57.100506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.104215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.104778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:57.106583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:57.107245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:57.122824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.123330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.123768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:57.124479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.124934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.125421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:57.361223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.370461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78edb1d3-4eb6-4105-932e-85c7213f1ac5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.318543 Oct 28 13:10:57.371170 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1114/2183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:57 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:57.390526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:57.392300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:57.405141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.405639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.408453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:57.409241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.409879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.424428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:57.458993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:57.542947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.563794 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6eb3c2e9-a904-4099-b159-07c3e5159f22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1245 microversion: 2.1 time: 0.484908 Oct 28 13:10:57.567256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1070/2184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:57 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1245 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:57.589311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.598863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.600297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:57.601465 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6afd0a36-18b9-4c55-befc-82a6b09c70ab tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.229318 Oct 28 13:10:57.603037 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1115/2185] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:57 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:57.853866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:57.858631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:57.869603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.870170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.870625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:57.871394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:57.871857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:57.872290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.078198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.079031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: 33e873a2-b078-4190-9f83-0644b1075f4a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:58.081109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.086031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.086527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.086992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.087691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.088167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.088716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.089962 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-843fae39-3146-44b3-9325-aa8f8b48a5ef tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.240153 Oct 28 13:10:58.090726 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1071/2186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:57 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:58.103639 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] HTTP exception thrown: Instance 33e873a2-b078-4190-9f83-0644b1075f4a could not be found. Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Request method failure captured: Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a HTTP/1.1 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MHyNdJYM314gkQphCFN80CvpK1uViP5snzksm1KI8rXm2ulJR8-yMpXB546OVqV2Jan9C5ZQlCCiXHDqrCi3q-D4ieH1boFTbI4e9rmcKWIzdwKghNe4E31EfSfR_qMu8J0PguC-q1coLfFVoW2_b9pL1_zNMk_8U89pqQj2z6ldk Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c310f7fe3104b3b8649ba13bd9c51ec", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 17a50d2f7a154acbbf6bc218efb8b67d Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 33e873a2-b078-4190-9f83-0644b1075f4a could not be found. Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '33e873a2-b078-4190-9f83-0644b1075f4a'} Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e873a2-b078-4190-9f83-0644b1075f4a could not be found. Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e873a2-b078-4190-9f83-0644b1075f4a could not be found. Oct 28 13:10:58.105703 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e873a2-b078-4190-9f83-0644b1075f4a could not be found. Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Returning 404 to user: Instance 33e873a2-b078-4190-9f83-0644b1075f4a could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0c76c60-f24b-4dd9-b773-562f6056f6ed tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a" status: 404 len: 111 microversion: 2.25 time: 0.033540 Oct 28 13:10:58.113195 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1116/2187] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:58 2022] GET /compute/v2.1/servers/33e873a2-b078-4190-9f83-0644b1075f4a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:10:58.114665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.115361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:58.115889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14a968fb-2d07-4980-a8f7-66826974eef2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '.version_select at 0x7f27bda2e670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.122264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.122771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.123212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.123909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.124390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.124821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.205474 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14a968fb-2d07-4980-a8f7-66826974eef2 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890038187" status: 204 len: 0 microversion: 2.25 time: 0.093188 Oct 28 13:10:58.206201 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1117/2188] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890038187 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:10:58.216019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.225648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.227507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.233244 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd6c6eba-aa47-4fea-9d5f-cea033ee13e8 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1531 microversion: 2.91 time: 0.127722 Oct 28 13:10:58.235561 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1072/2189] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:58 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1531 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:58.265508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.266261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:58.276326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.277060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.277801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.278878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.279542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.280235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.372464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] Lazy-loading 'services' on Instance uuid 604dad7e-a573-4bc6-b434-0ebe71a36c86 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:10:58.397629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2da90fd3-8eb1-4705-956e-67d2f541f43d tempest-UnshelveToHostMultiNodesTest-1357029300 tempest-UnshelveToHostMultiNodesTest-1357029300-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1936 microversion: 2.91 time: 0.136245 Oct 28 13:10:58.398920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1118/2190] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:58 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1936 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:58.399253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.400054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:58.405253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:58.407367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.408616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.409062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.409932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.410531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.410990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.428352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:10:58.463643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.464175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:58.489977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.490709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.491710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.492833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.494212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.495697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.563461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:10:58.647082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.656219 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d9a95582-2a66-4b7c-ac14-421501a87a38 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.262030 Oct 28 13:10:58.656796 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1073/2191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:58 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:58.663425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.666408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:58.675380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.676093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.676687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.677419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.677887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.678376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.765294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.776587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77314321-dd96-4a21-85e7-4161e93543c0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1301 microversion: 2.1 time: 0.118512 Oct 28 13:10:58.791899 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1074/2192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:58 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1301 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:58.799328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:58.800248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:58.807786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.812676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.812676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.812676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:58.812676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:58.812676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:58.925424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.933641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.935175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:58.936358 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5f7b383-cd97-44e8-a9a8-55cf1ff9bd2d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.143360 Oct 28 13:10:58.936922 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1075/2193] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:58 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:10:59.055303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-93905aa7-f1ce-4c81-a330-92f6057b4f0d tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "DELETE /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 204 len: 0 microversion: 2.91 time: 0.608532 Oct 28 13:10:59.061094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1119/2194] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:10:58 2022] DELETE /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:10:59.068095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:59.069003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:59.080689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.082139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.082866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.084548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.085246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.085913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.128003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:59.129387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:59.150075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.150984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.152125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.153101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.153882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.156059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.198228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:59.211824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:59.219865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:59.237883 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0065d4c7-3a27-481e-89b3-146227cf0465 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.175112 Oct 28 13:10:59.242816 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1076/2195] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:59 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:10:59.679399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:59.680064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:59.691141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.691639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.695131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.700914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.702160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.703486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.943204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:59.955811 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-544da9df-a7fc-4fd8-aeb9-8b7019facf0a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.842089 Oct 28 13:10:59.957248 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1120/2196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:59 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:10:59.961521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:10:59.970907 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12e7c456-50ef-4487-9ade-ca26af75a15f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.295305 Oct 28 13:10:59.972043 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1077/2197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:59 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:10:59.977192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:59.977340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:10:59.977994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:59.978482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:10:59.984789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.985211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.985727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.986004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.986573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.986985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.987506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.988002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:10:59.988125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.988636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:10:59.988883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:10:59.989449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.086582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.093689 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8248a5d9-6dbb-4775-ab80-1f7029f870a2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1299 microversion: 2.1 time: 0.135142 Oct 28 13:11:00.094360 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1121/2198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:10:59 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:00.099370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:00.100068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:00.115080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.115640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:00.124468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.124468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.124468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:00.124468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.132401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.142846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.145019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.146461 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0414c7cb-0a46-4661-81fb-d40f591d8831 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.173339 Oct 28 13:11:00.148778 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1078/2199] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:10:59 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:00.167559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:11:00.265508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:00.266126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:00.273197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.273689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:00.274133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.274858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.275350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:00.275766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.343692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.351964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.353528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.358440 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6af44ae7-f8ba-42a2-b149-84f84d3a7b03 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.096917 Oct 28 13:11:00.359052 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1079/2200] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:00 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:11:00.518792 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cfc0b3bf-7216-481e-9cab-38bd3f770ada tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 204 len: 0 microversion: 2.25 time: 0.422886 Oct 28 13:11:00.519705 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1122/2201] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:11:00 2022] DELETE /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:11:00.529488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:00.544945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:00.552566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.553132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:00.553672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.554520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.555058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:00.555543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.777904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.788908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.790538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:00.791751 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e81603c7-1a5f-427a-966a-84b673fd365d tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1549 microversion: 2.25 time: 0.267756 Oct 28 13:11:00.806407 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1080/2202] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:00 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1549 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:00.982160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:00.983212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:00.992294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.992294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:00.992294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:00.992650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:00.997778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:00.998397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:01.002360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.004955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.011285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.011285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.011285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.011522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.011985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.012439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.157401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.168860 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b2351b7-8e94-4504-9554-9f39fa8c81d5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.174771 Oct 28 13:11:01.169541 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1081/2203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:00 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:01.183184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:01.183184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:01.183184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.183562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.184589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.185486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.186123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.186725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.195709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.205029 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5045c8a1-3cbe-4ab7-a86c-2bfeb3cf0d21 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.226660 Oct 28 13:11:01.205659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1123/2204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:00 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:01.212188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:01.215974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:01.224862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.225699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.226180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.226915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.227373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.227801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.299336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.313108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.313108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.313108 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e5bbf03-0bd0-47ec-86c1-5ad3e0dfec4b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.105550 Oct 28 13:11:01.313108 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1124/2205] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:01 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:01.347333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.357222 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-919c7a11-0ce9-407f-ac5a-17df168c1bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1367 microversion: 2.1 time: 0.186634 Oct 28 13:11:01.370843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1082/2206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:01 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:01.387595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:01.388333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:01.396079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.396578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.397190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.398054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.398514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.398989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.494594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.503466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.505225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:01.510841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-65b3bd43-7bd9-4157-b4eb-ea9e2ff1837b tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1537 microversion: 2.91 time: 0.127101 Oct 28 13:11:01.511510 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1125/2207] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:01 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1537 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:01.779489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-53af6bd0-0d8a-4333-8aad-651a24e9b719 req-22ca4dc5-9646-42fb-8af0-6004e1290cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c24964-fb49-4247-a5fe-c8af53330f59", "tag": "ee85f85c-1f60-4689-b4ce-cb5af23703db"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:01.790254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-53af6bd0-0d8a-4333-8aad-651a24e9b719 req-22ca4dc5-9646-42fb-8af0-6004e1290cc6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.793763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-53af6bd0-0d8a-4333-8aad-651a24e9b719 req-22ca4dc5-9646-42fb-8af0-6004e1290cc6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.793763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-53af6bd0-0d8a-4333-8aad-651a24e9b719 req-22ca4dc5-9646-42fb-8af0-6004e1290cc6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.804598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-53af6bd0-0d8a-4333-8aad-651a24e9b719 req-22ca4dc5-9646-42fb-8af0-6004e1290cc6 service nova] Creating event network-changed:ee85f85c-1f60-4689-b4ce-cb5af23703db for instance 18c24964-fb49-4247-a5fe-c8af53330f59 on n-h2-862876-2 Oct 28 13:11:01.811759 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-53af6bd0-0d8a-4333-8aad-651a24e9b719 req-22ca4dc5-9646-42fb-8af0-6004e1290cc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035832 Oct 28 13:11:01.812362 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1083/2208] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:11:01.818863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:01.819689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:01.827072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.827717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.828288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:01.829486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:01.830106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:01.830852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.195886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:02.197936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:02.199671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.206951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.214155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.214155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.214155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.214155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.214155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.214522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.214522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.216013 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47346dc8-b802-4783-9a54-7d549844edf3 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1549 microversion: 2.25 time: 0.401747 Oct 28 13:11:02.237599 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1126/2209] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:01 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1549 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:11:02.241612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:02.242229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:02.248018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:02.249705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.250202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.250704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.251492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.252130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.253277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.404950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.414646 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-10f14b22-aa97-40e6-9c69-efa4047bd9e4 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.224494 Oct 28 13:11:02.415583 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1084/2210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:02 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:02.421604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:02.422895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:02.430334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.431043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.431708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.432550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.433014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.433490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.505039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.514179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.515665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.516853 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-888899f9-aa49-40e2-b508-78a238fe7b33 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.100128 Oct 28 13:11:02.517420 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1085/2211] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:02 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:02.522088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:02.522782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:02.528897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.529669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.536256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.537081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.537636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.538075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.614386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.625626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6049d331-0769-4eaf-8a7b-7d488aab62fe tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.387726 Oct 28 13:11:02.628387 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1127/2212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:02 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:02.633629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:02.634521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:02.641541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.642773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.643289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.644524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.645188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.646666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.688503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.690795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.690795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.691149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.691876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lazy-loading 'fault' on Instance uuid 604dad7e-a573-4bc6-b434-0ebe71a36c86 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:02.701348 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23a1ffb1-fdcb-447d-a01a-fc4cf68f418a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1367 microversion: 2.1 time: 0.182653 Oct 28 13:11:02.702819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1086/2213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:02 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:02.754603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.763634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.765122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c251a230ec584ef58e1bde3d67176080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cfb1afb585468e9a315fbe81e6e297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:02.770973 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4116c85a-d7e3-45a7-b95a-8186bb834209 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 200 len: 1542 microversion: 2.91 time: 0.141228 Oct 28 13:11:02.771763 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1128/2214] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:02 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 1542 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:02.927111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:02.927984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:02.934289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.934806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.935248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:02.935956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:02.936584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:02.937012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.089818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.098473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fed2d3ba-8dfc-4371-baf1-dd9a9fec6fe2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.175335 Oct 28 13:11:03.099079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1087/2215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:02 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:03.120805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:03.121884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.129366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.129863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.130304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.131044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.132034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.132471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.250464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:03.251665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.259255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.259698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.260138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.260835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.261289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.261710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.331918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.342561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.344277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.346800 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c36ed7e-ff60-4c7b-9db1-9d9d0d8ec418 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 200 len: 1331 microversion: 2.25 time: 0.099396 Oct 28 13:11:03.350876 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1088/2216] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:03 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:11:03.399647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.402518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:03.420740 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6e52914-350b-4953-bda7-f424117c2504 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.303886 Oct 28 13:11:03.421392 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1129/2217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:03 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:03.440806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:03.441530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.448891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:03.449503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.450221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.451059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.451806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.452951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.453654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.454347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.456644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.465262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.465821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.466566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.467062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.469215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.533662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:03.637018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.645653 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7c481e1-fe53-4c3b-b499-2be6b6765a9d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.201530 Oct 28 13:11:03.646274 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1130/2218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:03 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:03.652800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:03.653003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.653103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.658377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.659085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.659524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.660214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.660673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.661099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.661422 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-16a94498-96e2-412a-a5d8-5fa516cc720e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1522 microversion: 2.1 time: 0.225631 Oct 28 13:11:03.661995 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1089/2219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:03 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:03.670654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:03.671331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.677571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.678073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.678506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.679261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.679719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.680146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.725312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.734637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.736163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.737329 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3169804-30ff-4111-9a1f-d7e90788d5df tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.090027 Oct 28 13:11:03.737938 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1131/2220] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:03 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:03.743041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1929241570"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:03.745549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.753365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.753879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.754320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.755190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.755815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.756586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.874959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:03.878170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:03.886456 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-044c0229-45fa-4ec8-b616-f471bce938d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.222114 Oct 28 13:11:03.887567 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1090/2221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:03 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:03.893500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:03.897663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:03.900465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.901132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.901557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:03.902264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:03.902882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:03.903508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.001753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:04.030623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=16 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:04.072779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:04.080468 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da97d5d6-8515-42de-8816-0a87ec6cb01a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1367 microversion: 2.1 time: 0.191738 Oct 28 13:11:04.081111 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1091/2222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:03 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:04.085476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:04.086086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] [instance: 604dad7e-a573-4bc6-b434-0ebe71a36c86] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:04.091735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.092352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.092845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.093601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.094062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.094547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.109010 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] HTTP exception thrown: Instance 604dad7e-a573-4bc6-b434-0ebe71a36c86 could not be found. Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Request method failure captured: Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 HTTP/1.1 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Qm8bH7O2Ec-3PE6RDy1r8KLdeWvLBhwLqbVEbGL5Ty3WaKnK9d9rMiUS4MBblu9R0mwB-BkC3hOo8-6ocw0DGYVDk8LhqQhGm8YVMXw17Ld0vL9TWfJxTN6zmUneFQnjEcp91abyNyH8t-axUxjy868hOvFIW4MDK449lYS_DB7oA Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.91 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 10cfb1afb585468e9a315fbe81e6e297 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1571240443 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10cfb1afb585468e9a315fbe81e6e297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10cfb1afb585468e9a315fbe81e6e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10cfb1afb585468e9a315fbe81e6e297", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10cfb1afb585468e9a315fbe81e6e297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1571240443 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 10cfb1afb585468e9a315fbe81e6e297 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1571240443 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-UnshelveToHostMultiNodesTest-1571240443-project Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: c251a230ec584ef58e1bde3d67176080 Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1571240443-project Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 604dad7e-a573-4bc6-b434-0ebe71a36c86 could not be found. Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '604dad7e-a573-4bc6-b434-0ebe71a36c86'} Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604dad7e-a573-4bc6-b434-0ebe71a36c86 could not be found. Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604dad7e-a573-4bc6-b434-0ebe71a36c86 could not be found. Oct 28 13:11:04.111236 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604dad7e-a573-4bc6-b434-0ebe71a36c86 could not be found. Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] Returning 404 to user: Instance 604dad7e-a573-4bc6-b434-0ebe71a36c86 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a0cacb18-bbe5-4732-ae27-7b5af33f6d51 tempest-UnshelveToHostMultiNodesTest-1571240443 tempest-UnshelveToHostMultiNodesTest-1571240443-project] 10.222.0.25 "GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86" status: 404 len: 111 microversion: 2.91 time: 0.030605 Oct 28 13:11:04.115126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1092/2223] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:04 2022] GET /compute/v2.1/servers/604dad7e-a573-4bc6-b434-0ebe71a36c86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:11:04.117612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-dd6a65d8-b8d0-4c01-ad18-f4faaa701c5e req-48a4461a-4532-4529-85a2-53db5b5df299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d226cb64-78cc-4727-a90c-024cb6e5e87d", "name": "network-vif-deleted", "tag": "8ac23d6b-995f-4a03-8e2c-3436bb2388b1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:04.127195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dd6a65d8-b8d0-4c01-ad18-f4faaa701c5e req-48a4461a-4532-4529-85a2-53db5b5df299 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.127840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dd6a65d8-b8d0-4c01-ad18-f4faaa701c5e req-48a4461a-4532-4529-85a2-53db5b5df299 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.128110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dd6a65d8-b8d0-4c01-ad18-f4faaa701c5e req-48a4461a-4532-4529-85a2-53db5b5df299 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.140441 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-dd6a65d8-b8d0-4c01-ad18-f4faaa701c5e req-48a4461a-4532-4529-85a2-53db5b5df299 service nova] Creating event network-vif-deleted:8ac23d6b-995f-4a03-8e2c-3436bb2388b1 for instance d226cb64-78cc-4727-a90c-024cb6e5e87d on n-h1-862876-2 Oct 28 13:11:04.146774 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-dd6a65d8-b8d0-4c01-ad18-f4faaa701c5e req-48a4461a-4532-4529-85a2-53db5b5df299 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032142 Oct 28 13:11:04.147957 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1093/2224] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:04.353555 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50ff7795-2611-4149-aedb-ee6e55368eaf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.614261 Oct 28 13:11:04.355220 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1132/2225] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:11:03 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 13:11:04.372696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:04.373438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: d226cb64-78cc-4727-a90c-024cb6e5e87d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:04.379691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.380207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.380646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.381605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.382220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.382499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.396302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] HTTP exception thrown: Instance d226cb64-78cc-4727-a90c-024cb6e5e87d could not be found. Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Request method failure captured: Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d HTTP/1.1 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9MHyNdJYM314gkQphCFN80CvpK1uViP5snzksm1KI8rXm2ulJR8-yMpXB546OVqV2Jan9C5ZQlCCiXHDqrCi3q-D4ieH1boFTbI4e9rmcKWIzdwKghNe4E31EfSfR_qMu8J0PguC-q1coLfFVoW2_b9pL1_zNMk_8U89pqQj2z6ldk Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c310f7fe3104b3b8649ba13bd9c51ec", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 17a50d2f7a154acbbf6bc218efb8b67d Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance d226cb64-78cc-4727-a90c-024cb6e5e87d could not be found. Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'd226cb64-78cc-4727-a90c-024cb6e5e87d'} Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d226cb64-78cc-4727-a90c-024cb6e5e87d could not be found. Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d226cb64-78cc-4727-a90c-024cb6e5e87d could not be found. Oct 28 13:11:04.397939 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d226cb64-78cc-4727-a90c-024cb6e5e87d could not be found. Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Returning 404 to user: Instance d226cb64-78cc-4727-a90c-024cb6e5e87d could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e313efcb-6ca6-4c9d-b6ca-1c5e86fe4417 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d" status: 404 len: 111 microversion: 2.25 time: 0.032634 Oct 28 13:11:04.402441 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1094/2226] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:04 2022] GET /compute/v2.1/servers/d226cb64-78cc-4727-a90c-024cb6e5e87d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:11:04.419526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:04.420110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:04.426336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.426850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.427283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.427964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.428421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.428840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.465095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:11:04.684878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:04.686101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:04.693705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.694197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.694857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.695884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.696443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.703753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.832986 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-24366fc2-ba55-43b4-90b5-3ecaeda63a18 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 204 len: 0 microversion: 2.25 time: 0.417822 Oct 28 13:11:04.836869 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1133/2227] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:11:04 2022] DELETE /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:11:04.840628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:04.841551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:04.848120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.848611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.849045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.850354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.851096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.851830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.937646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:04.948754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:04.950560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:04.952005 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-41388717-ca0d-4455-9c8f-0f75e79c836b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.115650 Oct 28 13:11:04.954323 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1134/2228] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:04 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:04.960061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:04.960856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:04.968459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.969119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.969873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:04.970790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:04.971706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:04.972330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.105600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:05.116267 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7146786-1ee5-4fee-936d-0e08a8caa2a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1499 microversion: 2.1 time: 0.435207 Oct 28 13:11:05.116841 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1095/2229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:04 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1499 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:05.121747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:05.122519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:05.129889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.131495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.132611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.133333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.133868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.134294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.135912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:05.147264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:05.147264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:05.147623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c710cfb6-87e2-473e-bbf6-533e00584fb1 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1565 microversion: 2.25 time: 0.191797 Oct 28 13:11:05.148216 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1135/2230] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:04 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:05.153072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:05.153690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:05.160105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.160639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.161134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.161841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.162329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.162784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.447128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:05.460644 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-994a0811-8fed-47ed-a7d3-af872139e62e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1367 microversion: 2.1 time: 0.310857 Oct 28 13:11:05.462342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1136/2231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:05 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:05.479493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:05.488353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:05.490113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:05.498525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.499889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.500572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.502439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.503132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.504368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.528331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:05.551938 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc27b181-24dc-466d-a469-538c6d9ef883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.433891 Oct 28 13:11:05.555190 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1096/2232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:05 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:05.627674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:05.710630 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35a63fd3-65a6-450d-ae60-dc967a88c5b3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.245844 Oct 28 13:11:05.711940 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1137/2233] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Oct 28 13:11:05 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:05.725165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-621ee972-458d-4ce7-9bd8-1c5d09cfc1f3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:05.733329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-621ee972-458d-4ce7-9bd8-1c5d09cfc1f3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.734711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-621ee972-458d-4ce7-9bd8-1c5d09cfc1f3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.735463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-621ee972-458d-4ce7-9bd8-1c5d09cfc1f3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.799875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-621ee972-458d-4ce7-9bd8-1c5d09cfc1f3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Going to try to start instance {{(pid=127794) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 13:11:05.979144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:05.979895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:05.982037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:05.988473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.989053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.989562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:05.990375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:05.990922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:05.991441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.064996 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-621ee972-458d-4ce7-9bd8-1c5d09cfc1f3 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "POST /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb/action" status: 202 len: 0 microversion: 2.1 time: 0.345182 Oct 28 13:11:06.080612 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1097/2234] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:11:05 2022] POST /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:11:06.093137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:06.099572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:06.106455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.110883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.112033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.118843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.120901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.121718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.122352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.122498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.123714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.124120 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a37acc6-66ad-443a-9386-03316e7d803b tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1409 microversion: 2.54 time: 0.149980 Oct 28 13:11:06.125373 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1138/2235] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:05 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:06.164655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3f6666a5-30ea-48e4-b4f7-580f7db75c74 req-0d14974a-fbcd-4214-bb32-913118203d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33f2331-58e4-4f5a-b517-56192307a84b", "name": "network-vif-deleted", "tag": "f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:06.193377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3f6666a5-30ea-48e4-b4f7-580f7db75c74 req-0d14974a-fbcd-4214-bb32-913118203d05 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.193901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3f6666a5-30ea-48e4-b4f7-580f7db75c74 req-0d14974a-fbcd-4214-bb32-913118203d05 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.194346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3f6666a5-30ea-48e4-b4f7-580f7db75c74 req-0d14974a-fbcd-4214-bb32-913118203d05 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.207508 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3f6666a5-30ea-48e4-b4f7-580f7db75c74 req-0d14974a-fbcd-4214-bb32-913118203d05 service nova] Creating event network-vif-deleted:f4b12571-2b5b-45c5-9f7f-e7f54ce6ccd3 for instance f33f2331-58e4-4f5a-b517-56192307a84b on n-h1-862876-2 Oct 28 13:11:06.212496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3f6666a5-30ea-48e4-b4f7-580f7db75c74 req-0d14974a-fbcd-4214-bb32-913118203d05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052071 Oct 28 13:11:06.213107 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1139/2236] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:11:06.222276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:06.223414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:06.232753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.233246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.233687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.234667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.235241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.235775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.344076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.356135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.357801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.359281 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bdcf7093-2afa-4e92-9c6b-187fcee6d3bd tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1523 microversion: 2.25 time: 0.141821 Oct 28 13:11:06.361049 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1140/2237] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:06 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:06.485187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:06.488104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:06.495711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.496520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.497171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.498175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.498877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.499500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.762485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.771074 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4418f1bc-8594-4e58-a05c-9eeafe05285a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1367 microversion: 2.1 time: 0.289869 Oct 28 13:11:06.771838 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1141/2238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:06 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:06.785786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:06.788026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:06.792966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.793458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.793944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.794584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:06.795075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:06.795944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:06.799861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.810704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4cff11f6-1735-4b62-8b1e-580218936dbb tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1508 microversion: 2.1 time: 0.726994 Oct 28 13:11:06.827319 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1098/2239] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:06 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:06.944130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:06.952678 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5aabcd53-0feb-4c46-8d54-5c221cd40f4e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.180001 Oct 28 13:11:06.954813 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1142/2240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:06 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:07.155027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:07.157123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:07.166791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.167504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.168155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.169265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.169918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.170551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.273081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:07.284856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:07.286509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:07.288043 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2a70543d-703d-47df-ac0a-9a7d9b44fca4 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1415 microversion: 2.54 time: 0.139709 Oct 28 13:11:07.303604 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1099/2241] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:07 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1415 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:07.397169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:07.398107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:07.410186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.411004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.411987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.412913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.414431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.415853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.508395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.513049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.513517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.514002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lazy-loading 'fault' on Instance uuid f33f2331-58e4-4f5a-b517-56192307a84b {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:07.526273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:07.635763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:07.646319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:07.647819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17a50d2f7a154acbbf6bc218efb8b67d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c310f7fe3104b3b8649ba13bd9c51ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:07.649134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5809cc9d-e881-4950-bfd5-0bcefe4f778e tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 200 len: 1352 microversion: 2.25 time: 0.261404 Oct 28 13:11:07.663864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1143/2242] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:07 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 1352 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:07.760533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0b100df3-8d8c-43d7-a701-b0b3cf6afd23 req-a9034d24-2a8f-445c-848d-1243cb3eecb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c24964-fb49-4247-a5fe-c8af53330f59", "name": "network-vif-plugged", "status": "completed", "tag": "ee85f85c-1f60-4689-b4ce-cb5af23703db"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:07.773540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b100df3-8d8c-43d7-a701-b0b3cf6afd23 req-a9034d24-2a8f-445c-848d-1243cb3eecb1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.774703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b100df3-8d8c-43d7-a701-b0b3cf6afd23 req-a9034d24-2a8f-445c-848d-1243cb3eecb1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.775318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b100df3-8d8c-43d7-a701-b0b3cf6afd23 req-a9034d24-2a8f-445c-848d-1243cb3eecb1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.795430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:07.795831 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0b100df3-8d8c-43d7-a701-b0b3cf6afd23 req-a9034d24-2a8f-445c-848d-1243cb3eecb1 service nova] Creating event network-vif-plugged:ee85f85c-1f60-4689-b4ce-cb5af23703db for instance 18c24964-fb49-4247-a5fe-c8af53330f59 on n-h2-862876-2 Oct 28 13:11:07.796053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:07.802105 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0b100df3-8d8c-43d7-a701-b0b3cf6afd23 req-a9034d24-2a8f-445c-848d-1243cb3eecb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045431 Oct 28 13:11:07.803061 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1100/2243] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:07.803661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.804421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.804589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.805462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.805927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.806356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.841635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:07.844168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:07.861655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.862234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.863234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:07.865985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:07.866546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:07.868216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:08.194245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:08.203924 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2afc6d77-7027-4a0c-8693-1b259e2125b6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1508 microversion: 2.1 time: 0.371192 Oct 28 13:11:08.223336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1101/2244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:07 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1508 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:08.223631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:08.223631 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b4f0415-4c88-4670-85af-e37674da7b4a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1367 microversion: 2.1 time: 0.427553 Oct 28 13:11:08.224061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:08.224145 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1144/2245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:07 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:08.227087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:08.239637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:08.240240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:08.240756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:08.241941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:08.242486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:08.243696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:08.316402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:08.317181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:08.323660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:08.324382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:08.325131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:08.326982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:08.330716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:08.330716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:08.419395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:08.434212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:08.436873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:08.439283 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3cae6e6d-ad3b-469d-a316-ad5ef252695c tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1415 microversion: 2.54 time: 0.126299 Oct 28 13:11:08.457463 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1145/2246] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:08 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1415 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:11:08.551089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:08.572473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8884c61-c6f7-4e9f-89b1-52c3350f5ee7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.366221 Oct 28 13:11:08.574506 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1102/2247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:08 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:08.678384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:08.679998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] [instance: f33f2331-58e4-4f5a-b517-56192307a84b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:08.687592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:08.688582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:08.689272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:08.690367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:08.691060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:08.691678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:08.716983 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] HTTP exception thrown: Instance f33f2331-58e4-4f5a-b517-56192307a84b could not be found. Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Request method failure captured: Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b HTTP/1.1 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9MHyNdJYM314gkQphCFN80CvpK1uViP5snzksm1KI8rXm2ulJR8-yMpXB546OVqV2Jan9C5ZQlCCiXHDqrCi3q-D4ieH1boFTbI4e9rmcKWIzdwKghNe4E31EfSfR_qMu8J0PguC-q1coLfFVoW2_b9pL1_zNMk_8U89pqQj2z6ldk Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c310f7fe3104b3b8649ba13bd9c51ec", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c310f7fe3104b3b8649ba13bd9c51ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7c310f7fe3104b3b8649ba13bd9c51ec Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479 Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 17a50d2f7a154acbbf6bc218efb8b67d Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1540529479-project Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance f33f2331-58e4-4f5a-b517-56192307a84b could not be found. Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f33f2331-58e4-4f5a-b517-56192307a84b'} Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33f2331-58e4-4f5a-b517-56192307a84b could not be found. Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33f2331-58e4-4f5a-b517-56192307a84b could not be found. Oct 28 13:11:08.718658 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33f2331-58e4-4f5a-b517-56192307a84b could not be found. Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] Returning 404 to user: Instance f33f2331-58e4-4f5a-b517-56192307a84b could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f4af8a1-b776-4516-b945-4890473597b0 tempest-LiveAutoBlockMigrationV225Test-1540529479 tempest-LiveAutoBlockMigrationV225Test-1540529479-project] 10.222.0.25 "GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b" status: 404 len: 111 microversion: 2.25 time: 0.048418 Oct 28 13:11:08.723158 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1146/2248] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:08 2022] GET /compute/v2.1/servers/f33f2331-58e4-4f5a-b517-56192307a84b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:11:09.230370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:09.231830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:09.239611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.240373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.241088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.242499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.243701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.244424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.247279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:09.247748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:09.260387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.260911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.261347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.264349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.264839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.265271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.607261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:09.619005 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-01ecbb0a-c8bc-46a6-bcc6-0099f66f2b1d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1512 microversion: 2.1 time: 0.392177 Oct 28 13:11:09.619956 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1103/2249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:09 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:09.630950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:09.633289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:09.655566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.660088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.663570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.664647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.665860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.666399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.743977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:09.756773 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99ab5480-6d3f-4d7a-a06d-11fa3875c848 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1367 microversion: 2.1 time: 0.513283 Oct 28 13:11:09.757703 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1147/2250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:09 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:09.785258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:09.787325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:09.814724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.815263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.815707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.816425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.816883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.817316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.826980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:09.839216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:09.841596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:09.843121 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0816326-0c03-45af-be6c-409b2636f22d tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1400 microversion: 2.54 time: 0.221897 Oct 28 13:11:09.844243 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1104/2251] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:09 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1400 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:09.849751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:09.855067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:09.855521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.servers [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Removing options 'limit' from query {{(pid=127794) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 13:11:09.856441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:09.857872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.858355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.858810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.859770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:09.860993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:09.861584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:09.863148 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9203b061-080d-4cb5-bd3e-13f959e96a84 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.017165 Oct 28 13:11:09.864299 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1105/2252] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Oct 28 13:11:09 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:11:09.878595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2912d0ba-bf03-4a88-988e-fb3a5c5a1c49 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '.version_select at 0x7f27bd8c4f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:10.049290 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2912d0ba-bf03-4a88-988e-fb3a5c5a1c49 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1917505097" status: 204 len: 0 microversion: 2.54 time: 0.180940 Oct 28 13:11:10.057461 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1106/2253] 10.222.0.25 () {60 vars in 1319 bytes} [Fri Oct 28 13:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1917505097 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 13:11:10.066788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:10.067656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:10.084704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.086629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.087268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:10.089653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.090895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.091504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:10.194570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:10.236028 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3a7c38f3-3639-4003-a880-3453b180f5e2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.463229 Oct 28 13:11:10.236678 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1148/2254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:09 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:10.245327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:10.245826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:10.253633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.260969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.261650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:10.262540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.263169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.263735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:10.318603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:11:10.550084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:10.560526 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b41f6b13-2a7f-4aa5-b7bd-4f8ad3d498e6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1512 microversion: 2.1 time: 0.501782 Oct 28 13:11:10.561247 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1107/2255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:10 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:10.584315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:10.584940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:10.593323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.594275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.595295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:10.597278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.597783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.598236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:10.770466 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f449e301-5685-47eb-a847-e7d3155d0665 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 204 len: 0 microversion: 2.54 time: 0.530423 Oct 28 13:11:10.771269 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1149/2256] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:11:10 2022] DELETE /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:11:10.784751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:10.798928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:10.816336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.819173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.819910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:10.823927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:10.825012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:10.825616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.027442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:11.039985 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54ffab37-6b52-46bd-ba18-d99489cda4ae tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 200 len: 1511 microversion: 2.1 time: 0.459417 Oct 28 13:11:11.042104 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1108/2257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:10 2022] GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:11.054204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:11.061910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:11.066561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.070172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.070729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.074452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.075090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.075609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.271633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:11.283639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:11.285670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:11.293442 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3d59195-7972-416b-9cfa-73342c420846 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1406 microversion: 2.54 time: 0.243537 Oct 28 13:11:11.307565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1109/2258] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:11 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:11.465125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:11.479096 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-513301ca-9b54-4947-9546-0c0230058cd0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1558 microversion: 2.1 time: 0.700002 Oct 28 13:11:11.502866 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1150/2259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:10 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1558 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:11.520547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:11.521202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:11.534603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.535579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.536176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.539390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.542784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.542784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.640590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:11.645650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.646160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.646942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.647424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.647873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.653599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.691265 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81e012b3-8c66-4802-80f7-7780b2eeadb5 tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.382429 Oct 28 13:11:11.692442 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1110/2260] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:11:11 2022] GET /compute/v2.1/os-services => generated 944 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:11.704587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:11.707682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:11.718459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.721018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.721497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:11.722173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:11.725315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:11.725810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.171286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:12.185222 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c7b7fb6f-a9d3-4f07-870d-a3fd725ccdb5 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1509 microversion: 2.1 time: 0.697541 Oct 28 13:11:12.186139 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1151/2261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:11 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1509 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:12.199578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:12.200434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:12.214894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.217746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.218667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.222216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.223188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.223816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.255661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:12.259906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:12.266279 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5060e05b-6cf7-47d6-a0a8-87c8d6e15eb8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.572538 Oct 28 13:11:12.268908 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1111/2262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:11 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:12.273932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-15261fcb-86ba-4c26-8572-bab39df12927 req-6947ef55-05f3-4e83-bdbc-277c7b0e9c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "name": "network-vif-plugged", "status": "completed", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:12.284264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-15261fcb-86ba-4c26-8572-bab39df12927 req-6947ef55-05f3-4e83-bdbc-277c7b0e9c11 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.285102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-15261fcb-86ba-4c26-8572-bab39df12927 req-6947ef55-05f3-4e83-bdbc-277c7b0e9c11 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.285690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-15261fcb-86ba-4c26-8572-bab39df12927 req-6947ef55-05f3-4e83-bdbc-277c7b0e9c11 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.300153 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-15261fcb-86ba-4c26-8572-bab39df12927 req-6947ef55-05f3-4e83-bdbc-277c7b0e9c11 service nova] Creating event network-vif-plugged:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:11:12.305939 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-15261fcb-86ba-4c26-8572-bab39df12927 req-6947ef55-05f3-4e83-bdbc-277c7b0e9c11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035595 Oct 28 13:11:12.307105 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1112/2263] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:12.314213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:12.320193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.320881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.321587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.322567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.323200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.323782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.363118 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a00ddece-e0fe-42a1-9e67-a61ed493b6de tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-862876-2" status: 200 len: 578 microversion: 2.1 time: 0.049228 Oct 28 13:11:12.363118 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1113/2264] 10.222.0.25 () {58 vars in 1172 bytes} [Fri Oct 28 13:11:12 2022] GET /compute/v2.1/os-services?host=n-d-862876-2 => generated 578 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:12.364529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:12.370895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:12.371905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:12.493227 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00d010d5-acc4-4da6-9f5f-e6c35a7d6aba tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.305767 Oct 28 13:11:12.494691 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1152/2265] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:11:12 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-interface => generated 285 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:12.506833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:12.506833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:12.514699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.515425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.516014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.517607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.518237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.518877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.553424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.555092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.556550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.558616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.560674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.562286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.714557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:12.716359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:12.724844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:12.731159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:12.732457 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-036e2ec5-68bb-468e-a439-310de24a7dad tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1406 microversion: 2.54 time: 0.236755 Oct 28 13:11:12.733045 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1153/2266] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:12 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:12.759821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:12.771832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.772695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.775148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.776219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.777133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.777790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.809724 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-720741f0-f287-4864-a3b4-fda5af3cab2e tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053760 Oct 28 13:11:12.810680 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1154/2267] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:11:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:12.833778 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dcecf6a8-b5c2-495a-88d5-66ea7de57fb6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.473803 Oct 28 13:11:12.834603 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1114/2268] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Oct 28 13:11:12 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:12.839954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:12.845468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.845954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.846404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.847206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.847657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.848072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.881877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3dc8e83-1484-4cab-9e40-afcae4fcf95b tempest-ServicesAdminTestJSON-558498541 tempest-ServicesAdminTestJSON-558498541-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.045501 Oct 28 13:11:12.892659 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1115/2269] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:11:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:12.898656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:12.899512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:12.907383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.907871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.908304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.909005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:12.909458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:12.909937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:12.916556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1751670747", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "184d6486-2fb1-4ea8-8c08-875a24067721"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:12.988285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] validate_networks() for [('184d6486-2fb1-4ea8-8c08-875a24067721', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:11:13.173863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:13.186116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-33a917e4-2592-4715-ba2c-01b4cf313667 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1512 microversion: 2.1 time: 0.290545 Oct 28 13:11:13.187239 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1116/2270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:12 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:13.216759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:13.218198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:13.229186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:13.229964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:13.230602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:13.232084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:13.232742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:13.233314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:13.542210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:13.561362 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27b81154-50a2-4fec-8c09-293fb379ba70 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 200 len: 1511 microversion: 2.1 time: 0.345602 Oct 28 13:11:13.564093 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1117/2271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:13 2022] GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:13.571675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:13.578373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:13.597294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:13.598052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:13.598863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:13.599876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:13.600867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:13.601460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:13.894004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:13.905139 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-582b3833-bf21-4449-b2fd-4fa87db74b55 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.339471 Oct 28 13:11:13.930452 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1118/2272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:13 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:13.942001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:13.942638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:13.959430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:13.967326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:13.967835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:13.968277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:13.969192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:13.970043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:13.970477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:14.338537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:14.386188 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4cb8de69-3a19-4bf6-a3d7-0943086c63a6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1509 microversion: 2.1 time: 0.454411 Oct 28 13:11:14.386823 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1119/2273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:13 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:14.408699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:14.424170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:14.436607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:14.442939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:14.446141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:14.447378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:14.449466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:14.455235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:14.612676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:14.627085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:14.631107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:14.634860 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ec01567-1819-4657-9529-04eed6f63776 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1406 microversion: 2.54 time: 0.234435 Oct 28 13:11:14.635413 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1120/2274] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:14 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:14.642401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:14.656348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:14.660953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:14.670373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:14.670906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:14.671350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:14.672106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:14.672574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:14.679896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:14.773531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:14.857064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:14.866869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:14.867595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:14.868379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.084783 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-78ef1945-1d1f-4724-a7c5-b5af13903018 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.448244 Oct 28 13:11:15.101447 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1121/2275] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:11:14 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:15.106556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:15.107225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:15.115701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.116195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.116633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.117670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.117791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.118191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.199575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:11:15.200517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:11:15.203676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:11:15.204393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:11:15.205536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:11:15.225513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.229660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.230327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.233685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.234995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.236164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.314776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Getting quotas for project 15553ca6de9d413d9edce8ec5eafa99a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:11:15.333742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Getting quotas for user 832724d040b64a0c9ff91601aa5ae95a and project 15553ca6de9d413d9edce8ec5eafa99a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:11:15.360926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:11:15.364463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:11:15.396156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:15.411032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7700c230-6155-45ac-b389-e06ca1dc336a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.307939 Oct 28 13:11:15.413576 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1122/2276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:15 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:15.446534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:15.459554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:15.462182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:15.643604 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed7cfcbd-d4fb-433d-9f38-badce3034fa6 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.831481 Oct 28 13:11:15.648775 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1155/2277] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:11:15.661780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.662784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.665858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.665858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.665858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.665858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.675010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cd1b7398-e86d-4ed6-8e62-2ff213ffd8a4 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:15.694502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cd1b7398-e86d-4ed6-8e62-2ff213ffd8a4 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:15.764458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:15.826624 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a89419d1-3d37-4db3-80b5-de9d0e861e7c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1007 microversion: 2.1 time: 0.411740 Oct 28 13:11:15.828249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1123/2278] 10.222.0.25 () {58 vars in 1150 bytes} [Fri Oct 28 13:11:15 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1007 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:15.838780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:15.839234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:15.853391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.854330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.854330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.858830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.859394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.861323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.948333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:15.949934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:15.950667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:15.951165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lazy-loading 'fault' on Instance uuid e0c8107e-eb6e-487f-903d-024987d67411 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:15.984518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cd1b7398-e86d-4ed6-8e62-2ff213ffd8a4 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:15.995064 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cd1b7398-e86d-4ed6-8e62-2ff213ffd8a4 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1225 microversion: 2.1 time: 0.337283 Oct 28 13:11:15.996160 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1156/2279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:15 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1225 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:16.009298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:16.024368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:16.025367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:16.040008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.042188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.043635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.048321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.048727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.049582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.066076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:16.074825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:16.076339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35341e4340e445558f346f9487ee73b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30512b9387f4095a1c5e704965bba50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:16.077683 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e4ccc07-e7d4-406b-ae25-95d31ab74385 tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 200 len: 1411 microversion: 2.54 time: 0.247732 Oct 28 13:11:16.080791 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1124/2280] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:15 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 1411 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:16.336080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:16.435582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:16.436280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:16.455155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.456410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.458089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.461533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.463530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.465364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.535482 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1f237a3-b00e-4d52-8329-04e7e54cf237 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1007 microversion: 2.1 time: 0.524596 Oct 28 13:11:16.537696 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1157/2281] 10.222.0.25 () {58 vars in 1212 bytes} [Fri Oct 28 13:11:15 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1007 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:16.557381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:16.569043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:16.571144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:16.592037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.592533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.592974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.593705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.594169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.603018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.752458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:16.839097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63e650b6-e54e-41aa-8791-bf5e85e3ff3c tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1007 microversion: 2.1 time: 0.291170 Oct 28 13:11:16.840526 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1158/2282] 10.222.0.25 () {58 vars in 1196 bytes} [Fri Oct 28 13:11:16 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1007 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:16.854120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:16.869977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:16.870875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'name': '-965898666', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:16.913418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:16.925256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.941053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.941936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.945706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:16.952470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:16.957984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:16.972488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:16.993609 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-517f8cba-3ce6-49c3-b753-861092e3ef6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.562206 Oct 28 13:11:16.996891 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1125/2283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:16 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:17.016170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9c3ec867-d098-42c6-aaa6-d958595d89e0 req-48b8329a-40ec-4690-966c-411bd658647c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c24964-fb49-4247-a5fe-c8af53330f59", "tag": "ee85f85c-1f60-4689-b4ce-cb5af23703db"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:17.048862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c3ec867-d098-42c6-aaa6-d958595d89e0 req-48b8329a-40ec-4690-966c-411bd658647c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:17.049227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c3ec867-d098-42c6-aaa6-d958595d89e0 req-48b8329a-40ec-4690-966c-411bd658647c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:17.049558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c3ec867-d098-42c6-aaa6-d958595d89e0 req-48b8329a-40ec-4690-966c-411bd658647c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:17.076724 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9c3ec867-d098-42c6-aaa6-d958595d89e0 req-48b8329a-40ec-4690-966c-411bd658647c service nova] Creating event network-changed:ee85f85c-1f60-4689-b4ce-cb5af23703db for instance 18c24964-fb49-4247-a5fe-c8af53330f59 on n-h2-862876-2 Oct 28 13:11:17.087117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9c3ec867-d098-42c6-aaa6-d958595d89e0 req-48b8329a-40ec-4690-966c-411bd658647c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088930 Oct 28 13:11:17.091338 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1126/2284] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:17.118120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ad47102-8671-4372-9874-14de1c3cad44 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:17.118120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ad47102-8671-4372-9874-14de1c3cad44 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:17.206060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4ad47102-8671-4372-9874-14de1c3cad44 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:17.215887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ad47102-8671-4372-9874-14de1c3cad44 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1225 microversion: 2.1 time: 0.123221 Oct 28 13:11:17.231162 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1127/2285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:17 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:17.236689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:17.237352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] [instance: e0c8107e-eb6e-487f-903d-024987d67411] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:17.265338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:17.265854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:17.266297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:17.275686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:17.276943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:17.277994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:17.300631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:17.303823 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] HTTP exception thrown: Instance e0c8107e-eb6e-487f-903d-024987d67411 could not be found. Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Request method failure captured: Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 HTTP/1.1 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9S6Ja8a7qR0M9awsaaGaySdX3cVIcL5pqQieYlII64Y2LybhqvOsJcDubpTfDZSwHp_PwyAhrJY7IgyT3leipl0JX9qtOBb-W0wS_Z29vxNlhzWVOuAO_dbRkETb0XJgZ5Omh0kZ4uKbF-ALYjekPiVXx8dqFQyVb31SQn-ZqQNF48 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.54 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f30512b9387f4095a1c5e704965bba50 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerShowV254Test-1132455464 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f30512b9387f4095a1c5e704965bba50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f30512b9387f4095a1c5e704965bba50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f30512b9387f4095a1c5e704965bba50", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f30512b9387f4095a1c5e704965bba50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerShowV254Test-1132455464 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f30512b9387f4095a1c5e704965bba50 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerShowV254Test-1132455464 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerShowV254Test-1132455464-project Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 35341e4340e445558f346f9487ee73b1 Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerShowV254Test-1132455464-project Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance e0c8107e-eb6e-487f-903d-024987d67411 could not be found. Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'e0c8107e-eb6e-487f-903d-024987d67411'} Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c8107e-eb6e-487f-903d-024987d67411 could not be found. Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c8107e-eb6e-487f-903d-024987d67411 could not be found. Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:17.307594 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c8107e-eb6e-487f-903d-024987d67411 could not be found. Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] Returning 404 to user: Instance e0c8107e-eb6e-487f-903d-024987d67411 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9e0cfda-7e4f-4d55-aefa-1b101da9003e tempest-ServerShowV254Test-1132455464 tempest-ServerShowV254Test-1132455464-project] 10.222.0.25 "GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411" status: 404 len: 111 microversion: 2.54 time: 0.088315 Oct 28 13:11:17.313962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1128/2286] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:11:17 2022] GET /compute/v2.1/servers/e0c8107e-eb6e-487f-903d-024987d67411 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:11:17.465628 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9dbbfeff-f573-4629-b8f7-0f1edf77720a tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-965898666" status: 200 len: 345 microversion: 2.1 time: 0.615841 Oct 28 13:11:17.466223 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1159/2287] 10.222.0.25 () {58 vars in 1156 bytes} [Fri Oct 28 13:11:16 2022] GET /compute/v2.1/servers?name=-965898666 => generated 345 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:17.480026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:17.490304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:17.492550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:17.511309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:17.511872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:17.513270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:17.514096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:17.514567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:17.515056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:17.645105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:17.725288 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7ba4e300-8d88-463d-b61f-46033076cc36 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1007 microversion: 2.1 time: 0.249211 Oct 28 13:11:17.729923 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1129/2288] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Oct 28 13:11:17 2022] GET /compute/v2.1/servers?name=-instance => generated 1007 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:17.743297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:17.749142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:17.749827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-96589866', 'deleted': False, 'project_id': '52536665a18b4117a13fdecef7e39748'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:11:17.759163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:17.761010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:17.761234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:17.764836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:17.764836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:17.764836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:17.929535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:11:17.935176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:18.027261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:18.028345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:18.045280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.058233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68235acd-410f-471d-9f4d-7b07b99bcfd7 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-96589866" status: 200 len: 345 microversion: 2.1 time: 0.323114 Oct 28 13:11:18.059251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.063067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:18.063067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.064252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.074833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:18.075268 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1160/2289] 10.222.0.25 () {58 vars in 1226 bytes} [Fri Oct 28 13:11:17 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-96589866 => generated 345 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:18.095694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:18.106109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:18.129187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.134525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.135786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:18.137377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.144327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.144992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:18.236909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:11:18.695993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bce4afa7-e752-4736-814a-43624c4ff9c6 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 204 len: 0 microversion: 2.1 time: 0.619154 Oct 28 13:11:18.696757 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1161/2290] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:11:18 2022] DELETE /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:11:18.708668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:18.709849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:18.732345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.733546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.734184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:18.747769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.749776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.753155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:18.774185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:18.777462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:18.801976 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a0449ff0-29dd-4526-92c5-256ccf5c49cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.763655 Oct 28 13:11:18.818701 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1130/2291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:18 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:18.833376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:18.834019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:18.847052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.849995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.850471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:18.851242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:18.851700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:18.852137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:19.010391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:19.043220 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b428817d-5bbb-456b-a955-e8d61e9fa0ab tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1221 microversion: 2.1 time: 0.344929 Oct 28 13:11:19.046985 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1162/2292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:18 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1221 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:19.384482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:19.396945 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-543151fa-0cc9-4dbf-89f9-8bf582fa348b tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1515 microversion: 2.1 time: 0.577201 Oct 28 13:11:19.414354 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1131/2293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:18 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:19.832852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:19.833386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:19.887081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:19.893669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:19.895348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:19.902372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:19.903958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:19.908713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:20.070456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:20.071126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:20.079377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:20.082916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:20.085679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:20.087227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:20.091709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:20.098359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:20.351684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:20.361087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e975dea4-b510-4b43-b373-8d4ea34d09d1 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1277 microversion: 2.1 time: 0.295329 Oct 28 13:11:20.371904 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1132/2294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:20 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1277 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:20.411722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:20.421595 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-77287b0e-621f-4ab3-a9c1-504bc0ce4460 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.594790 Oct 28 13:11:20.423051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:20.424296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:20.442364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1163/2295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:19 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:20.446737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:20.452350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:20.453252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:20.455105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:20.455964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:20.456661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:20.941787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:20.949972 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8cce1aea-b506-4269-a392-c7edbfc2dfd0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1515 microversion: 2.1 time: 0.531667 Oct 28 13:11:20.952787 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1133/2296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:20 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1515 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:21.385864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:21.386510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:21.393805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:21.394285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:21.394716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:21.395459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:21.395908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:21.396351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:21.450067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:21.450854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:21.458292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:21.458821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:21.459262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:21.459975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:21.460438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:21.460894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:21.476896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:21.484736 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0aef421-549a-42c3-a468-6f08993bd005 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1285 microversion: 2.1 time: 0.103030 Oct 28 13:11:21.491920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1164/2297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:21 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:21.834594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7c9a76bf-2676-4110-bb31-d0ca63faf366 req-906b8582-0972-4b58-bb0c-a06152b1e615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7734075b-5bc5-43fb-b737-57e65a155610", "name": "network-vif-deleted", "tag": "97183e28-9057-488a-94a3-3d41f272aedb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:21.864258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7c9a76bf-2676-4110-bb31-d0ca63faf366 req-906b8582-0972-4b58-bb0c-a06152b1e615 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:21.865038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7c9a76bf-2676-4110-bb31-d0ca63faf366 req-906b8582-0972-4b58-bb0c-a06152b1e615 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:21.865492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7c9a76bf-2676-4110-bb31-d0ca63faf366 req-906b8582-0972-4b58-bb0c-a06152b1e615 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:21.897272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:21.908268 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb364502-5379-4430-959e-e112df6f0939 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.461187 Oct 28 13:11:21.910115 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7c9a76bf-2676-4110-bb31-d0ca63faf366 req-906b8582-0972-4b58-bb0c-a06152b1e615 service nova] Creating event network-vif-deleted:97183e28-9057-488a-94a3-3d41f272aedb for instance 7734075b-5bc5-43fb-b737-57e65a155610 on n-h1-862876-2 Oct 28 13:11:21.915895 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1134/2298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:21 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:21.937230 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7c9a76bf-2676-4110-bb31-d0ca63faf366 req-906b8582-0972-4b58-bb0c-a06152b1e615 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109898 Oct 28 13:11:21.937860 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1165/2299] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:21.978423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:21.980508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:21.989114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:21.994638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:21.994638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:21.994638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:21.994638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:21.994638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:22.172488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:22.183383 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec9dbdc5-c8db-475c-915b-09e915234759 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1473 microversion: 2.1 time: 0.210059 Oct 28 13:11:22.190801 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1135/2300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:21 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1473 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:22.509070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:22.510541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:22.528345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:22.535374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:22.536335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:22.543136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:22.547096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:22.548332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:22.967949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:22.977152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-982e5bed-7483-4d00-b338-6191b89450ad tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1283 microversion: 2.1 time: 0.472494 Oct 28 13:11:22.979859 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1166/2301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:22 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1283 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:22.991552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:22.991552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:23.001528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.004524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.005166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.009766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.013814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.014511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.097486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Action: 'update', calling method: .version_select at 0x7f27b93f4af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:23.101895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.102609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.103245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.112142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.112883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.113536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.121440 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] HTTP exception thrown: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Request method failure captured: Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee HTTP/1.1 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 56 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9T6omdyBQcfc0bR2ORHM6ajGsCvOI0Kx3PxQ9W-7u5WIZ9VKIwC8tLocPdkwqtgmZTOCQqCP0tYGO1XdUGGraH1vYcCWrMgCh-V5m5Kv1kkIYwUCquMkMXtV0_50KPKiweBi1zOlCNbrr3SK54dDF4F-XaJixS9l6lI_-mt1YvS1Nc Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 83945d00f77d49829584c86a1856a74d Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83945d00f77d49829584c86a1856a74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83945d00f77d49829584c86a1856a74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83945d00f77d49829584c86a1856a74d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83945d00f77d49829584c86a1856a74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 83945d00f77d49829584c86a1856a74d Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d5cd8eb9a0ef415196c96e787d5fa828 Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: exception: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:11:23.132652 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.137497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.139289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Returning 404 to user: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:23.146029 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3fec26f-921f-4d99-81ba-8f6c37f8085b tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee" status: 404 len: 110 microversion: 2.53 time: 0.458739 Oct 28 13:11:23.146946 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1136/2302] 10.222.0.25 () {62 vars in 1309 bytes} [Fri Oct 28 13:11:22 2022] PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee => generated 110 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:11:23.155009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Action: 'update', calling method: .version_select at 0x7f27bd9c4b80>, body: {"status": "disabled"} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:23.159947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.160801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.161440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.168050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.168750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.169533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.176552 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] HTTP exception thrown: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Request method failure captured: Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee HTTP/1.1 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 22 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9T6omdyBQcfc0bR2ORHM6ajGsCvOI0Kx3PxQ9W-7u5WIZ9VKIwC8tLocPdkwqtgmZTOCQqCP0tYGO1XdUGGraH1vYcCWrMgCh-V5m5Kv1kkIYwUCquMkMXtV0_50KPKiweBi1zOlCNbrr3SK54dDF4F-XaJixS9l6lI_-mt1YvS1Nc Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 83945d00f77d49829584c86a1856a74d Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83945d00f77d49829584c86a1856a74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83945d00f77d49829584c86a1856a74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83945d00f77d49829584c86a1856a74d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83945d00f77d49829584c86a1856a74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 83945d00f77d49829584c86a1856a74d Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d5cd8eb9a0ef415196c96e787d5fa828 Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: {"status": "disabled"} Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: exception: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee', 'body': {'status': 'disabled'}} Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:11:23.178622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Returning 404 to user: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-425678cf-f30c-4743-adb3-76a37947c270 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee" status: 404 len: 110 microversion: 2.53 time: 0.033129 Oct 28 13:11:23.192101 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1137/2303] 10.222.0.25 () {62 vars in 1309 bytes} [Fri Oct 28 13:11:23 2022] PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:11:23.209129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Action: 'update', calling method: .version_select at 0x7f27bd9c4550>, body: {"status": "enabled"} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:23.213293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.214014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.215217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.221865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.222641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.223334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.230595 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] HTTP exception thrown: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Request method failure captured: Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee HTTP/1.1 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 21 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9T6omdyBQcfc0bR2ORHM6ajGsCvOI0Kx3PxQ9W-7u5WIZ9VKIwC8tLocPdkwqtgmZTOCQqCP0tYGO1XdUGGraH1vYcCWrMgCh-V5m5Kv1kkIYwUCquMkMXtV0_50KPKiweBi1zOlCNbrr3SK54dDF4F-XaJixS9l6lI_-mt1YvS1Nc Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 83945d00f77d49829584c86a1856a74d Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83945d00f77d49829584c86a1856a74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/83945d00f77d49829584c86a1856a74d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_83945d00f77d49829584c86a1856a74d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/83945d00f77d49829584c86a1856a74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 83945d00f77d49829584c86a1856a74d Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d5cd8eb9a0ef415196c96e787d5fa828 Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: {"status": "enabled"} Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: exception: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee', 'body': {'status': 'enabled'}} Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:11:23.232789 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. Oct 28 13:11:23.237052 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:23.238530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Returning 404 to user: Service a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:23.239451 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-13300ded-068d-49ce-9152-d4cb2c8286b7 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee" status: 404 len: 110 microversion: 2.53 time: 0.041767 Oct 28 13:11:23.247331 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1138/2304] 10.222.0.25 () {62 vars in 1309 bytes} [Fri Oct 28 13:11:23 2022] PUT /compute/v2.1/os-services/a8abb8cf-edcb-41a3-b3e4-b5f74ebb10ee => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:11:23.253521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.254317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:23.262519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.263397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.264350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.270621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.270621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.270621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.319115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.319973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.327152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.327908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lazy-loading 'fault' on Instance uuid 7734075b-5bc5-43fb-b737-57e65a155610 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:23.354656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:23.367752 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1324ca83-7377-4e1d-a12a-ed824cf8eae5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1496 microversion: 2.1 time: 0.385592 Oct 28 13:11:23.368754 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1167/2305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:22 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1496 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:23.373707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.379327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.380300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.381046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.382588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.383345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.384058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.414610 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68828863-279c-40f5-9625-335b472123d3 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044457 Oct 28 13:11:23.426473 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1168/2306] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:23.431900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.436896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.437913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.439129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.440039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.440687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.441276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.474843 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-22da3f0c-24b1-4584-ab40-47aba286ea24 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.046534 Oct 28 13:11:23.482846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:23.485036 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1169/2307] 10.222.0.25 () {60 vars in 1211 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:23.490058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.492243 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f62ba84d-4cb9-47cd-9859-a69ad7fa9bff tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 200 len: 1308 microversion: 2.1 time: 0.243518 Oct 28 13:11:23.495254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.496096 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1139/2308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:23.496487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.496993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.497937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.498570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.499241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.530323 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a06b6bf-ef0f-4415-bb67-5fa8df9d4219 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043765 Oct 28 13:11:23.540232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1170/2309] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:23.545216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.551245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.551795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.559063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.559949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.560631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.561072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.617635 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e184580-325f-4370-a987-1a4ba20c159c tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-862876-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.076018 Oct 28 13:11:23.619142 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1140/2310] 10.222.0.25 () {60 vars in 1235 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/os-services?host=n-d-862876-2&binary=xxx => generated 16 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:23.633205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.636300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.638061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.638660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.639458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.640268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.640894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.691244 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8876e15-933b-40b7-90e2-4d3a04b5fb96 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063259 Oct 28 13:11:23.691942 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1171/2311] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:11:23.704277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.710863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.710863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.710863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.710863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:23.710863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:23.710863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:23.750084 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-603de0a1-8c0f-4a45-be8f-b024bc5d65d5 tempest-ServicesAdminNegativeV253TestJSON-965730026 tempest-ServicesAdminNegativeV253TestJSON-965730026-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.049473 Oct 28 13:11:23.751581 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1141/2312] 10.222.0.25 () {60 vars in 1239 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:23.984620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-433a9a57-3ee2-4461-844d-45dc4f067448 tempest-ServicesAdminNegativeV253TestJSON-1914668917 tempest-ServicesAdminNegativeV253TestJSON-1914668917-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:23.992301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-433a9a57-3ee2-4461-844d-45dc4f067448 tempest-ServicesAdminNegativeV253TestJSON-1914668917 tempest-ServicesAdminNegativeV253TestJSON-1914668917-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '225632016f2045e1a6cf72a7b924223e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c12600c625004faf964313841cdfa1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-433a9a57-3ee2-4461-844d-45dc4f067448 tempest-ServicesAdminNegativeV253TestJSON-1914668917 tempest-ServicesAdminNegativeV253TestJSON-1914668917-project] Request method failure captured: Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9T3SZTxivHqMRUpPF73vdM2uT_gjydhSc1S6c7LrwUsX15cXnOWEx4ZLvfpRn7rZGnszrv-QQRH8eNRpTVxOCfNkRUYIPcghVYjvVZi1TnvW3BpE2QXI6slS5ml-cxABBMu4clC44ZivndTl_vKZrB5eEVRtUtGauzDXH2d-89rt-4 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c12600c625004faf964313841cdfa1ee Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1914668917 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c12600c625004faf964313841cdfa1ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c12600c625004faf964313841cdfa1ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c12600c625004faf964313841cdfa1ee", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c12600c625004faf964313841cdfa1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1914668917 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c12600c625004faf964313841cdfa1ee Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1914668917 Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1914668917-project Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 225632016f2045e1a6cf72a7b924223e Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1914668917-project Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:11:23.996284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 13:11:24.000531 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.002272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-433a9a57-3ee2-4461-844d-45dc4f067448 tempest-ServicesAdminNegativeV253TestJSON-1914668917 tempest-ServicesAdminNegativeV253TestJSON-1914668917-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:24.002881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:24.003386 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-433a9a57-3ee2-4461-844d-45dc4f067448 tempest-ServicesAdminNegativeV253TestJSON-1914668917 tempest-ServicesAdminNegativeV253TestJSON-1914668917-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.243342 Oct 28 13:11:24.003706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:24.010947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.011568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.012005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.012715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.013175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.013601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.026056 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1172/2313] 10.222.0.25 () {60 vars in 1178 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 267 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:11:24.396314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:24.397341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:24.407707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.408445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.409055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.410079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.410762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.411397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.417943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:24.427625 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f533823b-8b60-4804-9285-3014feb51469 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.428213 Oct 28 13:11:24.445040 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1142/2314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:23 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:24.523320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:24.524186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 7734075b-5bc5-43fb-b737-57e65a155610] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:24.539255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.539771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.540211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.540943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.541398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.541826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.577157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] HTTP exception thrown: Instance 7734075b-5bc5-43fb-b737-57e65a155610 could not be found. Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Request method failure captured: Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 HTTP/1.1 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SqtcXKie5ib_MlbV-BbPb5VH5bi-Sv5tIii_s6xrrv6-Fcjp3qW-aAIjtT6JPQ2KsbaHbEQvPZyYorG31dJJogRrkwnGxDmhliyrNkzFcn_MxVvKjGk7gz1iX5_UAJIxbU71xMS6e6t1yunPIBzodYBNySUPfE9ao7HFrRalh01t4 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 52536665a18b4117a13fdecef7e39748 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52536665a18b4117a13fdecef7e39748"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52536665a18b4117a13fdecef7e39748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52536665a18b4117a13fdecef7e39748", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52536665a18b4117a13fdecef7e39748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 52536665a18b4117a13fdecef7e39748 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ListServerFiltersTestJSON-304550189-project Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e82fcb731fff4e84b6259a686b170d72 Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ListServerFiltersTestJSON-304550189-project Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7734075b-5bc5-43fb-b737-57e65a155610 could not be found. Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7734075b-5bc5-43fb-b737-57e65a155610'} Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7734075b-5bc5-43fb-b737-57e65a155610 could not be found. Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7734075b-5bc5-43fb-b737-57e65a155610 could not be found. Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:24.579406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7734075b-5bc5-43fb-b737-57e65a155610 could not be found. Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Returning 404 to user: Instance 7734075b-5bc5-43fb-b737-57e65a155610 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:24.584705 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49f9f39a-aa5a-4a7b-8dd3-8d5ad8628832 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610" status: 404 len: 111 microversion: 2.1 time: 0.062148 Oct 28 13:11:24.595735 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1143/2315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:24 2022] GET /compute/v2.1/servers/7734075b-5bc5-43fb-b737-57e65a155610 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:11:24.600940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:24.601432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:24.619418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.619974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.620429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.626281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.626281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.626281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.684463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:11:24.749877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:24.764705 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73089bfc-719e-44c3-b6ed-c93f1e2376cb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 200 len: 1473 microversion: 2.1 time: 0.372455 Oct 28 13:11:24.767980 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1173/2316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:24 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 1473 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:24.804213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1235708042"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:24.807064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:24.816041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.818493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.820976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:24.821991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:24.823029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:24.823663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:25.119992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31deb01e-1f55-4b68-a9c3-611f236f13b8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 204 len: 0 microversion: 2.1 time: 0.519789 Oct 28 13:11:25.124479 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1144/2317] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:11:24 2022] DELETE /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:11:25.134076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:25.137886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:25.151786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:25.162761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:25.166059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:25.167364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:25.170387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:25.175047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:25.434981 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc503833-d735-4389-9847-8000a2decb1d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517/action" status: 202 len: 0 microversion: 2.1 time: 0.643782 Oct 28 13:11:25.445562 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1174/2318] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:11:24 2022] POST /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:11:25.463428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b71597f0-3c52-4ec2-aa68-c9287ef82e33 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b94a4790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:25.592730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b71597f0-3c52-4ec2-aa68-c9287ef82e33 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.142930 Oct 28 13:11:25.593536 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1175/2319] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:25 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:25.619164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:25.620214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:25.637790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:25.638565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:25.639195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:25.640062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:25.644952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:25.645665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:25.992279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:26.096624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:26.112927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ea18fa3-3325-44c2-8185-39ead9988b11 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 200 len: 1517 microversion: 2.1 time: 0.982784 Oct 28 13:11:26.116526 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1145/2320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:25 2022] GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 1517 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:26.122422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d409572a-492e-4a40-92ef-08caed032d33 req-c22be97a-0eb0-4a08-b57c-f1aefc9c043a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfba971-195e-404b-85c8-c31f91f43677", "tag": "321aa4b4-fb02-42fa-ae34-2ff867164988"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:26.148714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d409572a-492e-4a40-92ef-08caed032d33 req-c22be97a-0eb0-4a08-b57c-f1aefc9c043a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:26.149200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d409572a-492e-4a40-92ef-08caed032d33 req-c22be97a-0eb0-4a08-b57c-f1aefc9c043a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:26.152425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d409572a-492e-4a40-92ef-08caed032d33 req-c22be97a-0eb0-4a08-b57c-f1aefc9c043a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:26.160210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:26.188873 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-570238df-5955-4c57-96cb-3fe4fb709aba tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.567881 Oct 28 13:11:26.188873 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1176/2321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:25 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:26.189040 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d409572a-492e-4a40-92ef-08caed032d33 req-c22be97a-0eb0-4a08-b57c-f1aefc9c043a service nova] Creating event network-changed:321aa4b4-fb02-42fa-ae34-2ff867164988 for instance 6dfba971-195e-404b-85c8-c31f91f43677 on n-h1-862876-2 Oct 28 13:11:26.189040 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d409572a-492e-4a40-92ef-08caed032d33 req-c22be97a-0eb0-4a08-b57c-f1aefc9c043a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069057 Oct 28 13:11:26.189234 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1146/2322] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:26.613366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da64f5b7-25ac-4019-9cae-8b6f0c5a74e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9695790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:26.712873 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da64f5b7-25ac-4019-9cae-8b6f0c5a74e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.106888 Oct 28 13:11:26.714072 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1177/2323] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:26 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:27.141412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:27.143311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:27.165417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:27.165417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:27.165417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:27.165417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:27.168498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:27.169174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:27.203258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:27.208702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:27.216633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:27.220410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:27.221595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:27.223674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:27.224784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:27.229880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:27.230076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:27.525343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:27.555654 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca1581d7-ecea-4736-b110-951a49672de0 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 200 len: 1517 microversion: 2.1 time: 0.421994 Oct 28 13:11:27.557472 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1147/2324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:27 2022] GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 1517 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:27.586362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:27.597887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-34c729c3-8645-4649-9c58-d42c4137a580 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.397610 Oct 28 13:11:27.619079 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1178/2325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:27 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:27.729644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-053b7e70-983f-43ae-9ce6-31f49f70ba71 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bdb05940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:27.838047 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-053b7e70-983f-43ae-9ce6-31f49f70ba71 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.112492 Oct 28 13:11:27.838652 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1148/2326] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:27 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:28.244179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-23b172c1-635c-416b-b72a-b3eeabb25b45 req-fd6d59fc-4138-4385-a2f2-d18a67f29b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b896e9-2972-4486-903e-01ca7c62aa34", "name": "network-vif-deleted", "tag": "9c6ddce2-47c8-43a9-8ef1-2270420ae4ad"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:28.283828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-23b172c1-635c-416b-b72a-b3eeabb25b45 req-fd6d59fc-4138-4385-a2f2-d18a67f29b3e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:28.284345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-23b172c1-635c-416b-b72a-b3eeabb25b45 req-fd6d59fc-4138-4385-a2f2-d18a67f29b3e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:28.285626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-23b172c1-635c-416b-b72a-b3eeabb25b45 req-fd6d59fc-4138-4385-a2f2-d18a67f29b3e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:28.318509 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-23b172c1-635c-416b-b72a-b3eeabb25b45 req-fd6d59fc-4138-4385-a2f2-d18a67f29b3e service nova] Creating event network-vif-deleted:9c6ddce2-47c8-43a9-8ef1-2270420ae4ad for instance b0b896e9-2972-4486-903e-01ca7c62aa34 on n-h2-862876-2 Oct 28 13:11:28.333672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-23b172c1-635c-416b-b72a-b3eeabb25b45 req-fd6d59fc-4138-4385-a2f2-d18a67f29b3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093997 Oct 28 13:11:28.336248 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1179/2327] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:28.585125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:28.585820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:28.597444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:28.597988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:28.598656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:28.599438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:28.600186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:28.600697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:28.622374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:28.623164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:28.631676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:28.635280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:28.638556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:28.639557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:28.640007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:28.640677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:28.641356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:28.641665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:28.642183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lazy-loading 'fault' on Instance uuid b0b896e9-2972-4486-903e-01ca7c62aa34 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:28.642309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:28.692614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:28.701614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32cfea1b-dcc9-4e54-bc5b-e83309a1048e tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 200 len: 1310 microversion: 2.1 time: 0.123954 Oct 28 13:11:28.706058 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1149/2328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:28 2022] GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 1310 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:28.870663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c039ceb2-560b-4397-a1d0-ad7d66bf0bd1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bdb05790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:28.906918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:28.920849 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9be5e270-0ddb-40b2-b6d4-84fe7c58ed36 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.300602 Oct 28 13:11:28.920849 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1180/2329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:28 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:29.050517 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c039ceb2-560b-4397-a1d0-ad7d66bf0bd1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.198587 Oct 28 13:11:29.060782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1150/2330] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:28 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:29.725714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:29.726974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: b0b896e9-2972-4486-903e-01ca7c62aa34] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:29.740899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:29.741704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:29.743507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:29.752405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:29.752405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:29.752405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:29.825750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:29.829771 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] HTTP exception thrown: Instance b0b896e9-2972-4486-903e-01ca7c62aa34 could not be found. Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Request method failure captured: Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 HTTP/1.1 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SqtcXKie5ib_MlbV-BbPb5VH5bi-Sv5tIii_s6xrrv6-Fcjp3qW-aAIjtT6JPQ2KsbaHbEQvPZyYorG31dJJogRrkwnGxDmhliyrNkzFcn_MxVvKjGk7gz1iX5_UAJIxbU71xMS6e6t1yunPIBzodYBNySUPfE9ao7HFrRalh01t4 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 52536665a18b4117a13fdecef7e39748 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52536665a18b4117a13fdecef7e39748"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52536665a18b4117a13fdecef7e39748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52536665a18b4117a13fdecef7e39748", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52536665a18b4117a13fdecef7e39748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 52536665a18b4117a13fdecef7e39748 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListServerFiltersTestJSON-304550189-project Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e82fcb731fff4e84b6259a686b170d72 Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListServerFiltersTestJSON-304550189-project Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b0b896e9-2972-4486-903e-01ca7c62aa34 could not be found. Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b0b896e9-2972-4486-903e-01ca7c62aa34'} Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b896e9-2972-4486-903e-01ca7c62aa34 could not be found. Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b896e9-2972-4486-903e-01ca7c62aa34 could not be found. Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:29.831505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b896e9-2972-4486-903e-01ca7c62aa34 could not be found. Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Returning 404 to user: Instance b0b896e9-2972-4486-903e-01ca7c62aa34 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a5a116c-a2a4-442f-a83d-12773e9586bc tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34" status: 404 len: 111 microversion: 2.1 time: 0.111305 Oct 28 13:11:29.838881 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1181/2331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:29 2022] GET /compute/v2.1/servers/b0b896e9-2972-4486-903e-01ca7c62aa34 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:11:29.842891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:29.843383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:29.859056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:29.875483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:29.876502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:29.878076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:29.878076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:29.878287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:29.944305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:29.944909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:29.957339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:29.958559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:29.961883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:29.965542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:29.967310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:29.970200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:29.974996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:11:29.985580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:30.398174 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07c5e85c-0fd2-4a10-9071-f4ee9c8a43ca tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 204 len: 0 microversion: 2.1 time: 0.559922 Oct 28 13:11:30.399298 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1151/2332] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:11:29 2022] DELETE /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:11:30.405499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-554dd1fa-23dd-46bd-a1a0-9991f8832e74 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93ec310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:30.458391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:30.477312 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cd192d1c-a875-469e-b1aa-9b73d7b267b5 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.536761 Oct 28 13:11:30.484190 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1182/2333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:29 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:30.504990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:30.509629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:30.534448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:30.539615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:30.540329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:30.541286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:30.543358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:30.546943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:30.950130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:30.968139 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d35c4b57-bf1c-4d95-83d9-ab59a6da9a22 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1518 microversion: 2.1 time: 0.480800 Oct 28 13:11:30.968758 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1183/2334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:30 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1518 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:31.512369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:31.513677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:31.529108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:31.554896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:31.559776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:31.563038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:31.564237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:31.566259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:32.264422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:32.274465 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78dbc78a-03be-47f2-8069-17a531c6f773 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.766986 Oct 28 13:11:32.281927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1184/2335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:31 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:32.299688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:32.300547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:32.326295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:32.326821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:32.327264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:32.327968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:32.335858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:32.340882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:33.062774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:33.083744 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ae56798-1dd4-4387-a435-cb0d0225bbc8 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1518 microversion: 2.1 time: 0.793814 Oct 28 13:11:33.084925 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1185/2336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:32 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1518 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:33.268024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5b2fe6e6-6d8f-4bf9-836d-6c9eb6c477a6 req-d10e1aa4-262a-4a2e-a7ac-e1e8847d82b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d7297-bb28-443a-b7fe-c8c4d0c3e517", "name": "network-vif-plugged", "status": "completed", "tag": "35017ab1-39a8-4290-b61f-bed07e59cd63"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:33.289216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5b2fe6e6-6d8f-4bf9-836d-6c9eb6c477a6 req-d10e1aa4-262a-4a2e-a7ac-e1e8847d82b2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:33.291493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5b2fe6e6-6d8f-4bf9-836d-6c9eb6c477a6 req-d10e1aa4-262a-4a2e-a7ac-e1e8847d82b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:33.293922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5b2fe6e6-6d8f-4bf9-836d-6c9eb6c477a6 req-d10e1aa4-262a-4a2e-a7ac-e1e8847d82b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:33.320427 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5b2fe6e6-6d8f-4bf9-836d-6c9eb6c477a6 req-d10e1aa4-262a-4a2e-a7ac-e1e8847d82b2 service nova] Creating event network-vif-plugged:35017ab1-39a8-4290-b61f-bed07e59cd63 for instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 on n-h1-862876-2 Oct 28 13:11:33.334118 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5b2fe6e6-6d8f-4bf9-836d-6c9eb6c477a6 req-d10e1aa4-262a-4a2e-a7ac-e1e8847d82b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070071 Oct 28 13:11:33.335389 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1186/2337] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:11:33.349288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:33.352019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:33.365771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:33.368292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:33.368937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:33.371026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:33.371707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:33.372942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:33.656250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=22 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:33.732858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=24 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:33.802666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:33.818617 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8938df78-cb75-4578-a209-a54b74be3330 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.475317 Oct 28 13:11:33.825591 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1187/2338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:33 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:34.111860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:34.112857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:34.119846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:34.120660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:34.125084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:34.125084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:34.125084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:34.125084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:34.971213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:34.987237 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b616409-a8c5-4087-8c9a-f7db3437f5e9 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1518 microversion: 2.1 time: 0.879566 Oct 28 13:11:34.989936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1188/2339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:34 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1518 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:35.003561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:35.005335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:35.026272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:35.030404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:35.032704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:35.036829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:35.036829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:35.036829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:35.616443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:35.632021 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db02faac-643b-4e87-9bb1-d842437fb417 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.639471 Oct 28 13:11:35.632681 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1189/2340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:34 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:35.644696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b1c7857a-d9fe-4f87-bc08-d7b2a12cd118 req-e954f8ee-4571-4b8a-9263-39f0086acaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cafde05-1d32-4513-afdf-c07cb41999cb", "name": "network-vif-deleted", "tag": "20295591-dab2-49ae-aa38-d95add1f7a58"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:35.670779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b1c7857a-d9fe-4f87-bc08-d7b2a12cd118 req-e954f8ee-4571-4b8a-9263-39f0086acaab service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:35.671434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b1c7857a-d9fe-4f87-bc08-d7b2a12cd118 req-e954f8ee-4571-4b8a-9263-39f0086acaab service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:35.672018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b1c7857a-d9fe-4f87-bc08-d7b2a12cd118 req-e954f8ee-4571-4b8a-9263-39f0086acaab service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:35.696615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b1c7857a-d9fe-4f87-bc08-d7b2a12cd118 req-e954f8ee-4571-4b8a-9263-39f0086acaab service nova] Creating event network-vif-deleted:20295591-dab2-49ae-aa38-d95add1f7a58 for instance 2cafde05-1d32-4513-afdf-c07cb41999cb on n-h1-862876-2 Oct 28 13:11:35.710466 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b1c7857a-d9fe-4f87-bc08-d7b2a12cd118 req-e954f8ee-4571-4b8a-9263-39f0086acaab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074310 Oct 28 13:11:35.711443 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1190/2341] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:35.716866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d1dca327-8176-4e9d-81d5-34a1a008da67 req-4c3c89b2-ffa0-4c4b-977f-b8e3d264f36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfba971-195e-404b-85c8-c31f91f43677", "name": "network-vif-plugged", "status": "completed", "tag": "321aa4b4-fb02-42fa-ae34-2ff867164988"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:35.762404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d1dca327-8176-4e9d-81d5-34a1a008da67 req-4c3c89b2-ffa0-4c4b-977f-b8e3d264f36c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:35.763208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d1dca327-8176-4e9d-81d5-34a1a008da67 req-4c3c89b2-ffa0-4c4b-977f-b8e3d264f36c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:35.763790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d1dca327-8176-4e9d-81d5-34a1a008da67 req-4c3c89b2-ffa0-4c4b-977f-b8e3d264f36c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:35.800468 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d1dca327-8176-4e9d-81d5-34a1a008da67 req-4c3c89b2-ffa0-4c4b-977f-b8e3d264f36c service nova] Creating event network-vif-plugged:321aa4b4-fb02-42fa-ae34-2ff867164988 for instance 6dfba971-195e-404b-85c8-c31f91f43677 on n-h1-862876-2 Oct 28 13:11:35.809735 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d1dca327-8176-4e9d-81d5-34a1a008da67 req-4c3c89b2-ffa0-4c4b-977f-b8e3d264f36c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096709 Oct 28 13:11:35.823607 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1191/2342] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:36.014288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:36.015766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:36.029812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:36.030685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:36.031424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:36.032381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:36.033785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:36.035629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:36.132217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:36.132991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:36.135574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:36.136320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lazy-loading 'fault' on Instance uuid 2cafde05-1d32-4513-afdf-c07cb41999cb {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:36.230834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:36.245635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0b3f0fd-347a-43b2-9172-cdc908221e5f tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1310 microversion: 2.1 time: 0.236471 Oct 28 13:11:36.254691 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1192/2343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:36 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1310 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:36.665041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:36.665717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:36.685542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:36.686072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:36.686518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:36.696060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:36.696588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:36.697038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:36.977130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:36.986664 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d31705b-7921-4c68-a8a9-4f12d5d6ed7a tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1325 microversion: 2.1 time: 0.328941 Oct 28 13:11:36.990584 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1193/2344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:36 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:37.277624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:37.278254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:37.287877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:37.288381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:37.288839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:37.289574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:37.290035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:37.290463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:37.436159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:37.436976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:37.439457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:37.445479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lazy-loading 'fault' on Instance uuid 2cafde05-1d32-4513-afdf-c07cb41999cb {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:37.606273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e82fcb731fff4e84b6259a686b170d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52536665a18b4117a13fdecef7e39748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:37.616055 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-714ed89e-0257-48f3-9c8c-eb2288780307 tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 200 len: 1310 microversion: 2.1 time: 0.342378 Oct 28 13:11:37.640461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1194/2345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:37 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 1310 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:38.013735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:38.014527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:38.027764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:38.029828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:38.034226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:38.035236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:38.036463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:38.038477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:38.520706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:38.534143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9f74d6ff-30b4-4611-b7d7-6a8a818f8c0e tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1521 microversion: 2.1 time: 0.523273 Oct 28 13:11:38.535542 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1195/2346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:38 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:38.565847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:38.566549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:38.599934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:38.602156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:38.604703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:38.606657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:38.607982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:38.614533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:38.860354 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] HTTP exception thrown: Action 999 not found Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Request method failure captured: Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677/os-instance-actions/999 HTTP/1.1 Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9TwjAeJiZAluZ_7hZ62-lKNHVhQc93wuYZ3kaYqzy-t9K1Bi29vT8NwylPNkzkAXud67DNYEITlW6E5MquO-uneITNHUbhlyHN1S-umlTNUzLaDYMNhXmDjPUnLuy76K2z5s3lts4kUgHGh4S6fwhr2F9uPUa7LwUml8HlilIRC1TE Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 15553ca6de9d413d9edce8ec5eafa99a Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_15553ca6de9d413d9edce8ec5eafa99a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 15553ca6de9d413d9edce8ec5eafa99a Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-InstanceActionsNegativeTestJSON-2084485263-project Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 832724d040b64a0c9ff91601aa5ae95a Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2084485263-project Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: exception: Action 999 not found Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'server_id': '6dfba971-195e-404b-85c8-c31f91f43677', 'id': '999'} Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 28 13:11:38.874182 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.879442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Returning 404 to user: Action 999 not found {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:38.881860 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-259f6447-c635-436a-8d12-7c58a598a6fa tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.320968 Oct 28 13:11:38.889038 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1196/2347] 10.222.0.25 () {58 vars in 1308 bytes} [Fri Oct 28 13:11:38 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677/os-instance-actions/999 => generated 66 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:11:38.905608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:38.907754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] [instance: 2cafde05-1d32-4513-afdf-c07cb41999cb] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:38.926489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:38.930389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:38.930893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:38.933968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:38.934600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:38.938543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:38.979599 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] HTTP exception thrown: Instance 2cafde05-1d32-4513-afdf-c07cb41999cb could not be found. Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Request method failure captured: Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb HTTP/1.1 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SqtcXKie5ib_MlbV-BbPb5VH5bi-Sv5tIii_s6xrrv6-Fcjp3qW-aAIjtT6JPQ2KsbaHbEQvPZyYorG31dJJogRrkwnGxDmhliyrNkzFcn_MxVvKjGk7gz1iX5_UAJIxbU71xMS6e6t1yunPIBzodYBNySUPfE9ao7HFrRalh01t4 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 52536665a18b4117a13fdecef7e39748 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52536665a18b4117a13fdecef7e39748"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52536665a18b4117a13fdecef7e39748"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52536665a18b4117a13fdecef7e39748", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52536665a18b4117a13fdecef7e39748"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 52536665a18b4117a13fdecef7e39748 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-304550189 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListServerFiltersTestJSON-304550189-project Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e82fcb731fff4e84b6259a686b170d72 Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListServerFiltersTestJSON-304550189-project Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 2cafde05-1d32-4513-afdf-c07cb41999cb could not be found. Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '2cafde05-1d32-4513-afdf-c07cb41999cb'} Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cafde05-1d32-4513-afdf-c07cb41999cb could not be found. Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cafde05-1d32-4513-afdf-c07cb41999cb could not be found. Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:38.981911 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.986085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:38.986085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:38.986085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:38.986085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:38.986085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:38.986085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cafde05-1d32-4513-afdf-c07cb41999cb could not be found. Oct 28 13:11:38.986085 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:38.991399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] Returning 404 to user: Instance 2cafde05-1d32-4513-afdf-c07cb41999cb could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:38.994270 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd50108a-efca-4796-8882-c52f0b1bb86d tempest-ListServerFiltersTestJSON-304550189 tempest-ListServerFiltersTestJSON-304550189-project] 10.222.0.25 "GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb" status: 404 len: 111 microversion: 2.1 time: 0.102565 Oct 28 13:11:39.001013 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1197/2348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:38 2022] GET /compute/v2.1/servers/2cafde05-1d32-4513-afdf-c07cb41999cb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:11:39.006815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d50c64e-98a3-4734-af3e-245b2f7e333b tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '.version_select at 0x7f27bd8e9550>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:39.007630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d50c64e-98a3-4734-af3e-245b2f7e333b tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:39.044240 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-2d50c64e-98a3-4734-af3e-245b2f7e333b tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] HTTP exception thrown: Instance 98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa could not be found. Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d50c64e-98a3-4734-af3e-245b2f7e333b tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Request method failure captured: Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa/os-instance-actions HTTP/1.1 Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9TwjAeJiZAluZ_7hZ62-lKNHVhQc93wuYZ3kaYqzy-t9K1Bi29vT8NwylPNkzkAXud67DNYEITlW6E5MquO-uneITNHUbhlyHN1S-umlTNUzLaDYMNhXmDjPUnLuy76K2z5s3lts4kUgHGh4S6fwhr2F9uPUa7LwUml8HlilIRC1TE Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 15553ca6de9d413d9edce8ec5eafa99a Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_15553ca6de9d413d9edce8ec5eafa99a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 15553ca6de9d413d9edce8ec5eafa99a Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-InstanceActionsNegativeTestJSON-2084485263-project Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 832724d040b64a0c9ff91601aa5ae95a Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2084485263-project Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa could not be found. Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'server_id': '98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa'} Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa could not be found. Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:39.054346 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa could not be found. Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa could not be found. Oct 28 13:11:39.059827 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:11:39.064167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d50c64e-98a3-4734-af3e-245b2f7e333b tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Returning 404 to user: Instance 98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:39.065596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d50c64e-98a3-4734-af3e-245b2f7e333b tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.062968 Oct 28 13:11:39.070169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1198/2349] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Oct 28 13:11:39 2022] GET /compute/v2.1/servers/98e4dfc0-d66b-478e-83d9-7cb9fa3fd4aa/os-instance-actions => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:11:39.085487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:39.087215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:39.121180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:39.121180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:39.121180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:39.121180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:39.134560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:39.135125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:39.217088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:11:39.510812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:39.780584 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-919a2489-dc5b-42fa-9746-436c768f9312 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 204 len: 0 microversion: 2.1 time: 0.698811 Oct 28 13:11:39.784547 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1199/2350] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:11:39 2022] DELETE /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:11:40.275530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:40.315190 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-554dd1fa-23dd-46bd-a1a0-9991f8832e74 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 9.905849 Oct 28 13:11:40.315190 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1152/2351] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:30 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 9907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:40.319436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-248083888", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:40.330994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:40.336443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:40.356732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:40.362461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:40.365159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:40.366441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:40.366973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:40.372288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:40.399455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:40.474997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] validate_networks() for [('15097bcb-93dc-4045-8562-028bd560b398', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:11:40.897746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:40.907688 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1a75411-37a9-4e79-9a48-d23d39ee8ca8 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1527 microversion: 2.1 time: 0.596574 Oct 28 13:11:40.908281 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1153/2352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:40 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1527 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:40.931555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:40.938798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:40.960782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:40.966100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:40.968238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:40.970665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:40.971355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:40.972572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:41.245622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:41.274173 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-64983574-a19f-4241-88f4-8e7feb64035e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.346497 Oct 28 13:11:41.274173 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1154/2353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:40 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:41.288876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1802851874"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:41.291628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:41.305465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:41.307460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:41.307930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:41.313881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:41.315345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:41.318640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:41.928226 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-10ba66a9-f4e4-49d4-8ea0-e7046be64515 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.644459 Oct 28 13:11:41.933389 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1155/2354] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:11:41 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 28 13:11:41.946593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-922a7035-f63e-441c-997f-a585a8ad82ed tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bdade550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:42.038155 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-922a7035-f63e-441c-997f-a585a8ad82ed tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.100540 Oct 28 13:11:42.042218 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1156/2355] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:41 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:42.079921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:42.080863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:42.094956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:42.095468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:42.096007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:42.097156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:42.097625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:42.098064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:42.211227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:11:42.212246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:11:42.212953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:11:42.213704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:11:42.214266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:11:42.244283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:42.245037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:42.245643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:42.251908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:42.252637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:42.253232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:42.306415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Getting quotas for project 49f2a1ab0afa467e9b9c6ec8cf78614c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:11:42.320400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Getting quotas for user 369a322f683e4c669d99eb762b7137ec and project 49f2a1ab0afa467e9b9c6ec8cf78614c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:11:42.352426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:42.363438 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-106d1974-b964-4e10-8aec-6b3a811e35cf tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1485 microversion: 2.1 time: 0.319629 Oct 28 13:11:42.372433 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1157/2356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:42 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1485 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:42.374149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:11:42.377179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:11:42.539416 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6235686d-13a4-45a9-b1d4-85741ca67e3b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.755603 Oct 28 13:11:42.549829 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1200/2357] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:11:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:11:42.554516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aa5ddcf2-9d33-4d0e-81eb-90ec8dab2a98 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:42.555199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aa5ddcf2-9d33-4d0e-81eb-90ec8dab2a98 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:42.704375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aa5ddcf2-9d33-4d0e-81eb-90ec8dab2a98 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:42.723546 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aa5ddcf2-9d33-4d0e-81eb-90ec8dab2a98 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1216 microversion: 2.1 time: 0.171807 Oct 28 13:11:42.743336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1158/2358] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:42 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:42.798126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2f82aeb5-a0b5-4113-a809-05120f2ab6c7 req-f8d07ce4-59a1-449d-925d-5017328db986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfba971-195e-404b-85c8-c31f91f43677", "name": "network-vif-deleted", "tag": "321aa4b4-fb02-42fa-ae34-2ff867164988"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:42.826485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2f82aeb5-a0b5-4113-a809-05120f2ab6c7 req-f8d07ce4-59a1-449d-925d-5017328db986 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:42.829268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2f82aeb5-a0b5-4113-a809-05120f2ab6c7 req-f8d07ce4-59a1-449d-925d-5017328db986 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:42.829268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2f82aeb5-a0b5-4113-a809-05120f2ab6c7 req-f8d07ce4-59a1-449d-925d-5017328db986 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:42.873565 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2f82aeb5-a0b5-4113-a809-05120f2ab6c7 req-f8d07ce4-59a1-449d-925d-5017328db986 service nova] Creating event network-vif-deleted:321aa4b4-fb02-42fa-ae34-2ff867164988 for instance 6dfba971-195e-404b-85c8-c31f91f43677 on n-h1-862876-2 Oct 28 13:11:42.894709 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2f82aeb5-a0b5-4113-a809-05120f2ab6c7 req-f8d07ce4-59a1-449d-925d-5017328db986 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102295 Oct 28 13:11:42.899541 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1201/2359] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:43.054776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8743789a-a338-4c13-8f89-77026f54bb83 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93a5790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:43.138479 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8743789a-a338-4c13-8f89-77026f54bb83 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.088052 Oct 28 13:11:43.143152 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1159/2360] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:43 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:43.401465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:43.403437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:43.422838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:43.427810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:43.428489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:43.432071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:43.433289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:43.434995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:43.579044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:43.580017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:43.580743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:43.581371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lazy-loading 'fault' on Instance uuid 6dfba971-195e-404b-85c8-c31f91f43677 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:11:43.752184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-326dd18b-4851-49ef-8404-7cf960769d17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:43.752712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-326dd18b-4851-49ef-8404-7cf960769d17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:43.831587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832724d040b64a0c9ff91601aa5ae95a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15553ca6de9d413d9edce8ec5eafa99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:43.850011 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f521850c-8841-4c12-99fe-fb88bee90b39 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 200 len: 1315 microversion: 2.1 time: 0.455543 Oct 28 13:11:43.864131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-326dd18b-4851-49ef-8404-7cf960769d17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:43.865414 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1202/2361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:43 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:43.871413 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-326dd18b-4851-49ef-8404-7cf960769d17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1216 microversion: 2.1 time: 0.124886 Oct 28 13:11:43.887580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1160/2362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:43 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:44.159133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cfabc46d-2b2c-4e7b-9b1d-db67a88a8bb0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bda69820>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:44.252602 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cfabc46d-2b2c-4e7b-9b1d-db67a88a8bb0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.098156 Oct 28 13:11:44.257059 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1203/2363] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:44 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:44.899643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:44.900319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:44.901126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:44.902665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] [instance: 6dfba971-195e-404b-85c8-c31f91f43677] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:44.925602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:44.931454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:44.933755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:44.934263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:44.934726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:44.935471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:44.935933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:44.936121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:44.936364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:44.936875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:44.941273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:44.945068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:45.009460 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] HTTP exception thrown: Instance 6dfba971-195e-404b-85c8-c31f91f43677 could not be found. Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Request method failure captured: Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 HTTP/1.1 Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TwjAeJiZAluZ_7hZ62-lKNHVhQc93wuYZ3kaYqzy-t9K1Bi29vT8NwylPNkzkAXud67DNYEITlW6E5MquO-uneITNHUbhlyHN1S-umlTNUzLaDYMNhXmDjPUnLuy76K2z5s3lts4kUgHGh4S6fwhr2F9uPUa7LwUml8HlilIRC1TE Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 15553ca6de9d413d9edce8ec5eafa99a Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_15553ca6de9d413d9edce8ec5eafa99a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/15553ca6de9d413d9edce8ec5eafa99a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 15553ca6de9d413d9edce8ec5eafa99a Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2084485263 Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-InstanceActionsNegativeTestJSON-2084485263-project Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 832724d040b64a0c9ff91601aa5ae95a Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2084485263-project Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6dfba971-195e-404b-85c8-c31f91f43677 could not be found. Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6dfba971-195e-404b-85c8-c31f91f43677'} Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dfba971-195e-404b-85c8-c31f91f43677 could not be found. Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dfba971-195e-404b-85c8-c31f91f43677 could not be found. Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:45.021655 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dfba971-195e-404b-85c8-c31f91f43677 could not be found. Oct 28 13:11:45.025767 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:11:45.027587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] Returning 404 to user: Instance 6dfba971-195e-404b-85c8-c31f91f43677 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:11:45.028593 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f074477c-3247-4ac1-8b06-344bf19ab247 tempest-InstanceActionsNegativeTestJSON-2084485263 tempest-InstanceActionsNegativeTestJSON-2084485263-project] 10.222.0.25 "GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677" status: 404 len: 111 microversion: 2.1 time: 0.144005 Oct 28 13:11:45.035229 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1161/2364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:44 2022] GET /compute/v2.1/servers/6dfba971-195e-404b-85c8-c31f91f43677 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:11:45.228675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:45.258483 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-485e5aa7-b4f0-4efb-b8c2-4f6b868e833c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1220 microversion: 2.1 time: 0.359249 Oct 28 13:11:45.269683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ddbf311c-a847-4b49-a095-845eb14f0f59 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93d4820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:45.277096 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1204/2365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:44 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1220 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:45.378006 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ddbf311c-a847-4b49-a095-845eb14f0f59 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.111556 Oct 28 13:11:45.378616 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1162/2366] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:45 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:46.288013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:46.289325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:46.332570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:46.333471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:46.338297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:46.341438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:46.343254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:46.347710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:46.407842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5fc86024-f78c-4582-b4ed-aa1d1dd576d3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93f44c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:46.800129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:46.814495 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c7c9695-6db1-434d-bf55-b763728c287d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1276 microversion: 2.1 time: 0.532688 Oct 28 13:11:46.835182 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1205/2367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:46 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:46.989651 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5fc86024-f78c-4582-b4ed-aa1d1dd576d3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1412 microversion: 2.1 time: 0.599878 Oct 28 13:11:46.990343 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1163/2368] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:46 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1412 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:47.848994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:47.851196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:47.882653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:47.894429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:47.895186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:47.900919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:47.901486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:47.904722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:48.011164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-73aeb2aa-0ba7-4999-b176-7d94bbf41dc4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93a49d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:48.695072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:48.707944 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6616cbca-3ee9-4b4d-8f36-ecc6cb39711a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1274 microversion: 2.1 time: 0.868612 Oct 28 13:11:48.715588 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1206/2369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:47 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1274 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:48.726938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:48.727828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:48.748867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:48.759506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:48.760925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:48.762257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:48.765742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:48.767233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:48.864514 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-151c8b1a-9682-441d-9707-b82007f4f60f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/ips" status: 200 len: 151 microversion: 2.1 time: 0.144783 Oct 28 13:11:48.866041 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1207/2370] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:11:48 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/ips => generated 151 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:49.744011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:49.745926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:49.763645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:49.764526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:49.769705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:49.771406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:49.772180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:49.772849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:50.288352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:50.300777 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b81a5770-54d4-4e68-92dc-5eb9fda4b7ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1274 microversion: 2.1 time: 0.565022 Oct 28 13:11:50.308143 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1208/2371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:49 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1274 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:51.327937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:51.327937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:51.355304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:51.355805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:51.363534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:51.370630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:51.371170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:51.376254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:52.353756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:52.353756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:53.851135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:53.866019 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7aa1349-2b2b-4b1a-825f-bf9059a41d3d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 2.544324 Oct 28 13:11:53.866883 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1209/2372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:51 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:53.868946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:54.170646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b9277e9-fc1a-4808-959c-977c1a054fc6"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:54.181339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:54.203884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:54.204586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:54.212892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:54.213782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:54.221569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:54.222130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:54.910829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=18 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:55.009337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:11:55.444111 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81432b1a-a20d-4cab-9e1e-19e0e4790c22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.278346 Oct 28 13:11:55.445889 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1210/2373] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:11:54 2022] POST /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 194 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:55.477907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-19ee1e2e-5b2d-4c93-9443-fe459a8b310a req-46913d3f-ea8f-40fb-9c82-7fbe9dbe7785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "name": "network-vif-plugged", "status": "completed", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:55.523652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-19ee1e2e-5b2d-4c93-9443-fe459a8b310a req-46913d3f-ea8f-40fb-9c82-7fbe9dbe7785 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:55.530364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-19ee1e2e-5b2d-4c93-9443-fe459a8b310a req-46913d3f-ea8f-40fb-9c82-7fbe9dbe7785 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:55.534492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-19ee1e2e-5b2d-4c93-9443-fe459a8b310a req-46913d3f-ea8f-40fb-9c82-7fbe9dbe7785 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:55.678205 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-19ee1e2e-5b2d-4c93-9443-fe459a8b310a req-46913d3f-ea8f-40fb-9c82-7fbe9dbe7785 service nova] Creating event network-vif-plugged:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:11:55.730546 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-19ee1e2e-5b2d-4c93-9443-fe459a8b310a req-46913d3f-ea8f-40fb-9c82-7fbe9dbe7785 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242946 Oct 28 13:11:55.733993 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1211/2374] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:55.823551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:57.068124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:11:57.082121 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2824c860-80fb-485f-a35e-aa3bd713fbab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 1.331347 Oct 28 13:11:57.082724 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1212/2375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:55 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:58.118475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:58.119870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:11:58.139092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:58.141223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:58.143585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:58.147074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:58.150990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:58.152004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:58.684581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-73aeb2aa-0ba7-4999-b176-7d94bbf41dc4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1421 microversion: 2.1 time: 10.681476 Oct 28 13:11:58.698786 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1164/2376] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:48 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1421 bytes in 10694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:11:58.705880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1ad9fe13-eef6-4e5e-bf94-e4749accdd9d req-2a75936c-f1ce-40d1-8aa1-fae27b04096c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045277a0-63fb-4041-b9b5-b0f275e6f17d", "tag": "e05c1d1a-5545-436c-a9b0-a4a597fea3cc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:11:58.737433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1ad9fe13-eef6-4e5e-bf94-e4749accdd9d req-2a75936c-f1ce-40d1-8aa1-fae27b04096c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:11:58.738602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1ad9fe13-eef6-4e5e-bf94-e4749accdd9d req-2a75936c-f1ce-40d1-8aa1-fae27b04096c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:11:58.739205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1ad9fe13-eef6-4e5e-bf94-e4749accdd9d req-2a75936c-f1ce-40d1-8aa1-fae27b04096c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:11:58.769543 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1ad9fe13-eef6-4e5e-bf94-e4749accdd9d req-2a75936c-f1ce-40d1-8aa1-fae27b04096c service nova] Creating event network-changed:e05c1d1a-5545-436c-a9b0-a4a597fea3cc for instance 045277a0-63fb-4041-b9b5-b0f275e6f17d on n-h2-862876-2 Oct 28 13:11:58.781553 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1ad9fe13-eef6-4e5e-bf94-e4749accdd9d req-2a75936c-f1ce-40d1-8aa1-fae27b04096c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080434 Oct 28 13:11:58.781553 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1165/2377] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:11:58.794216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ecda2d78-28f5-4e81-868a-03b9b47fea88 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd9c4940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:11:58.883793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ecda2d78-28f5-4e81-868a-03b9b47fea88 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 200 len: 1421 microversion: 2.1 time: 0.096138 Oct 28 13:11:58.895966 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1166/2378] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:11:58 2022] GET /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 1421 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:11:58.902398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb35d999-c8fb-4172-b00e-3a5eeec2e6ee tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93f43a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:00.042669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:00.061703 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5145fda5-8414-4ea8-bdb5-18ad5f091fc8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 1.943356 Oct 28 13:12:00.061703 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1213/2379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:58 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:01.059413 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb35d999-c8fb-4172-b00e-3a5eeec2e6ee tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 204 len: 0 microversion: 2.1 time: 2.161714 Oct 28 13:12:01.060060 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1167/2380] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:11:58 2022] DELETE /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 0 bytes in 2163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:12:01.068527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:01.069628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:01.082572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:01.083723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:01.089270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:01.097248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:01.099609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:01.101258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:01.105936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:01.106394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:01.107214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:01.107886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:01.108535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:01.109558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:01.115397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:01.116150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:01.937339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:01.946000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6578d18b-9620-4120-94e5-6ba2040801db tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 0.867641 Oct 28 13:12:01.967257 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1168/2381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:01 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:02.019015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:12:02.452410 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cfbccb09-343a-4aa3-aaaf-15497fb27f46 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 204 len: 0 microversion: 2.1 time: 1.387670 Oct 28 13:12:02.454718 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1214/2382] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:12:01 2022] DELETE /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:12:02.772568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1741214275", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "09db6954-888a-48c6-adf5-d40098ae89d9"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:02.934481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] validate_networks() for [('09db6954-888a-48c6-adf5-d40098ae89d9', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:12:02.974674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:02.975589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:02.991494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:02.992003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:02.992428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:02.993127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:02.993577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:02.993994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:05.462596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:12:05.463381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:12:05.463869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:12:05.464283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:12:05.464773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:12:05.494720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:05.495362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:05.495956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:05.496959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:05.497514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:05.498059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:05.554444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:12:05.564133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for user a43aa3346a70490d9c5e489c8e39d91d and project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:12:05.625996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:12:05.634064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:12:05.850331 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a25a233-71c4-4bac-83b3-98252db76f2b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.081491 Oct 28 13:12:05.863719 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1169/2383] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:12:05.894725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-652367b7-12fb-44fc-b3b1-7c0cf89d318a req-533af970-4126-4813-b988-85643147043b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d7297-bb28-443a-b7fe-c8c4d0c3e517", "name": "network-vif-unplugged", "status": "completed", "tag": "35017ab1-39a8-4290-b61f-bed07e59cd63"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:05.951524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-652367b7-12fb-44fc-b3b1-7c0cf89d318a req-533af970-4126-4813-b988-85643147043b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:05.952034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-652367b7-12fb-44fc-b3b1-7c0cf89d318a req-533af970-4126-4813-b988-85643147043b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:05.955748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-652367b7-12fb-44fc-b3b1-7c0cf89d318a req-533af970-4126-4813-b988-85643147043b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:05.997274 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-652367b7-12fb-44fc-b3b1-7c0cf89d318a req-533af970-4126-4813-b988-85643147043b service nova] Creating event network-vif-unplugged:35017ab1-39a8-4290-b61f-bed07e59cd63 for instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 on n-h1-862876-2 Oct 28 13:12:06.014947 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-652367b7-12fb-44fc-b3b1-7c0cf89d318a req-533af970-4126-4813-b988-85643147043b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149934 Oct 28 13:12:06.017835 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1170/2384] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:06.035714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a138ab5-dfd6-4bd4-9be8-c3522e324058 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:06.036694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a138ab5-dfd6-4bd4-9be8-c3522e324058 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:06.385305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a138ab5-dfd6-4bd4-9be8-c3522e324058 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:06.395738 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a138ab5-dfd6-4bd4-9be8-c3522e324058 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1208 microversion: 2.1 time: 0.376582 Oct 28 13:12:06.396322 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1171/2385] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:06 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1208 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:06.775226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:06.788211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c2ef08f-ad78-4c3b-9caf-c6b357bf9301 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 3.817780 Oct 28 13:12:06.795957 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1215/2386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:02 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 3827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:07.436043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0bf122b3-c3af-4d10-b3ab-d6b7250e5f51 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:07.438511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0bf122b3-c3af-4d10-b3ab-d6b7250e5f51 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:07.749480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0bf122b3-c3af-4d10-b3ab-d6b7250e5f51 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:07.758775 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0bf122b3-c3af-4d10-b3ab-d6b7250e5f51 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1208 microversion: 2.1 time: 0.337015 Oct 28 13:12:07.764090 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1172/2387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:07 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1208 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:07.821637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:07.822257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:07.837637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:07.838147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:07.839290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:07.841265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:07.851225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:07.851945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:07.904896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:08.799002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:08.801971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:08.824933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:08.825438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:08.825888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:08.838541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:08.839286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:08.839421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:09.049481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:09.075403 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-564674b5-a29e-491e-9d08-880fdf9f2469 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 1.248950 Oct 28 13:12:09.083085 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1216/2388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:07 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:09.104395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b0f1bef8-56b6-4fc5-92dc-941cb27922f4 req-4ea3ba4d-d887-4307-b7b2-47d8908cf9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1d7297-bb28-443a-b7fe-c8c4d0c3e517", "name": "network-vif-deleted", "tag": "35017ab1-39a8-4290-b61f-bed07e59cd63"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:09.167489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b0f1bef8-56b6-4fc5-92dc-941cb27922f4 req-4ea3ba4d-d887-4307-b7b2-47d8908cf9e5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:09.167489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b0f1bef8-56b6-4fc5-92dc-941cb27922f4 req-4ea3ba4d-d887-4307-b7b2-47d8908cf9e5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:09.167489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b0f1bef8-56b6-4fc5-92dc-941cb27922f4 req-4ea3ba4d-d887-4307-b7b2-47d8908cf9e5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:09.207650 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b0f1bef8-56b6-4fc5-92dc-941cb27922f4 req-4ea3ba4d-d887-4307-b7b2-47d8908cf9e5 service nova] Creating event network-vif-deleted:35017ab1-39a8-4290-b61f-bed07e59cd63 for instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 on n-h1-862876-2 Oct 28 13:12:09.257737 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b0f1bef8-56b6-4fc5-92dc-941cb27922f4 req-4ea3ba4d-d887-4307-b7b2-47d8908cf9e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169329 Oct 28 13:12:09.266699 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1217/2389] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:09.442963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:09.452293 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-982a7783-3830-4298-b43e-bd34a0daf8a0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1204 microversion: 2.1 time: 0.660605 Oct 28 13:12:09.466982 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1173/2390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:08 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1204 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:10.098379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:10.099166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:10.119490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:10.120814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:10.122921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:10.123847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:10.127196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:10.127853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:10.480577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:10.481897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:10.498533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:10.502548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:10.504952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:10.507917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:10.508671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:10.511340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:10.624254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:10.643331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60a7c60b-67cb-4856-b6d5-1ffa45c2425e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 0.549249 Oct 28 13:12:10.660868 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1218/2391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:10 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:10.903378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:10.910689 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be6ab89f-05d5-4fa6-a521-c143eff35799 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1268 microversion: 2.1 time: 0.434041 Oct 28 13:12:10.926859 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1174/2392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:10 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1268 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:11.117873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-540a14fb-f481-4af7-97e4-cdd2c58e4948 req-d509d938-2964-4669-9f9f-210ba95b35a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045277a0-63fb-4041-b9b5-b0f275e6f17d", "name": "network-vif-plugged", "status": "completed", "tag": "e05c1d1a-5545-436c-a9b0-a4a597fea3cc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:11.138723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-540a14fb-f481-4af7-97e4-cdd2c58e4948 req-d509d938-2964-4669-9f9f-210ba95b35a3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:11.140827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-540a14fb-f481-4af7-97e4-cdd2c58e4948 req-d509d938-2964-4669-9f9f-210ba95b35a3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:11.141889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-540a14fb-f481-4af7-97e4-cdd2c58e4948 req-d509d938-2964-4669-9f9f-210ba95b35a3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:11.170546 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-540a14fb-f481-4af7-97e4-cdd2c58e4948 req-d509d938-2964-4669-9f9f-210ba95b35a3 service nova] Creating event network-vif-plugged:e05c1d1a-5545-436c-a9b0-a4a597fea3cc for instance 045277a0-63fb-4041-b9b5-b0f275e6f17d on n-h2-862876-2 Oct 28 13:12:11.180385 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-540a14fb-f481-4af7-97e4-cdd2c58e4948 req-d509d938-2964-4669-9f9f-210ba95b35a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066196 Oct 28 13:12:11.184070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1219/2393] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:11.686560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:11.691268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:11.732189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:11.733520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:11.735502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:11.739553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:11.743603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:11.744880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:11.941315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:11.942185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:11.944626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:11.971450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:11.972272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:11.973236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:11.973794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:11.974316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:11.974980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:12.322400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:12.332137 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6c4e0ec-1485-4ddb-8792-7fe625d63a84 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1316 microversion: 2.1 time: 0.656412 Oct 28 13:12:12.341807 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1175/2394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:11 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:12.403331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:12.412301 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bd8659e-d0bb-42e9-8683-afc4bceef556 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1266 microversion: 2.1 time: 0.475530 Oct 28 13:12:12.440132 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1220/2395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:11 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1266 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:13.364355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:13.364999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:13.375706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:13.381763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:13.382840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:13.387822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:13.393734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:13.396001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:13.444661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:13.445281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:13.481442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:13.491138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:13.494876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:13.502865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:13.505809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:13.508363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:14.099571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:14.108978 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc4b0be3-7f12-4380-acab-abbd41355b4d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.748398 Oct 28 13:12:14.109580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1176/2396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:13 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:14.279463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:14.316474 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-820ec96f-3268-4fdc-b61d-f71f3178f1b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 0.865184 Oct 28 13:12:14.317506 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1221/2397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:13 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:14.587819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-314062602", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:15.345198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:15.345849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:15.371915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:15.374175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:15.381231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:15.381231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:15.382808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:15.386278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:15.531782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:17.585535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:17.611023 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b7ba3e9-4172-421f-b982-ae4cc7ffa604 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 2.270631 Oct 28 13:12:17.618237 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1222/2398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:15 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:17.753996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:18.221347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18edfb93-330d-4087-82bf-9037749375a8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: .version_select at 0x7f27b96538b0>, body: {"keypair": {"name": "tempest-keypair-2035103096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICrCrZ1c3IWm9btSN8EhH9s1Iy9NBv5V9j032pLlWlYKLNDRJJnvzeGrTigcV39s0PsvcKh1GPl+VE6Iod95r6kmf7g54GGlgWP52FtERmUmW1HCxhmLynu1sHkxs4NuA=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:18.267225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-18edfb93-330d-4087-82bf-9037749375a8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:12:18.290242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-18edfb93-330d-4087-82bf-9037749375a8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:12:18.413603 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-18edfb93-330d-4087-82bf-9037749375a8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205336 Oct 28 13:12:18.415422 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1223/2399] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:12:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:18.857761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1449990466", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "51362cf5-b33f-4740-8f97-96df2d83eb6b"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:22.095394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] validate_networks() for [('15097bcb-93dc-4045-8562-028bd560b398', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:12:22.882297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] validate_networks() for [('51362cf5-b33f-4740-8f97-96df2d83eb6b', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:12:24.104623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=36 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:24.316428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:12:24.317486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:12:24.318068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:12:24.318921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:12:24.319452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:12:24.340795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:24.344321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:24.345142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:24.347165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:24.350422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:24.351289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:24.407162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Getting quotas for project 2598a075668a43e492dacb3eff4f7071. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:12:24.428682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Getting quotas for user 0dcd59c06d654cb191b0460bcb8dc689 and project 2598a075668a43e492dacb3eff4f7071. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:12:24.477563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Going to run 3 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:12:24.482869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:12:24.618733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:24.648760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=66d808f4-9720-4a77-981a-9a937fac2737,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:12:24.877093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=c633e2f6-b6c2-4334-b71e-9e2176e0f753,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:12:25.256976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:12:25.257763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:12:25.258347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:12:25.258901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:12:25.259197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:12:25.260832 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4adacb80-0c4c-4717-9294-aad3d8a0fb64 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.780950 Oct 28 13:12:25.270263 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1224/2400] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 6790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:12:25.275182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:25.276075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:25.284429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.285821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.286318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.286791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.286915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.287853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.288518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.289146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.295123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.297403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.297403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.306629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.405405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Getting quotas for project 49f2a1ab0afa467e9b9c6ec8cf78614c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:12:25.446323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Getting quotas for user 369a322f683e4c669d99eb762b7137ec and project 49f2a1ab0afa467e9b9c6ec8cf78614c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:12:25.501464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:12:25.511055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:12:25.746316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:25.768578 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-324d74a7-737e-45c5-85af-759036653dc4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.185023 Oct 28 13:12:25.773938 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0ed6b0f0-3c70-497f-8632-87ee474e684a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 0.503399 Oct 28 13:12:25.784719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1225/2401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:25 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:25.793554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1177/2402] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:12:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 11211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:12:25.805878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-337869a1-2dd0-4ea9-88d0-823da6819f3d req-113f31a2-4c0e-46eb-a383-06811858b0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23c46ff-706a-4918-8cf5-a16d7f29617f", "tag": "afc87e88-81fb-45ed-a23f-deceb3e4e759"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:25.816793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:25.824534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:25.831322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-337869a1-2dd0-4ea9-88d0-823da6819f3d req-113f31a2-4c0e-46eb-a383-06811858b0f0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.832340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-337869a1-2dd0-4ea9-88d0-823da6819f3d req-113f31a2-4c0e-46eb-a383-06811858b0f0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.833735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-337869a1-2dd0-4ea9-88d0-823da6819f3d req-113f31a2-4c0e-46eb-a383-06811858b0f0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.850894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-337869a1-2dd0-4ea9-88d0-823da6819f3d req-113f31a2-4c0e-46eb-a383-06811858b0f0 service nova] Creating event network-changed:afc87e88-81fb-45ed-a23f-deceb3e4e759 for instance f23c46ff-706a-4918-8cf5-a16d7f29617f on n-h1-862876-2 Oct 28 13:12:25.862730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-337869a1-2dd0-4ea9-88d0-823da6819f3d req-113f31a2-4c0e-46eb-a383-06811858b0f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070325 Oct 28 13:12:25.871861 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1226/2403] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:25.878599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:25.918501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.921380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:25.924096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:12:25.926597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.930376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.933122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.935405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.940324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.982561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:25.986280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:25.987300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:25.989550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:26.009177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:26.009768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:26.113744 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-65075946-c833-4b32-806a-29bc9533b3bb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.237690 Oct 28 13:12:26.118058 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1227/2404] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:12:25 2022] GET /compute/v2.1/servers => generated 1018 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:26.130014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ce28f82-7a16-403d-b1d3-6f4332fdd711 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:26.131147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ce28f82-7a16-403d-b1d3-6f4332fdd711 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:26.825521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ce28f82-7a16-403d-b1d3-6f4332fdd711 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:26.841661 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ce28f82-7a16-403d-b1d3-6f4332fdd711 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1216 microversion: 2.1 time: 0.717849 Oct 28 13:12:26.849066 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1228/2405] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:26 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1216 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:26.890260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f6e93d1-74f4-490e-96f9-dcf1b8c80b08 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:26.893479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5f6e93d1-74f4-490e-96f9-dcf1b8c80b08 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:27.101916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5f6e93d1-74f4-490e-96f9-dcf1b8c80b08 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:27.122285 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f6e93d1-74f4-490e-96f9-dcf1b8c80b08 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1223 microversion: 2.1 time: 0.248093 Oct 28 13:12:27.126838 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1229/2406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:26 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1223 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:27.156972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:27.159890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:27.183491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:27.186837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:27.188621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:27.194274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:27.196433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:27.199073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:27.485299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:27.494626 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-307daffb-70a8-468f-890b-e27ca151a044 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 1.699760 Oct 28 13:12:27.508204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1178/2407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:25 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:27.518780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-905381316", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53d6a3ea-bd12-4a26-b93d-1b74de68c817"}], "security_groups": [{"name": "tempest-securitygroup--612600675"}], "key_name": "tempest-keypair-2035103096", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:27.571840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:27.602866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e0ec0f11-a41b-40a8-99ff-fba16b697198 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 0.464210 Oct 28 13:12:27.607658 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1230/2408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:27 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:27.646107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-195824998"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:27.651192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:27.680510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:27.688510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:27.688510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:27.688510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:27.688510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:27.689376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:28.398103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] validate_networks() for [('53d6a3ea-bd12-4a26-b93d-1b74de68c817', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:12:28.477435 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52ad5968-a278-4189-b095-e8e64fa4a84b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.857436 Oct 28 13:12:28.482710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1231/2409] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:12:27 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 13:12:28.505171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:28.510299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:28.537255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:28.537849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:28.541699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:28.542494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:28.543014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:28.545537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:28.840220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:28.853270 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-296f3de8-8246-443d-a9c4-46b5e90e1bf7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1212 microversion: 2.1 time: 0.367008 Oct 28 13:12:28.859831 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1232/2410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:28 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1212 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:28.867516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93c48ef6-c73b-4151-a6a3-777609580651 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:28.868132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93c48ef6-c73b-4151-a6a3-777609580651 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:29.053600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-93c48ef6-c73b-4151-a6a3-777609580651 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:29.061092 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-93c48ef6-c73b-4151-a6a3-777609580651 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1223 microversion: 2.1 time: 0.199927 Oct 28 13:12:29.062584 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1233/2411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:28 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1223 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:29.097563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:29.098410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:29.128475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:29.130919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:29.131566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:29.132920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:29.136514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:29.137224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:29.482862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:29.490685 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49ab2cc8-3b99-4306-96e8-a62404f31bac tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.423321 Oct 28 13:12:29.491423 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1234/2412] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:29 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:29.502513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:29.505736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:29.520050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:29.535340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:29.535340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:29.535340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:29.535340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:29.535340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:29.892809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:29.907462 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-efb144ce-173a-463c-9468-fdf4e018b510 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 0.411153 Oct 28 13:12:29.908295 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1235/2413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:29 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:29.937845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c857bd73-4338-4a13-b71b-932d8ac2a51e req-89e46313-d2e2-404d-b124-2f33b3b5bc72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "name": "network-vif-unplugged", "status": "completed", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:30.000217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c857bd73-4338-4a13-b71b-932d8ac2a51e req-89e46313-d2e2-404d-b124-2f33b3b5bc72 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.001029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c857bd73-4338-4a13-b71b-932d8ac2a51e req-89e46313-d2e2-404d-b124-2f33b3b5bc72 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.001621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c857bd73-4338-4a13-b71b-932d8ac2a51e req-89e46313-d2e2-404d-b124-2f33b3b5bc72 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.036733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c857bd73-4338-4a13-b71b-932d8ac2a51e req-89e46313-d2e2-404d-b124-2f33b3b5bc72 service nova] Creating event network-vif-unplugged:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:12:30.049153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c857bd73-4338-4a13-b71b-932d8ac2a51e req-89e46313-d2e2-404d-b124-2f33b3b5bc72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131618 Oct 28 13:12:30.050129 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1236/2414] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:30.061376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:30.066968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:30.084905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.085531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.086030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.086833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.087398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.087913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.331448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:12:30.334204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:12:30.334944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:12:30.336172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:12:30.336898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:12:30.368353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.369268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.369910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.370900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.375706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.380452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.422279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:12:30.428483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:12:30.448064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:30.461957 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36ef5119-bfc1-41cc-8287-58935f8af3d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1276 microversion: 2.1 time: 0.409202 Oct 28 13:12:30.463711 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1237/2415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:30 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1276 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:30.490851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:12:30.494278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:30.494278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:30.501276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:12:30.530846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.530846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.530846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.536148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.536876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.539193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.667291 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6108bb3e-f8b9-45ce-bb1f-bc7e722f4761 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.156087 Oct 28 13:12:30.676623 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1179/2416] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:12:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 3167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:12:30.689328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:30.690633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:30.704511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:30.709209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.710835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.712361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.713501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.715949 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d6e78f6-0dcb-49f0-a995-13bc8f9e2b82 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1227 microversion: 2.1 time: 0.249007 Oct 28 13:12:30.716648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.722782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.725162 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1238/2417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:30 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1227 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:30.737774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed550798-a952-4581-b963-559315ef17ef tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:30.738569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed550798-a952-4581-b963-559315ef17ef tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:30.865052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ed550798-a952-4581-b963-559315ef17ef tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:30.872838 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed550798-a952-4581-b963-559315ef17ef tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1241 microversion: 2.1 time: 0.153724 Oct 28 13:12:30.875300 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1239/2418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:30 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:30.942732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:30.943653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:30.959789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.960513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.961011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:30.961732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:30.962835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:30.963263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:31.060846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:31.060846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3c90c68-2978-4b5e-ba03-967dc4db5a0b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1685 microversion: 2.1 time: 0.366034 Oct 28 13:12:31.060846 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1180/2419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:30 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1685 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:31.303422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:31.306012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:31.313592 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d55c006b-b640-4512-b0e4-4fbd8c787ea2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 0.376629 Oct 28 13:12:31.329954 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1240/2420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:30 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:31.510840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:31.512060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:31.531361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:31.533053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:31.535229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:31.537880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:31.538458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:31.541453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:31.755533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:31.756479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:31.769178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:31.772966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:31.774861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:31.777085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:31.782336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:31.784829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:31.845833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:31.866205 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bceec7a2-914c-44f6-8bd3-d2f0893e74f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1274 microversion: 2.1 time: 0.360935 Oct 28 13:12:31.874799 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1181/2421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:31 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:31.899981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c025dbfe-93e4-475b-a78d-0a6058dfa612 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:31.900957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c025dbfe-93e4-475b-a78d-0a6058dfa612 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:32.026646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c025dbfe-93e4-475b-a78d-0a6058dfa612 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:32.037165 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c025dbfe-93e4-475b-a78d-0a6058dfa612 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1241 microversion: 2.1 time: 0.140782 Oct 28 13:12:32.042261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:32.050652 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5a17090-108b-43de-89ad-2da3ef313f1c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1219 microversion: 2.1 time: 0.301469 Oct 28 13:12:32.052844 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1182/2422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:31 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:32.057137 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1241/2423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:31 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1219 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:32.088997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:32.089708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:32.107972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:32.108525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:32.115257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:32.119027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:32.121304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:32.123459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:32.341883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:32.342999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:32.373597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:32.376989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:32.379017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:32.379997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:32.382879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:32.384251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:32.974121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:32.985678 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79826b6b-758a-450b-86f5-6298c6963f31 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 0.649098 Oct 28 13:12:32.987795 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1242/2424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:32 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:33.002983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9a825ace-ca66-4c50-b996-02de6d191791 req-0d21f3d7-b3a5-4445-bbe9-5653671be374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23c46ff-706a-4918-8cf5-a16d7f29617f", "name": "network-vif-plugged", "status": "completed", "tag": "afc87e88-81fb-45ed-a23f-deceb3e4e759"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:33.028036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9a825ace-ca66-4c50-b996-02de6d191791 req-0d21f3d7-b3a5-4445-bbe9-5653671be374 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:33.031395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9a825ace-ca66-4c50-b996-02de6d191791 req-0d21f3d7-b3a5-4445-bbe9-5653671be374 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:33.034183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9a825ace-ca66-4c50-b996-02de6d191791 req-0d21f3d7-b3a5-4445-bbe9-5653671be374 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:33.069919 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9a825ace-ca66-4c50-b996-02de6d191791 req-0d21f3d7-b3a5-4445-bbe9-5653671be374 service nova] Creating event network-vif-plugged:afc87e88-81fb-45ed-a23f-deceb3e4e759 for instance f23c46ff-706a-4918-8cf5-a16d7f29617f on n-h1-862876-2 Oct 28 13:12:33.083988 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9a825ace-ca66-4c50-b996-02de6d191791 req-0d21f3d7-b3a5-4445-bbe9-5653671be374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092771 Oct 28 13:12:33.085023 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1243/2425] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:33.100910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:33.104895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:33.133408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:33.136385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:33.138157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:33.138635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:33.145906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:33.146646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:33.151039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:33.151168 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c40bb23f-6515-4609-b4cb-8b9e021ae513 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1685 microversion: 2.1 time: 1.066673 Oct 28 13:12:33.175175 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1183/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:32 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1685 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:33.207021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:33.210426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:33.241531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:33.250501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:33.251497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:33.255693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:33.261901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:33.269053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:33.757683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:33.792373 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c0033da-f489-4d2c-8fda-61bf93f47081 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1237 microversion: 2.1 time: 0.615979 Oct 28 13:12:33.797828 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1184/2427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:33 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1237 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:33.820402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:33.823069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:33.856127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:33.861707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:33.863063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:33.864322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:33.865299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:33.867072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:34.270299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:34.286693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-344bb38b-2c03-4325-9fca-0b0d74aeb366 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1283 microversion: 2.1 time: 0.487414 Oct 28 13:12:34.289648 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1185/2428] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:33 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1283 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:34.953378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-907058103", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "8a5ca9f0-82b0-4d71-8677-088d1cfb750f"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:35.650436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:35.658806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e596fc1-6097-46e6-a431-ef74dc733fd8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1316 microversion: 2.1 time: 2.569661 Oct 28 13:12:35.659406 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1244/2429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:33 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1316 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:35.686327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:35.686327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:35.728087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:35.728087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:35.738900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:35.740409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:35.743430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:35.746362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:36.052291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:37.580994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:37.609311 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-24797352-1309-4742-bfbb-79fe912c1fba tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1308 microversion: 2.1 time: 1.938780 Oct 28 13:12:37.633119 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1245/2430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:35 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1308 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:37.648537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:37.652289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:37.674694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:37.675247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:37.675702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:37.683591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:37.684213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:37.690333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:38.450265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:38.476962 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f16d84c8-5a87-4c17-9ef9-b64fb1d703fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1680 microversion: 2.1 time: 0.838747 Oct 28 13:12:38.477892 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1246/2431] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:37 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1680 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:38.511014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:38.529296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:38.572214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:38.572720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:38.573164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:38.573879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:38.574363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:38.595817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:39.258235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:39.271620 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d4e630c-23c4-4e30-858a-1594762ab7ab tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1299 microversion: 2.1 time: 0.792925 Oct 28 13:12:39.276171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1247/2432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:38 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1299 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:39.285020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:39.285634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:39.307914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:39.311314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:39.312483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:39.313529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:39.314172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:39.315338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:40.334715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:40.364894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47040d3a-6557-4c9a-b8b9-6b54aae163c6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1323 microversion: 2.1 time: 1.087062 Oct 28 13:12:40.379695 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1248/2433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:39 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1323 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:40.398739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:40.407316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:40.418467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:40.425784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:40.432025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:40.433056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:40.434518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:40.435584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:40.437118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:40.872868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=18 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:41.901497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:41.932563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3988d0b2-7624-4fcf-83c5-5c93371852ea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1316 microversion: 2.1 time: 1.548588 Oct 28 13:12:41.958434 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1249/2434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:40 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1316 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:41.966674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-94297341-9ed4-4d3c-a062-cacc48f056d1 req-c922c9cc-8ac6-4635-94e6-2ee1d8ffe623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d808f4-9720-4a77-981a-9a937fac2737", "tag": "e1094ce7-61fe-4edf-a449-7796d4ad9df1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:41.978901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:41.981263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-94297341-9ed4-4d3c-a062-cacc48f056d1 req-c922c9cc-8ac6-4635-94e6-2ee1d8ffe623 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:41.981961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-94297341-9ed4-4d3c-a062-cacc48f056d1 req-c922c9cc-8ac6-4635-94e6-2ee1d8ffe623 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:41.983017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-94297341-9ed4-4d3c-a062-cacc48f056d1 req-c922c9cc-8ac6-4635-94e6-2ee1d8ffe623 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:42.006174 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-94297341-9ed4-4d3c-a062-cacc48f056d1 req-c922c9cc-8ac6-4635-94e6-2ee1d8ffe623 service nova] Creating event network-changed:e1094ce7-61fe-4edf-a449-7796d4ad9df1 for instance 66d808f4-9720-4a77-981a-9a937fac2737 on n-h2-862876-2 Oct 28 13:12:42.016525 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-94297341-9ed4-4d3c-a062-cacc48f056d1 req-c922c9cc-8ac6-4635-94e6-2ee1d8ffe623 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053117 Oct 28 13:12:42.021262 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1250/2435] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:42.035641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:42.038079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5d064b40-ecd5-40d3-8184-0432dd1bf4f9 req-2ad4dde7-2bb1-40ea-8ff1-cda3432cb18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "name": "network-vif-plugged", "status": "completed", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:42.062543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5d064b40-ecd5-40d3-8184-0432dd1bf4f9 req-2ad4dde7-2bb1-40ea-8ff1-cda3432cb18f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:42.063347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5d064b40-ecd5-40d3-8184-0432dd1bf4f9 req-2ad4dde7-2bb1-40ea-8ff1-cda3432cb18f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:42.064110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5d064b40-ecd5-40d3-8184-0432dd1bf4f9 req-2ad4dde7-2bb1-40ea-8ff1-cda3432cb18f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:42.108376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5d064b40-ecd5-40d3-8184-0432dd1bf4f9 req-2ad4dde7-2bb1-40ea-8ff1-cda3432cb18f service nova] Creating event network-vif-plugged:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:12:42.146044 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5d064b40-ecd5-40d3-8184-0432dd1bf4f9 req-2ad4dde7-2bb1-40ea-8ff1-cda3432cb18f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104615 Oct 28 13:12:42.146044 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1251/2436] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:42.147905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:42.148899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:42.158073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:42.159625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:42.160234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:42.161161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:42.161806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:42.162385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:43.854814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:43.871448 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0ab7cbc-d14f-45ed-b8de-a7cd22916db1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1487 microversion: 2.1 time: 1.728565 Oct 28 13:12:43.872649 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1252/2437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:42 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1487 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:43.886610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:43.887577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:43.901149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:43.907236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:43.908002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:43.909086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:43.910982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:43.913061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:44.282204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=40 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:44.446735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:44.473686 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-870807d2-7c8a-4256-a334-3cef3d1f49f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1680 microversion: 2.1 time: 0.599673 Oct 28 13:12:44.475010 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1253/2438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:43 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1680 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:44.484229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:44.485103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:44.512986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:44.513774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:44.514444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:44.515426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:44.516119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:44.516968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:44.976195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:44.995483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:45.008906 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-caba239b-574d-4409-916e-876a9d648034 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1366 microversion: 2.1 time: 0.530750 Oct 28 13:12:45.024130 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1254/2439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:44 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:45.038408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-328cef66-c4b6-4229-91d2-3483f9ba21bd req-cd757e2d-092c-40ec-b631-2a9609beba39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99289a7-5b75-40b8-b832-8d1f1223ddd3", "tag": "98f29cf1-13d1-4688-80fa-44ac57639ab5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:45.062069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-328cef66-c4b6-4229-91d2-3483f9ba21bd req-cd757e2d-092c-40ec-b631-2a9609beba39 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:45.064839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-328cef66-c4b6-4229-91d2-3483f9ba21bd req-cd757e2d-092c-40ec-b631-2a9609beba39 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:45.066982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-328cef66-c4b6-4229-91d2-3483f9ba21bd req-cd757e2d-092c-40ec-b631-2a9609beba39 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:45.115961 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-328cef66-c4b6-4229-91d2-3483f9ba21bd req-cd757e2d-092c-40ec-b631-2a9609beba39 service nova] Creating event network-changed:98f29cf1-13d1-4688-80fa-44ac57639ab5 for instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 on n-h2-862876-2 Oct 28 13:12:45.123608 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-328cef66-c4b6-4229-91d2-3483f9ba21bd req-cd757e2d-092c-40ec-b631-2a9609beba39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094121 Oct 28 13:12:45.125488 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1255/2440] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:45.131818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:45.134343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:45.142667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:45.143475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:45.144238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:45.145234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:45.145967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:45.146614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:45.906474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:45.919763 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b9ce0e5-8cbd-4763-b48f-3d48f7114a14 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1323 microversion: 2.1 time: 0.790632 Oct 28 13:12:45.938774 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1256/2441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:45 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1323 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:45.948832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:45.948832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:45.963943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:45.971944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:45.972498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:45.973343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:45.974787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:45.977538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:46.953516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:46.972840 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a940ca3d-0f21-4efe-a8c1-f6fb81327c67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1316 microversion: 2.1 time: 1.037513 Oct 28 13:12:46.972840 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1257/2442] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:45 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1316 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:46.972840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:46.972840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:46.980368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:46.981872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:46.982528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:46.984083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:46.984771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:46.985426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:47.073126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lazy-loading 'flavor' on Instance uuid f23c46ff-706a-4918-8cf5-a16d7f29617f {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:12:47.344656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:47.699312 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f652372-24db-46ba-837b-1f2a4df7d78a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f/action" status: 202 len: 0 microversion: 2.1 time: 0.731974 Oct 28 13:12:47.700401 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1258/2443] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:12:46 2022] POST /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:12:48.132091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-20d69314-d905-4a95-892f-6472628b5474 req-5784d0df-bd24-4057-83f9-3b5019e68933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be0a200a-8337-4ce1-9404-6e719e6c00c3", "tag": "967b35f9-36cc-4cb3-a61d-6cafecb65010"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:48.147611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-20d69314-d905-4a95-892f-6472628b5474 req-5784d0df-bd24-4057-83f9-3b5019e68933 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:48.149151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-20d69314-d905-4a95-892f-6472628b5474 req-5784d0df-bd24-4057-83f9-3b5019e68933 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:48.151439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-20d69314-d905-4a95-892f-6472628b5474 req-5784d0df-bd24-4057-83f9-3b5019e68933 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:48.180158 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-20d69314-d905-4a95-892f-6472628b5474 req-5784d0df-bd24-4057-83f9-3b5019e68933 service nova] Creating event network-changed:967b35f9-36cc-4cb3-a61d-6cafecb65010 for instance be0a200a-8337-4ce1-9404-6e719e6c00c3 on n-h1-862876-2 Oct 28 13:12:48.196262 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-20d69314-d905-4a95-892f-6472628b5474 req-5784d0df-bd24-4057-83f9-3b5019e68933 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.494238 Oct 28 13:12:48.205149 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1259/2444] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:48.214051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:48.216059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:48.227940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:48.230306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:48.230803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:48.231682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:48.238677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:48.241294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:48.897371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:48.907416 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c234b3f3-71ea-4180-83a6-ae548338bdb3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1680 microversion: 2.1 time: 0.700619 Oct 28 13:12:48.912167 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1260/2445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:48 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1680 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:48.923083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:48.927874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:48.946510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:48.950312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:48.950312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:48.950312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:48.950312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:48.950312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:49.231004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:49.249253 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f5e4879-c59f-4127-889b-e5b1b25f4bd7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1366 microversion: 2.1 time: 0.335789 Oct 28 13:12:49.262358 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1261/2446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:48 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:49.275968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-278cb946-902e-4518-b755-638badd28e16 req-858bf7b1-6b5c-42ee-85ed-fd9610f3eb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d808f4-9720-4a77-981a-9a937fac2737", "name": "network-vif-plugged", "status": "completed", "tag": "e1094ce7-61fe-4edf-a449-7796d4ad9df1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:49.307728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-278cb946-902e-4518-b755-638badd28e16 req-858bf7b1-6b5c-42ee-85ed-fd9610f3eb83 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:49.309350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-278cb946-902e-4518-b755-638badd28e16 req-858bf7b1-6b5c-42ee-85ed-fd9610f3eb83 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:49.310429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-278cb946-902e-4518-b755-638badd28e16 req-858bf7b1-6b5c-42ee-85ed-fd9610f3eb83 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:49.351503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-278cb946-902e-4518-b755-638badd28e16 req-858bf7b1-6b5c-42ee-85ed-fd9610f3eb83 service nova] Creating event network-vif-plugged:e1094ce7-61fe-4edf-a449-7796d4ad9df1 for instance 66d808f4-9720-4a77-981a-9a937fac2737 on n-h2-862876-2 Oct 28 13:12:49.370218 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-278cb946-902e-4518-b755-638badd28e16 req-858bf7b1-6b5c-42ee-85ed-fd9610f3eb83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103756 Oct 28 13:12:49.391854 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1262/2447] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:49.418577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:49.421785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:49.442415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:49.443943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:49.444612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:49.449290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:49.450344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:49.451195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:50.338340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:50.353126 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5258f11-9034-4a85-80d2-233331162f17 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1323 microversion: 2.1 time: 0.959368 Oct 28 13:12:50.354996 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1263/2448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:49 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1323 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:50.372409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a98402b0-5e49-48b8-a47e-d21db3d61923 req-7521e6e0-c428-459b-84ae-940e2ce44521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c633e2f6-b6c2-4334-b71e-9e2176e0f753", "tag": "80e21ecc-28af-4e9a-83bf-0e2d099f9947"}, {"name": "network-changed", "server_uuid": "74de78ee-1eff-4dfe-8c7f-496c62551854", "tag": "c2959aee-6533-4f25-8885-82b3f7d2ed36"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:50.407461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a98402b0-5e49-48b8-a47e-d21db3d61923 req-7521e6e0-c428-459b-84ae-940e2ce44521 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:50.408285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a98402b0-5e49-48b8-a47e-d21db3d61923 req-7521e6e0-c428-459b-84ae-940e2ce44521 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:50.409500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a98402b0-5e49-48b8-a47e-d21db3d61923 req-7521e6e0-c428-459b-84ae-940e2ce44521 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:50.429134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a98402b0-5e49-48b8-a47e-d21db3d61923 req-7521e6e0-c428-459b-84ae-940e2ce44521 service nova] Creating event network-changed:80e21ecc-28af-4e9a-83bf-0e2d099f9947 for instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 on n-h1-862876-2 Oct 28 13:12:50.429999 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a98402b0-5e49-48b8-a47e-d21db3d61923 req-7521e6e0-c428-459b-84ae-940e2ce44521 service nova] Creating event network-changed:c2959aee-6533-4f25-8885-82b3f7d2ed36 for instance 74de78ee-1eff-4dfe-8c7f-496c62551854 on n-h2-862876-2 Oct 28 13:12:50.457558 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a98402b0-5e49-48b8-a47e-d21db3d61923 req-7521e6e0-c428-459b-84ae-940e2ce44521 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.101022 Oct 28 13:12:50.459655 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1264/2449] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:50.493747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:50.502574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:50.526221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:50.527292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:50.527908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:50.535090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:50.535090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:50.535944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:51.535647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:51.550255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d80fb99-3e47-48e9-88d3-8f85353781d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 200 len: 1478 microversion: 2.1 time: 1.073026 Oct 28 13:12:51.550255 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1265/2450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:50 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 1478 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:51.564802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:51.565587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:51.582210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:51.583133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:51.583888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:51.584724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:51.585296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:51.586608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:52.136063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:52.145122 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70251d1c-d2c8-4125-9508-319855643b76 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1316 microversion: 2.1 time: 0.588678 Oct 28 13:12:52.151593 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1266/2451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:51 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:52.158595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:52.164114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:52.174897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:52.183510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:52.184121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:52.185138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:52.185823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:52.186528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:52.755459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:52.767517 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b326fcc-bb4b-4541-9a70-35f783ff5b89 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1680 microversion: 2.1 time: 0.614094 Oct 28 13:12:52.778862 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1267/2452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:52 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1680 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:52.778862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:52.778862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:52.784408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:52.784914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:52.785358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:52.786056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:52.786676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:52.787262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:52.955988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:52.956174 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-506d994e-c62c-4673-9628-e7c3ca24d7ff tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1366 microversion: 2.1 time: 0.184325 Oct 28 13:12:52.956647 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1268/2453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:52 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:52.961001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:52.961600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:52.979491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:52.979969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:52.980394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:52.981073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:52.981526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:52.981944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:53.121877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:53.129805 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e78ebb7c-2486-4042-8526-5fb4439c4c89 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1323 microversion: 2.1 time: 0.172226 Oct 28 13:12:53.130376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1269/2454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:52 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:53.252873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fb7e86a7-9ea9-4a05-9905-976c631948a0 req-fe738995-5a88-40ab-bcf2-9115e2c40b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99289a7-5b75-40b8-b832-8d1f1223ddd3", "name": "network-vif-plugged", "status": "completed", "tag": "98f29cf1-13d1-4688-80fa-44ac57639ab5"}, {"server_uuid": "be0a200a-8337-4ce1-9404-6e719e6c00c3", "name": "network-vif-plugged", "status": "completed", "tag": "967b35f9-36cc-4cb3-a61d-6cafecb65010"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:53.263648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb7e86a7-9ea9-4a05-9905-976c631948a0 req-fe738995-5a88-40ab-bcf2-9115e2c40b26 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:53.264129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb7e86a7-9ea9-4a05-9905-976c631948a0 req-fe738995-5a88-40ab-bcf2-9115e2c40b26 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:53.265059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb7e86a7-9ea9-4a05-9905-976c631948a0 req-fe738995-5a88-40ab-bcf2-9115e2c40b26 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:53.278384 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fb7e86a7-9ea9-4a05-9905-976c631948a0 req-fe738995-5a88-40ab-bcf2-9115e2c40b26 service nova] Creating event network-vif-plugged:98f29cf1-13d1-4688-80fa-44ac57639ab5 for instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 on n-h2-862876-2 Oct 28 13:12:53.278950 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fb7e86a7-9ea9-4a05-9905-976c631948a0 req-fe738995-5a88-40ab-bcf2-9115e2c40b26 service nova] Creating event network-vif-plugged:967b35f9-36cc-4cb3-a61d-6cafecb65010 for instance be0a200a-8337-4ce1-9404-6e719e6c00c3 on n-h1-862876-2 Oct 28 13:12:53.288153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fb7e86a7-9ea9-4a05-9905-976c631948a0 req-fe738995-5a88-40ab-bcf2-9115e2c40b26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.156649 Oct 28 13:12:53.288844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1270/2455] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:53.294368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1594208372"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:53.297042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:53.303884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:53.304115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:53.304560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:53.305266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:53.305722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:53.306145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:55.405859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] validate_networks() for [('8a5ca9f0-82b0-4d71-8677-088d1cfb750f', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:12:55.819884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:12:55.819884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:12:55.819884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:12:55.819884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:12:55.819884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:12:55.826379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:55.827707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:55.828317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:55.829402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:55.829873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:55.830300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:55.848114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:12:55.853434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for user 2042816d9181427cb51f1c710281aa53 and project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:12:55.866539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:12:55.868751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:12:55.910368 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-599c396b-b62d-4383-a10f-ebd3cb0a135a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f/action" status: 202 len: 0 microversion: 2.1 time: 2.620048 Oct 28 13:12:55.911546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1271/2456] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:12:53 2022] POST /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f/action => generated 0 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:12:55.916931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:55.917645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:55.925094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:55.925641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:55.926080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:55.926801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:55.927262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:55.934564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.079442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:56.081341 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b655345c-d67f-489b-bc5b-264a5a5ace18 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 21.789575 Oct 28 13:12:56.081454 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1186/2457] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 21791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:12:56.086014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:56.086624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:56.094807 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-623b7633-58f0-4518-b985-26bbfe9a0aca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1506 microversion: 2.1 time: 0.181989 Oct 28 13:12:56.096241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1272/2458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:55 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:56.101877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:56.102704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:56.115173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.115173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.115173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.115173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.115173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.115173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.118963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.130560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.131436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.131694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.132153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.132858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.338293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:56.352821 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc597262-9889-4530-aa3b-dfe45f4db222 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1556 microversion: 2.1 time: 0.255129 Oct 28 13:12:56.357241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1273/2459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:56 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1556 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:56.357381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:56.365760 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6bf5c916-3052-43ad-a458-b2a1872c5b13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.283239 Oct 28 13:12:56.366843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1187/2460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:56 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:56.371584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8cebbd1f-d3f1-40a8-89aa-3e4630e6a0b3 req-fe542b48-dbd4-4879-a3c2-0b90d31b3675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c633e2f6-b6c2-4334-b71e-9e2176e0f753", "name": "network-vif-plugged", "status": "completed", "tag": "80e21ecc-28af-4e9a-83bf-0e2d099f9947"}, {"server_uuid": "74de78ee-1eff-4dfe-8c7f-496c62551854", "name": "network-vif-plugged", "status": "completed", "tag": "c2959aee-6533-4f25-8885-82b3f7d2ed36"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:56.384688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8cebbd1f-d3f1-40a8-89aa-3e4630e6a0b3 req-fe542b48-dbd4-4879-a3c2-0b90d31b3675 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.386629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8cebbd1f-d3f1-40a8-89aa-3e4630e6a0b3 req-fe542b48-dbd4-4879-a3c2-0b90d31b3675 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.387309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8cebbd1f-d3f1-40a8-89aa-3e4630e6a0b3 req-fe542b48-dbd4-4879-a3c2-0b90d31b3675 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.401174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:56.403787 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8cebbd1f-d3f1-40a8-89aa-3e4630e6a0b3 req-fe542b48-dbd4-4879-a3c2-0b90d31b3675 service nova] Creating event network-vif-plugged:80e21ecc-28af-4e9a-83bf-0e2d099f9947 for instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 on n-h1-862876-2 Oct 28 13:12:56.404533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:56.405859 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8cebbd1f-d3f1-40a8-89aa-3e4630e6a0b3 req-fe542b48-dbd4-4879-a3c2-0b90d31b3675 service nova] Creating event network-vif-plugged:c2959aee-6533-4f25-8885-82b3f7d2ed36 for instance 74de78ee-1eff-4dfe-8c7f-496c62551854 on n-h2-862876-2 Oct 28 13:12:56.421673 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8cebbd1f-d3f1-40a8-89aa-3e4630e6a0b3 req-fe542b48-dbd4-4879-a3c2-0b90d31b3675 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051572 Oct 28 13:12:56.432049 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1188/2461] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:56.432282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.432282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.432282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.433707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.435410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.436001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.785031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:56.798216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-38b70639-2474-4be9-a489-9c5bbfc05fff tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Action: 'create', calling method: .version_select at 0x7f27b94229d0>, body: {"keypair": {"name": "tempest-keypair-605127733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOENrPoZ/pslUBwqb8TVv50bdqtJxU/3Y8RnqyAWxT8OjGZ4ZVXVuIFL1mjOELX+MOSTHfH18kJYME4v7qPP6EfuATVOQMJ4Hee8spyD8cRAEkjCieHxvMsOoqZsGFDfQ=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:56.809924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-426575ae-c9a0-4124-950e-2caf314079e4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1323 microversion: 2.1 time: 0.429432 Oct 28 13:12:56.809924 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1274/2462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:56 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:56.830520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0e7f7d85-0267-495e-a6f4-b0c73d5d8883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9395ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:56.843759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-38b70639-2474-4be9-a489-9c5bbfc05fff tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Getting quotas for project f973a578f68f48978ec53c2e2cfe64d7. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:12:56.849691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-38b70639-2474-4be9-a489-9c5bbfc05fff tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Getting quotas for user 6b89eeb21ebe45d8a33f5faa090b48df and project f973a578f68f48978ec53c2e2cfe64d7. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:12:56.876008 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0e7f7d85-0267-495e-a6f4-b0c73d5d8883 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.056127 Oct 28 13:12:56.876582 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1275/2463] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:12:56 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:56.881157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a6ec08f3-5576-4488-ba44-a6682ba02d6f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:56.881758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a6ec08f3-5576-4488-ba44-a6682ba02d6f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:56.937651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a6ec08f3-5576-4488-ba44-a6682ba02d6f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:56.950483 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a6ec08f3-5576-4488-ba44-a6682ba02d6f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1210 microversion: 2.1 time: 0.072475 Oct 28 13:12:56.952277 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1276/2464] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:56 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1210 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:56.959593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:56.960209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:56.966298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.966792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.967233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.968490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:56.968939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:56.969358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:56.995378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:12:57.021937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:12:57.052732 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-38b70639-2474-4be9-a489-9c5bbfc05fff tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.623399 Oct 28 13:12:57.053332 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1189/2465] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:12:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:57.058028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:57.058640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:57.065464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.066040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.066594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:57.067433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.067895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.068320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:57.185128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bac5765f-24d8-4317-9da1-9d1b6d7e8260 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130596 Oct 28 13:12:57.185887 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1190/2466] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:12:57 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:57.374733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-999ebf11-7b97-4fd3-992b-0cca8f037354 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 204 len: 0 microversion: 2.1 time: 0.420582 Oct 28 13:12:57.375671 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1277/2467] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:12:56 2022] DELETE /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:12:57.383942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:57.384542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:57.390701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.391248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.391856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:57.392566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.393017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.393591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:57.563388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:57.571863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a7e9242-0d2b-4b7f-b2a2-2e3fa0e9e8ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1512 microversion: 2.1 time: 0.192154 Oct 28 13:12:57.586772 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1191/2468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:57 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:57.836207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:57.836956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:57.844537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.845040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.845703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:57.846402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.847108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.847539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:57.892035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bb0066fc-8897-47d6-bcea-0f646b3d14e7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9386550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:57.941249 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bb0066fc-8897-47d6-bcea-0f646b3d14e7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.053421 Oct 28 13:12:57.941943 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1192/2469] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:12:57 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:57.975902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:57.976692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:57.983844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.984347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.985043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:57.986178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:57.986977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:57.987629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:58.063726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:58.069845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:58.073045 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf2b6bd8-6389-4d14-a615-faaaf5433670 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1323 microversion: 2.1 time: 0.242468 Oct 28 13:12:58.074498 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1278/2470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:57 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1323 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:58.084513 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c3642db-64b5-4bf7-be34-bd21c281e7c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1214 microversion: 2.1 time: 0.113801 Oct 28 13:12:58.085592 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1193/2471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:57 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:58.512547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fb8f76f9-d825-45db-8298-6c858764657e req-ca5f09d1-488c-47ed-aca1-b229ee0888d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be0a200a-8337-4ce1-9404-6e719e6c00c3", "tag": "967b35f9-36cc-4cb3-a61d-6cafecb65010"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:12:58.523371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb8f76f9-d825-45db-8298-6c858764657e req-ca5f09d1-488c-47ed-aca1-b229ee0888d5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:58.523912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb8f76f9-d825-45db-8298-6c858764657e req-ca5f09d1-488c-47ed-aca1-b229ee0888d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:58.524443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb8f76f9-d825-45db-8298-6c858764657e req-ca5f09d1-488c-47ed-aca1-b229ee0888d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:58.540630 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fb8f76f9-d825-45db-8298-6c858764657e req-ca5f09d1-488c-47ed-aca1-b229ee0888d5 service nova] Creating event network-changed:967b35f9-36cc-4cb3-a61d-6cafecb65010 for instance be0a200a-8337-4ce1-9404-6e719e6c00c3 on n-h1-862876-2 Oct 28 13:12:58.550247 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fb8f76f9-d825-45db-8298-6c858764657e req-ca5f09d1-488c-47ed-aca1-b229ee0888d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041576 Oct 28 13:12:58.550975 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1279/2472] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:12:58.597825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:58.599260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:58.612001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:58.612370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:58.613093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:58.613892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:58.622765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:58.624624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:58.625235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:58.625724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:58.639999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:58.642737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:58.643218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:58.643972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:58.644437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:58.644889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:58.817684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:58.824513 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-56e9c157-ee86-4e8e-86cc-de436a6e41ca tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1512 microversion: 2.1 time: 0.233193 Oct 28 13:12:58.835963 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1194/2473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:58 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:58.869625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:58.877796 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e441ca7-5732-4e81-a091-7cbc4f70cad8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.271355 Oct 28 13:12:58.878419 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1280/2474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:58 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:58.958128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-117b7789-a280-4fef-add4-388af1d311c0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b957f160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:59.098536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:59.099919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:59.114363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.120151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.122105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:59.129605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.129605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.129605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:59.141013 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-117b7789-a280-4fef-add4-388af1d311c0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.186489 Oct 28 13:12:59.142469 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1195/2475] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:12:58 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:59.163425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:59.166408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:59.183143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.186105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.186105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:59.187250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.188125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.190470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:59.285484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:59.294942 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-13cd613e-a935-4a70-a7de-30d956309278 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1262 microversion: 2.1 time: 0.151178 Oct 28 13:12:59.316705 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1196/2476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:59 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:12:59.785645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:12:59.798309 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd269c51-802c-48ee-b867-da387fbc697e tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 200 len: 1516 microversion: 2.1 time: 0.704717 Oct 28 13:12:59.805618 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1281/2477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:59 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 1516 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:12:59.824429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:59.826022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:59.849064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:12:59.849681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:12:59.854586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.855279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.855734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:59.857967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.857967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.857967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:59.862456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.862983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.863426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:12:59.864124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:12:59.864749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:12:59.865324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:00.394657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:00.408347 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26321799-3c0d-4453-b920-af3c292901f7 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753" status: 200 len: 1516 microversion: 2.1 time: 0.589824 Oct 28 13:13:00.410527 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1197/2478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:59 2022] GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753 => generated 1516 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:00.423014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:00.431779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0b6b3988-b93a-426d-96dc-d14c6e6230ed req-7e8f9a41-3c8b-4c59-887b-a48f255fd5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "name": "network-vif-unplugged", "status": "completed", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:00.434806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2ba0e3eb-8a42-4ba6-adff-2cee2611a62f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1512 microversion: 2.1 time: 0.589482 Oct 28 13:13:00.435411 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1282/2479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:12:59 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1512 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:00.443436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d9d31c68-4e60-4a72-8fec-29f03d5095ed tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bda691f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:00.475375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b6b3988-b93a-426d-96dc-d14c6e6230ed req-7e8f9a41-3c8b-4c59-887b-a48f255fd5a1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:00.476447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b6b3988-b93a-426d-96dc-d14c6e6230ed req-7e8f9a41-3c8b-4c59-887b-a48f255fd5a1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:00.477226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b6b3988-b93a-426d-96dc-d14c6e6230ed req-7e8f9a41-3c8b-4c59-887b-a48f255fd5a1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:00.509978 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0b6b3988-b93a-426d-96dc-d14c6e6230ed req-7e8f9a41-3c8b-4c59-887b-a48f255fd5a1 service nova] Creating event network-vif-unplugged:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:13:00.527721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0b6b3988-b93a-426d-96dc-d14c6e6230ed req-7e8f9a41-3c8b-4c59-887b-a48f255fd5a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106724 Oct 28 13:13:00.529235 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1198/2480] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:00.540495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:00.541552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:00.561432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:00.562434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:00.562986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:00.563807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:00.572084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:00.572084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:01.401910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:01.419309 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49b65385-143c-43ba-8d11-89361b566840 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1268 microversion: 2.1 time: 0.888092 Oct 28 13:13:01.422282 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1199/2481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:00 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1268 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:01.444425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:01.445314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:01.453169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:01.454052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:01.454722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:01.455664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:01.456304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:01.457717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:01.786370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:01.805024 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-010cf109-98c6-48f9-baa9-1d3a01a618ac tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 200 len: 1515 microversion: 2.1 time: 0.377892 Oct 28 13:13:01.807972 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1200/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:01 2022] GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:01.814952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-09f42447-0e5e-4881-986e-d1f01950bacc req-1b35971b-853b-4cdf-a50a-3d646e0e5feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99289a7-5b75-40b8-b832-8d1f1223ddd3", "name": "network-vif-deleted", "tag": "98f29cf1-13d1-4688-80fa-44ac57639ab5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:01.835911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-09f42447-0e5e-4881-986e-d1f01950bacc req-1b35971b-853b-4cdf-a50a-3d646e0e5feb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:01.836994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-09f42447-0e5e-4881-986e-d1f01950bacc req-1b35971b-853b-4cdf-a50a-3d646e0e5feb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:01.837618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-09f42447-0e5e-4881-986e-d1f01950bacc req-1b35971b-853b-4cdf-a50a-3d646e0e5feb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:01.851696 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-09f42447-0e5e-4881-986e-d1f01950bacc req-1b35971b-853b-4cdf-a50a-3d646e0e5feb service nova] Creating event network-vif-deleted:98f29cf1-13d1-4688-80fa-44ac57639ab5 for instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 on n-h2-862876-2 Oct 28 13:13:01.858864 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-09f42447-0e5e-4881-986e-d1f01950bacc req-1b35971b-853b-4cdf-a50a-3d646e0e5feb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048935 Oct 28 13:13:01.860017 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1201/2483] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:01.868409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:01.869483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:01.877395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:01.878253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:01.878872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:01.882840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:01.882840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:01.882840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:01.932327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:01.933083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:01.933665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:01.934324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lazy-loading 'fault' on Instance uuid b99289a7-5b75-40b8-b832-8d1f1223ddd3 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:13:02.048267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:02.069615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6712d69e-d0c5-4a95-851e-a89dc045755a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 200 len: 1306 microversion: 2.1 time: 0.206704 Oct 28 13:13:02.070694 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1202/2484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:01 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 1306 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:02.077501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:02.078735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:02.090027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:02.091103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:02.092061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:02.093644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:02.094486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:02.095430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:02.145131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:13:02.568865 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a4ac89f-4fd6-42e2-b7f7-063129f36e0b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 204 len: 0 microversion: 2.1 time: 0.496415 Oct 28 13:13:02.569526 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1203/2485] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:02 2022] DELETE /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:13:02.575557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:02.576481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:02.604552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:02.609255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:02.612994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:02.616129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:02.620938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:02.624811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:02.728143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d9d31c68-4e60-4a72-8fec-29f03d5095ed tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 2.291435 Oct 28 13:13:02.728739 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1283/2486] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:00 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:02.751588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-568336221", "imageRef": "fde2ba4c-0de3-49c4-add8-ffb38b77e47f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3d4ef8ba-90e7-415a-92e3-a6a7369f6845"}], "security_groups": [{"name": "tempest-securitygroup--1092248296"}], "key_name": "tempest-keypair-605127733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:02.926577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] validate_networks() for [('3d4ef8ba-90e7-415a-92e3-a6a7369f6845', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:13:03.048239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:03.062679 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c84ac272-9c72-46b9-9580-f83126835c3a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1310 microversion: 2.1 time: 0.491940 Oct 28 13:13:03.063634 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1204/2487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:02 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1310 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:03.094251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:03.095232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:03.101952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.102697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.103345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.105780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.105780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.105780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.377970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:03.391660 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ed8d5cb7-37cc-4617-8617-1582909ff9f5 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 200 len: 1521 microversion: 2.1 time: 0.326701 Oct 28 13:13:03.392581 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1205/2488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:03 2022] GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:03.397166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e736d72a-fa2f-4768-8c05-ad7605911451 req-bd40cfd5-ceb7-4392-9c67-8438753dbe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23c46ff-706a-4918-8cf5-a16d7f29617f", "name": "network-vif-plugged", "status": "completed", "tag": "afc87e88-81fb-45ed-a23f-deceb3e4e759"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:03.429119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e736d72a-fa2f-4768-8c05-ad7605911451 req-bd40cfd5-ceb7-4392-9c67-8438753dbe35 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.429680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e736d72a-fa2f-4768-8c05-ad7605911451 req-bd40cfd5-ceb7-4392-9c67-8438753dbe35 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.430224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e736d72a-fa2f-4768-8c05-ad7605911451 req-bd40cfd5-ceb7-4392-9c67-8438753dbe35 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.446210 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e736d72a-fa2f-4768-8c05-ad7605911451 req-bd40cfd5-ceb7-4392-9c67-8438753dbe35 service nova] Creating event network-vif-plugged:afc87e88-81fb-45ed-a23f-deceb3e4e759 for instance f23c46ff-706a-4918-8cf5-a16d7f29617f on n-h1-862876-2 Oct 28 13:13:03.463162 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e736d72a-fa2f-4768-8c05-ad7605911451 req-bd40cfd5-ceb7-4392-9c67-8438753dbe35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068508 Oct 28 13:13:03.463807 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1206/2489] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:03.472908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:03.473625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:03.480299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.480804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.481295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.482017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.482479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.483146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.515526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:03.719776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:13:03.720183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:13:03.720667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:13:03.721086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:13:03.721502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:13:03.736716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.739315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.739853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.740804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.741493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.742384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.765138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Getting quotas for project f973a578f68f48978ec53c2e2cfe64d7. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:13:03.772260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Getting quotas for user 6b89eeb21ebe45d8a33f5faa090b48df and project f973a578f68f48978ec53c2e2cfe64d7. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:13:03.785832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:13:03.788369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fde2ba4c-0de3-49c4-add8-ffb38b77e47f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:13:03.814579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:03.829633 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-22325d87-f1f3-4b0e-8877-e55b0b641d13 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.364152 Oct 28 13:13:03.830838 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1207/2490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:03 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:03.860331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:03.860331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:03.866604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.867194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.867797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.868681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:03.869342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:03.870333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 HTTP/1.1 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b99289a7-5b75-40b8-b832-8d1f1223ddd3'} Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:03.902272 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:03.906815 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:03.909096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:03.910759 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4c5b388-35bc-47cd-973f-dcb945a1c043 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 404 len: 111 microversion: 2.1 time: 0.058981 Oct 28 13:13:03.917105 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1208/2491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:03 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:03.924294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e00e33d-5b02-46df-9858-688166330b9e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b957fee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:03.991365 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-038b5021-28e0-4286-b14d-bff9ea12414b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.252230 Oct 28 13:13:03.993135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1284/2492] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:13:03.994295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e00e33d-5b02-46df-9858-688166330b9e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.075349 Oct 28 13:13:03.995050 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1209/2493] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:03 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:04.010324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-22a96cf0-8e28-486a-8729-de925dfdbded req-d44ae9c6-2d74-4bfc-a3fc-ab0dbcbbe358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1ffca7-434e-4a17-b653-1de7ad966c6c", "tag": "c9686326-87a8-4332-8fdd-fc24a3f1076c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:04.037315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-22a96cf0-8e28-486a-8729-de925dfdbded req-d44ae9c6-2d74-4bfc-a3fc-ab0dbcbbe358 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.037896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-22a96cf0-8e28-486a-8729-de925dfdbded req-d44ae9c6-2d74-4bfc-a3fc-ab0dbcbbe358 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.039263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-22a96cf0-8e28-486a-8729-de925dfdbded req-d44ae9c6-2d74-4bfc-a3fc-ab0dbcbbe358 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.053976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:04.054911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:04.059987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-22a96cf0-8e28-486a-8729-de925dfdbded req-d44ae9c6-2d74-4bfc-a3fc-ab0dbcbbe358 service nova] Creating event network-changed:c9686326-87a8-4332-8fdd-fc24a3f1076c for instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c on n-h1-862876-2 Oct 28 13:13:04.079182 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-22a96cf0-8e28-486a-8729-de925dfdbded req-d44ae9c6-2d74-4bfc-a3fc-ab0dbcbbe358 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070079 Oct 28 13:13:04.080159 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1210/2494] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:04.087081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.090787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.093804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.096378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.097280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:04.097869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.098235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:04.100058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.116951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.117551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.120749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.121950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.122083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.124252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.344900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:04.357525 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a18d6f7-9ea7-4b00-a1a5-73ae3d68eded tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.354054 Oct 28 13:13:04.365452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1285/2495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:03 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:04.379637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-969a02aa-dedb-4d85-9c75-e6f55c7d89fd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:04.380267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-969a02aa-dedb-4d85-9c75-e6f55c7d89fd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:04.449180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-969a02aa-dedb-4d85-9c75-e6f55c7d89fd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:04.459096 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-969a02aa-dedb-4d85-9c75-e6f55c7d89fd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1244 microversion: 2.1 time: 0.092373 Oct 28 13:13:04.459895 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1286/2496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:04 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:04.481182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:04.482041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:04.504708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.511297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.511762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.512501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.513516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.514883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.529364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:04.538642 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e9c42ee-fd49-4833-a3b2-cfbc971b2f5f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.457249 Oct 28 13:13:04.543313 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1211/2497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:04 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:04.559142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:04.560336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:04.583046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.583580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.584034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.584773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.585233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.596888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.821320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:04.832363 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d83877a1-5421-4aac-aa69-d847cdca5807 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1310 microversion: 2.1 time: 0.363044 Oct 28 13:13:04.845822 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1287/2498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:04 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1310 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:04.855133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:04.856787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:04.861780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:04.863554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.864307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.865003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.865925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.866867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.867760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.870142 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8af15d8-3b47-420f-8af6-352153de7944 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.324139 Oct 28 13:13:04.870714 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1212/2499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:04 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:04.875842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c76b4944-4a8f-4666-af4b-b562a8766ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c76b4944-4a8f-4666-af4b-b562a8766ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 163 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": 12345, "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 12345 Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:04.894047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c76b4944-4a8f-4666-af4b-b562a8766ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c76b4944-4a8f-4666-af4b-b562a8766ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019939 Oct 28 13:13:04.897824 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1213/2500] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:04 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:04.903151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:04.906020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:04.914289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.914814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.917048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:04.917048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:04.917048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:04.917499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:05.120014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:05.147963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c5a7f01-be14-459f-983a-bc1a7ca4059d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 200 len: 1521 microversion: 2.1 time: 0.286392 Oct 28 13:13:05.147963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1288/2501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:04 2022] GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:05.147963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:05.147963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:05.159862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:05.161824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:05.162309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:05.162737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:05.168053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:05.168748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:05.171717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:05.204618 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c2f6873c-2af8-4c62-b879-3ea1a589edd5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.309624 Oct 28 13:13:05.212132 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1214/2502] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:04 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:13:05.242457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0401a727-4318-44a8-9404-4d40a157ff60 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b93d4a60>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:05.358510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0401a727-4318-44a8-9404-4d40a157ff60 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.142332 Oct 28 13:13:05.359163 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1215/2503] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:05 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:05.385066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:05.385877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:05.398719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:05.399239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:05.399616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:05.400728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:05.402779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:05.402779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:05.777611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:05.789223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a03b13bc-c1c7-4b7c-85eb-42a97ce1708b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1669 microversion: 2.1 time: 0.428581 Oct 28 13:13:05.792081 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1216/2504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:05 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:05.799782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:05.800753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:05.828362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:05.830294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:05.832982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:05.836109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:05.837957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:05.838780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:05.839412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:05.966657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:06.011587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6c3c7eba-a633-4e10-b537-2db18c72b9f6 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1248 microversion: 2.1 time: 0.217535 Oct 28 13:13:06.029352 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1217/2505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:05 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1248 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:06.236139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:06.252949 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-03e3b5c0-d550-411d-8e52-2f313597d07e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 1.116807 Oct 28 13:13:06.255261 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1289/2506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:05 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:06.263730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:06.265223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:06.271919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.273377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.274086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.275376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.276090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.276714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.455266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5eb57b6a-ffa7-4339-b22a-b5e2c17224d5 req-53be568e-286e-4213-a892-c2b037dd02d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d808f4-9720-4a77-981a-9a937fac2737", "name": "network-vif-deleted", "tag": "e1094ce7-61fe-4edf-a449-7796d4ad9df1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:06.490968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5eb57b6a-ffa7-4339-b22a-b5e2c17224d5 req-53be568e-286e-4213-a892-c2b037dd02d4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.491480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5eb57b6a-ffa7-4339-b22a-b5e2c17224d5 req-53be568e-286e-4213-a892-c2b037dd02d4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.491928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5eb57b6a-ffa7-4339-b22a-b5e2c17224d5 req-53be568e-286e-4213-a892-c2b037dd02d4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.513717 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5eb57b6a-ffa7-4339-b22a-b5e2c17224d5 req-53be568e-286e-4213-a892-c2b037dd02d4 service nova] Creating event network-vif-deleted:e1094ce7-61fe-4edf-a449-7796d4ad9df1 for instance 66d808f4-9720-4a77-981a-9a937fac2737 on n-h2-862876-2 Oct 28 13:13:06.521996 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5eb57b6a-ffa7-4339-b22a-b5e2c17224d5 req-53be568e-286e-4213-a892-c2b037dd02d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.490914 Oct 28 13:13:06.523004 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1218/2507] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:06.528309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:06.529035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:06.540710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.541204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.541731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.542450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.543402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.543888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lazy-loading 'fault' on Instance uuid 66d808f4-9720-4a77-981a-9a937fac2737 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e3d1afd3-7211-4287-9368-c55237d473bd tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 200 len: 1313 microversion: 2.1 time: 0.128070 Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1219/2508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:06 2022] GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 1313 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.859408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.859408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a141bd74-2024-44d2-bad0-3913dd9f8632 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1310 microversion: 2.1 time: 0.441757 Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1290/2509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:06 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1310 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce2ace61-3a21-4be9-885b-1df74845f7d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9dac9d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce2ace61-3a21-4be9-885b-1df74845f7d5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.056634 Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1291/2510] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:06 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:06.861704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:06.865830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:06.900782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:06.911036 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14685ffa-763c-4822-aa8c-8838175ca3d8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.255826 Oct 28 13:13:06.911913 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1220/2511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:06 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:07.037643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:07.039063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:07.045363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:07.046577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:07.047295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:07.048177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:07.049212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:07.049816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:07.050400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:07.058259 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-77468d5e-0fd8-456c-b76b-779c8f7e5b47 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1669 microversion: 2.1 time: 0.240657 Oct 28 13:13:07.062847 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1292/2512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:06 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1669 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:07.129877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:07.138550 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-829b0468-b34d-4695-ab2e-a2fd5e0779a4 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1240 microversion: 2.1 time: 0.106403 Oct 28 13:13:07.146940 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1221/2513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:07 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:07.882327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85f0f4fa-28ba-483f-be57-41d1562125a9 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bda77ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:07.898183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:07.898986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:07.912033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:07.914123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:07.914699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:07.917449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:07.918124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:07.919168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:07.975127 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85f0f4fa-28ba-483f-be57-41d1562125a9 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.097792 Oct 28 13:13:07.976672 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1293/2514] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:07 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:07.987334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:07.987958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:08.002990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.002990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.002990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.002990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.002990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.002990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.036817 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] HTTP exception thrown: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 HTTP/1.1 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '66d808f4-9720-4a77-981a-9a937fac2737'} Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.038566 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 404 to user: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:08.042670 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60ca691f-df6c-443c-9ced-84731b9c860b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 404 len: 111 microversion: 2.1 time: 0.061427 Oct 28 13:13:08.044505 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1294/2515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:07 2022] GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:08.049663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.055353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.056258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:08.062816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.063488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.078154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.078154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.078154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.078154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.126290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.139895 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2698acea-35b4-4b31-9411-7786b4b7d329 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1310 microversion: 2.1 time: 0.250102 Oct 28 13:13:08.141127 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1222/2516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:07 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1310 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:08.146361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.147260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:08.153642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.154210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.158626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.159872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.160548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.161173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.185160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9d09705-8721-491c-b04a-3c5ec9cfbb7b tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.139308 Oct 28 13:13:08.186418 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1295/2517] 10.222.0.25 () {58 vars in 1230 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:13:08.194618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.202259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:08.203381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.203894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.204391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.205293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.207323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.207993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.297105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.306165 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e90d1bc-fc14-4ae0-b5a5-022344ae992d tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1296 microversion: 2.1 time: 0.115664 Oct 28 13:13:08.307094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1296/2518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:08.316479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3070d16-a816-4d00-a042-85c33ec07ea6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3070d16-a816-4d00-a042-85c33ec07ea6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 13:13:08.329113 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3070d16-a816-4d00-a042-85c33ec07ea6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3070d16-a816-4d00-a042-85c33ec07ea6 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026754 Oct 28 13:13:08.344445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1297/2519] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:08.359438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.376460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.377171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:08.407664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.408168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.408656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.409334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.411643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.418960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.419452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.426588 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2558c823-315e-4324-a72e-3e190020c278 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.281510 Oct 28 13:13:08.432912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1223/2520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:08.450826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:08.455378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:08.460417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:08.461946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.464323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.465847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.468997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.469814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.470468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.509029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:13:08.551397 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ccb5cdca-6683-43aa-bada-c359efa3cd78 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 200 len: 322 microversion: 2.1 time: 0.107131 Oct 28 13:13:08.563557 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1224/2521] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:08 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 322 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:13:08.582584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.586255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:08.593273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c23877e2-bf10-4ada-b5a7-b299f89cda0c tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.246604 Oct 28 13:13:08.593886 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1298/2522] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers => generated 683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:08.601666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.602228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.602670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.603452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.603915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.604399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.614648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.619831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.621192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.servers [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Removing options 'limit' from query {{(pid=127793) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 13:13:08.621192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:08.627353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.628063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.628668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.629753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.630873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.631459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.664301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:13:08.714839 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1dda0323-f96a-452d-8971-3fbe55316e27 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.111604 Oct 28 13:13:08.717690 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1299/2523] 10.222.0.25 () {58 vars in 1144 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:08.730613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e62d733-97fb-4414-9185-d48cfb1e6542 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e62d733-97fb-4414-9185-d48cfb1e6542 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi '-1' Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 13:13:08.740095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 13:13:08.744699 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.749322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e62d733-97fb-4414-9185-d48cfb1e6542 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:08.750566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e62d733-97fb-4414-9185-d48cfb1e6542 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024120 Oct 28 13:13:08.751556 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1300/2524] 10.222.0.25 () {58 vars in 1142 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:08.772596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e38bbcf-d1de-424d-ae16-23e93c680cee tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e38bbcf-d1de-424d-ae16-23e93c680cee tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: action_args: {} Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'testing' Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 13:13:08.783488 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e38bbcf-d1de-424d-ae16-23e93c680cee tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9e38bbcf-d1de-424d-ae16-23e93c680cee tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029332 Oct 28 13:13:08.797575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1301/2525] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:08.811630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed2c2fb2-f67b-4fc7-bf63-056951bc1943 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.817963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ed2c2fb2-f67b-4fc7-bf63-056951bc1943 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.818793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed2c2fb2-f67b-4fc7-bf63-056951bc1943 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:08.830008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.servers [None req-ed2c2fb2-f67b-4fc7-bf63-056951bc1943 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Flavor 'non_existing_flavor' could not be found {{(pid=127793) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 28 13:13:08.831852 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed2c2fb2-f67b-4fc7-bf63-056951bc1943 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.035552 Oct 28 13:13:08.834477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1302/2526] 10.222.0.25 () {58 vars in 1178 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:13:08.846939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:08.852660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.853512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:08.860314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.863399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.864033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.865067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:08.871246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:08.871246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:08.952463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:08.962617 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-127248a4-fef1-4888-a1cd-2a3954c0f897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.390185 Oct 28 13:13:08.975570 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1225/2527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:08.994159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d7e1987e-4ea3-4aab-a9eb-ab1e385bce6e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9418670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:09.084169 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b03792bb-ddeb-439c-be01-a9e7176630cb tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.237918 Oct 28 13:13:09.087859 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1303/2528] 10.222.0.25 () {58 vars in 1174 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:13:09.088261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d7e1987e-4ea3-4aab-a9eb-ab1e385bce6e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1438 microversion: 2.1 time: 0.099651 Oct 28 13:13:09.089281 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1226/2529] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:08 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:09.105050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:09.105930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:09.113408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.114180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.116915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.116915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.116915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.116915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.122087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:09.128896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:09.149995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:09.150966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:09.174232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.174232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.174232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.179058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.179571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.180024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.305965 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee0b88d1-ff12-4381-b02e-91f8159cf9a0 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.203758 Oct 28 13:13:09.316758 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1227/2530] 10.222.0.25 () {58 vars in 1184 bytes} [Fri Oct 28 13:13:09 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:13:09.322625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:09.325561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:09.336038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.336830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.337631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.338618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.339241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.339900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.500313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:09.526105 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b17d94bd-e1fb-4c84-9cdc-7d4b5d174ef6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.436444 Oct 28 13:13:09.534151 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1304/2531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:09 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:09.551271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:09.568418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:09.575243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:09.584383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:09.592902 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-103cf17c-c874-4a9c-8e7a-fc78f8e5dcee tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1310 microversion: 2.1 time: 0.274909 Oct 28 13:13:09.595459 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1228/2532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:09 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1310 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:09.604347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:09.605361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:09.613252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.613750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.618307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.618578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.618786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.618786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.618928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.619001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.619095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.619188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.619284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.619362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.648428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:13:09.652720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:09.726635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:09.737483 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1711a629-22b4-4f4a-8f13-315ed91040b9 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1302 microversion: 2.1 time: 0.140788 Oct 28 13:13:09.738553 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1229/2533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:09 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:09.751765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:09.754060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:09.767566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.768078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.768529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.769250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.769715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.770149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:09.791262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:09.809113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:09.810647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:09.811084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:10.028363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:10.049091 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7cba4799-bdc5-422b-babc-908e05a608a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.309119 Oct 28 13:13:10.058199 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1230/2534] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:09 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:10.088338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:10.090524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:10.109231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:10.110013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:10.111271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:10.112479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:10.113567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:10.115525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:10.386227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:10.417823 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-22bbac5c-0d74-48ce-93be-49a27f19b9eb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.335420 Oct 28 13:13:10.420830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1231/2535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:10 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:10.440152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12b36ae0-8445-479e-a361-5c110e05bd2d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b960a3a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:10.441756 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4dc5c7d-da39-4a2e-a622-b09442a206a4 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.909003 Oct 28 13:13:10.443458 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1305/2536] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:13:09 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:10.474279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-606a287b-477a-4013-9049-da4d4a1a1566 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:10.488053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-606a287b-477a-4013-9049-da4d4a1a1566 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:10.500635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-606a287b-477a-4013-9049-da4d4a1a1566 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.022263 Oct 28 13:13:10.503362 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1306/2537] 10.222.0.25 () {58 vars in 1178 bytes} [Fri Oct 28 13:13:10 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:13:10.517720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:10.551937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:10.555676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Searching by: {'deleted': False, 'project_id': '2598a075668a43e492dacb3eff4f7071'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:10.624236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:10.630163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:10.630987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:10.635316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:10.637989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:10.637989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:10.712909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:13:10.765225 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea7a11c3-c05e-4c03-88f1-1c2aa915d019 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.252863 Oct 28 13:13:10.767023 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1307/2538] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:13:10 2022] GET /compute/v2.1/servers => generated 683 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:10.793407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:10.794712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:10.810147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:10.810656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:10.812239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:10.819038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:10.819038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:10.819038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:11.188914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:11.202103 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d3fcef33-84bc-48ec-b1f2-bf143b81b866 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1310 microversion: 2.1 time: 0.433128 Oct 28 13:13:11.202710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1308/2539] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:10 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1310 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:11.225037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-243026724", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a6d79be4-5785-49f8-a61c-931d9498eb9a"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:18.762602 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12b36ae0-8445-479e-a361-5c110e05bd2d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1447 microversion: 2.1 time: 8.339531 Oct 28 13:13:18.764043 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1232/2540] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:10 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1447 bytes in 8342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:18.765808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] validate_networks() for [('a6d79be4-5785-49f8-a61c-931d9498eb9a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:13:18.771132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-804b37dd-392d-4f63-aa3e-65c45b0f0b5d req-faac896b-b7f3-4fe7-95c9-8b37e8d44ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1ffca7-434e-4a17-b653-1de7ad966c6c", "name": "network-vif-plugged", "status": "completed", "tag": "c9686326-87a8-4332-8fdd-fc24a3f1076c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:18.785849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-804b37dd-392d-4f63-aa3e-65c45b0f0b5d req-faac896b-b7f3-4fe7-95c9-8b37e8d44ffc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:18.786417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-804b37dd-392d-4f63-aa3e-65c45b0f0b5d req-faac896b-b7f3-4fe7-95c9-8b37e8d44ffc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:18.786879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-804b37dd-392d-4f63-aa3e-65c45b0f0b5d req-faac896b-b7f3-4fe7-95c9-8b37e8d44ffc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:18.799100 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-804b37dd-392d-4f63-aa3e-65c45b0f0b5d req-faac896b-b7f3-4fe7-95c9-8b37e8d44ffc service nova] Creating event network-vif-plugged:c9686326-87a8-4332-8fdd-fc24a3f1076c for instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c on n-h1-862876-2 Oct 28 13:13:18.804858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-804b37dd-392d-4f63-aa3e-65c45b0f0b5d req-faac896b-b7f3-4fe7-95c9-8b37e8d44ffc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039675 Oct 28 13:13:18.806442 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1233/2541] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:18.814933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:18.816075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:18.823098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:18.823834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:18.824441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:18.825324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:18.825966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:18.826595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.028654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:19.037844 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30667b1d-8dd6-4df1-a110-12b4f0ef8822 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.229878 Oct 28 13:13:19.041744 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1234/2542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:18 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:19.058452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:19.059256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:19.066572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.072019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.072019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.072019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.072019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.072019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.088478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] HTTP exception thrown: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 HTTP/1.1 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '66d808f4-9720-4a77-981a-9a937fac2737'} Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:19.090190 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 404 to user: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c25d9d6-3ab2-482b-8119-3634ca4a6045 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 404 len: 111 microversion: 2.1 time: 0.037050 Oct 28 13:13:19.103797 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1235/2543] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:19 2022] DELETE /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:19.105700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d77d3700-8a16-440b-ba5a-317d4b962c54 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-279964619", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9a058d02-b248-4e2b-acea-84fee1437126", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:19.180197 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d77d3700-8a16-440b-ba5a-317d4b962c54 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Block Device 9a058d02-b248-4e2b-acea-84fee1437126 is not bootable. Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d77d3700-8a16-440b-ba5a-317d4b962c54 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 357 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-279964619", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9a058d02-b248-4e2b-acea-84fee1437126", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: exception: Block Device 9a058d02-b248-4e2b-acea-84fee1437126 is not bootable. Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-279964619', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '9a058d02-b248-4e2b-acea-84fee1437126'}], 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 9a058d02-b248-4e2b-acea-84fee1437126 is not bootable. Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:19.186824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 9a058d02-b248-4e2b-acea-84fee1437126 is not bootable. Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 9a058d02-b248-4e2b-acea-84fee1437126 is not bootable. Oct 28 13:13:19.190330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:19.192965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d77d3700-8a16-440b-ba5a-317d4b962c54 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Block Device 9a058d02-b248-4e2b-acea-84fee1437126 is not bootable. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:19.194434 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d77d3700-8a16-440b-ba5a-317d4b962c54 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.097755 Oct 28 13:13:19.195247 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1236/2544] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:19 2022] POST /compute/v2.1/servers => generated 110 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:19.217952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:19.220570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:19.226239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:19.233961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.235851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.236328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.237242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.237770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.238538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.327245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:13:19.327746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:13:19.328293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:13:19.328785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:13:19.329271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:13:19.371807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.372389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.373044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.373846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.374631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.375133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.400435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:13:19.407126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for user d70178138d974c20bb9598de42bd3294 and project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:13:19.421222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:13:19.423926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:13:19.451110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:19.465681 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d904d7a5-f76d-46cf-af90-680245187093 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1310 microversion: 2.1 time: 0.266318 Oct 28 13:13:19.472302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1237/2545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:19 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1310 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:19.485073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e23dc771-0306-4d8c-b3da-23bb81a4a2e0 req-ece09f26-0b29-499d-94b2-2198cf337193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddabee5d-0299-4cbc-8229-6d9b7094d711", "tag": "02a72b35-1813-44ed-a9ec-b28228621ebb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:19.502705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e23dc771-0306-4d8c-b3da-23bb81a4a2e0 req-ece09f26-0b29-499d-94b2-2198cf337193 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.503634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e23dc771-0306-4d8c-b3da-23bb81a4a2e0 req-ece09f26-0b29-499d-94b2-2198cf337193 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.504182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e23dc771-0306-4d8c-b3da-23bb81a4a2e0 req-ece09f26-0b29-499d-94b2-2198cf337193 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.521821 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e23dc771-0306-4d8c-b3da-23bb81a4a2e0 req-ece09f26-0b29-499d-94b2-2198cf337193 service nova] Creating event network-changed:02a72b35-1813-44ed-a9ec-b28228621ebb for instance ddabee5d-0299-4cbc-8229-6d9b7094d711 on n-h2-862876-2 Oct 28 13:13:19.527364 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e23dc771-0306-4d8c-b3da-23bb81a4a2e0 req-ece09f26-0b29-499d-94b2-2198cf337193 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057714 Oct 28 13:13:19.528514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1238/2546] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:19.534426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4b2effe1-8e77-4a41-8d97-0c14e78eb331 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b957f550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:19.561782 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-02e8b32b-9cbe-4dbe-acbe-fd2a4a17e23c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.357741 Oct 28 13:13:19.563385 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1309/2547] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 8360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:13:19.569861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:19.570369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:19.577671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.586368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.586368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.586368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.586368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.586368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.612344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:13:19.811313 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4b2effe1-8e77-4a41-8d97-0c14e78eb331 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 200 len: 1447 microversion: 2.1 time: 0.281314 Oct 28 13:13:19.823578 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1239/2548] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:19 2022] GET /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:19.835599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:19.839129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:19.859192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.859192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.859192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:19.859192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:19.859192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:19.859192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:20.054202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:20.064813 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-250264ac-c123-4e00-8a59-9f842a22c479 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.239882 Oct 28 13:13:20.065988 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1240/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:19 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:20.071546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2467a116-e482-4373-a603-acdc405a4813 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:20.073057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2467a116-e482-4373-a603-acdc405a4813 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:20.073916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da91a3a3-7955-4a4e-b2c9-79aa665fa411 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753" status: 204 len: 0 microversion: 2.1 time: 0.508682 Oct 28 13:13:20.076419 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1310/2550] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:19 2022] DELETE /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:13:20.089540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0b79cfb-6c90-4af9-b2ec-b40ff2f57693 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9479040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:20.150236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2467a116-e482-4373-a603-acdc405a4813 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:20.158057 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2467a116-e482-4373-a603-acdc405a4813 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1214 microversion: 2.1 time: 0.090757 Oct 28 13:13:20.159289 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1241/2551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:20 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:20.181169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:20.182000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:20.188517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:20.189432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:20.190029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:20.191259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:20.191895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:20.192477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:20.409009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:20.423084 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5e989929-6edf-46b0-8ef7-fc3dc7b9cafd tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.245670 Oct 28 13:13:20.424517 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1242/2552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:20 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:20.443258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:20.444083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:20.457055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:20.457737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:20.458251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:20.459090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:20.459685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:20.460177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:21.147639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:13:21.465780 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71b8b1ab-d697-4c21-b579-f3d9e04e4226 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 204 len: 0 microversion: 2.1 time: 1.032048 Oct 28 13:13:21.465780 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1243/2553] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:20 2022] DELETE /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:13:21.472475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:21.473191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:21.479325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:21.479823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:21.480262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:21.480996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:21.481459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:21.481967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:21.917159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:21.927892 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7959a995-303c-4da7-911b-08c7854d2a2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.464856 Oct 28 13:13:21.934571 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1244/2554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:21 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:21.939625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:21.940261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:21.952396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:21.953394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:21.954295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:21.963594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:21.963594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:21.963594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.184286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:22.193121 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c04a3a8-14f6-41d4-b8da-3a4b73ecba7c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1494 microversion: 2.1 time: 0.257298 Oct 28 13:13:22.202999 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1245/2555] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:21 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1494 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:22.216432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:22.217100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:22.223251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.224254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.224919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.226266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.227559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.228610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.267618 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0b79cfb-6c90-4af9-b2ec-b40ff2f57693 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 204 len: 0 microversion: 2.1 time: 2.188142 Oct 28 13:13:22.268416 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1311/2556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:20 2022] DELETE /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 0 bytes in 2190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:13:22.274101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:22.275137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:22.282564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.283091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.283623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.284327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.284784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.285545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.297725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:22.305809 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63c4f3da-e641-4a19-b33e-a039f9e5d425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1210 microversion: 2.1 time: 0.101762 Oct 28 13:13:22.306380 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1246/2557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:22 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:22.311344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:22.311971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 66d808f4-9720-4a77-981a-9a937fac2737] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:22.322858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.323926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.325052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.325460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.326095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.327213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.343216 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] HTTP exception thrown: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 HTTP/1.1 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '66d808f4-9720-4a77-981a-9a937fac2737'} Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:22.355972 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 404 to user: Instance 66d808f4-9720-4a77-981a-9a937fac2737 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-199804b7-4b84-4a1e-b807-04190438afbc tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737" status: 404 len: 111 microversion: 2.1 time: 0.048095 Oct 28 13:13:22.359611 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1247/2558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:22 2022] GET /compute/v2.1/servers/66d808f4-9720-4a77-981a-9a937fac2737 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:22.478791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:22.492187 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20359dab-6800-4f96-82f9-86b6d9594d7f tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.221979 Oct 28 13:13:22.494293 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1312/2559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:22 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:22.514016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:22.515155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:22.523582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.524415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.525030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.525900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.526511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.527618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.564224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:13:22.860831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:22.861451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:22.867443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.868320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.868761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.869449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.870075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.870502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.899814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-45a2e425-7ece-4929-99d3-64361c8e3e04 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 204 len: 0 microversion: 2.1 time: 0.403182 Oct 28 13:13:22.905069 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1313/2560] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:22 2022] DELETE /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:13:22.913813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:22.919165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:22.936951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.937758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.938457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:22.949786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:22.952452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:22.953537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.019239 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-659a2f48-3ffb-4627-998f-eaec9577b1e0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1645 microversion: 2.1 time: 0.660493 Oct 28 13:13:23.020076 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1248/2561] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:22 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1645 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:23.024678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bd0864de-57b3-45c4-804c-0d20721535bc req-8b6a270d-ace2-4d3c-b32e-9146e98ab41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c633e2f6-b6c2-4334-b71e-9e2176e0f753", "name": "network-vif-deleted", "tag": "80e21ecc-28af-4e9a-83bf-0e2d099f9947"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:23.032523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.033271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.033897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.034980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd0864de-57b3-45c4-804c-0d20721535bc req-8b6a270d-ace2-4d3c-b32e-9146e98ab41b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.035781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lazy-loading 'fault' on Instance uuid c633e2f6-b6c2-4334-b71e-9e2176e0f753 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:13:23.035958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd0864de-57b3-45c4-804c-0d20721535bc req-8b6a270d-ace2-4d3c-b32e-9146e98ab41b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.036356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd0864de-57b3-45c4-804c-0d20721535bc req-8b6a270d-ace2-4d3c-b32e-9146e98ab41b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.052017 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bd0864de-57b3-45c4-804c-0d20721535bc req-8b6a270d-ace2-4d3c-b32e-9146e98ab41b service nova] Creating event network-vif-deleted:80e21ecc-28af-4e9a-83bf-0e2d099f9947 for instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 on n-h1-862876-2 Oct 28 13:13:23.057167 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bd0864de-57b3-45c4-804c-0d20721535bc req-8b6a270d-ace2-4d3c-b32e-9146e98ab41b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035784 Oct 28 13:13:23.058269 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1249/2562] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:23.064791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1020345723", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "09db6954-888a-48c6-adf5-d40098ae89d9"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:23.122293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] validate_networks() for [('09db6954-888a-48c6-adf5-d40098ae89d9', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:13:23.135455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:23.147150 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7f5e76e-9ae1-43ae-8cd7-33148352f49d tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753" status: 200 len: 1313 microversion: 2.1 time: 0.236907 Oct 28 13:13:23.147150 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1314/2563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:22 2022] GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:23.150408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:23.151070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:23.157592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.158105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.158527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.159463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.160076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.160659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.354505 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5dbd679-6684-44b5-960c-3cd19c33f08b tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1645 microversion: 2.1 time: 0.207181 Oct 28 13:13:23.356135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1315/2564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:23 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1645 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:23.378208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:23.385603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:23.388163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.389168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.390566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.392109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.393211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.393789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.477767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:23.487277 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b2882c8-15b2-4d9e-bce7-9acd45bf2d38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1266 microversion: 2.1 time: 0.129839 Oct 28 13:13:23.487915 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1316/2565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:23 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:23.494187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:23.499861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.500676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.501377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.502356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.503053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.503710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.531285 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7598d9ed-ac27-4975-9556-f8805eb64aae tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040817 Oct 28 13:13:23.532492 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1317/2566] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:13:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:23.537563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:23.538402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:23.549633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.551548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.552270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.553319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.553977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.554808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.643530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:13:23.644670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:13:23.645508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:13:23.646120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:13:23.646544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:13:23.659060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.659839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.660288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.661013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.661661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.662246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.681579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:13:23.687001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for user a43aa3346a70490d9c5e489c8e39d91d and project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:13:23.699843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:13:23.702366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:13:23.744260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:23.751945 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c02bc4ff-ee96-4ee0-958a-2d44e839806b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.218203 Oct 28 13:13:23.755568 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1318/2567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:23 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:23.757412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862876-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:23.760156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:23.766998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.767557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.768064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.768958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:23.769488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:23.769987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:23.787583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:23.799174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lazy-loading 'flavor' on Instance uuid 8b1ffca7-434e-4a17-b653-1de7ad966c6c {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:13:23.814474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Going to try to live migrate instance to n-h2-862876-2 {{(pid=127793) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:13:23.856159 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d71675f5-118d-4bdc-bb23-75cd3e5451d7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796429 Oct 28 13:13:23.856838 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1250/2568] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:13:23.868842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b76f4f28-342a-4fcb-a132-0329b1d0ae27 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:23.869462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b76f4f28-342a-4fcb-a132-0329b1d0ae27 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:23.944870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b76f4f28-342a-4fcb-a132-0329b1d0ae27 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:23.954655 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b76f4f28-342a-4fcb-a132-0329b1d0ae27 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1208 microversion: 2.1 time: 0.089659 Oct 28 13:13:23.958795 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1251/2569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:23 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:24.173283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:24.173283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:24.177714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.178280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.178720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:24.179441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.179894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.180318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:24.212103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.213766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.214222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:24.214773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lazy-loading 'fault' on Instance uuid c633e2f6-b6c2-4334-b71e-9e2176e0f753 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:13:24.270653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:24.283479 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52f05550-b9a0-45c6-808c-1e9fe0af4251 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753" status: 200 len: 1313 microversion: 2.1 time: 0.115576 Oct 28 13:13:24.301883 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1252/2570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:24 2022] GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753 => generated 1313 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:24.369818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-803fbeb1-35d8-4a20-9608-4a2b519481ec req-f6d775c4-5d5d-47d5-9ecb-fda988c5dc8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23c46ff-706a-4918-8cf5-a16d7f29617f", "name": "network-vif-unplugged", "status": "completed", "tag": "afc87e88-81fb-45ed-a23f-deceb3e4e759"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:24.380006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-803fbeb1-35d8-4a20-9608-4a2b519481ec req-f6d775c4-5d5d-47d5-9ecb-fda988c5dc8b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.380484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-803fbeb1-35d8-4a20-9608-4a2b519481ec req-f6d775c4-5d5d-47d5-9ecb-fda988c5dc8b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.380931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-803fbeb1-35d8-4a20-9608-4a2b519481ec req-f6d775c4-5d5d-47d5-9ecb-fda988c5dc8b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:24.384958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:24.392749 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-803fbeb1-35d8-4a20-9608-4a2b519481ec req-f6d775c4-5d5d-47d5-9ecb-fda988c5dc8b service nova] Creating event network-vif-unplugged:afc87e88-81fb-45ed-a23f-deceb3e4e759 for instance f23c46ff-706a-4918-8cf5-a16d7f29617f on n-h1-862876-2 Oct 28 13:13:24.397643 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-803fbeb1-35d8-4a20-9608-4a2b519481ec req-f6d775c4-5d5d-47d5-9ecb-fda988c5dc8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031584 Oct 28 13:13:24.398290 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1253/2571] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:13:24.515163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:24.516493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:24.525645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.526708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.527397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:24.528431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.529372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.530099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:24.656819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:24.668696 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-962eed9e-09b6-4dd8-876e-693cc681c57f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1266 microversion: 2.1 time: 0.160445 Oct 28 13:13:24.671302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1254/2572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:24 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:24.775604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:24.776425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:24.783649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.784140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.784582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:24.785286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:24.785742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:24.786356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.073050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:25.083688 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c066cdd-7bc1-43fe-a69b-01a1ae2780c7 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.311139 Oct 28 13:13:25.085401 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1255/2573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:24 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:25.094638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:25.095845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:25.103827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.104922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.108228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.110009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.110737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.111472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.242891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:25.253921 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9b31f40-343a-4a15-83fb-5d067f2584c1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1212 microversion: 2.1 time: 0.166786 Oct 28 13:13:25.254637 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1256/2574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:25 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1212 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:25.275918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82e83dfc-aaa9-4f75-8b5b-7f5eb21d8664 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089398170", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "65e1a51d-1f44-4651-86a6-90233a26cd48", "destination_type": "local"}, {"source_type": "volume", "uuid": "3a827446-dc97-4cee-a151-e23ba288a808", "destination_type": "invalid"}], "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82e83dfc-aaa9-4f75-8b5b-7f5eb21d8664 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 495 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089398170", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "65e1a51d-1f44-4651-86a6-90233a26cd48", "destination_type": "local"}, {"source_type": "volume", "uuid": "3a827446-dc97-4cee-a151-e23ba288a808", "destination_type": "invalid"}], "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2089398170', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3a827446-dc97-4cee-a151-e23ba288a808', 'destination_type': 'invalid'}], 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:25.281743 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 13:13:25.285974 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:25.289314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82e83dfc-aaa9-4f75-8b5b-7f5eb21d8664 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:25.290874 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-82e83dfc-aaa9-4f75-8b5b-7f5eb21d8664 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020743 Oct 28 13:13:25.296316 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1257/2575] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:25 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:25.301283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:25.302197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:25.311251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.311825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.312524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.314172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.314943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.315597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.474911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:25.483863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23d75bc5-5085-4f97-902a-d130c81605a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.186409 Oct 28 13:13:25.484540 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1258/2576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:25 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:25.491030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:25.491650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:25.499075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.505589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.505589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.509648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.511464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.513278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.589145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.590143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.593004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.593305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lazy-loading 'fault' on Instance uuid c633e2f6-b6c2-4334-b71e-9e2176e0f753 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:13:25.755372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcd59c06d654cb191b0460bcb8dc689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2598a075668a43e492dacb3eff4f7071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:25.773459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a181b894-485f-4108-8923-371317d94cde tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753" status: 200 len: 1313 microversion: 2.1 time: 0.285824 Oct 28 13:13:25.774171 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1259/2577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:25 2022] GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:25.782273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:25.787879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:25.808375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.809209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.809864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:25.811445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:25.812182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:25.812675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:26.326553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:26.337557 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c90531c1-562d-4270-8fee-eef2945dc115 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.561891 Oct 28 13:13:26.338151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1260/2578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:25 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:26.348050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:26.348579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:26.362320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:26.363098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:26.363687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:26.364727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:26.365333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:26.369552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:26.472287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:26.481801 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff17cf34-dfd1-4be6-9677-6920cc33213c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1272 microversion: 2.1 time: 0.142609 Oct 28 13:13:26.484999 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1261/2579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:26 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:26.493326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1d80e9d0-6e71-4eae-8921-fa05a8593889 req-22929c08-1197-45c0-9e99-06056a1467e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74de78ee-1eff-4dfe-8c7f-496c62551854", "name": "network-vif-deleted", "tag": "c2959aee-6533-4f25-8885-82b3f7d2ed36"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:26.524929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1d80e9d0-6e71-4eae-8921-fa05a8593889 req-22929c08-1197-45c0-9e99-06056a1467e9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:26.526494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1d80e9d0-6e71-4eae-8921-fa05a8593889 req-22929c08-1197-45c0-9e99-06056a1467e9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:26.549956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1d80e9d0-6e71-4eae-8921-fa05a8593889 req-22929c08-1197-45c0-9e99-06056a1467e9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:26.567407 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1d80e9d0-6e71-4eae-8921-fa05a8593889 req-22929c08-1197-45c0-9e99-06056a1467e9 service nova] Creating event network-vif-deleted:c2959aee-6533-4f25-8885-82b3f7d2ed36 for instance 74de78ee-1eff-4dfe-8c7f-496c62551854 on n-h2-862876-2 Oct 28 13:13:26.573232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1d80e9d0-6e71-4eae-8921-fa05a8593889 req-22929c08-1197-45c0-9e99-06056a1467e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087034 Oct 28 13:13:26.574022 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1262/2580] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:26.585085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:26.585966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:26.607621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:26.608297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:26.609133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:26.610194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:26.610881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:26.611468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:26.902794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:26.914915 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a2c3195b-2cdc-402a-a524-a0a450ad45ac tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.338241 Oct 28 13:13:26.928334 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1263/2581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:26 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:26.941362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:26.947830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:26.958738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:26.963362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:26.963976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:26.964421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:26.965121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:26.966673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:26.967713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.048027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:27.058407 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd795acc-6b25-49fa-a76e-2722e6f06526 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1260 microversion: 2.1 time: 0.126644 Oct 28 13:13:27.064058 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1264/2582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:26 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1260 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:27.071978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3a15d2f-23d0-4bfb-939d-0cd345732ec7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1957779298", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3a15d2f-23d0-4bfb-939d-0cd345732ec7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 492 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1957779298", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1957779298', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.080174 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 13:13:27.083297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.092957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3a15d2f-23d0-4bfb-939d-0cd345732ec7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:27.095592 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e3a15d2f-23d0-4bfb-939d-0cd345732ec7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.030243 Oct 28 13:13:27.096344 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1265/2583] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:27 2022] POST /compute/v2.1/servers => generated 624 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:27.106885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:27.108040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: c633e2f6-b6c2-4334-b71e-9e2176e0f753] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:27.119930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.120578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.120996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.121698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.122149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.122770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.139216 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] HTTP exception thrown: Instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 could not be found. Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753 HTTP/1.1 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 could not be found. Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'c633e2f6-b6c2-4334-b71e-9e2176e0f753'} Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 could not be found. Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 could not be found. Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.141460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 could not be found. Oct 28 13:13:27.145673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.147456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 404 to user: Instance c633e2f6-b6c2-4334-b71e-9e2176e0f753 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:27.148686 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14d3d0bb-b9e9-49ac-a908-4d0ae4c16082 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753" status: 404 len: 111 microversion: 2.1 time: 0.049924 Oct 28 13:13:27.149252 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1266/2584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:27 2022] GET /compute/v2.1/servers/c633e2f6-b6c2-4334-b71e-9e2176e0f753 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:27.154825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:27.155466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:27.164761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.164761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.164761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.164761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.164761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.164761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.437982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:27.465533 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cee1a075-f5a1-4ad4-8320-b819b19e659f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.308089 Oct 28 13:13:27.466353 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1267/2585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:27 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:27.478622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:27.485724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] [instance: 74de78ee-1eff-4dfe-8c7f-496c62551854] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:27.492544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.493326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.493754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.494628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.495134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.495557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.512438 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] HTTP exception thrown: Instance 74de78ee-1eff-4dfe-8c7f-496c62551854 could not be found. Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Request method failure captured: Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 HTTP/1.1 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UyaBdhhmfW5KY3I2m0wKXnq3PFddHw7uUb5GruMoJUYYr2ekfPHAGv0_c8cJpK3ke02ceYSJQB4jkU5ctLVvBQqVqBiSr0DN0V5cYK_ppM6x26VZ18eReVhLhHzN4ERR8DOtDs9R9feooyBaC64sgji6c-vzidCAbTP0D3whsJTGI Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2598a075668a43e492dacb3eff4f7071", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2598a075668a43e492dacb3eff4f7071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 2598a075668a43e492dacb3eff4f7071 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1128501770 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 0dcd59c06d654cb191b0460bcb8dc689 Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ListServersNegativeTestJSON-1128501770-project Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 74de78ee-1eff-4dfe-8c7f-496c62551854 could not be found. Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '74de78ee-1eff-4dfe-8c7f-496c62551854'} Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74de78ee-1eff-4dfe-8c7f-496c62551854 could not be found. Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74de78ee-1eff-4dfe-8c7f-496c62551854 could not be found. Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.514466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74de78ee-1eff-4dfe-8c7f-496c62551854 could not be found. Oct 28 13:13:27.522294 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:27.524742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] Returning 404 to user: Instance 74de78ee-1eff-4dfe-8c7f-496c62551854 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:27.525971 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d1f4ff6-4c14-439a-abcb-328f715dff34 tempest-ListServersNegativeTestJSON-1128501770 tempest-ListServersNegativeTestJSON-1128501770-project] 10.222.0.25 "GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854" status: 404 len: 111 microversion: 2.1 time: 0.057982 Oct 28 13:13:27.527121 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1268/2586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:27 2022] GET /compute/v2.1/servers/74de78ee-1eff-4dfe-8c7f-496c62551854 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:27.534439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:27.535092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:27.542151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.543930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.543930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.544148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.544495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.546190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.577134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a72ecb01-52e3-4b09-92e6-724fcd0e698d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c/action" status: 202 len: 0 microversion: 2.1 time: 3.823236 Oct 28 13:13:27.578103 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1319/2587] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:23 2022] POST /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c/action => generated 0 bytes in 3825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:13:27.583554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:27.584373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:27.609356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.610114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.610949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.611815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.612422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.613066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.886188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:27.897795 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-120189ce-b73e-4bb2-8221-ea9bd21e4626 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.369393 Oct 28 13:13:27.926877 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1269/2588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:27 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:27.930331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:27.943329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:27.946133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:27.961976 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b5818af-6d3a-4bc9-a0b6-fafcbb42648b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.381376 Oct 28 13:13:27.964799 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1320/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:27 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:27.975568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.976148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.976609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:27.977363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:27.977831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:27.979128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.000800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:28.003297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:28.035657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.039046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.040701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.042938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.046113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.049298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.381927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:28.392986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-43d8b7d9-97c1-4c20-bab3-1a102431b8a9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.464773 Oct 28 13:13:28.396817 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1270/2590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:27 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:28.407097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:28.407937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:28.422884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.423589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.424191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.425577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.426308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.426922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.450970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:28.461409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea9a2186-6384-4f2f-9ee2-600b0f2bf281 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.495103 Oct 28 13:13:28.462067 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1321/2591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:27 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7675f082-c5c9-437a-a04e-3d479454c6fe tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7675f082-c5c9-437a-a04e-3d479454c6fe tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 416 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:28.479807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:28.483748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7675f082-c5c9-437a-a04e-3d479454c6fe tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:28.487061 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7675f082-c5c9-437a-a04e-3d479454c6fe tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.016355 Oct 28 13:13:28.487061 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1322/2592] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:28 2022] POST /compute/v2.1/servers => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:28.494583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9dc0f3d8-8980-44c2-a002-9b340469259c req-f24457cd-6ed5-4b65-9bb1-2ac333ebd545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddabee5d-0299-4cbc-8229-6d9b7094d711", "name": "network-vif-plugged", "status": "completed", "tag": "02a72b35-1813-44ed-a9ec-b28228621ebb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:28.507501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9dc0f3d8-8980-44c2-a002-9b340469259c req-f24457cd-6ed5-4b65-9bb1-2ac333ebd545 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.510003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9dc0f3d8-8980-44c2-a002-9b340469259c req-f24457cd-6ed5-4b65-9bb1-2ac333ebd545 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.510442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9dc0f3d8-8980-44c2-a002-9b340469259c req-f24457cd-6ed5-4b65-9bb1-2ac333ebd545 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.525303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9dc0f3d8-8980-44c2-a002-9b340469259c req-f24457cd-6ed5-4b65-9bb1-2ac333ebd545 service nova] Creating event network-vif-plugged:02a72b35-1813-44ed-a9ec-b28228621ebb for instance ddabee5d-0299-4cbc-8229-6d9b7094d711 on n-h2-862876-2 Oct 28 13:13:28.542896 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9dc0f3d8-8980-44c2-a002-9b340469259c req-f24457cd-6ed5-4b65-9bb1-2ac333ebd545 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052412 Oct 28 13:13:28.543662 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1323/2593] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:28.568192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:28.568192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:28.568192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.568192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.568192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.568640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.568765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.569440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.621050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:28.634104 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-260fa4ab-1d1d-49e1-8cf5-61aea05b03be tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1266 microversion: 2.1 time: 0.229618 Oct 28 13:13:28.635317 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1271/2594] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:28 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:28.652220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0e07f85e-7283-4e2d-8122-dbd6217f1b65 req-eab41914-d37b-4dcc-bcd5-b5f6cce6e22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23c46ff-706a-4918-8cf5-a16d7f29617f", "name": "network-vif-deleted", "tag": "afc87e88-81fb-45ed-a23f-deceb3e4e759"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:28.664516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0e07f85e-7283-4e2d-8122-dbd6217f1b65 req-eab41914-d37b-4dcc-bcd5-b5f6cce6e22d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:28.664884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0e07f85e-7283-4e2d-8122-dbd6217f1b65 req-eab41914-d37b-4dcc-bcd5-b5f6cce6e22d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:28.665306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0e07f85e-7283-4e2d-8122-dbd6217f1b65 req-eab41914-d37b-4dcc-bcd5-b5f6cce6e22d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:28.678345 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0e07f85e-7283-4e2d-8122-dbd6217f1b65 req-eab41914-d37b-4dcc-bcd5-b5f6cce6e22d service nova] Creating event network-vif-deleted:afc87e88-81fb-45ed-a23f-deceb3e4e759 for instance f23c46ff-706a-4918-8cf5-a16d7f29617f on n-h1-862876-2 Oct 28 13:13:28.685679 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0e07f85e-7283-4e2d-8122-dbd6217f1b65 req-eab41914-d37b-4dcc-bcd5-b5f6cce6e22d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048893 Oct 28 13:13:28.686653 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1272/2595] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:28.994341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:28.996686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:29.006627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.007166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.008153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.008865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.009669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.010096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.020355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:29.028195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09ecf177-5329-4188-bde1-6f83ae7f5cf9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.483347 Oct 28 13:13:29.028991 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1324/2596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:28 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:29.053947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:29.054730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:29.061406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.062229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.062781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.063698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.064366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.064997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.266105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:29.278211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e81997e-6117-4ce2-ba4b-411f512be897 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.289707 Oct 28 13:13:29.286989 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1273/2597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:28 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:29.296599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-083bd184-7c54-4f51-99dc-af9bf613b64c req-d3a93a71-940d-4b78-ab2c-ddc9cd2e28d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d991d48-c735-4695-976c-650b4b1bc7d8", "tag": "0d58dc1c-13e4-4b35-b312-3b8e237f18a9"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:29.307167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-083bd184-7c54-4f51-99dc-af9bf613b64c req-d3a93a71-940d-4b78-ab2c-ddc9cd2e28d7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.307870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-083bd184-7c54-4f51-99dc-af9bf613b64c req-d3a93a71-940d-4b78-ab2c-ddc9cd2e28d7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.308821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-083bd184-7c54-4f51-99dc-af9bf613b64c req-d3a93a71-940d-4b78-ab2c-ddc9cd2e28d7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.321723 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-083bd184-7c54-4f51-99dc-af9bf613b64c req-d3a93a71-940d-4b78-ab2c-ddc9cd2e28d7 service nova] Creating event network-changed:0d58dc1c-13e4-4b35-b312-3b8e237f18a9 for instance 4d991d48-c735-4695-976c-650b4b1bc7d8 on n-h1-862876-2 Oct 28 13:13:29.329345 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-083bd184-7c54-4f51-99dc-af9bf613b64c req-d3a93a71-940d-4b78-ab2c-ddc9cd2e28d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039466 Oct 28 13:13:29.330166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1274/2598] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:29.392971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:29.408929 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7fbc854-779f-49f4-9712-d65d3b1268fc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.358768 Oct 28 13:13:29.411813 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1325/2599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:29 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:29.423306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:29.424029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:29.440009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.440606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.440940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.441643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.442098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.442514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.464039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:29.486462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:29.489213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:29.504645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=18 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:29.507278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.508205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.508817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.509672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.510455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.511448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.772599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:29.783663 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-04e2039f-aaa9-4734-99da-81a1613e901b tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1370 microversion: 2.1 time: 0.301138 Oct 28 13:13:29.785187 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1326/2600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:29 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:29.792820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e7f0e92-db78-4b90-9662-68b2cd185151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627235914", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": -1, "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:29.808051 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-3e7f0e92-db78-4b90-9662-68b2cd185151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Flavor -1 could not be found. Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e7f0e92-db78-4b90-9662-68b2cd185151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 205 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627235914", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": -1, "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor -1 could not be found. Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-627235914', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': -1, 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:29.811721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 28 13:13:29.815829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:29.818048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e7f0e92-db78-4b90-9662-68b2cd185151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:29.819248 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e7f0e92-db78-4b90-9662-68b2cd185151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032556 Oct 28 13:13:29.819883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:29.820507 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1327/2601] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:29 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:13:29.831513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:29.838175 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bca2280f-0a1d-427f-9972-2758fdd4ac78 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.418345 Oct 28 13:13:29.838301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:29.838394 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1275/2602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:29 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:29.844446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.845140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.845737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.846595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.847861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:29.848210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.848819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.849244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:29.860283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.860866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.861511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:29.863085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:29.863790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:29.864381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.145773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:30.155295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-546ea594-e1af-4a2b-84ad-6551f381a34a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.315003 Oct 28 13:13:30.156379 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1276/2603] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:29 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:30.181173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:30.182076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:30.189158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.189872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.190460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.191329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.191932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.192507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.283998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:30.295045 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fad3ce81-d9a8-4521-8dd2-fbb199f277a2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.472791 Oct 28 13:13:30.306797 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1328/2604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:29 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:30.306797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:30.306797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:30.332964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.333466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.334024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.335522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.335999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.336899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.530122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:30.537782 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a9cbdf1-d814-4ef4-afd0-518fcf5409a4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.359234 Oct 28 13:13:30.539241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1277/2605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:30 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:30.610783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c0c566a-d855-4255-960c-560461ad76ec tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2042347284", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c0c566a-d855-4255-960c-560461ad76ec tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 173 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2042347284", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2042347284', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi -1 Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:30.616099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 13:13:30.620642 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:30.638112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c0c566a-d855-4255-960c-560461ad76ec tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:30.643237 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c0c566a-d855-4255-960c-560461ad76ec tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.033050 Oct 28 13:13:30.648714 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1278/2606] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:30 2022] POST /compute/v2.1/servers => generated 145 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:30.659356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:30.661852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:30.676347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.676898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.677353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.678276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.678769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.679213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.754402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:30.762522 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e0b97eb3-c8b9-485d-9e66-32aa811de0d5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.461921 Oct 28 13:13:30.767242 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1329/2607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:30 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:30.808163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:30.809044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:30.817186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:30.819575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.820215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.820804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.821865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.823383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.824312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.932924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:30.941586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-56b35234-4305-4459-aca5-69e3f6009645 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.291745 Oct 28 13:13:30.942320 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1279/2608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:30 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:30.947479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:30.948346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:30.954813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.955586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.956241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:30.957154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:30.957793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:30.962269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.200020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:31.208880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4264bb3f-faa2-44c9-acbb-0f1c11526061 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1555 microversion: 2.1 time: 0.405170 Oct 28 13:13:31.223257 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1330/2609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:30 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1555 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:31.223257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:31.223257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:31.240215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.240742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.241178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.241903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.242358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.242808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.324829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:31.337117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91db1bad-531e-49b7-8208-391c3279b14b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.393475 Oct 28 13:13:31.337966 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1280/2610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:30 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:31.347457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3b6daa37-99cc-4c79-8496-21e141be5f03 req-6a8a5d50-2d05-42ec-a846-3288a9a56d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1ffca7-434e-4a17-b653-1de7ad966c6c", "name": "network-vif-unplugged", "status": "completed", "tag": "c9686326-87a8-4332-8fdd-fc24a3f1076c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:31.371568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3b6daa37-99cc-4c79-8496-21e141be5f03 req-6a8a5d50-2d05-42ec-a846-3288a9a56d5a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.373551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3b6daa37-99cc-4c79-8496-21e141be5f03 req-6a8a5d50-2d05-42ec-a846-3288a9a56d5a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.374950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3b6daa37-99cc-4c79-8496-21e141be5f03 req-6a8a5d50-2d05-42ec-a846-3288a9a56d5a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.408157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3b6daa37-99cc-4c79-8496-21e141be5f03 req-6a8a5d50-2d05-42ec-a846-3288a9a56d5a service nova] Creating event network-vif-unplugged:c9686326-87a8-4332-8fdd-fc24a3f1076c for instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c on n-h1-862876-2 Oct 28 13:13:31.419381 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3b6daa37-99cc-4c79-8496-21e141be5f03 req-6a8a5d50-2d05-42ec-a846-3288a9a56d5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079845 Oct 28 13:13:31.421336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1281/2611] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:31.427295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:31.431629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:31.448936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.449954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.452807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.453999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.454691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.455459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.668519 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e5d811f-45ad-4fb1-a100-fd5e1598f4af tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.245707 Oct 28 13:13:31.669434 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1282/2612] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:13:31 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:31.683917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:31.684738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:31.686481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:31.696454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.697484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.698077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.700521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.701280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.703499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.708104 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b7c7ac9-560d-408b-b466-6b2d46eeba32 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.492956 Oct 28 13:13:31.719186 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1331/2613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:31 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:31.790920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:31.791530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:31.806430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.807199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.807909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:31.808759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:31.809364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:31.809937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:32.112264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:32.126249 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50af8f9c-9725-4bca-8ff1-1fa90eb74585 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.452860 Oct 28 13:13:32.132391 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1283/2614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:31 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:32.154902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-382f31ae-3d51-4631-809c-14828e64d179 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-809124398", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:32.166533 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-382f31ae-3d51-4631-809c-14828e64d179 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-382f31ae-3d51-4631-809c-14828e64d179 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 215 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-809124398", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-809124398', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:32.172934 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:32.177553 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:32.177553 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:32.177553 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:32.177553 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:32.177553 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:32.177553 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 13:13:32.177553 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:32.179351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-382f31ae-3d51-4631-809c-14828e64d179 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:32.180973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-382f31ae-3d51-4631-809c-14828e64d179 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.046648 Oct 28 13:13:32.185768 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1284/2615] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:32 2022] POST /compute/v2.1/servers => generated 123 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:32.193565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:32.194481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:32.207444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:32.214292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:32.214922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:32.217599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:32.218171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:32.219780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:32.342999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:32.356619 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6632e436-eb0b-4b58-84ea-adeafcc996e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.564360 Oct 28 13:13:32.356619 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1332/2616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:31 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:32.367434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:32.370031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:32.377061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:32.377649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:32.378175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:32.379602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:32.380232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:32.380731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:32.812582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:32.821456 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd65ab18-ff46-4860-ae5c-47d11640e044 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.633706 Oct 28 13:13:32.823765 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1285/2617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:32 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:32.847547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:32.848401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:32.855441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:32.856238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:32.856678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:32.857985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:32.860526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:32.860526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.158447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:33.171535 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-202a7177-1134-4db3-9dfa-8ee72570b018 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.809870 Oct 28 13:13:33.172693 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1333/2618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:32 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:33.194165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:33.195290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:33.205534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.207557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.208008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.208898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.209358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.210019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.234087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:33.246358 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f38e435-df05-49bd-946d-a2dc39348962 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.402757 Oct 28 13:13:33.247180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1286/2619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:32 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:33.253585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:33.254393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:33.262892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.283128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.285064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.286805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.288649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.289328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.334386 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2fc9cdc1-c80f-4ef9-941a-c1c4bf672b97 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3/ips" status: 200 len: 150 microversion: 2.1 time: 0.085324 Oct 28 13:13:33.335379 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1287/2620] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:13:33 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:33.351037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d19adfc-3b00-4c69-bea2-ad93f3c2ddb4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-66512299", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-key-2040128720", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:33.462025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7d19adfc-3b00-4c69-bea2-ad93f3c2ddb4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] validate_networks() for [('15097bcb-93dc-4045-8562-028bd560b398', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:13:33.510320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=18 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:33.609883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:33.617799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35cac539-ff91-47ff-99ee-94f88ffebe1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.428969 Oct 28 13:13:33.618454 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1334/2621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:33 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:33.624728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b9277e9-fc1a-4808-959c-977c1a054fc6"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:33.627525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:33.636301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.636301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.636301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.636756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.637342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.637901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.672839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:33.738502 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Invalid volume: volume 3b9277e9-fc1a-4808-959c-977c1a054fc6 is already attached to instances: 18c24964-fb49-4247-a5fe-c8af53330f59 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3/os-volume_attachments HTTP/1.1 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 74 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: {"volumeAttachment": {"volumeId": "3b9277e9-fc1a-4808-959c-977c1a054fc6"}} Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid volume: volume 3b9277e9-fc1a-4808-959c-977c1a054fc6 is already attached to instances: 18c24964-fb49-4247-a5fe-c8af53330f59 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'server_id': 'be0a200a-8337-4ce1-9404-6e719e6c00c3', 'body': {'volumeAttachment': {'volumeId': '3b9277e9-fc1a-4808-959c-977c1a054fc6'}}} Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b9277e9-fc1a-4808-959c-977c1a054fc6 is already attached to instances: 18c24964-fb49-4247-a5fe-c8af53330f59 Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:33.740987 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b9277e9-fc1a-4808-959c-977c1a054fc6 is already attached to instances: 18c24964-fb49-4247-a5fe-c8af53330f59 Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b9277e9-fc1a-4808-959c-977c1a054fc6 is already attached to instances: 18c24964-fb49-4247-a5fe-c8af53330f59 Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.745573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 400 to user: Invalid volume: volume 3b9277e9-fc1a-4808-959c-977c1a054fc6 is already attached to instances: 18c24964-fb49-4247-a5fe-c8af53330f59 {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:33.747361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2aa43661-2dda-496d-bd1b-de76d8f64de6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127526 Oct 28 13:13:33.752018 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1335/2622] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:13:33 2022] POST /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3/os-volume_attachments => generated 174 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:33.758007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:33.761853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:33.770203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.771237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.771871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.772659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.773343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.773939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.820400 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-7d19adfc-3b00-4c69-bea2-ad93f3c2ddb4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Invalid key_name provided. Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d19adfc-3b00-4c69-bea2-ad93f3c2ddb4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 245 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-66512299", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-key-2040128720", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid key_name provided. Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-66512299', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'key_name': 'tempest-key-2040128720', 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2040128720 not found for user 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:33.830935 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 28 13:13:33.835333 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:33.838440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d19adfc-3b00-4c69-bea2-ad93f3c2ddb4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid key_name provided. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:33.839372 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d19adfc-3b00-4c69-bea2-ad93f3c2ddb4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.502292 Oct 28 13:13:33.840448 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1288/2623] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:33 2022] POST /compute/v2.1/servers => generated 70 bytes in 504 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:13:33.846053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ffe50e12-750a-4ce0-a64a-5daf3f7e698a req-a69134e6-0f18-41c4-836d-4694a93cecb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3069cd51-a7b8-468d-98b4-74fda3e00ab8", "tag": "d36b485d-13dc-42b8-b88a-f1839e31d629"}, {"name": "network-changed", "server_uuid": "8b1ffca7-434e-4a17-b653-1de7ad966c6c", "tag": "c9686326-87a8-4332-8fdd-fc24a3f1076c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:33.859274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ffe50e12-750a-4ce0-a64a-5daf3f7e698a req-a69134e6-0f18-41c4-836d-4694a93cecb2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.860171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ffe50e12-750a-4ce0-a64a-5daf3f7e698a req-a69134e6-0f18-41c4-836d-4694a93cecb2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.860937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ffe50e12-750a-4ce0-a64a-5daf3f7e698a req-a69134e6-0f18-41c4-836d-4694a93cecb2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.882445 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ffe50e12-750a-4ce0-a64a-5daf3f7e698a req-a69134e6-0f18-41c4-836d-4694a93cecb2 service nova] Creating event network-changed:d36b485d-13dc-42b8-b88a-f1839e31d629 for instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 on n-h1-862876-2 Oct 28 13:13:33.882445 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ffe50e12-750a-4ce0-a64a-5daf3f7e698a req-a69134e6-0f18-41c4-836d-4694a93cecb2 service nova] Creating event network-changed:c9686326-87a8-4332-8fdd-fc24a3f1076c for instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c on n-h1-862876-2 Oct 28 13:13:33.890260 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ffe50e12-750a-4ce0-a64a-5daf3f7e698a req-a69134e6-0f18-41c4-836d-4694a93cecb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048268 Oct 28 13:13:33.891615 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1289/2624] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:33.897624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:33.898432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:33.906709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.907648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.908279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.909175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:33.910022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:33.910909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:33.944755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:13:33.951984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:34.067964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:34.074334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:34.077252 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe823311-02f2-401f-939a-4d5ab0e1901b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.324912 Oct 28 13:13:34.082839 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1336/2625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:33 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:34.092911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:34.098572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:34.105434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.105925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.106369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.107115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.107564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.108157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.331872 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7396afae-efe3-4e7d-bc06-37f6eedf7311 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 204 len: 0 microversion: 2.1 time: 0.437403 Oct 28 13:13:34.333616 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1290/2626] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:33 2022] DELETE /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:13:34.343730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:34.346966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:34.348479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:34.357560 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4921590-d118-44ac-9f67-504513acab7e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.276992 Oct 28 13:13:34.358703 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1337/2627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:34 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:34.364810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:34.366785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:34.376984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.377675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.378252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.379163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.379771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.380419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.387012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.387757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.390727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.391981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.392594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.394446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.597313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:34.616552 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f5ef0037-83f9-476f-8365-3746a531af84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1681 microversion: 2.1 time: 0.255585 Oct 28 13:13:34.617389 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1338/2628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:34 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1681 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:34.622395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:34.623593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:34.633074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.635288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.638620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.639653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.640308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.643699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.827776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:34.840841 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ce23a0f-b239-4c75-91ef-90be6dccb032 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.504252 Oct 28 13:13:34.843215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1291/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:34 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:34.861009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:34.861891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:34.870710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.871468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.872126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.873861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:34.874540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:34.875998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:34.918611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:34.929994 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37c03f72-8ebc-4edf-986e-de34a0652bc1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.311217 Oct 28 13:13:34.938789 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1339/2630] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:34 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:35.101270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:35.101974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:35.111727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.114127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.119167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.120315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.121006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.121666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.256422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:35.271466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7dd19ee1-440b-442d-a198-072735302818 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.426488 Oct 28 13:13:35.273038 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1292/2631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:34 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:35.277706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e90116b8-3cdb-4c37-a79f-8fcc356fb30a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1809579407", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:35.409751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:35.419629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3304883e-c2ae-41c3-b114-807558103a0a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.322321 Oct 28 13:13:35.420811 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1340/2632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:35 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:35.487870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-e90116b8-3cdb-4c37-a79f-8fcc356fb30a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Neutron security group does_not_exist not found {{(pid=127794) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 28 13:13:35.488447 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-e90116b8-3cdb-4c37-a79f-8fcc356fb30a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e90116b8-3cdb-4c37-a79f-8fcc356fb30a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 258 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1809579407", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1809579407', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 28 13:13:35.496074 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:35.508714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e90116b8-3cdb-4c37-a79f-8fcc356fb30a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:35.513020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e90116b8-3cdb-4c37-a79f-8fcc356fb30a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.223774 Oct 28 13:13:35.513020 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1293/2633] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:35 2022] POST /compute/v2.1/servers => generated 106 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:35.513193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:35.513193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:35.515640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.516129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.516567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.517301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.517701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.518225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.641584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:35.642116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:35.651801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.652306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.652806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.654954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.655408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.655989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.757117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:35.775142 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0400fa1a-f6ce-47d6-8797-5f5e9f9891eb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.272295 Oct 28 13:13:35.775743 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1341/2634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:35 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:35.800026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:35.801042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:35.807835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.808636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.809235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.810133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.810885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.811476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.855438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:35.866881 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e1f31029-2d79-4a18-9434-f3bb0a962e43 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1681 microversion: 2.1 time: 0.229141 Oct 28 13:13:35.867770 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1294/2635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:35 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:35.873237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:35.874102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:35.881195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.882023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.882614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.883791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:35.884558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:35.885151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:35.975196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:35.987802 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-897abc71-5a0e-40a0-a75f-68970dc5aa64 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.191713 Oct 28 13:13:35.988411 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1342/2636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:35 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:35.993074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-868ede86-24c3-4527-b184-28b36f3b4588 req-da286fa7-6217-4216-abcb-720640170192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddabee5d-0299-4cbc-8229-6d9b7094d711", "tag": "02a72b35-1813-44ed-a9ec-b28228621ebb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:36.017662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-868ede86-24c3-4527-b184-28b36f3b4588 req-da286fa7-6217-4216-abcb-720640170192 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.018724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-868ede86-24c3-4527-b184-28b36f3b4588 req-da286fa7-6217-4216-abcb-720640170192 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.019410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-868ede86-24c3-4527-b184-28b36f3b4588 req-da286fa7-6217-4216-abcb-720640170192 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.031581 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-868ede86-24c3-4527-b184-28b36f3b4588 req-da286fa7-6217-4216-abcb-720640170192 service nova] Creating event network-changed:02a72b35-1813-44ed-a9ec-b28228621ebb for instance ddabee5d-0299-4cbc-8229-6d9b7094d711 on n-h2-862876-2 Oct 28 13:13:36.036648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-868ede86-24c3-4527-b184-28b36f3b4588 req-da286fa7-6217-4216-abcb-720640170192 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046861 Oct 28 13:13:36.040249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1343/2637] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:36.046410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-826c5e9e-935e-4d88-b139-de41d603cf23 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:36.047803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-826c5e9e-935e-4d88-b139-de41d603cf23 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 46af8a1a-40f8-402a-a531-156ccbaee9b0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:36.052527 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-826c5e9e-935e-4d88-b139-de41d603cf23 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 46af8a1a-40f8-402a-a531-156ccbaee9b0 could not be found. Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-826c5e9e-935e-4d88-b139-de41d603cf23 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/46af8a1a-40f8-402a-a531-156ccbaee9b0 HTTP/1.1 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 46af8a1a-40f8-402a-a531-156ccbaee9b0 could not be found. Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '46af8a1a-40f8-402a-a531-156ccbaee9b0'} Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46af8a1a-40f8-402a-a531-156ccbaee9b0 could not be found. Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46af8a1a-40f8-402a-a531-156ccbaee9b0 could not be found. Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:36.054177 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46af8a1a-40f8-402a-a531-156ccbaee9b0 could not be found. Oct 28 13:13:36.058616 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:36.060881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-826c5e9e-935e-4d88-b139-de41d603cf23 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 46af8a1a-40f8-402a-a531-156ccbaee9b0 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:36.062132 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-826c5e9e-935e-4d88-b139-de41d603cf23 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46af8a1a-40f8-402a-a531-156ccbaee9b0" status: 404 len: 111 microversion: 2.1 time: 0.020398 Oct 28 13:13:36.063743 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1344/2638] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:36 2022] DELETE /compute/v2.1/servers/46af8a1a-40f8-402a-a531-156ccbaee9b0 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:36.072761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:36.073721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:36.086875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:36.097442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.098155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.098603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.099386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.100441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.104843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.106211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-324a1baa-5bb9-48c7-b769-05b9bb98c532 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.227128 Oct 28 13:13:36.129431 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1295/2639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:35 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:36.297718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:36.298649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:36.305053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.305755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.306440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.307270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.307791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.308310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.358531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:36.563331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:36.576960 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da9a36fd-9de8-4ded-bf6e-e2156b371ac8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.508350 Oct 28 13:13:36.579035 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1345/2640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:36 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:36.602733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:36.604146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:36.618191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.618721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.620352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.622303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.624737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.625733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.665867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:36.674984 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-44b7b4c9-141a-48c1-a0f7-1b48affef2d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.381229 Oct 28 13:13:36.709293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1296/2641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:36 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:36.721820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:36.727032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:36.740274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.740975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.741579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:36.742440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:36.743150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:36.743725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.023704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:37.035111 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dccabea6-23a9-461a-afac-d64b8fea7460 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.454787 Oct 28 13:13:37.042006 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1346/2642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:36 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:37.051967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4246fdb3-468b-4453-a767-2a95a706d046 req-e25e6c57-efa9-4878-929e-5f5afae4487c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d991d48-c735-4695-976c-650b4b1bc7d8", "name": "network-vif-plugged", "status": "completed", "tag": "0d58dc1c-13e4-4b35-b312-3b8e237f18a9"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:37.069884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4246fdb3-468b-4453-a767-2a95a706d046 req-e25e6c57-efa9-4878-929e-5f5afae4487c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.070618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4246fdb3-468b-4453-a767-2a95a706d046 req-e25e6c57-efa9-4878-929e-5f5afae4487c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.071805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4246fdb3-468b-4453-a767-2a95a706d046 req-e25e6c57-efa9-4878-929e-5f5afae4487c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.090104 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4246fdb3-468b-4453-a767-2a95a706d046 req-e25e6c57-efa9-4878-929e-5f5afae4487c service nova] Creating event network-vif-plugged:0d58dc1c-13e4-4b35-b312-3b8e237f18a9 for instance 4d991d48-c735-4695-976c-650b4b1bc7d8 on n-h1-862876-2 Oct 28 13:13:37.098543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4246fdb3-468b-4453-a767-2a95a706d046 req-e25e6c57-efa9-4878-929e-5f5afae4487c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054028 Oct 28 13:13:37.104964 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1347/2643] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:37.107698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:37.109257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:37.112574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:37.118575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.119348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.120058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.121229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.121871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.123453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.134579 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-90aba21d-1858-4a33-a76a-ea338e6bb212 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.423192 Oct 28 13:13:37.173249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1297/2644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:36 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:37.195348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:37.198580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:37.223567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.224044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.225847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.226599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.228247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.230436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.445809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:37.454514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2692b836-761d-4c43-9ff2-f97847800abf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.279770 Oct 28 13:13:37.457813 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1298/2645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:37 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:37.464676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-542c57f3-114b-471f-a1c3-34277e1c9524 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:37.466005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-542c57f3-114b-471f-a1c3-34277e1c9524 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 13:13:37.466940 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-542c57f3-114b-471f-a1c3-34277e1c9524 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-542c57f3-114b-471f-a1c3-34277e1c9524 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 9223372036854775808 could not be found. Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '9223372036854775808'} Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:37.470453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:37.474119 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:37.474119 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:37.474119 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:37.474119 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 28 13:13:37.474119 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:37.480886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-542c57f3-114b-471f-a1c3-34277e1c9524 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:37.482613 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-542c57f3-114b-471f-a1c3-34277e1c9524 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.022473 Oct 28 13:13:37.483416 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1299/2646] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Oct 28 13:13:37 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:13:37.492279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:37.493314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:37.502611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.503521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.504481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.505536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.506449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.507111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.701563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:37.709750 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99ced810-75aa-4fcc-a9b8-9a6140f44f9f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1681 microversion: 2.1 time: 0.607895 Oct 28 13:13:37.723246 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1348/2647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:37 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1681 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:37.733390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:37.738716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:37.740249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:37.743899 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e9967453-f752-4323-8f33-28086cd263a8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.255601 Oct 28 13:13:37.744809 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1300/2648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:37 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:37.751712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.752212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.752835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.753712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.754392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.755158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.773266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:37.773947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:37.788446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.790698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.791220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.791958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:37.795336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:37.795336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:37.983471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:37.994423 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61ceeb90-03a2-43df-993b-2290af498184 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.270001 Oct 28 13:13:38.000869 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1349/2649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:37 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:38.064390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:38.065545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:38.077962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.079612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.080158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:38.080764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.083096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.083630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:38.308442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:38.317093 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-017ac3a5-e69c-4909-bba8-c1c9383ce508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.548312 Oct 28 13:13:38.331503 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1301/2650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:37 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:38.346405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6f4b743-a77f-4585-b6db-b4197dce483f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:38.347179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f6f4b743-a77f-4585-b6db-b4197dce483f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Failed to fetch instance by id -1 {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 13:13:38.347843 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f6f4b743-a77f-4585-b6db-b4197dce483f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance -1 could not be found. Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6f4b743-a77f-4585-b6db-b4197dce483f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance -1 could not be found. Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '-1'} Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:38.349476 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:38.354218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:38.354218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:38.354218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 28 13:13:38.354218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:38.355200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6f4b743-a77f-4585-b6db-b4197dce483f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:38.356203 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f6f4b743-a77f-4585-b6db-b4197dce483f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.013788 Oct 28 13:13:38.360302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1302/2651] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:13:38 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:13:38.365986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:38.366871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:38.374850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.375710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.376304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:38.377374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.377989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.378570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:38.827247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:38.842337 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2dbcb9f3-ac9d-4ec0-8979-45593c724c96 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.480460 Oct 28 13:13:38.845342 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1303/2652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:38 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:38.852735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:38.855087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:38.868290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.868811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.869257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:38.875049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.877171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.879179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:38.908425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:38.916978 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f2bbba1-782f-4622-9f27-15f7847c5be6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1314 microversion: 2.1 time: 0.858290 Oct 28 13:13:38.926564 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1350/2653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:38 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:38.957787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:38.957787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:38.967782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.968590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.969137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:38.971490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:38.972083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:38.985283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.105721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:39.112893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-95829ca7-81bb-4af7-907b-4562cc7428fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 200 len: 1326 microversion: 2.1 time: 0.166673 Oct 28 13:13:39.116294 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1351/2654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:38 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 1326 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:39.129050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-53b7fb73-65e1-4aa0-816f-c7185aa7f0c1 req-78aa77f6-62df-4afe-ad96-287501c91c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0a200a-8337-4ce1-9404-6e719e6c00c3", "name": "network-vif-deleted", "tag": "967b35f9-36cc-4cb3-a61d-6cafecb65010"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:39.145956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-53b7fb73-65e1-4aa0-816f-c7185aa7f0c1 req-78aa77f6-62df-4afe-ad96-287501c91c80 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.146879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-53b7fb73-65e1-4aa0-816f-c7185aa7f0c1 req-78aa77f6-62df-4afe-ad96-287501c91c80 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.147578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-53b7fb73-65e1-4aa0-816f-c7185aa7f0c1 req-78aa77f6-62df-4afe-ad96-287501c91c80 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.163334 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-53b7fb73-65e1-4aa0-816f-c7185aa7f0c1 req-78aa77f6-62df-4afe-ad96-287501c91c80 service nova] Creating event network-vif-deleted:967b35f9-36cc-4cb3-a61d-6cafecb65010 for instance be0a200a-8337-4ce1-9404-6e719e6c00c3 on n-h1-862876-2 Oct 28 13:13:39.170802 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-53b7fb73-65e1-4aa0-816f-c7185aa7f0c1 req-78aa77f6-62df-4afe-ad96-287501c91c80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051633 Oct 28 13:13:39.172772 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1352/2655] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:39.181526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:39.182565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:39.193528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.194325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.194956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.197073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.197986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.198563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.276088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:39.287157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-53155776-138b-45ca-894f-202bdfaf8f2f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.438928 Oct 28 13:13:39.290637 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1304/2656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:38 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:39.296075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:39.304428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:39.313597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.320360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.321057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.321804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.322426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.323246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.582853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:39.590714 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e35fe740-e288-4a1a-a68d-de7dad78cc2f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.298769 Oct 28 13:13:39.591852 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1305/2657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:39 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:39.605916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b8619071-85aa-4b38-a61b-af9914a3196b req-85ee9a9d-23d8-44ab-9474-b7b5a3b6ea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3069cd51-a7b8-468d-98b4-74fda3e00ab8", "name": "network-vif-plugged", "status": "completed", "tag": "d36b485d-13dc-42b8-b88a-f1839e31d629"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:39.615938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b8619071-85aa-4b38-a61b-af9914a3196b req-85ee9a9d-23d8-44ab-9474-b7b5a3b6ea7d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.625423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b8619071-85aa-4b38-a61b-af9914a3196b req-85ee9a9d-23d8-44ab-9474-b7b5a3b6ea7d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.625905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b8619071-85aa-4b38-a61b-af9914a3196b req-85ee9a9d-23d8-44ab-9474-b7b5a3b6ea7d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.650534 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b8619071-85aa-4b38-a61b-af9914a3196b req-85ee9a9d-23d8-44ab-9474-b7b5a3b6ea7d service nova] Creating event network-vif-plugged:d36b485d-13dc-42b8-b88a-f1839e31d629 for instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 on n-h1-862876-2 Oct 28 13:13:39.656623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b8619071-85aa-4b38-a61b-af9914a3196b req-85ee9a9d-23d8-44ab-9474-b7b5a3b6ea7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063586 Oct 28 13:13:39.657767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1306/2658] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:39.709829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:39.734663 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be38b4e5-d33a-4db4-bd8f-52f76a517007 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.559766 Oct 28 13:13:39.745400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1353/2659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:39 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:39.764361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8dad709-b511-4b7e-b61e-0a2582b3e2ab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:39.765259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a8dad709-b511-4b7e-b61e-0a2582b3e2ab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 60f02352-3b11-4847-b8e5-63b685b78891] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:39.773661 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a8dad709-b511-4b7e-b61e-0a2582b3e2ab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 60f02352-3b11-4847-b8e5-63b685b78891 could not be found. Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8dad709-b511-4b7e-b61e-0a2582b3e2ab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/60f02352-3b11-4847-b8e5-63b685b78891/action HTTP/1.1 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 19 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: {"forceDelete": {}} Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 60f02352-3b11-4847-b8e5-63b685b78891 could not be found. Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '60f02352-3b11-4847-b8e5-63b685b78891', 'body': {'forceDelete': {}}} Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f02352-3b11-4847-b8e5-63b685b78891 could not be found. Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f02352-3b11-4847-b8e5-63b685b78891 could not be found. Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:39.780603 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:39.789434 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:39.789434 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:39.789434 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f02352-3b11-4847-b8e5-63b685b78891 could not be found. Oct 28 13:13:39.789434 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:39.789434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8dad709-b511-4b7e-b61e-0a2582b3e2ab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 60f02352-3b11-4847-b8e5-63b685b78891 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:39.789434 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a8dad709-b511-4b7e-b61e-0a2582b3e2ab tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/60f02352-3b11-4847-b8e5-63b685b78891/action" status: 404 len: 111 microversion: 2.1 time: 0.026356 Oct 28 13:13:39.789434 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1307/2660] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:39 2022] POST /compute/v2.1/servers/60f02352-3b11-4847-b8e5-63b685b78891/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:39.794386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:39.795119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:39.802233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.802720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.803256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.804018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.804477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.804921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.952337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:39.953149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:39.960781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.961288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.961727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:39.962437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:39.962927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:39.963367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.031354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:40.051749 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e85660a-4dda-4c18-865d-dbc40b8f53bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.256200 Oct 28 13:13:40.052915 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1354/2661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:39 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:40.081362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:40.082388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:40.095506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.096246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.097307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.099907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.099907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.099907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.304070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:40.336173 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be067939-1f5f-4060-bd4a-c15112852961 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1500 microversion: 2.1 time: 0.388484 Oct 28 13:13:40.353180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1308/2662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:39 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1500 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:40.353180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:40.353180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:40.353180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.353180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.359160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.360360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.361252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.363822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.387434 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 HTTP/1.1 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'be0a200a-8337-4ce1-9404-6e719e6c00c3'} Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:40.392087 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5954ef22-b3ca-4e2a-b120-31802afd5236 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 404 len: 111 microversion: 2.1 time: 0.051055 Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1309/2663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:40 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:40.396653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:40.397954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:40.401451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:40.406002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.406723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.407196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.408548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.409163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.409596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.410654 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32e4ca83-28b0-4c89-8ec2-2c2cb39a8209 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.335329 Oct 28 13:13:40.411713 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1355/2664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:40 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:40.417533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-988d65fa-0493-43a6-9ac4-ff5a8a1089c4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:40.424600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988d65fa-0493-43a6-9ac4-ff5a8a1089c4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.425235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988d65fa-0493-43a6-9ac4-ff5a8a1089c4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.425782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-988d65fa-0493-43a6-9ac4-ff5a8a1089c4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.442857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:40.452470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-988d65fa-0493-43a6-9ac4-ff5a8a1089c4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:13:40.589085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:40.600819 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ccc4245e-70c5-4864-b9c8-4e6219ea01bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.207693 Oct 28 13:13:40.601879 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1310/2665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:40 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:40.608730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2e532eb-22cc-40aa-bf21-a88f06bdce6c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '.version_select at 0x7f27b9afa9d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:40.686534 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-988d65fa-0493-43a6-9ac4-ff5a8a1089c4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.273388 Oct 28 13:13:40.687276 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1356/2666] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:40 2022] POST /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:13:40.693636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c267b7c7-ca35-4232-ba00-f68547186dfd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:40.696044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c267b7c7-ca35-4232-ba00-f68547186dfd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 851e5d59-a947-4b89-aed0-2293b0150909] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:40.702135 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-c267b7c7-ca35-4232-ba00-f68547186dfd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 851e5d59-a947-4b89-aed0-2293b0150909 could not be found. Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c267b7c7-ca35-4232-ba00-f68547186dfd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/851e5d59-a947-4b89-aed0-2293b0150909/action HTTP/1.1 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 39 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: {"os-getConsoleOutput": {"length": 10}} Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 851e5d59-a947-4b89-aed0-2293b0150909 could not be found. Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '851e5d59-a947-4b89-aed0-2293b0150909', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 851e5d59-a947-4b89-aed0-2293b0150909 could not be found. Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 851e5d59-a947-4b89-aed0-2293b0150909 could not be found. Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.708698 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 851e5d59-a947-4b89-aed0-2293b0150909 could not be found. Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c267b7c7-ca35-4232-ba00-f68547186dfd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 851e5d59-a947-4b89-aed0-2293b0150909 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c267b7c7-ca35-4232-ba00-f68547186dfd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/851e5d59-a947-4b89-aed0-2293b0150909/action" status: 404 len: 111 microversion: 2.1 time: 0.021791 Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1357/2667] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:40 2022] POST /compute/v2.1/servers/851e5d59-a947-4b89-aed0-2293b0150909/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:40.719275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:40.723824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.724320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.724792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.725490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.725950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.726382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.783904 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2e532eb-22cc-40aa-bf21-a88f06bdce6c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035103096" status: 202 len: 0 microversion: 2.1 time: 0.180602 Oct 28 13:13:40.785041 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1311/2668] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035103096 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:13:40.790261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:40.791207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:40.800563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.801232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.802003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.803122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:40.803587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:40.804019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:40.995408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:41.004429 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a7a11545-28c5-491b-b305-760b658bf6d4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1308 microversion: 2.1 time: 0.292649 Oct 28 13:13:41.008845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1358/2669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:40 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:41.010029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:41.022900 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71612c1b-a67e-47f1-bd4f-ab44dd5c04ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.236731 Oct 28 13:13:41.026835 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1312/2670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:40 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:41.030048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:41.032455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:41.045440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.047226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.048475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:41.057287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.058408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.059093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:41.381243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:41.397214 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dfe4bfa5-c5f3-41c4-978a-5f6421f2b993 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.387066 Oct 28 13:13:41.397760 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1359/2671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:41 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:41.423253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:41.425267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:41.434315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.436021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.436606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:41.437454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.438055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.438849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:41.639554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:41.640390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:41.654560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.654560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.654560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:41.655988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.656616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.657525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:41.847984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:41.856467 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3e5d5bff-e722-4c89-87a7-d40c7198e88a tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.437700 Oct 28 13:13:41.868903 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1313/2672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:41 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:41.869936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:41.879279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3585bb64-e1df-4315-b753-4c6ecea64d63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:41.887226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3585bb64-e1df-4315-b753-4c6ecea64d63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 449f87fd-3108-4fe0-91ff-2ba70f7e49cd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:41.887226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:41.887226 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-3585bb64-e1df-4315-b753-4c6ecea64d63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 449f87fd-3108-4fe0-91ff-2ba70f7e49cd could not be found. Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3585bb64-e1df-4315-b753-4c6ecea64d63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/449f87fd-3108-4fe0-91ff-2ba70f7e49cd HTTP/1.1 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 449f87fd-3108-4fe0-91ff-2ba70f7e49cd could not be found. Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '449f87fd-3108-4fe0-91ff-2ba70f7e49cd'} Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449f87fd-3108-4fe0-91ff-2ba70f7e49cd could not be found. Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449f87fd-3108-4fe0-91ff-2ba70f7e49cd could not be found. Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:41.887770 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:41.892887 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:41.892887 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:41.892887 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:41.892887 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449f87fd-3108-4fe0-91ff-2ba70f7e49cd could not be found. Oct 28 13:13:41.892887 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:41.892887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3585bb64-e1df-4315-b753-4c6ecea64d63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 449f87fd-3108-4fe0-91ff-2ba70f7e49cd could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:41.892887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3585bb64-e1df-4315-b753-4c6ecea64d63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/449f87fd-3108-4fe0-91ff-2ba70f7e49cd" status: 404 len: 111 microversion: 2.1 time: 0.014595 Oct 28 13:13:41.893461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58b912d0-ffc0-42c6-8304-4b7da1bb132b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1504 microversion: 2.1 time: 0.258816 Oct 28 13:13:41.893461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1360/2673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:41 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:41.894927 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1314/2674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:41 2022] GET /compute/v2.1/servers/449f87fd-3108-4fe0-91ff-2ba70f7e49cd => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:13:41.919338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:41.921358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:41.931485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.932379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.933010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:41.933939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:41.934602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:41.937270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.036561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:42.037362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:42.058721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.061263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.061965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.063567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.069116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.070356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.210334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:42.226087 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0dad89a8-92b6-400c-9060-6909e12a7151 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.315450 Oct 28 13:13:42.239878 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1361/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:41 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:42.251186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:42.251892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:42.258821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.259517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.260500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.260991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.261459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.261884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.449057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:42.461597 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a0302c07-6cc3-4638-bb43-0d4db1122f53 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 200 len: 1487 microversion: 2.1 time: 0.429158 Oct 28 13:13:42.462167 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1315/2676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:42 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 1487 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:42.479779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:42.480653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:42.486935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.487708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.488151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.491811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.492460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.492899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.529895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:42.541858 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-936ce644-86ee-4d60-9e4a-67d8487514fd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.300388 Oct 28 13:13:42.543956 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1362/2677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:42 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:42.569737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-75310920"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:42.582617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:42.602273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.602955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.603459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.604232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.604837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.605351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.864990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:42.873402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b169a7b7-14ee-46ac-a883-b9e318206ccd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.396869 Oct 28 13:13:42.875028 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1316/2678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:42 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:42.915296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:42.916029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:42.923878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.924378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.935033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:42.935033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:42.935033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:42.935033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.194839 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ac7b574-f99f-4fdb-807b-634c282cf3d6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8/action" status: 202 len: 0 microversion: 2.1 time: 0.649466 Oct 28 13:13:43.195416 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1363/2679] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:42 2022] POST /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:13:43.201407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:43.202293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:43.209228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.209803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.210317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.211129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.211734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.212101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.317325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:43.324334 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0246e137-98f5-46c1-8dde-922ffd55ae27 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1494 microversion: 2.1 time: 0.412829 Oct 28 13:13:43.339680 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1317/2680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:42 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1494 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:43.351088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a46664c-0bc0-44c2-9996-76247c0e8d46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-380797403", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a46664c-0bc0-44c2-9996-76247c0e8d46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 237 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-380797403", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-380797403', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.376176 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a46664c-0bc0-44c2-9996-76247c0e8d46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a46664c-0bc0-44c2-9996-76247c0e8d46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.039975 Oct 28 13:13:43.381466 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1318/2681] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:13:43.388615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8b5eebc-823a-4e38-81f5-3bd77d5bd207 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b940a5e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:43.445318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lazy-loading 'services' on Instance uuid 18c24964-fb49-4247-a5fe-c8af53330f59 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:13:43.493271 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8b5eebc-823a-4e38-81f5-3bd77d5bd207 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.109128 Oct 28 13:13:43.494035 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1319/2682] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:43 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:43.513707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be3bb396-88f4-4beb-80cb-7525cf2f91a8 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '.version_select at 0x7f27b93c5280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:43.520199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be3bb396-88f4-4beb-80cb-7525cf2f91a8 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.521522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be3bb396-88f4-4beb-80cb-7525cf2f91a8 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.525304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be3bb396-88f4-4beb-80cb-7525cf2f91a8 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.531042 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be3bb396-88f4-4beb-80cb-7525cf2f91a8 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.034630 Oct 28 13:13:43.532464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1320/2683] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:13:43 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:43.545910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:43.547612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:43.580210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.583481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.584051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.585145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.585684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.586191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.741411 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5d68578-6795-4415-a1e8-d81df2ce2d39 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments/3b9277e9-fc1a-4808-959c-977c1a054fc6" status: 202 len: 0 microversion: 2.1 time: 0.543644 Oct 28 13:13:43.742198 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1364/2684] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:13:43 2022] DELETE /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments/3b9277e9-fc1a-4808-959c-977c1a054fc6 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:13:43.751239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:43.752532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:43.760035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.760805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.762112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.763214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.763951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.764629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.953038 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0c40a708-1dc1-491c-9300-e6674d6db882 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1645 microversion: 2.1 time: 0.208475 Oct 28 13:13:43.956309 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1365/2685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:43 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1645 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:43.963683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:43.964560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:43.972936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.973445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.974007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:43.975523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:43.976000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:43.976437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:44.148867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:44.157788 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a70442b5-3c9d-4b89-a021-ac4db1c9f16f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.199313 Oct 28 13:13:44.159183 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1366/2686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:43 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:44.164587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:44.167896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:44.176947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:44.177666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:44.178248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:44.179183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:44.179855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:44.180528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:44.207684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:44.215820 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1cc5cfbf-ef62-46a9-83c6-4b99ed564d37 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.682144 Oct 28 13:13:44.216962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1321/2687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:43 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:44.221537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1806098293", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "8a5ca9f0-82b0-4d71-8677-088d1cfb750f"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:44.275964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] validate_networks() for [('8a5ca9f0-82b0-4d71-8677-088d1cfb750f', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:13:44.291276 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2ab948a3-96d8-4e02-984f-14fe4771fd57 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130846 Oct 28 13:13:44.291929 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1367/2688] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:44 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:44.296813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:44.297646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:44.314049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:44.314049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:44.314049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:44.314049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:44.314049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:44.314049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:44.440907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:44.451424 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-77fd8f7a-b4be-45e6-96c8-4e8436224f50 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.157633 Oct 28 13:13:44.453378 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1368/2689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:44 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:44.509034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e2edf07-beb5-4757-97f8-72b73158c276 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd8c4af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:44.580128 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e2edf07-beb5-4757-97f8-72b73158c276 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.075267 Oct 28 13:13:44.589265 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1369/2690] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:44 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:44.683923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86b9a9a8-10c1-4036-ac7b-df5bd9ee0e47 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-909423923", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86b9a9a8-10c1-4036-ac7b-df5bd9ee0e47 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 234 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-909423923", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-909423923', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.703234 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86b9a9a8-10c1-4036-ac7b-df5bd9ee0e47 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86b9a9a8-10c1-4036-ac7b-df5bd9ee0e47 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025670 Oct 28 13:13:44.713837 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1370/2691] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:44 2022] POST /compute/v2.1/servers => generated 133 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:13:44.716251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:44.716251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:44.736575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:44.737083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:44.737520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:44.738222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:44.738732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:44.742294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:44.995825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:13:44.996363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:13:44.997030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:13:44.998122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:13:44.998607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:13:45.011255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.012035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.012698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.013828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.014636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.015298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.025319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:45.038854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:13:45.046727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for user 2042816d9181427cb51f1c710281aa53 and project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:13:45.057252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:45.062264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:13:45.065434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:13:45.066414 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13158064-93c7-47b5-8428-656ecc101403 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.355459 Oct 28 13:13:45.067382 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1371/2692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:44 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:45.089530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:45.097091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:45.110403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.110959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.111402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.112103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.112609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.113043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.324945 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5450e2ea-facb-42f7-b26c-4156915e2bf6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106773 Oct 28 13:13:45.330440 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1322/2693] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:13:45.345390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:45.350882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:45.373296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:45.381454 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b65bde17-dab8-4fbb-ba65-ebfa9ff635c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.295801 Oct 28 13:13:45.394058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.394058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.394256 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1372/2694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:45 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:45.394349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.394349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.394349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.394349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.402791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:45.402791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:45.410190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.410713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.412739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.413681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.414333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.414977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.438885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:45.451487 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-864e60ff-b6f1-44b5-984d-dc7792e412b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063919 Oct 28 13:13:45.452761 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1373/2695] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:45 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:45.457737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f08ecf8-2d0e-4cdd-9927-592e2c97e2e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:45.458838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f08ecf8-2d0e-4cdd-9927-592e2c97e2e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:45.546950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7f08ecf8-2d0e-4cdd-9927-592e2c97e2e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:45.557659 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f08ecf8-2d0e-4cdd-9927-592e2c97e2e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1211 microversion: 2.1 time: 0.101581 Oct 28 13:13:45.572180 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1374/2696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:45 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:45.593251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc1f658c-6189-4d86-a0de-188a2e629f87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:45.593899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bc1f658c-6189-4d86-a0de-188a2e629f87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 77eb8563-6696-47f8-833e-947e35411a8d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:45.603946 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-bc1f658c-6189-4d86-a0de-188a2e629f87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 77eb8563-6696-47f8-833e-947e35411a8d could not be found. Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc1f658c-6189-4d86-a0de-188a2e629f87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/77eb8563-6696-47f8-833e-947e35411a8d/action HTTP/1.1 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 13 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: {"pause": {}} Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 77eb8563-6696-47f8-833e-947e35411a8d could not be found. Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '77eb8563-6696-47f8-833e-947e35411a8d', 'body': {'pause': {}}} Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77eb8563-6696-47f8-833e-947e35411a8d could not be found. Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77eb8563-6696-47f8-833e-947e35411a8d could not be found. Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:45.615288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:45.623528 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:45.623528 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:45.623528 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77eb8563-6696-47f8-833e-947e35411a8d could not be found. Oct 28 13:13:45.623528 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:45.623528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc1f658c-6189-4d86-a0de-188a2e629f87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 77eb8563-6696-47f8-833e-947e35411a8d could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:45.623528 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bc1f658c-6189-4d86-a0de-188a2e629f87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/77eb8563-6696-47f8-833e-947e35411a8d/action" status: 404 len: 111 microversion: 2.1 time: 0.037047 Oct 28 13:13:45.623528 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1375/2697] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:45 2022] POST /compute/v2.1/servers/77eb8563-6696-47f8-833e-947e35411a8d/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:45.627448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3885d6b-de1b-41ab-a439-41db73d79188 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd8c4f70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:45.719432 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3885d6b-de1b-41ab-a439-41db73d79188 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.100645 Oct 28 13:13:45.719766 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1376/2698] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:45 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:45.751672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:45.752655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:45.783192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.783698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.784128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.785269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:45.785882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:45.786450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:45.829081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:45.840492 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-607be64f-ed0c-430e-ba68-98fc66fb35f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.508843 Oct 28 13:13:45.841084 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1323/2699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:45 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:45.976828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:45.985453 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ffd2adb7-5575-4786-8384-d6602affb004 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.246461 Oct 28 13:13:45.986804 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1377/2700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:45 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:46.009369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:46.010563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:46.018473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.019177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.019764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.020705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.021309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.022066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.373723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:46.403531 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b3642e6-a4f0-4ac6-9b60-f3de6d6adb61 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.399078 Oct 28 13:13:46.405276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1324/2701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:46 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:46.429502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:46.430634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:46.441496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.442262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.443240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.449866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.451149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.451816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.464278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:46.467514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:46.485241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.486597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.491354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.497475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.521018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.521018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.605527 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ab2e5f3-f38a-4d3d-b4d5-cd7b94b46d19 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144994 Oct 28 13:13:46.607584 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1325/2702] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:46 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:13:46.630875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-afb2037d-0f3e-491d-b7a2-a1db62d3f336 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:46.630875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-afb2037d-0f3e-491d-b7a2-a1db62d3f336 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:46.687251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-afb2037d-0f3e-491d-b7a2-a1db62d3f336 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:46.701153 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-afb2037d-0f3e-491d-b7a2-a1db62d3f336 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1211 microversion: 2.1 time: 0.091760 Oct 28 13:13:46.718845 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1326/2703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:46 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:46.739928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a083095c-9662-443d-9a65-fc3be8bec2b6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8b86040>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:46.834103 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a083095c-9662-443d-9a65-fc3be8bec2b6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.102675 Oct 28 13:13:46.838891 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1327/2704] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:46 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:46.847972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b0c98e3-090b-4b1d-b606-8caddf695298 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 202 len: 0 microversion: 2.1 time: 0.421253 Oct 28 13:13:46.850402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1378/2705] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:46 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:13:46.858416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:46.864689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:46.871607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:46.881366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:46.887075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.887075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.887075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.887414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.887556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.891020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.896320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.896836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.897281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:46.897998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:46.904459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:46.905378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:47.246557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:47.256579 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b8d06f97-9437-4137-ba27-39dfdfdda500 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.392296 Oct 28 13:13:47.264992 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1379/2706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:46 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:47.488060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:47.503240 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7261b9d2-3576-4017-97ec-93bee9694d04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1510 microversion: 2.1 time: 0.647633 Oct 28 13:13:47.504929 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1328/2707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:46 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1510 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:47.620477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:47.623617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:47.631471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:47.632060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:47.632737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:47.633790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:47.634387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:47.634943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:47.681958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b9e24c7-c66c-42a1-a952-08e5b1df28dc tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065853 Oct 28 13:13:47.688845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1380/2708] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:47 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:47.729989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:47.736565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:47.753142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:47.753142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:47.753142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:47.753142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:47.753142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:47.753142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:47.849671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0aaa68d6-2202-4dcd-94f8-d64705f2f6de tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9695670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:47.946803 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0aaa68d6-2202-4dcd-94f8-d64705f2f6de tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.098857 Oct 28 13:13:47.947417 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1381/2709] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:47 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:48.008370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:48.037195 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8fe55449-845f-4bb8-9bd3-238cb8f355fb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1207 microversion: 2.1 time: 0.314340 Oct 28 13:13:48.040159 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1329/2710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:47 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1207 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:48.287386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:48.298354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:48.302542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:48.303696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:48.304312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:48.305395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:48.306036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:48.306615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:48.534358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:48.536065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:48.557029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:48.561859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:48.563716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:48.579542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:48.581250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:48.581872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:48.829668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:48.844567 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11516c3a-e530-460b-a177-bf820afdcc3b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.560836 Oct 28 13:13:48.849700 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1382/2711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:48 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:48.893191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:48.901506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:48.934469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:48.940643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:48.941155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:48.944943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:48.948098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:48.948765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:48.949068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.076589 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49b2d73e-fd34-4ab5-9e23-6397ec36458e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225267 Oct 28 13:13:49.078180 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1383/2712] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:48 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:49.095698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a7e2a760-97dd-4967-b6d6-e45e653de958 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd9a4310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:49.192091 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a7e2a760-97dd-4967-b6d6-e45e653de958 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.110636 Oct 28 13:13:49.200545 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1384/2713] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:49 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:49.207443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:49.208402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:49.222963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:49.226465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:49.227513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.228470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:49.229151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:49.229736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.333244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:49.348549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8d262a2a-01b8-45a3-8f7c-70ac83e15865 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1490 microversion: 2.1 time: 0.819698 Oct 28 13:13:49.361365 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1330/2714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:48 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1490 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:49.380376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e1dae8ee-607d-41ea-b648-2249f632d8e1 req-c2d8328f-32b5-4633-8b35-5cf5478ef58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3069cd51-a7b8-468d-98b4-74fda3e00ab8", "name": "network-vif-plugged", "status": "completed", "tag": "d36b485d-13dc-42b8-b88a-f1839e31d629"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:49.426603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e1dae8ee-607d-41ea-b648-2249f632d8e1 req-c2d8328f-32b5-4633-8b35-5cf5478ef58f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:49.430775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e1dae8ee-607d-41ea-b648-2249f632d8e1 req-c2d8328f-32b5-4633-8b35-5cf5478ef58f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:49.433814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e1dae8ee-607d-41ea-b648-2249f632d8e1 req-c2d8328f-32b5-4633-8b35-5cf5478ef58f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.457230 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e1dae8ee-607d-41ea-b648-2249f632d8e1 req-c2d8328f-32b5-4633-8b35-5cf5478ef58f service nova] Creating event network-vif-plugged:d36b485d-13dc-42b8-b88a-f1839e31d629 for instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 on n-h1-862876-2 Oct 28 13:13:49.477623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e1dae8ee-607d-41ea-b648-2249f632d8e1 req-c2d8328f-32b5-4633-8b35-5cf5478ef58f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111764 Oct 28 13:13:49.478772 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1331/2715] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:49.493517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:49.496999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:49.520385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:49.524202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:49.525699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.526535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:49.528268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:49.536744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.621478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Cannot 'pause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state paused Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action HTTP/1.1 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 13 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: {"pause": {}} Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'pause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state paused Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'pause': {}}} Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d in vm_state paused. Cannot pause while the instance is in this state. Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state paused Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:49.631197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:49.636097 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:49.636097 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:49.636097 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:49.636097 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state paused Oct 28 13:13:49.636097 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:49.638947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 409 to user: Cannot 'pause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state paused {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:49.652951 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6e8e87e-c649-43d7-8ab9-0cbf98746cea tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 409 len: 143 microversion: 2.1 time: 0.161733 Oct 28 13:13:49.657523 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1332/2716] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:49 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 143 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:13:49.675106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:49.676203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:49.698178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:49.704649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:49.709280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:49.710466 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c4e4fcd8-c254-48c6-a4f0-3bbb137accc2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1281 microversion: 2.1 time: 0.512139 Oct 28 13:13:49.711118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.711978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:49.718875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:49.719406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:49.733242 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1385/2717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:49 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1281 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:50.034996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1730871898", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "4876f925-c1e0-49c6-8444-cd7a605c6ddb"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:50.128688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] validate_networks() for [('4876f925-c1e0-49c6-8444-cd7a605c6ddb', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:13:50.135357 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c59474d-95b0-475f-8438-7236e1439d87 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 202 len: 0 microversion: 2.1 time: 0.469704 Oct 28 13:13:50.137704 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1333/2718] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:49 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:13:50.155749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:50.156836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:50.164854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:50.165655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:50.166288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:50.170923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:50.170923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:50.170923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:50.470913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:50.482371 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce1eb1f9-15b7-4917-8e24-3e1dfbb929be tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.344806 Oct 28 13:13:50.483099 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1334/2719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:50 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:50.509345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:50.517050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:50.554141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:50.555056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:50.555190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:50.555913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:50.556246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:50.556680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:50.661940 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f15c9519-7e8d-45a5-83cb-9d290f03cd81 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173993 Oct 28 13:13:50.670957 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1335/2720] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:50 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:50.677010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:50.677632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:50.704687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:50.705181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:50.705688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:50.706558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:50.707379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:50.707860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.120687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:51.138972 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8d278331-ba81-40f1-9117-79d277d71846 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.463994 Oct 28 13:13:51.143126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1336/2721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:50 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:51.148784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b093e4e-3d56-4d11-b883-0bae0a13d610 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd905f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:51.249959 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b093e4e-3d56-4d11-b883-0bae0a13d610 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.104825 Oct 28 13:13:51.251324 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1337/2722] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:51 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:51.257252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:51.258362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:51.269930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.269930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.270157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.271859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.272492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.273819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.300069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:13:51.300616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:13:51.300981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:13:51.301383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:13:51.301796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:13:51.313092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.313791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.314389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.315304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.316759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.319298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.368951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Getting quotas for project 4c5269fb91904a768882033082d150a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:13:51.378322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Getting quotas for user e49876703e4b4b08a78fba7500764f16 and project 4c5269fb91904a768882033082d150a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:13:51.406175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Going to run 2 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:13:51.410718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 010dcbd1-f5bc-4fde-a379-a5a775110ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:13:51.588843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=010dcbd1-f5bc-4fde-a379-a5a775110ec4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:13:51.636847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:51.669020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee32cff6-c3a8-4a6d-abd9-c0b333bf9c33 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 0.411967 Oct 28 13:13:51.672149 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1338/2723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:51 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:51.681750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:51.685361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:51.700375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.702585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.704351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.707397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.709220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.710618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.957306 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bfbd58f0-ea8d-4349-b9a1-0102b925f661 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222948 Oct 28 13:13:51.961118 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1386/2724] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:13:51.968038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:51.968667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:51.988470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.988984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.989432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:51.990154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:51.990618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:51.991074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.076614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:52.096034 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-416260e5-5590-49c3-b7d9-db67f4189ba0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.414224 Oct 28 13:13:52.101217 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1339/2725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:51 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:52.131883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:52.137213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:52.157647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.158162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.158609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.159377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.159835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.160246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.227238 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf39ffd1-05e6-4c58-8614-d2bb861f220b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112777 Oct 28 13:13:52.231429 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1340/2726] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:52 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:52.242376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:52.257676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:52.257676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Searching by: {'deleted': False, 'project_id': '4c5269fb91904a768882033082d150a8'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:13:52.279642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.280088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.280546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.281295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.281814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.282235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.313079 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7136dc5-18c6-4f21-9d7f-1176f189b8c0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.079517 Oct 28 13:13:52.314484 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1341/2727] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:13:52 2022] GET /compute/v2.1/servers => generated 677 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:52.330180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:52.338648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:52.346621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.347514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.348956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.350379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.351449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.352555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.376549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3/action HTTP/1.1 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 28 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: {"reboot": {"type": "SOFT"}} Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b99289a7-5b75-40b8-b832-8d1f1223ddd3', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:52.380836 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:52.386631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:52.391114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:52.393663 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e67e06fa-ca7d-4e37-9cb6-57f6b5e2dd60 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3/action" status: 404 len: 111 microversion: 2.1 time: 0.074354 Oct 28 13:13:52.394882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1342/2728] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:52 2022] POST /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:52.404008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-206856bc-0fad-4293-869e-b306589f4d76 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b966ae50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:52.493432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:52.532324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37c7d599-6dbd-407d-9f0a-b5e43de8c54c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.555583 Oct 28 13:13:52.534078 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-206856bc-0fad-4293-869e-b306589f4d76 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.133212 Oct 28 13:13:52.536287 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1343/2729] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:52 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:52.548666 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1387/2730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:51 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:52.555392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-805a0182-d3a5-46d7-b19e-b5ab30b304a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:52.559305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-805a0182-d3a5-46d7-b19e-b5ab30b304a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:52.567783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:52.568417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:52.592729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.593243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.593690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.599692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.600533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.600955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.676075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-805a0182-d3a5-46d7-b19e-b5ab30b304a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:52.686082 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-805a0182-d3a5-46d7-b19e-b5ab30b304a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1220 microversion: 2.1 time: 0.147223 Oct 28 13:13:52.687102 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1344/2731] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:52 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:52.703119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:52.704110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:52.714223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.718692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.719448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.720463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:52.723565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:52.724390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:52.939100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:52.957157 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a01443fb-3189-4bad-8936-2a8844dab3b6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.407100 Oct 28 13:13:52.957874 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1388/2732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:52 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:52.981172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:52.986125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:53.006921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.007543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.007860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.008883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.009297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.009730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.279765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:53.293525 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4271228b-f16b-4984-8ce5-d9c0c6421cc7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.314936 Oct 28 13:13:53.307854 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1389/2733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:52 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:13:53.322624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:53.325671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:53.333470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.334349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.335039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.335967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.336622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.337253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.408284 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e0cd145e-7836-4431-9d56-9eb59359c15d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098899 Oct 28 13:13:53.413009 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1390/2734] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:13:53 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:13:53.436302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dddbf570-07f6-4be8-89c7-09a562adff3c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:53.436302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dddbf570-07f6-4be8-89c7-09a562adff3c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 00c964bf-f8c3-486a-a1a1-dda688a7b8ee] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:53.449465 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-dddbf570-07f6-4be8-89c7-09a562adff3c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 00c964bf-f8c3-486a-a1a1-dda688a7b8ee could not be found. Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dddbf570-07f6-4be8-89c7-09a562adff3c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/00c964bf-f8c3-486a-a1a1-dda688a7b8ee/action HTTP/1.1 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 28 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: {"reboot": {"type": "SOFT"}} Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 00c964bf-f8c3-486a-a1a1-dda688a7b8ee could not be found. Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '00c964bf-f8c3-486a-a1a1-dda688a7b8ee', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c964bf-f8c3-486a-a1a1-dda688a7b8ee could not be found. Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c964bf-f8c3-486a-a1a1-dda688a7b8ee could not be found. Oct 28 13:13:53.453954 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c964bf-f8c3-486a-a1a1-dda688a7b8ee could not be found. Oct 28 13:13:53.458706 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:53.462463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dddbf570-07f6-4be8-89c7-09a562adff3c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 00c964bf-f8c3-486a-a1a1-dda688a7b8ee could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:53.465746 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dddbf570-07f6-4be8-89c7-09a562adff3c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/00c964bf-f8c3-486a-a1a1-dda688a7b8ee/action" status: 404 len: 111 microversion: 2.1 time: 0.049710 Oct 28 13:13:53.467461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1391/2735] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:53 2022] POST /compute/v2.1/servers/00c964bf-f8c3-486a-a1a1-dda688a7b8ee/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:53.483532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f8c9e99e-b9e9-4de1-b73c-4f52be579e9a req-8d1d8c7a-63b1-4fe3-8d99-18c40c87a19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55347b5e-23a4-471d-b5a0-bbb0e8134ba9", "tag": "03324192-3f49-463e-9862-16252a818baa"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:53.511729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f8c9e99e-b9e9-4de1-b73c-4f52be579e9a req-8d1d8c7a-63b1-4fe3-8d99-18c40c87a19e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.513948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f8c9e99e-b9e9-4de1-b73c-4f52be579e9a req-8d1d8c7a-63b1-4fe3-8d99-18c40c87a19e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.518098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f8c9e99e-b9e9-4de1-b73c-4f52be579e9a req-8d1d8c7a-63b1-4fe3-8d99-18c40c87a19e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.563052 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f8c9e99e-b9e9-4de1-b73c-4f52be579e9a req-8d1d8c7a-63b1-4fe3-8d99-18c40c87a19e service nova] Creating event network-changed:03324192-3f49-463e-9862-16252a818baa for instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 on n-h1-862876-2 Oct 28 13:13:53.581967 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f8c9e99e-b9e9-4de1-b73c-4f52be579e9a req-8d1d8c7a-63b1-4fe3-8d99-18c40c87a19e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106573 Oct 28 13:13:53.583120 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1392/2736] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:13:53.596197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:53.596930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:53.612902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.613411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.613850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.619151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.619665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.620113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.879093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:53.882886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:53.886865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:53.889770 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b52c3f7e-69a1-401d-a716-f53189b6af46 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.305422 Oct 28 13:13:53.892706 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1393/2737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:53 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:53.897456 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48fc795f-5369-4cb3-bbf1-6de1cf91357d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 1.202825 Oct 28 13:13:53.898024 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1345/2738] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:52 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:53.901468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d65366a5-770d-42c6-954f-aefdc4403344 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b96e3c10>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:53.919909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:53.923899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:53.948892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.949414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.957051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.958416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:53.961162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:53.961774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:53.982251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d65366a5-770d-42c6-954f-aefdc4403344 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.085812 Oct 28 13:13:53.983231 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1394/2739] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:53 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:53.995008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:53.996865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:54.011125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.014790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.016617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.017492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.018870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.020741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.106345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:13:54.296001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:54.308287 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e3030d2-4c9f-4bd1-aa04-c61c150d9425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.407087 Oct 28 13:13:54.313247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:54.330898 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1346/2740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:53 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:54.342508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c9283aa1-e71d-4679-9fb9-22e7f90f8aa9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:54.344261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c9283aa1-e71d-4679-9fb9-22e7f90f8aa9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:54.442363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c9283aa1-e71d-4679-9fb9-22e7f90f8aa9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:54.451047 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c9283aa1-e71d-4679-9fb9-22e7f90f8aa9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1220 microversion: 2.1 time: 0.118565 Oct 28 13:13:54.451907 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1347/2741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:54 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:54.457553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:54.464350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:54.465921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.467267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.467894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.468770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.469396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.470012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.665095 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-53dadd1d-10bf-423e-ad44-5abeb16cf72a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 204 len: 0 microversion: 2.1 time: 0.679222 Oct 28 13:13:54.670381 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1395/2742] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:13:53 2022] DELETE /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:13:54.671310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:54.699510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:54.703151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:54.706053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0fa40251-9d42-43da-bf42-0732fad951d3 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.252949 Oct 28 13:13:54.708505 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1348/2743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:54 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:54.718207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.718601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.719390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.724818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.725575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.726236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.737329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:54.740620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:54.766623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.767632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.768313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.769261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.770010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.770974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.793187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3/action HTTP/1.1 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 65 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b99289a7-5b75-40b8-b832-8d1f1223ddd3', 'body': {'rebuild': {'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48'}}} Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 13:13:54.798150 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e1d58ec4-3770-43bd-9d2e-08390a5518f9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3/action" status: 404 len: 111 microversion: 2.1 time: 0.067061 Oct 28 13:13:54.804936 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1349/2744] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:54 2022] POST /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:13:54.810415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:54.820296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:54.836077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.837102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.843648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:54.843648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:54.843648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:54.843648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.085761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:55.098047 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59cb7bc7-a724-472b-9642-aee88c32b8d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.291707 Oct 28 13:13:55.099107 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1350/2745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:54 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:55.104517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:55.105220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:55.111980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.112476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.113078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.113785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.114299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.114667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.417709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:55.429305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-03d36520-081e-4cd8-ab8d-7bfcddaad6f5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 0.328924 Oct 28 13:13:55.431481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1351/2746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:55 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:55.436338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0d1f04d-724b-4a44-9d87-9acf48d4039c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd9058b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:55.510630 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0d1f04d-724b-4a44-9d87-9acf48d4039c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.079447 Oct 28 13:13:55.518932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1352/2747] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:55 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:55.518932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:55.518932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:55.523845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.524362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.524836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.525724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.526185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.526634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07b7a2b8-4f29-4cf7-9f66-a4aaca9bffd1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1683 microversion: 2.1 time: 0.898374 Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1396/2748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:54 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1683 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.639241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.716223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:55.726848 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0d637e70-3219-46c8-bb89-80a24afc9740 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.214485 Oct 28 13:13:55.738774 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1353/2749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:55 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:55.738774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:55.738774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:55.744633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.744633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.744633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.744633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.744633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.744633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.819915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:55.828170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dc541b4e-032c-48ed-a303-bcf99f765193 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1224 microversion: 2.1 time: 0.099090 Oct 28 13:13:55.836587 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1354/2750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:55 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:55.855106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-90619888-49f4-42dc-b041-dd27b3af7881 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:55.858991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-90619888-49f4-42dc-b041-dd27b3af7881 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 1ef1ddae-1e53-4a6d-93e8-2e0222f52978] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:55.876651 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-90619888-49f4-42dc-b041-dd27b3af7881 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 1ef1ddae-1e53-4a6d-93e8-2e0222f52978 could not be found. Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-90619888-49f4-42dc-b041-dd27b3af7881 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/1ef1ddae-1e53-4a6d-93e8-2e0222f52978/action HTTP/1.1 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 65 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 1ef1ddae-1e53-4a6d-93e8-2e0222f52978 could not be found. Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '1ef1ddae-1e53-4a6d-93e8-2e0222f52978', 'body': {'rebuild': {'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48'}}} Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef1ddae-1e53-4a6d-93e8-2e0222f52978 could not be found. Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 13:13:55.878738 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef1ddae-1e53-4a6d-93e8-2e0222f52978 could not be found. Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef1ddae-1e53-4a6d-93e8-2e0222f52978 could not be found. Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-90619888-49f4-42dc-b041-dd27b3af7881 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 1ef1ddae-1e53-4a6d-93e8-2e0222f52978 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:55.886850 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-90619888-49f4-42dc-b041-dd27b3af7881 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/1ef1ddae-1e53-4a6d-93e8-2e0222f52978/action" status: 404 len: 111 microversion: 2.1 time: 0.043781 Oct 28 13:13:55.889681 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1355/2751] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:55 2022] POST /compute/v2.1/servers/1ef1ddae-1e53-4a6d-93e8-2e0222f52978/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:55.904023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:55.904757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:55.911953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.912709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.913249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.914019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:55.914553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:55.915074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:55.931981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:55.941689 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0ad851b-1877-4801-9ad6-98d2bd19e3a5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.345501 Oct 28 13:13:55.957124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1397/2752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:55 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:56.100593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:56.125181 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e477aa7f-7e4b-48cc-bed1-f1e590de7515 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.226787 Oct 28 13:13:56.125985 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1356/2753] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:55 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:56.161300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:56.162203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:56.173334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:56.174306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:56.174920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:56.175939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:56.176652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:56.177254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:56.463038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:56.463663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:56.472016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:56.472792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:56.473474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:56.474343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:56.474972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:56.477047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:56.501190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:56.522873 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a6a97a3-8858-45a9-9683-89a417991cd1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.366397 Oct 28 13:13:56.535310 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1398/2754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:56 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:56.566107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa3b6d65-70a6-48cc-b305-a2ff9b1a07f4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b96e3700>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:56.651420 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa3b6d65-70a6-48cc-b305-a2ff9b1a07f4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.122520 Oct 28 13:13:56.672683 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1399/2755] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:56 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:56.691093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6be4d49f-4ae1-4c4b-aa92-fbadcf60b642 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:56.691640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6be4d49f-4ae1-4c4b-aa92-fbadcf60b642 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 21a2e9b8-3e2b-4fea-a8d4-e67c3238308c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:56.704574 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6be4d49f-4ae1-4c4b-aa92-fbadcf60b642 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 21a2e9b8-3e2b-4fea-a8d4-e67c3238308c could not be found. Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6be4d49f-4ae1-4c4b-aa92-fbadcf60b642 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/21a2e9b8-3e2b-4fea-a8d4-e67c3238308c/action HTTP/1.1 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 15 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: {"restore": {}} Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 21a2e9b8-3e2b-4fea-a8d4-e67c3238308c could not be found. Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '21a2e9b8-3e2b-4fea-a8d4-e67c3238308c', 'body': {'restore': {}}} Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a2e9b8-3e2b-4fea-a8d4-e67c3238308c could not be found. Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a2e9b8-3e2b-4fea-a8d4-e67c3238308c could not be found. Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:56.710119 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:56.715199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:56.715199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:56.715199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a2e9b8-3e2b-4fea-a8d4-e67c3238308c could not be found. Oct 28 13:13:56.715199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:56.715199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6be4d49f-4ae1-4c4b-aa92-fbadcf60b642 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 21a2e9b8-3e2b-4fea-a8d4-e67c3238308c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:56.715199 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6be4d49f-4ae1-4c4b-aa92-fbadcf60b642 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/21a2e9b8-3e2b-4fea-a8d4-e67c3238308c/action" status: 404 len: 111 microversion: 2.1 time: 0.036037 Oct 28 13:13:56.715199 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1400/2756] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:56 2022] POST /compute/v2.1/servers/21a2e9b8-3e2b-4fea-a8d4-e67c3238308c/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:56.746897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:56.748023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:56.764726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:56.765220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:56.765651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:56.766359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:56.766838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:56.775112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.042022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:57.050693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abe91c36-15af-4f59-b059-302b76e59b13 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 0.593987 Oct 28 13:13:57.059501 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1357/2757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:56 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:57.075214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:57.076054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:57.101129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.102238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.102855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.103713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.109358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.109358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.124947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:57.137187 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e0895acf-c7ae-4f40-958a-1e60cb6070b9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1683 microversion: 2.1 time: 0.421659 Oct 28 13:13:57.138098 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1401/2758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:56 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1683 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:57.142920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:57.154242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:57.176267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.177017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.177609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.179529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.181783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.182389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.397244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:57.409821 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bf8bb11e-2602-442b-8aef-631310aba417 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.347594 Oct 28 13:13:57.414780 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1358/2759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:57 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:57.426882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:57.427821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:57.437774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.441593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.442340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.444522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.445738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.449392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.794195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:57.808428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54d1b72b-0260-4c73-8c7a-ec9db3e184e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.395720 Oct 28 13:13:57.811935 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1359/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:57 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:57.828951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:57.831025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:57.839999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.843976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.843976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.843976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:57.843976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:57.844904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:57.992205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:58.007756 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad473a67-841a-4be1-8a7f-94575b6fb569 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1272 microversion: 2.1 time: 0.868390 Oct 28 13:13:58.027598 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1402/2761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:57 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1272 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:58.049148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a20a24f-f18e-4fcf-acbc-d9868b81d03d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8800430>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:58.100014 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a20a24f-f18e-4fcf-acbc-d9868b81d03d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.055074 Oct 28 13:13:58.100821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1403/2762] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:58 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:58.119618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:58.120607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:58.129054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.130338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.131087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:58.132174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.133373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.134222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:58.195547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:58.213154 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-636926f3-1f43-4669-91d1-0d190b3499ad tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.399267 Oct 28 13:13:58.213943 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1360/2763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:57 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:58.221220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:58.222327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:58.229867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:58.232006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.232688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.233426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:58.234439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.237516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.238412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:58.334630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:58.357212 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f2090eb-8457-4a92-8c80-f645b4991a84 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1615 microversion: 2.1 time: 0.141139 Oct 28 13:13:58.373647 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1361/2764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:58 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1615 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:58.382846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:58.384990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:58.404850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.408470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.408470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:58.408470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.409001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.409930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:58.502131 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Cannot 'restore' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action HTTP/1.1 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 15 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: {"restore": {}} Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'restore' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'restore': {}}} Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d in vm_state active. Cannot restore while the instance is in this state. Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:58.509508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 409 to user: Cannot 'restore' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e29cf86f-7fcf-47ea-9d3c-415b277b51af tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 409 len: 145 microversion: 2.1 time: 0.147317 Oct 28 13:13:58.518421 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1362/2765] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:58 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 145 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:13:58.559747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:58.563066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:58.586261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.589843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.590579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:58.592337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:58.593089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:58.596156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.116789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:59.127147 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cdba3c24-98ff-409f-8c4a-d3f1b30f81ec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 1.021176 Oct 28 13:13:59.130613 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1404/2766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:58 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:59.142063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:59.146993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:59.148118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:59.159316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.160872 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-33b6c7fb-63b1-4506-84f7-8a1a0eb0212e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.635389 Oct 28 13:13:59.162820 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1363/2767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:58 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:59.163931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.164454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.165320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.170511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:59.171344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.175389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.176058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:59.190451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.191094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.191663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.192859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.193635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.194146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.352030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:59.362399 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31a7961c-4142-4439-9ff0-0096ec889f79 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1278 microversion: 2.1 time: 0.199761 Oct 28 13:13:59.367128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1364/2768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:59 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:59.372914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8dd0cadf-8b22-4bac-b6e2-546bb7bb968c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b997d700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:59.462347 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8dd0cadf-8b22-4bac-b6e2-546bb7bb968c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.094026 Oct 28 13:13:59.465878 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1365/2769] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:13:59 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:59.480314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:59.482340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:59.491760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.492417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.492957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.494502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.495149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.495675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.714519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:59.735059 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-784a675d-a96e-4c12-a7cd-33599561f978 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.258506 Oct 28 13:13:59.736447 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1366/2770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:59 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:59.743315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:59.748541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:59.789256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.790051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.790717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.791717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.792435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.793394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.831268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:13:59.860273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:59.874935 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eacb6e9d-f29c-4feb-ae92-1c45a66300e4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.738560 Oct 28 13:13:59.875941 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1405/2771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:59 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:59.899390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1db102d1-ad48-4c17-bacc-289bfe19dd81 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:59.903039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1db102d1-ad48-4c17-bacc-289bfe19dd81 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:13:59.929155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:13:59.952206 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea3c0ead-e139-4f10-a90a-5cc06e06b4e9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 200 len: 1615 microversion: 2.1 time: 0.213229 Oct 28 13:13:59.953774 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1367/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:59 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 1615 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:13:59.955941 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1db102d1-ad48-4c17-bacc-289bfe19dd81 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5 could not be found. Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1db102d1-ad48-4c17-bacc-289bfe19dd81 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5/action HTTP/1.1 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 14 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: {"resume": {}} Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5 could not be found. Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5', 'body': {'resume': {}}} Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5 could not be found. Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5 could not be found. Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:13:59.965537 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:13:59.973842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:13:59.973842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:13:59.973842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5 could not be found. Oct 28 13:13:59.973842 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:13:59.974375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4f5094fb-bf9a-4fcc-a2e2-4ffb1b9d489f req-9336e911-d03c-4046-9a0c-34927d0bf195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c24964-fb49-4247-a5fe-c8af53330f59", "name": "network-vif-deleted", "tag": "ee85f85c-1f60-4689-b4ce-cb5af23703db"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:13:59.976759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1db102d1-ad48-4c17-bacc-289bfe19dd81 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:13:59.982493 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1db102d1-ad48-4c17-bacc-289bfe19dd81 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5/action" status: 404 len: 111 microversion: 2.1 time: 0.091214 Oct 28 13:13:59.982493 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1406/2773] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:13:59 2022] POST /compute/v2.1/servers/3bccbfb8-2d50-43c1-a6fd-6b2fe7db98b5/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:13:59.990881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4f5094fb-bf9a-4fcc-a2e2-4ffb1b9d489f req-9336e911-d03c-4046-9a0c-34927d0bf195 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:13:59.991465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4f5094fb-bf9a-4fcc-a2e2-4ffb1b9d489f req-9336e911-d03c-4046-9a0c-34927d0bf195 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:13:59.991964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4f5094fb-bf9a-4fcc-a2e2-4ffb1b9d489f req-9336e911-d03c-4046-9a0c-34927d0bf195 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:13:59.995476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:13:59.996375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:00.006802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.007465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.008945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.010625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.011249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.011758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.013768 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4f5094fb-bf9a-4fcc-a2e2-4ffb1b9d489f req-9336e911-d03c-4046-9a0c-34927d0bf195 service nova] Creating event network-vif-deleted:ee85f85c-1f60-4689-b4ce-cb5af23703db for instance 18c24964-fb49-4247-a5fe-c8af53330f59 on n-h2-862876-2 Oct 28 13:14:00.022392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4f5094fb-bf9a-4fcc-a2e2-4ffb1b9d489f req-9336e911-d03c-4046-9a0c-34927d0bf195 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066309 Oct 28 13:14:00.023392 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1368/2774] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:00.156706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:00.157522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:00.171688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.172383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.172887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.174994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.175473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.175916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.605865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:00.619522 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b688b856-a4c3-4a94-afbe-af3e2164a86d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.635370 Oct 28 13:14:00.620327 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1407/2775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:13:59 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:00.634211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:00.639703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:00.651177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.651687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.652135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.652851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.653850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.654308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.720593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:00.735773 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d154b7b-0e4a-4bac-9a43-aa02c82fd1e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 0.581761 Oct 28 13:14:00.738537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1369/2776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:00 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:00.752226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27945eab-5776-4674-928d-96e76f8e4943 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8b39550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:00.835586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27945eab-5776-4674-928d-96e76f8e4943 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.095374 Oct 28 13:14:00.837256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1370/2777] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:00 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:00.846603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:00.849943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:00.865260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.865762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.867834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.867834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.870644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.870644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.896266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:00.908057 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2eca2c78-395e-4016-93c3-77da2a3586ee tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1278 microversion: 2.1 time: 0.285237 Oct 28 13:14:00.918128 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1408/2778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:00 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:00.925465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:00.937606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:00.955360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.956782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.957406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:00.960196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:00.964821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:00.967211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:01.341923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:01.391114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:01.564900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:01.574458 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-457e5a96-23b4-416b-b94e-8630ff5637a6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.735415 Oct 28 13:14:01.598653 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1371/2779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:00 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:01.608797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:01.609553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:01.616190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:01.616751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:01.617445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:01.618426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:01.626714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:01.633501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:01.644099 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 HTTP/1.1 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '18c24964-fb49-4247-a5fe-c8af53330f59'} Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:01.646060 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.650914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:14:01.651615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b402d90-9641-434e-8358-766dd4cf978b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 404 len: 111 microversion: 2.1 time: 0.068173 Oct 28 13:14:01.652559 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1372/2780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:01 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:14:01.669847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-49900131-77b8-4627-a8d4-64ee9240ce2a req-dbbf7898-8e80-434c-a2ad-f612a86bc1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55347b5e-23a4-471d-b5a0-bbb0e8134ba9", "name": "network-vif-plugged", "status": "completed", "tag": "03324192-3f49-463e-9862-16252a818baa"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:01.675810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-49900131-77b8-4627-a8d4-64ee9240ce2a req-dbbf7898-8e80-434c-a2ad-f612a86bc1bb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:01.676414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-49900131-77b8-4627-a8d4-64ee9240ce2a req-dbbf7898-8e80-434c-a2ad-f612a86bc1bb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:01.676860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-49900131-77b8-4627-a8d4-64ee9240ce2a req-dbbf7898-8e80-434c-a2ad-f612a86bc1bb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:01.696338 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-49900131-77b8-4627-a8d4-64ee9240ce2a req-dbbf7898-8e80-434c-a2ad-f612a86bc1bb service nova] Creating event network-vif-plugged:03324192-3f49-463e-9862-16252a818baa for instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 on n-h1-862876-2 Oct 28 13:14:01.704270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-49900131-77b8-4627-a8d4-64ee9240ce2a req-dbbf7898-8e80-434c-a2ad-f612a86bc1bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048843 Oct 28 13:14:01.704270 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1373/2781] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:01.710103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:01.710987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:01.728493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:01.729693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:01.730270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:01.731232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:01.731892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:01.732486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:01.765772 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Cannot 'resume' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action HTTP/1.1 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 14 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: {"resume": {}} Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'resume' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'resume': {}}} Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d in vm_state active. Cannot resume while the instance is in this state. Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:01.768003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.772751 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:01.772751 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:01.772751 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:01.772751 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:14:01.772751 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:14:01.772751 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:14:01.772751 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:01.776795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 409 to user: Cannot 'resume' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:14:01.777340 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d68fd661-6f77-4fa8-bbe5-91a7a20295bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 409 len: 144 microversion: 2.1 time: 0.071908 Oct 28 13:14:01.778997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1374/2782] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:01 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 144 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:14:01.784255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a2d13bf-503a-438b-93cf-c511e10f2d95 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '.version_select at 0x7f27b9646e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:01.881368 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a2d13bf-503a-438b-93cf-c511e10f2d95 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544071105" status: 202 len: 0 microversion: 2.1 time: 0.100976 Oct 28 13:14:01.886504 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1375/2783] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:14:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544071105 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:14:01.891940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:01.892566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:01.913426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:01.913930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:01.914367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:01.915117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:01.917577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:01.918045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.173852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:02.185256 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e9638c3-ee3b-4d7f-b2ce-5e2f22fd2ded tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 0.300122 Oct 28 13:14:02.214204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1376/2784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:01 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:02.239112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:02.239112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:02.283863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.283863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.283863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.283863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.283863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.283863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.299232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:02.377717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:02.401418 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe18f338-0a54-49fc-9203-635cd0bcf068 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 1.481675 Oct 28 13:14:02.402122 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1409/2785] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:00 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:02.409642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b3e5e362-23aa-4ca7-8aa3-99f98824f27b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b881b670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:02.481229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b3e5e362-23aa-4ca7-8aa3-99f98824f27b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.076298 Oct 28 13:14:02.490305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:02.490612 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1410/2786] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:02 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:02.494869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-417a2313-4d55-4474-9811-dd1ce9c6add7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.276243 Oct 28 13:14:02.498826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1377/2787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:02 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:02.498995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:02.498995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:02.504679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.505529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.506175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.507369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.508044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.508961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.528634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:02.529620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:02.547094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.547743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.548366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.550025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.555779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.556361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.789248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:02.798615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4aa2e4d2-93ed-43b0-b6a2-df305721f625 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.277044 Oct 28 13:14:02.799577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1378/2788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:02 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:02.862577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:02.875545 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40e17a8e-d355-4a2c-a06b-57298e5f9a7a tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.379364 Oct 28 13:14:02.879245 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1411/2789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:02 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:02.932510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba0c5791-1713-433a-914c-42790039d499 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba0c5791-1713-433a-914c-42790039d499 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 160 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "15097bcb-93dc-4045-8562-028bd560b398"}]}} Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'server': {'name': '', 'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48', 'flavorRef': '452', 'networks': [{'uuid': '15097bcb-93dc-4045-8562-028bd560b398'}]}}} Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '' Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:14:02.936194 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:02.941054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba0c5791-1713-433a-914c-42790039d499 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:14:02.943530 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba0c5791-1713-433a-914c-42790039d499 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015826 Oct 28 13:14:02.944174 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1379/2790] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:14:02 2022] POST /compute/v2.1/servers => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:14:02.953735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:02.954355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:02.983292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.983794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.984235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:02.984969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:02.985423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:02.994235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.218878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:03.219497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:03.230420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.230958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.243503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.244389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.244886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.245328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.400358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:03.419803 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aaafb9d8-2738-44ee-b85f-be6153e6c08b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.471169 Oct 28 13:14:03.420400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1412/2791] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:02 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:03.427135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:03.427966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:03.440152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.447432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.448249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.449004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.449480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.449906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.632912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:03.645346 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3687d542-56bc-4e22-bf87-4316668f0124 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1311 microversion: 2.1 time: 0.432019 Oct 28 13:14:03.646592 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1380/2792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:03 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:03.655091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:03.656279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:03.664631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.665925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.666610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.669868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.669868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.669868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.866126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:03.882541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0290792-3a8c-4d24-b808-739732d348b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.458834 Oct 28 13:14:03.885003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1413/2793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:03 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:03.894700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c525ed8-1781-4901-87a2-fecce73c996f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b9b613a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:03.952267 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c525ed8-1781-4901-87a2-fecce73c996f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.065580 Oct 28 13:14:03.953078 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1414/2794] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:03 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:03.960885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:03.966726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:03.968192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:03.970575 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6874d487-ddda-4265-a6fc-97ddd273c1c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.322073 Oct 28 13:14:03.971557 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1381/2795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:03 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:03.987119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.987964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.988957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.991104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:03.991818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:03.992546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:03.993714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-19192085-68dd-4294-85da-5734d3983991 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:03.994264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-19192085-68dd-4294-85da-5734d3983991 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: e9a9ded2-a450-4322-96f7-0ef129742099] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:04.000535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-19192085-68dd-4294-85da-5734d3983991 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance e9a9ded2-a450-4322-96f7-0ef129742099 could not be found. Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-19192085-68dd-4294-85da-5734d3983991 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/e9a9ded2-a450-4322-96f7-0ef129742099/action HTTP/1.1 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 14 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: {"shelve": {}} Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance e9a9ded2-a450-4322-96f7-0ef129742099 could not be found. Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'e9a9ded2-a450-4322-96f7-0ef129742099', 'body': {'shelve': {}}} Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a9ded2-a450-4322-96f7-0ef129742099 could not be found. Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a9ded2-a450-4322-96f7-0ef129742099 could not be found. Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:04.003112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:04.010681 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:14:04.010681 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:14:04.010681 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a9ded2-a450-4322-96f7-0ef129742099 could not be found. Oct 28 13:14:04.010681 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:04.010681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-19192085-68dd-4294-85da-5734d3983991 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance e9a9ded2-a450-4322-96f7-0ef129742099 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:14:04.010681 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-19192085-68dd-4294-85da-5734d3983991 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/e9a9ded2-a450-4322-96f7-0ef129742099/action" status: 404 len: 111 microversion: 2.1 time: 0.016177 Oct 28 13:14:04.010681 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1382/2796] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:03 2022] POST /compute/v2.1/servers/e9a9ded2-a450-4322-96f7-0ef129742099/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:14:04.015878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:04.016503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:04.034826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.035621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.035621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.040955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.040955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.040955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.338479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:04.350611 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76f85f83-928b-409d-8fb2-18cffca09d89 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.337995 Oct 28 13:14:04.351543 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1383/2797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:04 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:04.372551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f926a417-e5be-4906-b53d-7ad7cb4fd98a req-8ee4518d-e5a6-4aa2-883b-275983d684b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010dcbd1-f5bc-4fde-a379-a5a775110ec4", "tag": "c076bba9-99fe-4fbd-858c-1db2c3d1d621"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:04.391177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f926a417-e5be-4906-b53d-7ad7cb4fd98a req-8ee4518d-e5a6-4aa2-883b-275983d684b0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.392757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f926a417-e5be-4906-b53d-7ad7cb4fd98a req-8ee4518d-e5a6-4aa2-883b-275983d684b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.392757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f926a417-e5be-4906-b53d-7ad7cb4fd98a req-8ee4518d-e5a6-4aa2-883b-275983d684b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.405422 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f926a417-e5be-4906-b53d-7ad7cb4fd98a req-8ee4518d-e5a6-4aa2-883b-275983d684b0 service nova] Creating event network-changed:c076bba9-99fe-4fbd-858c-1db2c3d1d621 for instance 010dcbd1-f5bc-4fde-a379-a5a775110ec4 on n-h1-862876-2 Oct 28 13:14:04.416184 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f926a417-e5be-4906-b53d-7ad7cb4fd98a req-8ee4518d-e5a6-4aa2-883b-275983d684b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062432 Oct 28 13:14:04.419801 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1384/2798] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:04.428479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d069ae1e-717c-404c-b9e8-81399277784a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: .version_select at 0x7f27b8b62820>, body: {"keypair": {"name": "tempest-keypair-1503398557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7yF8wxZv8eiGYc2ZxQ57KMRIb/Q7qgvgF5n9oU6zKgoySu6yUrF4kK9RwDCZ+ckivUvAfnpKy4p780Zy8eKHBGnqFWGJPU6PbuqnyzqvItdZuOs7AD1mBVbiPP++wpgg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:04.447057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d069ae1e-717c-404c-b9e8-81399277784a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:04.453531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d069ae1e-717c-404c-b9e8-81399277784a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:04.557784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:04.565825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac5aca5a-edbd-4908-ba3d-3a0ea2ed85d4 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.602897 Oct 28 13:14:04.583886 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1415/2799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:03 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:04.589151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:04.589846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:04.596831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.597602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.598269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.598393 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d069ae1e-717c-404c-b9e8-81399277784a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177235 Oct 28 13:14:04.599460 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1385/2800] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:14:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:04.602933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.603737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.605026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.678772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:04.679998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:04.688088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.693256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.693256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.693256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.693256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.693256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.939927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:04.948510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52ef8294-02e3-432c-88fd-d242de8e08c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1494 microversion: 2.1 time: 0.274485 Oct 28 13:14:04.959475 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1386/2801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:04 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1494 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:04.975950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:04.975950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:04.981918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.983643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.983643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:04.984137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:04.984652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:04.985275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.055937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:05.069893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ec78b65-9968-46af-adc8-1c9f848e6d1b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.481970 Oct 28 13:14:05.072557 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1416/2802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:04 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:05.081864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dcf59eb8-4de4-4777-bce1-bf1f52c53ff0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b882fa60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:05.148115 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dcf59eb8-4de4-4777-bce1-bf1f52c53ff0 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.068071 Oct 28 13:14:05.148115 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1417/2803] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:05 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:05.150477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:05.151160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:05.161794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.162298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.162733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.163460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.163910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.164336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.248970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:05.262366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bd2f2d1-3180-4a58-a22b-df53726d5b10 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.301713 Oct 28 13:14:05.263598 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1387/2804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:04 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:05.274732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:05.276534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:05.284836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.285559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.286173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.287217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.287821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.288403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.323402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lazy-loading 'flavor' on Instance uuid 045277a0-63fb-4041-b9b5-b0f275e6f17d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:14:05.515413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8081c788-65b1-4024-979c-4873a9a96caa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1645 microversion: 2.1 time: 0.370221 Oct 28 13:14:05.516002 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1418/2805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:05 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1645 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:05.541818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:05.542793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:05.560832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.561559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.563790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.567744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.568392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.570486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.577740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:05.886803 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef222a65-5d6b-4b77-a8ce-63de1130a11c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1645 microversion: 2.1 time: 0.352556 Oct 28 13:14:05.902048 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1419/2806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:05 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1645 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:05.913332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:05.916464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:05.933053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.935361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.935977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.937561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:05.939403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:05.941412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:05.989681 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c9e20848-11e2-4b5d-80cb-824dae8ce7bb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 202 len: 0 microversion: 2.1 time: 0.724310 Oct 28 13:14:05.990580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1388/2807] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:05 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:14:06.001589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:06.006436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.007288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.008447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.009487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.010297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.011004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.042098 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d28b72e-a8ab-46c8-a83e-b2f45684a6d0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048882 Oct 28 13:14:06.047248 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1389/2808] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:14:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:06.059904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:06.060737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:06.074290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.088231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.089037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.093468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.096137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.096813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.255831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:06.267087 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5aaff4e1-1bf7-41e9-bed9-f8321d21f42f tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.362278 Oct 28 13:14:06.268586 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1420/2809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:05 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:06.279597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:06.280410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:06.290012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.290911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.294137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.295152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.295847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.296320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.321765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:06.329716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:06.334165 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3ef42c3-807c-4a34-971f-f6796c790c57 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.285589 Oct 28 13:14:06.346444 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1390/2810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:06 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:06.346444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4035c1de-3940-418f-b3ea-3703266d44e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b98a44c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:06.424567 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4035c1de-3940-418f-b3ea-3703266d44e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.083145 Oct 28 13:14:06.424567 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1391/2811] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:06 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:06.428818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:06.439526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:06.448805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.448805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.448805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.452094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.452681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.453212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.654118 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad1bfda5-3244-4b72-a3e5-4ba42ccecb04 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.383200 Oct 28 13:14:06.658477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1421/2812] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:06 2022] POST /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:14:06.671682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6c051cfa-d134-42d2-8f8d-7c4f3cebc1fe req-d833cc0a-2474-492a-9678-23b294f9d34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52ee369-6320-4e39-bf16-9ca9ec32c75f", "tag": "61936e3d-d3c9-4725-85f6-90214baec61c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:06.687020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6c051cfa-d134-42d2-8f8d-7c4f3cebc1fe req-d833cc0a-2474-492a-9678-23b294f9d34f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.687882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6c051cfa-d134-42d2-8f8d-7c4f3cebc1fe req-d833cc0a-2474-492a-9678-23b294f9d34f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.688538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6c051cfa-d134-42d2-8f8d-7c4f3cebc1fe req-d833cc0a-2474-492a-9678-23b294f9d34f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.705261 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6c051cfa-d134-42d2-8f8d-7c4f3cebc1fe req-d833cc0a-2474-492a-9678-23b294f9d34f service nova] Creating event network-changed:61936e3d-d3c9-4725-85f6-90214baec61c for instance d52ee369-6320-4e39-bf16-9ca9ec32c75f on n-h2-862876-2 Oct 28 13:14:06.711834 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6c051cfa-d134-42d2-8f8d-7c4f3cebc1fe req-d833cc0a-2474-492a-9678-23b294f9d34f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051451 Oct 28 13:14:06.712918 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1422/2813] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:06.714949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:06.718967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:06.719953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:06.725708 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8fb27203-b8df-4634-b21f-8112426d8e2f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.304349 Oct 28 13:14:06.726897 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1392/2814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:06 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:06.740702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.743927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.744454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:06.745305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:06.748395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:06.748982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:07.211929 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a09a8b0d-3225-4aac-83da-c3cd908f0faa tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1650 microversion: 2.1 time: 0.497538 Oct 28 13:14:07.230400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1423/2815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:06 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1650 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:07.295712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:07.296343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:07.307827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:07.308598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:07.309230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:07.313799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:07.314552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:07.315044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:07.420004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:07.436809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:07.448938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:07.452177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:07.453004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:07.454113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:07.459624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:07.460466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:07.601169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:07.610543 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-479dd94b-ae77-49ec-89ff-053c74011c77 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.321114 Oct 28 13:14:07.611383 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1393/2816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:07 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:07.616939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-092f4957-5d89-473d-ab14-b098c59f387c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b98a4160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:07.669638 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-092f4957-5d89-473d-ab14-b098c59f387c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.057062 Oct 28 13:14:07.670262 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1394/2817] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:07 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:07.753005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:07.753939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:07.760890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:07.761486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:07.761999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:07.763355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:07.763889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:07.764406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:07.909652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:07.920693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-523da7bd-8638-4c24-96ed-a40df41eda3e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.171645 Oct 28 13:14:07.921394 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1395/2818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:07 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:08.190160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:08.200935 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cc754c69-54b5-460b-b1c9-d8ccfc116646 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.790106 Oct 28 13:14:08.222611 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1424/2819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:07 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:08.242658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:08.243388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:08.265455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:08.265455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:08.265455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:08.265455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:08.265455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:08.265834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:08.634260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:08.634928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:08.643515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:08.648736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:08.650332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:08.652185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:08.660573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:08.660573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:08.701097 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e4c82afb-71b3-4dc9-b2d0-4e26658ab883 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1630 microversion: 2.1 time: 0.466075 Oct 28 13:14:08.704134 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1396/2820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:08 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1630 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:08.723172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a282a578-ea2b-4954-9e84-41ea1ae7da45 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8b67700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:08.794518 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a282a578-ea2b-4954-9e84-41ea1ae7da45 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1410 microversion: 2.1 time: 0.088646 Oct 28 13:14:08.799378 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1397/2821] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:08 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:08.806458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862876-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:08.814151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:08.825512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:08.828063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:08.828063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:08.828063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:08.828063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:08.828063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:08.886193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lazy-loading 'flavor' on Instance uuid 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:14:08.914022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Going to try to live migrate instance to n-h2-862876-2 {{(pid=127794) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:14:09.032049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:09.042069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0704e43c-986e-4a2d-88fc-2d82bf638483 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.412342 Oct 28 13:14:09.042654 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1425/2822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:08 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:09.047873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:09.048484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:09.054207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:09.054691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:09.055165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:09.056239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:09.056876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:09.057559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:09.253798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:09.262133 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c22a694-9fcd-4903-9618-0082f340aebb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.218274 Oct 28 13:14:09.262768 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1426/2823] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:09 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:09.267217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:09.267829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:09.274219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:09.278056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:09.278056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:09.278056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:09.278056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:09.278056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:09.425018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:09.432786 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7bed6b3e-9258-4cbc-8169-4f53605a542b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.169043 Oct 28 13:14:09.433366 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1427/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:09 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:09.442008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-568659430", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53d6a3ea-bd12-4a26-b93d-1b74de68c817"}], "security_groups": [{"name": "tempest-securitygroup--718791445"}], "key_name": "tempest-keypair-1503398557", "user_data": "}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:09.448995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:09.564958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] validate_networks() for [('53d6a3ea-bd12-4a26-b93d-1b74de68c817', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:14:09.989846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:14:09.990260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:14:09.990977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:14:09.991388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:14:09.991797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:14:10.001638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:10.002357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:10.003036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:10.003852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:10.004411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:10.004953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:10.035873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:10.038261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:10.052054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:14:10.054487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:14:10.179305 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f7d1e52-435e-442c-bcfa-538591ee0987 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.744820 Oct 28 13:14:10.180709 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1428/2825] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:14:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:14:10.187242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68fc3792-bfe1-4ede-b6c5-b2695dbe03c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd937a60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:10.235847 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68fc3792-bfe1-4ede-b6c5-b2695dbe03c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1419 microversion: 2.1 time: 0.053905 Oct 28 13:14:10.236428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1429/2826] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:10 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1419 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:10.248112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:10.249098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:10.256504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:10.257062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:10.257558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:10.258669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:10.259566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:10.260192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:10.521072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:10.561386 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0513a8de-af62-4963-930e-50f83ab128ed tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.323669 Oct 28 13:14:10.562719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1430/2827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:10 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:10.569634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2fb5f4b-54eb-4bee-adf2-37a6803d5154 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:10.570427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b2fb5f4b-54eb-4bee-adf2-37a6803d5154 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:10.662844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2fb5f4b-54eb-4bee-adf2-37a6803d5154 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:10.675844 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2fb5f4b-54eb-4bee-adf2-37a6803d5154 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1241 microversion: 2.1 time: 0.111800 Oct 28 13:14:10.676426 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1431/2828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:10 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:10.702861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f32148f5-631a-4b75-bdcf-a54eeeea42b3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27bd937dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:10.771143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f32148f5-631a-4b75-bdcf-a54eeeea42b3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 200 len: 1419 microversion: 2.1 time: 0.073807 Oct 28 13:14:10.772006 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1432/2829] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:14:10 2022] GET /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 1419 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:10.780330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:10.781082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:10.798110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:10.800042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:10.800145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:10.802408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:10.804983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:10.805900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:11.007277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:11.017511 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e4c90530-77d7-4dd2-b1ce-86ef07d7752d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1510 microversion: 2.1 time: 0.244230 Oct 28 13:14:11.018273 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1433/2830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:10 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:11.027678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:11.029263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:11.036522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:11.042255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:11.042255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:11.042255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:11.042255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:11.042255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:11.231190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:11.239499 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-89a8cb92-a46b-4e25-92f5-9a6201587689 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.219773 Oct 28 13:14:11.254515 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1434/2831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:11 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:11.260295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-984875338", "imageRef": "c96643a0-1f39-4d21-afd3-45e946111f92", "flavorRef": "452", "networks": [{"uuid": "09db6954-888a-48c6-adf5-d40098ae89d9"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:11.334071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] validate_networks() for [('09db6954-888a-48c6-adf5-d40098ae89d9', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:14:12.225213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:14:12.225741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:14:12.226318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:14:12.226854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:14:12.227435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:14:12.244912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:12.246485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:12.247703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:12.249184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:12.249912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:12.250597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:12.281277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:12.290916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for user a43aa3346a70490d9c5e489c8e39d91d and project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:12.326708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:14:12.331656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c96643a0-1f39-4d21-afd3-45e946111f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:14:12.560948 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47f35d71-263a-4954-a304-3d377920cd5e tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302884 Oct 28 13:14:12.563231 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1435/2832] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:14:12.577052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0bb77a8f-7596-4aef-a8f1-34ed4b91c360 req-2cf35642-725e-47ce-9b5d-6df01b4a06b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010dcbd1-f5bc-4fde-a379-a5a775110ec4", "name": "network-vif-plugged", "status": "completed", "tag": "c076bba9-99fe-4fbd-858c-1db2c3d1d621"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:12.593659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0bb77a8f-7596-4aef-a8f1-34ed4b91c360 req-2cf35642-725e-47ce-9b5d-6df01b4a06b0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:12.594292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0bb77a8f-7596-4aef-a8f1-34ed4b91c360 req-2cf35642-725e-47ce-9b5d-6df01b4a06b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:12.598256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0bb77a8f-7596-4aef-a8f1-34ed4b91c360 req-2cf35642-725e-47ce-9b5d-6df01b4a06b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:12.611544 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0bb77a8f-7596-4aef-a8f1-34ed4b91c360 req-2cf35642-725e-47ce-9b5d-6df01b4a06b0 service nova] Creating event network-vif-plugged:c076bba9-99fe-4fbd-858c-1db2c3d1d621 for instance 010dcbd1-f5bc-4fde-a379-a5a775110ec4 on n-h1-862876-2 Oct 28 13:14:12.618331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0bb77a8f-7596-4aef-a8f1-34ed4b91c360 req-2cf35642-725e-47ce-9b5d-6df01b4a06b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053365 Oct 28 13:14:12.619472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1436/2833] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:12.626993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:12.628074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:12.635620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:12.636110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:12.636617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:12.638288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:12.638634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:12.639122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:12.985922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:12.996711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ef5c5d4-56ef-4294-aca0-0520c1e1e028 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.375637 Oct 28 13:14:13.000027 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1437/2834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:12 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:13.025737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:13.028866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.038499 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2705d079-76ea-4348-a006-dcdaf5f76f29 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9/action" status: 202 len: 0 microversion: 2.1 time: 4.242196 Oct 28 13:14:13.039757 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1398/2835] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:08 2022] POST /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9/action => generated 0 bytes in 4244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:14:13.044113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.044628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.045100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.045868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.046312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.046787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.054857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:13.056241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.087527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.093380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.094547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.100455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.100455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.100455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.154484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:13.164554 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-109b373d-0768-4629-9a8b-4f9c9401eb1f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1293 microversion: 2.1 time: 0.162747 Oct 28 13:14:13.176825 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1438/2836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:12 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:13.176825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:13.176825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.182248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.182933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.184139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.185221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.185684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.186116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.406271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:13.418608 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a377e172-dbd1-48b8-a38a-5b27e70243a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1487 microversion: 2.1 time: 0.375955 Oct 28 13:14:13.419781 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1399/2837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:13 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1487 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:13.425966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4d45bfb-a372-46ca-9584-826338ab6ee2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:13.427537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4d45bfb-a372-46ca-9584-826338ab6ee2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.493435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4d45bfb-a372-46ca-9584-826338ab6ee2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:13.509358 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4d45bfb-a372-46ca-9584-826338ab6ee2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1207 microversion: 2.1 time: 0.088224 Oct 28 13:14:13.523188 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1400/2838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:13 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1207 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:13.529937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:13.530952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.538961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.539696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.540288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.541180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.541790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.542370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.598146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:13.619639 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-564b3a95-5942-4f03-9b95-7b4a33f71e04 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.451705 Oct 28 13:14:13.620249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1439/2839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:13 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:13.635147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e06e7d2d-538f-4863-9893-2a23fdacc608"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:13.651716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.670404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.671031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.671484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.672228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.672690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.673112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.757493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:13.821788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:13.828251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-528013b1-fa6e-4a6a-87d5-49f3c1fa9339 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1504 microversion: 2.1 time: 0.303472 Oct 28 13:14:13.847181 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1401/2840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:13 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:13.855663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:13.858955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.870671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.875520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.884856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.886190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.887087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.887723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.968135 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e23732e-045b-4f7a-bfdf-394d56a4d190 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 200 len: 177 microversion: 2.1 time: 0.119232 Oct 28 13:14:13.969296 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1402/2841] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:13 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 177 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:13.981185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:13.987484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:13.990875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.991479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.992014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:13.993336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:13.993988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:13.994712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.192159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:14.203604 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9e1b353f-0133-4657-a87e-20c83276bf34 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.227433 Oct 28 13:14:14.204663 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1403/2842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:13 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:14.209644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:14.210448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:14.217752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.218531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.219143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.234168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.234168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.234168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.375595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:14.385844 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b523055-a6d3-414c-94d5-ea91efb7e45e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.179764 Oct 28 13:14:14.386838 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1404/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:14 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:14.392115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:14.392730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:14.399187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.399673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.400101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.401590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.402221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.402851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.476479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:14.486721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c154e0de-1452-4ff3-9c25-07b44f159e44 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1299 microversion: 2.1 time: 0.097943 Oct 28 13:14:14.487598 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1405/2844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:14 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:14.493154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:14.494064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:14.502117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.502857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.506347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.506347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.506347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.506347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.689593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:14.704349 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ace9e6b2-2018-4947-866c-cd2b66453d83 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.214850 Oct 28 13:14:14.705712 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1406/2845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:14 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:14.713053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:14.714088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:14.739778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.740287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.740730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.744452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.744452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.744452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.834232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:14.841568 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea4cc64b-cb7d-4ff6-b767-a4e2810ecef3 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "POST /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.219842 Oct 28 13:14:14.842955 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1440/2846] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:14:13 2022] POST /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments => generated 194 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:14.865772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0b607492-f6bb-4625-8e28-cd77f13f6182 req-ef0f4059-0c00-4e03-b1ba-9c7bb49a6e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52ee369-6320-4e39-bf16-9ca9ec32c75f", "name": "network-vif-plugged", "status": "completed", "tag": "61936e3d-d3c9-4725-85f6-90214baec61c"}, {"server_uuid": "3069cd51-a7b8-468d-98b4-74fda3e00ab8", "name": "network-vif-unplugged", "status": "completed", "tag": "d36b485d-13dc-42b8-b88a-f1839e31d629"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:14.873764 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ed0ce42c-6032-4971-897f-aa01e0c96239 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1211 microversion: 2.1 time: 0.165818 Oct 28 13:14:14.893343 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1407/2847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:14 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1211 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:14.895110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0b607492-f6bb-4625-8e28-cd77f13f6182 req-ef0f4059-0c00-4e03-b1ba-9c7bb49a6e06 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.895677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0b607492-f6bb-4625-8e28-cd77f13f6182 req-ef0f4059-0c00-4e03-b1ba-9c7bb49a6e06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.898316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:14.899091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0b607492-f6bb-4625-8e28-cd77f13f6182 req-ef0f4059-0c00-4e03-b1ba-9c7bb49a6e06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.899282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:14.905286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:14.906757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.907263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.907703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.908409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.908868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.909888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.927894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0b607492-f6bb-4625-8e28-cd77f13f6182 req-ef0f4059-0c00-4e03-b1ba-9c7bb49a6e06 service nova] Creating event network-vif-plugged:61936e3d-d3c9-4725-85f6-90214baec61c for instance d52ee369-6320-4e39-bf16-9ca9ec32c75f on n-h2-862876-2 Oct 28 13:14:14.928982 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0b607492-f6bb-4625-8e28-cd77f13f6182 req-ef0f4059-0c00-4e03-b1ba-9c7bb49a6e06 service nova] Creating event network-vif-unplugged:d36b485d-13dc-42b8-b88a-f1839e31d629 for instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 on n-h1-862876-2 Oct 28 13:14:14.951004 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0b607492-f6bb-4625-8e28-cd77f13f6182 req-ef0f4059-0c00-4e03-b1ba-9c7bb49a6e06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.104889 Oct 28 13:14:14.954865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1441/2848] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:14.973046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:14.973046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:14.982479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.983008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.983451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:14.984166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:14.984626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:14.985052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.339146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:15.364480 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a16d187-ae58-4a8a-8151-9c3d0fcb99e6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.468297 Oct 28 13:14:15.367135 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1408/2849] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:14 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:15.382730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:15.384226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:15.392309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.393184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.393913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.396305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.396954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.397624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.538918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:15.560463 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-490151cc-f7c6-4afc-ae23-25cf7587f3f8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.602762 Oct 28 13:14:15.577834 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1442/2850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:14 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:15.583007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:15.583007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:15.593711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.598989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.600237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.602407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.603094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.607785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:15.611273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.614271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:15.620745 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-330be6e5-ebe2-455b-812c-684a7f7eec3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1504 microversion: 2.1 time: 0.251418 Oct 28 13:14:15.622589 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1409/2851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:15 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:15.628121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:15.628996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:15.637961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.639088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.639534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.640297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.641091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.641696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.765453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:15.773680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef3ea523-4fc3-4683-a8a8-051fe7290a52 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1299 microversion: 2.1 time: 0.149632 Oct 28 13:14:15.774302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1410/2852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:15 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:15.784675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:15.785641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:15.795592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.796332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.796775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:15.797532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:15.797922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:15.798516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:16.007272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:16.015730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50438fe6-39ac-4199-8ad5-c3ac97cb97b5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1320 microversion: 2.1 time: 0.443972 Oct 28 13:14:16.020399 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1443/2853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:15 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1320 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:16.024910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:16.025533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:16.026125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:16.048967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:16.051553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:16.051553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:16.067012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:16.067717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:16.068381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:16.071177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:16.084432 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ac3078d-1f48-41ec-adc6-b163272dcda2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.308838 Oct 28 13:14:16.086861 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1411/2854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:15 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:16.285614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:16.298080 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0eb00961-a6a1-421f-ab6d-1704e74315c6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1267 microversion: 2.1 time: 0.275687 Oct 28 13:14:16.299481 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1444/2855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:16 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:16.392527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-493281415", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a6d79be4-5785-49f8-a61c-931d9498eb9a"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:16.393578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:16.394197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:16.408692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:16.411576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:16.412249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:16.414449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:16.419884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:16.420394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:16.511882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] validate_networks() for [('a6d79be4-5785-49f8-a61c-931d9498eb9a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:14:16.899150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:16.907211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-15baeccb-698d-4d5e-85ff-920ecb783cd6 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.518815 Oct 28 13:14:16.907810 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1445/2856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:16 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:16.916531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:16.917648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:16.927039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:16.927807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:16.928644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:16.929617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:16.930336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:16.931359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:17.346906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:17.359030 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2490bdea-d5e0-4829-9f4d-c510b1abb612 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1504 microversion: 2.1 time: 0.450139 Oct 28 13:14:17.360464 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1446/2857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:16 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:17.365928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:17.366969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:17.387450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:17.389197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:17.389948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:17.391488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:17.392161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:17.392681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:17.728434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:14:17.729535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:14:17.730327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:14:17.730942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:14:17.732120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:14:17.748176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=19 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:17.757067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:17.757067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:17.757067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:17.757067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:17.758477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:17.759965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:17.803561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:17.817461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for user d70178138d974c20bb9598de42bd3294 and project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:17.851478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:14:17.854353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:14:18.085113 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83468500-685b-4062-8c9e-af6a80897685 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694266 Oct 28 13:14:18.087699 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1412/2858] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:14:18.105444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:18.109147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:18.112732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:18.118921 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fb75d14-3d33-4055-8400-4c81775e2049 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.757189 Oct 28 13:14:18.123723 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1447/2859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:17 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:18.138441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:18.138990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:18.140825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:18.143030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:18.143666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d451b6ed-8618-47a4-a0b9-ecefffc6a828 req-41742caa-e797-4dd9-a42e-b549a2e3d05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55347b5e-23a4-471d-b5a0-bbb0e8134ba9", "name": "network-vif-unplugged", "status": "completed", "tag": "03324192-3f49-463e-9862-16252a818baa"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:18.145375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:18.145375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:18.203157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d451b6ed-8618-47a4-a0b9-ecefffc6a828 req-41742caa-e797-4dd9-a42e-b549a2e3d05e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:18.219154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d451b6ed-8618-47a4-a0b9-ecefffc6a828 req-41742caa-e797-4dd9-a42e-b549a2e3d05e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:18.227612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d451b6ed-8618-47a4-a0b9-ecefffc6a828 req-41742caa-e797-4dd9-a42e-b549a2e3d05e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:18.274407 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d451b6ed-8618-47a4-a0b9-ecefffc6a828 req-41742caa-e797-4dd9-a42e-b549a2e3d05e service nova] Creating event network-vif-unplugged:03324192-3f49-463e-9862-16252a818baa for instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 on n-h1-862876-2 Oct 28 13:14:18.314334 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d451b6ed-8618-47a4-a0b9-ecefffc6a828 req-41742caa-e797-4dd9-a42e-b549a2e3d05e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.181212 Oct 28 13:14:18.315110 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1448/2860] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:18.331889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:18.336481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:18.349533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:18.352474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:18.353470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:18.354532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:18.356044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:18.356758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:18.943553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:18.958876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2cd610c5-43b4-462a-8239-c54ae20ad3d5 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 200 len: 1508 microversion: 2.1 time: 0.863382 Oct 28 13:14:18.960190 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1413/2861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:18 2022] GET /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 1508 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:18.966724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:18.971784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:18.989024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:18.989944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:18.990569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:18.991500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:18.991962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:18.992587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:19.092756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:19.103811 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-53f13735-3c68-47b7-805b-397c1c9894c2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.787411 Oct 28 13:14:19.104410 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1449/2862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:18 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:19.132592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3260f04-7ce5-4564-8377-06d8aa84035a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:19.133931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f3260f04-7ce5-4564-8377-06d8aa84035a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:19.345202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:19.356658 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce1bad7e-5733-4470-9e1c-58f0d671ab15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.394842 Oct 28 13:14:19.359417 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1414/2863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:18 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:19.370217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:19.378103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:19.397165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:19.405293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:19.406033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:19.407846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:19.410040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:19.411822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f3260f04-7ce5-4564-8377-06d8aa84035a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:19.418238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:19.421306 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3260f04-7ce5-4564-8377-06d8aa84035a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1214 microversion: 2.1 time: 0.312966 Oct 28 13:14:19.454117 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1450/2864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:19 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1214 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:19.462512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:19.463172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 010dcbd1-f5bc-4fde-a379-a5a775110ec4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:19.483054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:19.483576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:19.484281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:19.485173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:19.485811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:19.486604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:20.019394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:20.051162 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fdb54474-ef1a-44cb-b583-1cf689fa80a2 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/010dcbd1-f5bc-4fde-a379-a5a775110ec4" status: 200 len: 1509 microversion: 2.1 time: 0.583799 Oct 28 13:14:20.051162 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1451/2865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:19 2022] GET /compute/v2.1/servers/010dcbd1-f5bc-4fde-a379-a5a775110ec4 => generated 1509 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:20.067316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:20.068303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:20.077877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:20.078701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:20.079310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:20.080441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:20.081100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:20.081722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:20.581081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:20.599538 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7127ed28-d5b6-41d5-aa4b-94189de6529e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.543996 Oct 28 13:14:20.601132 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1452/2866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:20 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:20.621444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:20.623073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 010dcbd1-f5bc-4fde-a379-a5a775110ec4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:20.634172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:20.640302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:20.641546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:20.642318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:20.646016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:20.647414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:20.649355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:20.650929 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17ba2d36-07bc-42af-8314-49bbf4887cfc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1504 microversion: 2.1 time: 1.289412 Oct 28 13:14:20.652329 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1415/2867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:19 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1504 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:20.657644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:20.662787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:20.684795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:20.685757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:20.686490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:20.687581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:20.688281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:20.688954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:20.770995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 010dcbd1-f5bc-4fde-a379-a5a775110ec4] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:14:21.310894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:21.323999 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8a7c90f-519b-4db0-a72f-45de71801ac1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.670317 Oct 28 13:14:21.351154 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1416/2868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:20 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:21.368964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:21.369981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:21.384509 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-016138da-2d08-4e64-a2c0-a053a86f153b tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "DELETE /compute/v2.1/servers/010dcbd1-f5bc-4fde-a379-a5a775110ec4" status: 204 len: 0 microversion: 2.1 time: 0.778858 Oct 28 13:14:21.391370 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1453/2869] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:14:20 2022] DELETE /compute/v2.1/servers/010dcbd1-f5bc-4fde-a379-a5a775110ec4 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:14:21.407798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7d7c8d28-7e6a-42ef-a80d-f9924d18815f req-30338599-3e2e-434d-9e0f-ccfe200e7e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55347b5e-23a4-471d-b5a0-bbb0e8134ba9", "tag": "03324192-3f49-463e-9862-16252a818baa"}, {"name": "network-changed", "server_uuid": "2947206d-44a2-41bb-af6a-75fed884b370", "tag": "a493248d-69d2-46c2-ba4f-9cad741c0946"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:21.416753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:21.419879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:21.420607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:21.424372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:21.426254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:21.428173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:21.463757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7d7c8d28-7e6a-42ef-a80d-f9924d18815f req-30338599-3e2e-434d-9e0f-ccfe200e7e16 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:21.469399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7d7c8d28-7e6a-42ef-a80d-f9924d18815f req-30338599-3e2e-434d-9e0f-ccfe200e7e16 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:21.469399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7d7c8d28-7e6a-42ef-a80d-f9924d18815f req-30338599-3e2e-434d-9e0f-ccfe200e7e16 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:21.492578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7d7c8d28-7e6a-42ef-a80d-f9924d18815f req-30338599-3e2e-434d-9e0f-ccfe200e7e16 service nova] Creating event network-changed:03324192-3f49-463e-9862-16252a818baa for instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 on n-h1-862876-2 Oct 28 13:14:21.493134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7d7c8d28-7e6a-42ef-a80d-f9924d18815f req-30338599-3e2e-434d-9e0f-ccfe200e7e16 service nova] Creating event network-changed:a493248d-69d2-46c2-ba4f-9cad741c0946 for instance 2947206d-44a2-41bb-af6a-75fed884b370 on n-h1-862876-2 Oct 28 13:14:21.501459 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7d7c8d28-7e6a-42ef-a80d-f9924d18815f req-30338599-3e2e-434d-9e0f-ccfe200e7e16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109602 Oct 28 13:14:21.502580 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1454/2870] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:21.510016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:21.511088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:21.518624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:21.519473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:21.520156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:21.521414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:21.522062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:21.522652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:21.714473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:21.726901 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bfdb1cc4-dee9-4379-a6d3-dd11f665728b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1266 microversion: 2.1 time: 0.222447 Oct 28 13:14:21.734252 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1455/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:21 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:21.754478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:21.755321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:21.782628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:21.786637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:21.790005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:21.795727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:21.796062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:21.796408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:21.848847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: d52ee369-6320-4e39-bf16-9ca9ec32c75f] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:14:21.921280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:22.271162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:22.286851 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b2f33de-25fe-4f37-9392-4b55d8d754e7 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f" status: 204 len: 0 microversion: 2.1 time: 0.549247 Oct 28 13:14:22.287989 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1456/2872] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:14:21 2022] DELETE /compute/v2.1/servers/d52ee369-6320-4e39-bf16-9ca9ec32c75f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:14:22.302487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e2796759-fa38-4621-a55a-30d0b9deacae req-cc82f0f6-2987-4672-90fd-24f170ac2b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045277a0-63fb-4041-b9b5-b0f275e6f17d", "name": "network-vif-plugged", "status": "completed", "tag": "e05c1d1a-5545-436c-a9b0-a4a597fea3cc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:22.329162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:22.333109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:22.341476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e2796759-fa38-4621-a55a-30d0b9deacae req-cc82f0f6-2987-4672-90fd-24f170ac2b64 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:22.342301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e2796759-fa38-4621-a55a-30d0b9deacae req-cc82f0f6-2987-4672-90fd-24f170ac2b64 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:22.344068 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ba4fd26-c0e2-4e42-9aef-23dc417d585c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.985684 Oct 28 13:14:22.344758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e2796759-fa38-4621-a55a-30d0b9deacae req-cc82f0f6-2987-4672-90fd-24f170ac2b64 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:22.364609 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1417/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:21 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:22.373214 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e2796759-fa38-4621-a55a-30d0b9deacae req-cc82f0f6-2987-4672-90fd-24f170ac2b64 service nova] Creating event network-vif-plugged:e05c1d1a-5545-436c-a9b0-a4a597fea3cc for instance 045277a0-63fb-4041-b9b5-b0f275e6f17d on n-h2-862876-2 Oct 28 13:14:22.378297 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e2796759-fa38-4621-a55a-30d0b9deacae req-cc82f0f6-2987-4672-90fd-24f170ac2b64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082763 Oct 28 13:14:22.379749 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1457/2874] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:22.387941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:22.388175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:22.388776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:22.389346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:22.399696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:22.400498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:22.402187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:22.403267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:22.405166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:22.405777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:22.414878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:22.415382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:22.428556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:22.430512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:22.437306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:22.439941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:23.179601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:23.191680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-692a8047-575d-41e2-9893-33f8cb099011 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.825722 Oct 28 13:14:23.203765 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1418/2875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:22 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:23.367131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:23.368453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:23.390004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:23.397231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:23.397954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:23.400961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:23.404479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:23.407337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:24.422369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:24.434931 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2478d6af-7f9c-45a2-8f05-8391b9b84eda tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 1.228214 Oct 28 13:14:24.460363 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1419/2876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:23 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:24.478056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-540899597", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "4876f925-c1e0-49c6-8444-cd7a605c6ddb"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:24.829844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:24.840793 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87c54055-ed66-4e57-a856-8be99c39e7e2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1504 microversion: 2.1 time: 2.457659 Oct 28 13:14:24.843715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1458/2877] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:22 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1504 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:24.850698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-789a36c4-8ee9-4158-94e2-c41177684326 req-5e4fd18b-56b5-4679-9306-10948315cb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf", "tag": "7c9d3a5f-166c-483f-a5d4-dec8f355a54d"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:24.880926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-789a36c4-8ee9-4158-94e2-c41177684326 req-5e4fd18b-56b5-4679-9306-10948315cb08 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:24.882198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-789a36c4-8ee9-4158-94e2-c41177684326 req-5e4fd18b-56b5-4679-9306-10948315cb08 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:24.882974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-789a36c4-8ee9-4158-94e2-c41177684326 req-5e4fd18b-56b5-4679-9306-10948315cb08 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:24.932116 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-789a36c4-8ee9-4158-94e2-c41177684326 req-5e4fd18b-56b5-4679-9306-10948315cb08 service nova] Creating event network-changed:7c9d3a5f-166c-483f-a5d4-dec8f355a54d for instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf on n-h1-862876-2 Oct 28 13:14:24.948398 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-789a36c4-8ee9-4158-94e2-c41177684326 req-5e4fd18b-56b5-4679-9306-10948315cb08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101495 Oct 28 13:14:24.953535 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1459/2878] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:24.976348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:24.977618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:24.992855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:24.996469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:25.004649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:25.004649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:25.004649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:25.004649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:25.135224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:25.148615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d25b70a4-1e59-4fca-a63e-b908427b08f3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1272 microversion: 2.1 time: 0.191478 Oct 28 13:14:25.151374 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1460/2879] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:24 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:25.162607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:25.163461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:25.180627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:25.181412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:25.186822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:25.186822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:25.186822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:25.186822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:25.527092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:25.574403 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ca3ec90d-d357-4d1d-ae71-4a55bac08210 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.421680 Oct 28 13:14:25.583486 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1461/2880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:25 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:25.583486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:25.583486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:25.592093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:25.593396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:25.594025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:25.594945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:25.595569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:25.596180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:26.072016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:26.081038 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3dbbcb29-5292-413d-9cb5-ae092cbff9eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.504471 Oct 28 13:14:26.081742 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1462/2881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:25 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:26.122078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:26.122714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:26.149976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:26.155398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:26.161890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:26.162667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:26.163169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:26.163600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:26.898140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:26.917570 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76c34e9f-526d-4855-abe6-333220cf3751 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.833267 Oct 28 13:14:26.939760 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1463/2882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:26 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:26.950430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:26.951831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:26.961776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:26.963103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:26.965184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:26.971595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:26.973711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:26.974868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:27.784879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:27.899282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:27.925163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8fd6b3f0-50e4-44df-85de-64a696f6997f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1504 microversion: 2.1 time: 0.983001 Oct 28 13:14:27.927125 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1464/2883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:26 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1504 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:27.946060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:27.950625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:27.968523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:27.969136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:27.969539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:27.974904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:27.975622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:27.978067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:28.147332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:28.158637 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eeecd8fe-4d92-47cc-9c65-31afca6c3328 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1272 microversion: 2.1 time: 0.227819 Oct 28 13:14:28.159519 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1465/2884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:27 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:28.183509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:28.185323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:28.201956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:28.217988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:28.217988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:28.217988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:28.217988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:28.217988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:28.218796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=5 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:28.815682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:28.830066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ceb1ca7e-f247-4f0b-bc5e-3e6499c7a799 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.668380 Oct 28 13:14:28.862778 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1466/2885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:28 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:28.862778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-eba98b5c-e67d-4514-b713-c791470bcbe3 req-1fb6c74f-542b-46c0-83cd-296e1376f307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010dcbd1-f5bc-4fde-a379-a5a775110ec4", "name": "network-vif-deleted", "tag": "c076bba9-99fe-4fbd-858c-1db2c3d1d621"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:28.920662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-eba98b5c-e67d-4514-b713-c791470bcbe3 req-1fb6c74f-542b-46c0-83cd-296e1376f307 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:28.920662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-eba98b5c-e67d-4514-b713-c791470bcbe3 req-1fb6c74f-542b-46c0-83cd-296e1376f307 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:28.920662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-eba98b5c-e67d-4514-b713-c791470bcbe3 req-1fb6c74f-542b-46c0-83cd-296e1376f307 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:28.969095 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-eba98b5c-e67d-4514-b713-c791470bcbe3 req-1fb6c74f-542b-46c0-83cd-296e1376f307 service nova] Creating event network-vif-deleted:c076bba9-99fe-4fbd-858c-1db2c3d1d621 for instance 010dcbd1-f5bc-4fde-a379-a5a775110ec4 on n-h1-862876-2 Oct 28 13:14:28.994305 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-eba98b5c-e67d-4514-b713-c791470bcbe3 req-1fb6c74f-542b-46c0-83cd-296e1376f307 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144005 Oct 28 13:14:28.999090 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1467/2886] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:29.012194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:29.012911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:29.030141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:29.031155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:29.033645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:29.034572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:29.037231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:29.037865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:29.417947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:29.961594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:29.971502 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63bbea0a-014b-4865-970a-d01deb0297f0 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.968633 Oct 28 13:14:29.972085 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1468/2887] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:28 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:29.983911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fd7e94d2-9660-4c30-aace-cba289507842 req-c35aa6b6-db35-4e13-932d-0685bf8722d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52ee369-6320-4e39-bf16-9ca9ec32c75f", "name": "network-vif-deleted", "tag": "61936e3d-d3c9-4725-85f6-90214baec61c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:29.987439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fd7e94d2-9660-4c30-aace-cba289507842 req-c35aa6b6-db35-4e13-932d-0685bf8722d0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:29.987584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fd7e94d2-9660-4c30-aace-cba289507842 req-c35aa6b6-db35-4e13-932d-0685bf8722d0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:29.987893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fd7e94d2-9660-4c30-aace-cba289507842 req-c35aa6b6-db35-4e13-932d-0685bf8722d0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.000908 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fd7e94d2-9660-4c30-aace-cba289507842 req-c35aa6b6-db35-4e13-932d-0685bf8722d0 service nova] Creating event network-vif-deleted:61936e3d-d3c9-4725-85f6-90214baec61c for instance d52ee369-6320-4e39-bf16-9ca9ec32c75f on n-h2-862876-2 Oct 28 13:14:30.010290 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fd7e94d2-9660-4c30-aace-cba289507842 req-c35aa6b6-db35-4e13-932d-0685bf8722d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Oct 28 13:14:30.010290 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1469/2888] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:30.015409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:30.016782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:30.025330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.026155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.026783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.027690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.028413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.029076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.483527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:30.494510 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2da855e-3d94-4971-a21f-9253b3e5af41 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.484756 Oct 28 13:14:30.499009 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1470/2889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:30 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:30.504102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:30.504960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:30.512397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.512887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.513400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.514088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.514595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.515231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.720850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:30.729565 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c24ab741-cbf4-49af-abaa-3a58efd246a1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1504 microversion: 2.1 time: 0.229492 Oct 28 13:14:30.741230 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1471/2890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:30 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:30.747325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:30.747974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:30.754257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.754737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.755197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.755938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.756388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.756835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.901487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:30.909863 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc0a7949-9ad9-46a3-b850-544c9aad471d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1314 microversion: 2.1 time: 0.167503 Oct 28 13:14:30.910373 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1472/2891] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:30 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:30.914917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:30.915526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:30.921567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.922048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.922479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:30.923188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:30.923641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:30.924057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:31.060445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:31.064484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0775d18-698c-4240-a792-9bd9912cf9a9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.153071 Oct 28 13:14:31.078769 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1473/2892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:30 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:31.085021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:31.086182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:31.093121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:31.093660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:31.094290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:31.095088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:31.095560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:31.096004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:31.261850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:31.286066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:31.318984 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-72a49f54-8148-4516-aec3-be7468e98d83 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.251448 Oct 28 13:14:31.346665 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1474/2893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:31 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:31.524759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:31.526062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:31.536461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:31.538350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:31.539423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:31.540588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:31.541244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:31.541843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:31.950973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:31.972835 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84916174-5302-4ddb-a5c1-ab87f9f0b4da tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.453041 Oct 28 13:14:31.977168 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1475/2894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:31 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:31.998608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:31.998608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:32.020562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:32.020562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:32.020562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:32.021669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:32.022609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:32.023430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:32.427863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:32.439752 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0efc2299-cbc5-47bc-af7f-8b84b8ca5372 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1479 microversion: 2.1 time: 0.460392 Oct 28 13:14:32.440668 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1476/2895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:31 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1479 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:32.453422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-efb50152-b087-4f61-b285-7247382ce0aa req-4fc3d690-96a4-4c77-b934-7f6e9c50f96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d63c99-cc82-4458-bfbc-27b3f944f3ea", "tag": "f1cc1003-7a92-4dc8-baa1-095391669b36"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:32.482146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efb50152-b087-4f61-b285-7247382ce0aa req-4fc3d690-96a4-4c77-b934-7f6e9c50f96e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:32.483600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efb50152-b087-4f61-b285-7247382ce0aa req-4fc3d690-96a4-4c77-b934-7f6e9c50f96e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:32.484208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efb50152-b087-4f61-b285-7247382ce0aa req-4fc3d690-96a4-4c77-b934-7f6e9c50f96e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:32.552123 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-efb50152-b087-4f61-b285-7247382ce0aa req-4fc3d690-96a4-4c77-b934-7f6e9c50f96e service nova] Creating event network-changed:f1cc1003-7a92-4dc8-baa1-095391669b36 for instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea on n-h2-862876-2 Oct 28 13:14:32.572588 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-efb50152-b087-4f61-b285-7247382ce0aa req-4fc3d690-96a4-4c77-b934-7f6e9c50f96e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127268 Oct 28 13:14:32.573227 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1477/2896] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:32.596575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:32.597297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:32.625671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:32.626193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:32.626725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:32.629405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:32.632715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:32.633191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:32.968133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:32.978509 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c962c68-f162-443f-81ae-5df96b3a3d93 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1314 microversion: 2.1 time: 0.400898 Oct 28 13:14:32.979663 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1478/2897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:32 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:32.986303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:32.987314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:32.996207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:32.997475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:32.998115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:32.999224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:32.999850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.000378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.338986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:33.348357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d06cecee-7bd5-4504-ae22-22d4ebd666a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.367237 Oct 28 13:14:33.349298 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1479/2898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:32 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:33.370890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:33.372362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:33.386989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.398672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.402180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.403109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.405327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.405784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.567598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:33.575729 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0b5715a-1c10-430b-9537-cd5b9c3d6b9e tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.211339 Oct 28 13:14:33.576312 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1480/2899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:33 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:33.580659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c0ea57f-fd33-416b-b5d2-6a0159baf1fe tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '.version_select at 0x7f27b864e280>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:33.584248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c0ea57f-fd33-416b-b5d2-6a0159baf1fe tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.584726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c0ea57f-fd33-416b-b5d2-6a0159baf1fe tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.585164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c0ea57f-fd33-416b-b5d2-6a0159baf1fe tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.592680 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c0ea57f-fd33-416b-b5d2-6a0159baf1fe tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.015347 Oct 28 13:14:33.593182 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1481/2900] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:14:33 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:33.600460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:33.601093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:33.607609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.608258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.618598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.618598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.618598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.618598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.767538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:33.775511 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-957e5cc6-ad7b-4c91-ab30-92c2121363e5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.181352 Oct 28 13:14:33.776195 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1482/2901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:33 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:33.793732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4f56be35-310b-49ba-a3ec-17e6d815181b req-454a8e0e-81cd-4f19-b005-43d291f97f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2947206d-44a2-41bb-af6a-75fed884b370", "name": "network-vif-plugged", "status": "completed", "tag": "a493248d-69d2-46c2-ba4f-9cad741c0946"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:33.807926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4f56be35-310b-49ba-a3ec-17e6d815181b req-454a8e0e-81cd-4f19-b005-43d291f97f4e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.807926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4f56be35-310b-49ba-a3ec-17e6d815181b req-454a8e0e-81cd-4f19-b005-43d291f97f4e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.807926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4f56be35-310b-49ba-a3ec-17e6d815181b req-454a8e0e-81cd-4f19-b005-43d291f97f4e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.829584 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4f56be35-310b-49ba-a3ec-17e6d815181b req-454a8e0e-81cd-4f19-b005-43d291f97f4e service nova] Creating event network-vif-plugged:a493248d-69d2-46c2-ba4f-9cad741c0946 for instance 2947206d-44a2-41bb-af6a-75fed884b370 on n-h1-862876-2 Oct 28 13:14:33.836346 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4f56be35-310b-49ba-a3ec-17e6d815181b req-454a8e0e-81cd-4f19-b005-43d291f97f4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058851 Oct 28 13:14:33.837434 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1483/2902] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:33.843249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:33.845529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:33.852212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.852707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.853190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.853961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.854610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.854731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.889402 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d67020a-454a-42f2-85dc-8cb9434d8efa tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050584 Oct 28 13:14:33.890796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1484/2903] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:14:33 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:33.896519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:33.897643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:33.914807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.916013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.922359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:33.923414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:33.924120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:33.924797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f700f754-aa6f-43c6-93a6-d746f64c0d41 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1630 microversion: 2.1 time: 0.211272 Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1485/2904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:33 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1630 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:34.174379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:34.322556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lazy-loading 'services' on Instance uuid ddabee5d-0299-4cbc-8229-6d9b7094d711 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:14:34.427327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=56 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:34.507292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:34.716622 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-252c9dda-33ff-48df-900d-a90b891f419e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments/e06e7d2d-538f-4863-9893-2a23fdacc608" status: 202 len: 0 microversion: 2.1 time: 0.611057 Oct 28 13:14:34.721496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1486/2905] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:14:34 2022] DELETE /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments/e06e7d2d-538f-4863-9893-2a23fdacc608 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:14:34.734643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:34.744331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:34.765248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:34.766189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:34.766638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:34.767493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:34.767953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:34.768421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:34.965240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:34.975052 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ca98da8-bbe1-42bb-a06e-6aacbe662b58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1314 microversion: 2.1 time: 0.250639 Oct 28 13:14:34.975608 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1487/2906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:34 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:35.031761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60d149ba-5ffd-40d5-8982-2730985c04d2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Action: 'create', calling method: .version_select at 0x7f27bd9a4550>, body: {"keypair": {"name": "tempest-keypair-892498360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrT+hSt1Vb7Czp8lFsJtMPe8SOkYPrsysKEeJCyccKFU6sHUiGE99+Yw/Awy3ObHghGB5gjPH9rRYo2lLFgEPM9VMbF8sV+UEst/25EVd8o2df2NG9kqSSaS5+UA/4HIg=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:35.107862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-60d149ba-5ffd-40d5-8982-2730985c04d2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:35.161245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-60d149ba-5ffd-40d5-8982-2730985c04d2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for user 2042816d9181427cb51f1c710281aa53 and project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:35.342254 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60d149ba-5ffd-40d5-8982-2730985c04d2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.364460 Oct 28 13:14:35.346167 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1488/2907] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:14:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:35.357729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:35.360028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:35.379387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:35.380440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:35.380976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:35.381604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:35.382067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:35.382497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:35.812954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:35.839760 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f3d6f55-3231-467f-a362-c4ae33ceff7b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.487330 Oct 28 13:14:35.843572 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1489/2908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:35 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:35.892216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:35.895337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:35.935304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:35.935784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:35.940485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:35.943057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:35.943557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:35.943996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:36.618981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:36.637185 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de007642-a7fe-4ef1-b13a-2c0c2fa7ac59 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1366 microversion: 2.1 time: 0.774206 Oct 28 13:14:36.642646 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1490/2909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:35 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1366 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:36.664741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:36.665959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:36.677346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:36.682395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:36.683895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:36.684964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:36.686168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:36.692525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:37.314132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:37.333734 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-05f92303-59f9-4384-a4ca-08729b8154a1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.685613 Oct 28 13:14:37.335221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1491/2910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:36 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:37.355188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:37.369176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:37.411634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:37.412052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:37.412493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:37.413208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:37.413979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:37.419360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:37.948405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:37.963792 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a99f9d46-8556-4bfb-9d14-84467bc729b4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1314 microversion: 2.1 time: 0.626029 Oct 28 13:14:37.965884 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1492/2911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:37 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:37.978684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:37.978684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:38.009096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:38.009511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:38.009963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:38.010790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:38.011305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:38.011776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:38.401422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:38.406387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:38.417175 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f613875-1c70-4720-9d57-015310679efb tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.449674 Oct 28 13:14:38.435554 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1493/2912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:37 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:38.448211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:38.448211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:38.450773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:38.451377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:38.451911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:38.452709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:38.453324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:38.453839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:38.765076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:38.794699 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0015afb0-2b17-492f-9b65-ee2a77b4431a tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1557 microversion: 2.1 time: 0.353138 Oct 28 13:14:38.794699 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1494/2913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:38 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1557 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:38.832379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:38.836184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:38.879688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:38.879688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:38.879688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:38.879688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:38.879688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:38.879688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:39.006925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] validate_networks() for [('4876f925-c1e0-49c6-8444-cd7a605c6ddb', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:14:39.366460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:39.384484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-120e358e-47d1-45c2-bd32-a541cdb08e1c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.570987 Oct 28 13:14:39.385423 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1495/2914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:38 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:39.396483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:39.408350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:39.440610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:39.548370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:39.548370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:39.548370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:39.548370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:39.548370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:39.649077 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54275aa3-8e20-4635-994d-bacbe73f279f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.261317 Oct 28 13:14:39.660006 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1496/2915] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:14:39 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:39.665271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:39.666062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:39.675278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:39.676610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:39.677229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:39.678117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:39.679437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:39.680766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:39.951872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:14:39.952416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:14:39.953134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:14:39.954198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:14:39.954865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:14:39.987207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:39.987793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:39.988332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:39.989167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:39.989726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:39.990273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.013840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Getting quotas for project 4c5269fb91904a768882033082d150a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:40.020096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Getting quotas for user e49876703e4b4b08a78fba7500764f16 and project 4c5269fb91904a768882033082d150a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:40.039478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Going to run 2 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:14:40.040125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:40.042840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:14:40.055917 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78138a37-181f-4577-bcf2-0d5462a61f6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1314 microversion: 2.1 time: 0.394491 Oct 28 13:14:40.060286 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1497/2916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:39 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:40.065190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:40.078585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:40.094802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:40.110205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:40.125183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.130347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:40.130945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:40.131604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.190442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=82658fb3-b6fd-453b-a042-49d19c006272,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:14:40.437846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c0f627ed-f5a4-49f3-ae14-0432a4a73f58 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 15.974234 Oct 28 13:14:40.443227 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1420/2917] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:14:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 15981 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:14:40.459396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:40.461999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:40.514271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:40.515060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:40.517838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.523741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:40.524491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:40.533527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.561962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:40.575748 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a469ce7-a133-4978-b708-e9734fa6a769 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.513965 Oct 28 13:14:40.599389 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1498/2918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:40 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:40.604588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:40.610682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:40.611853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Searching by: {'deleted': False, 'project_id': '4c5269fb91904a768882033082d150a8'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:14:40.628275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:40.629161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:40.629972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.630978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:40.631684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:40.632346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.656152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6ee3c66-5035-4648-bea6-a19cb81edb39 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.055217 Oct 28 13:14:40.657520 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1499/2919] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:14:40 2022] GET /compute/v2.1/servers => generated 671 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:40.676673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebb10a7f-7b42-4e05-9731-2985e4b1a4b8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:40.678506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ebb10a7f-7b42-4e05-9731-2985e4b1a4b8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:40.883952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:40.899133 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-004df846-b347-460a-afaf-7ca0015ae812 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.453948 Oct 28 13:14:40.900426 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1421/2920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:40 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:40.909625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3773e0b1-5c02-41ea-a6e6-f5119926c419 req-acc95bd3-25eb-4310-8100-674c598ee7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d63c99-cc82-4458-bfbc-27b3f944f3ea", "name": "network-vif-plugged", "status": "completed", "tag": "f1cc1003-7a92-4dc8-baa1-095391669b36"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:40.931718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3773e0b1-5c02-41ea-a6e6-f5119926c419 req-acc95bd3-25eb-4310-8100-674c598ee7a7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:40.936503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3773e0b1-5c02-41ea-a6e6-f5119926c419 req-acc95bd3-25eb-4310-8100-674c598ee7a7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:40.941433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3773e0b1-5c02-41ea-a6e6-f5119926c419 req-acc95bd3-25eb-4310-8100-674c598ee7a7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:40.968588 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3773e0b1-5c02-41ea-a6e6-f5119926c419 req-acc95bd3-25eb-4310-8100-674c598ee7a7 service nova] Creating event network-vif-plugged:f1cc1003-7a92-4dc8-baa1-095391669b36 for instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea on n-h2-862876-2 Oct 28 13:14:40.979748 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3773e0b1-5c02-41ea-a6e6-f5119926c419 req-acc95bd3-25eb-4310-8100-674c598ee7a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077893 Oct 28 13:14:40.983453 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1422/2921] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:41.042468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ebb10a7f-7b42-4e05-9731-2985e4b1a4b8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:41.071420 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ebb10a7f-7b42-4e05-9731-2985e4b1a4b8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1217 microversion: 2.1 time: 0.400625 Oct 28 13:14:41.073834 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1500/2922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:40 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1217 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:41.093668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:41.095289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:41.102819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:41.105775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:41.108770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:41.115076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:41.117693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:41.118154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:41.523160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:41.556657 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48faaef2-2f45-4db4-886f-feaf5149e265 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1314 microversion: 2.1 time: 0.468862 Oct 28 13:14:41.557437 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1423/2923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:41 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:41.607885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:41.608676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:41.628966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:41.630603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:41.634241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:41.635645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:41.638122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:41.638695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:41.929258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:41.929912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:41.936614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:41.937147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:41.937587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:41.938326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:41.939077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:41.939722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:42.028490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:42.043327 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2fbcdb6-31bc-499f-967a-45e2926571d9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1527 microversion: 2.1 time: 0.436596 Oct 28 13:14:42.044798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1501/2924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:41 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1527 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:42.096867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-608c9b54-b8f9-4d7f-a5a7-a5da23dad512 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:42.097811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-608c9b54-b8f9-4d7f-a5a7-a5da23dad512 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:42.101418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:42.208887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:42.210784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-608c9b54-b8f9-4d7f-a5a7-a5da23dad512 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:42.218334 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-608c9b54-b8f9-4d7f-a5a7-a5da23dad512 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1217 microversion: 2.1 time: 0.125456 Oct 28 13:14:42.220288 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-13673d74-c9ef-4d8c-9fd4-00aa55591bdc tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.295298 Oct 28 13:14:42.227535 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1502/2925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:42 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:42.266916 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1424/2926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:41 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:42.760514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1310943868", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "8a5ca9f0-82b0-4d71-8677-088d1cfb750f"}], "security_groups": [{"name": "tempest-securitygroup--1563953300"}], "key_name": "tempest-keypair-892498360", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:43.022124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:43.022787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:43.036247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.038895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.040927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:43.042511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.050309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.051198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:43.134090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] validate_networks() for [('8a5ca9f0-82b0-4d71-8677-088d1cfb750f', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:14:43.405859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:43.429106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fde7db6a-144f-48cc-9579-040483452594 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1500 microversion: 2.1 time: 0.849302 Oct 28 13:14:43.430352 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1503/2927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:42 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1500 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:43.436735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:43.437631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:43.455009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.455865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.457541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:43.459034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.459670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.460280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:43.748420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:43.759301 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-187f2d82-e922-4109-a950-2f063b711920 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1509 microversion: 2.1 time: 0.326731 Oct 28 13:14:43.763045 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1504/2928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:43 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:43.775395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:43.776187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:43.788649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.792194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.793140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:43.793966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.796263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.796786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:43.907616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:43.919526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-780c94cd-d4ce-4237-afed-2e1950565097 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1221 microversion: 2.1 time: 0.155101 Oct 28 13:14:43.937697 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1505/2929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:43 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:43.943052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:43.958949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:43.968078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.968928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.969611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:43.970852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:43.971559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:43.972276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:44.210629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:44.228856 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1392d9ba-cf79-4e69-b837-a4a04993b67f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.289461 Oct 28 13:14:44.229891 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1506/2930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:43 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:44.235496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c19e9a1c-3c7d-4887-aa9b-8d950e34caee req-f34db696-f1f7-4cfc-91ba-2a8349eb5399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2947206d-44a2-41bb-af6a-75fed884b370", "tag": "a493248d-69d2-46c2-ba4f-9cad741c0946"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:44.245736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c19e9a1c-3c7d-4887-aa9b-8d950e34caee req-f34db696-f1f7-4cfc-91ba-2a8349eb5399 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:44.246563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c19e9a1c-3c7d-4887-aa9b-8d950e34caee req-f34db696-f1f7-4cfc-91ba-2a8349eb5399 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:44.247500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c19e9a1c-3c7d-4887-aa9b-8d950e34caee req-f34db696-f1f7-4cfc-91ba-2a8349eb5399 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:44.272868 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c19e9a1c-3c7d-4887-aa9b-8d950e34caee req-f34db696-f1f7-4cfc-91ba-2a8349eb5399 service nova] Creating event network-changed:a493248d-69d2-46c2-ba4f-9cad741c0946 for instance 2947206d-44a2-41bb-af6a-75fed884b370 on n-h1-862876-2 Oct 28 13:14:44.284638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c19e9a1c-3c7d-4887-aa9b-8d950e34caee req-f34db696-f1f7-4cfc-91ba-2a8349eb5399 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052706 Oct 28 13:14:44.285255 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1507/2931] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:44.297658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:44.309852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:44.318286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:44.319213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:44.319905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:44.320854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:44.321573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:44.322282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:44.504320 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3818f018-6516-4420-80a3-1921abb6def7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 0.211368 Oct 28 13:14:44.506819 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1508/2932] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:44 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:44.711975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:14:44.714156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:14:44.715293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:14:44.715965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:14:44.716635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:14:44.731648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:44.732729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:44.734480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:44.735808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:44.736581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:44.737235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:44.767507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:44.773050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for user 2042816d9181427cb51f1c710281aa53 and project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:44.786292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:14:44.789151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:14:44.795243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:44.796275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:44.815343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:44.816163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:44.816813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:44.817728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:44.818347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:44.819002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.020622 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08fcf3ec-c3d0-4fa4-9ff3-87aa10d09984 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.264564 Oct 28 13:14:45.021295 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1425/2933] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:14:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:14:45.075961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:45.077973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:45.094135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.094908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.096438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.097329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.097977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.098871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.189575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:45.209735 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2155bfd1-61cb-4207-a51d-2c7cc34cbc2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1509 microversion: 2.1 time: 0.417672 Oct 28 13:14:45.209735 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1509/2934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:44 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:45.213634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dda26a38-205e-4c08-8a43-745143df1313 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:45.214253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dda26a38-205e-4c08-8a43-745143df1313 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:45.214728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:45.239880 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cac208c2-e702-44da-8e76-46dd47b6dc40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1269 microversion: 2.1 time: 0.211830 Oct 28 13:14:45.241252 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1426/2935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:45 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1269 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:45.250374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:45.261639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:45.264443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.265819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.266615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.267660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.268277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.268945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.312272 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f795881-0fc1-42e9-b5fe-00d877996579 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069591 Oct 28 13:14:45.312913 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1427/2936] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:14:45 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:45.318239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cfce1e8b-29be-4247-89ea-c4e173597c37 req-fbdcd7b7-dbd8-47eb-b9b4-8ef27842be9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf", "name": "network-vif-plugged", "status": "completed", "tag": "7c9d3a5f-166c-483f-a5d4-dec8f355a54d"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:45.333485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cfce1e8b-29be-4247-89ea-c4e173597c37 req-fbdcd7b7-dbd8-47eb-b9b4-8ef27842be9a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.334086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cfce1e8b-29be-4247-89ea-c4e173597c37 req-fbdcd7b7-dbd8-47eb-b9b4-8ef27842be9a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.334633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cfce1e8b-29be-4247-89ea-c4e173597c37 req-fbdcd7b7-dbd8-47eb-b9b4-8ef27842be9a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.354564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cfce1e8b-29be-4247-89ea-c4e173597c37 req-fbdcd7b7-dbd8-47eb-b9b4-8ef27842be9a service nova] Creating event network-vif-plugged:7c9d3a5f-166c-483f-a5d4-dec8f355a54d for instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf on n-h1-862876-2 Oct 28 13:14:45.373874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dda26a38-205e-4c08-8a43-745143df1313 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:45.385232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cfce1e8b-29be-4247-89ea-c4e173597c37 req-fbdcd7b7-dbd8-47eb-b9b4-8ef27842be9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069492 Oct 28 13:14:45.387866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dda26a38-205e-4c08-8a43-745143df1313 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1234 microversion: 2.1 time: 0.177715 Oct 28 13:14:45.388599 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1428/2937] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:45.391546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1510/2938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:45 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1234 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:45.428081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:45.428998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:45.441318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.441992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.442588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.443469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.444216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.444873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.460469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:45.470517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:45.480501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.481409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.482154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.483293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.483933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.484462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.550543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ce8b13e-17a1-49f4-9a4a-a9a0c710190e tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106326 Oct 28 13:14:45.558395 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1511/2939] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:14:45 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:45.564505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:45.567128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:45.574945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.575627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.576164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:45.577015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:45.577573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:45.578480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.157706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:46.168979 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-771bf2e6-f49b-4a6b-8732-32ae050b0b75 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.777257 Oct 28 13:14:46.170114 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1429/2940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:45 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:46.176572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:46.183818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:46.184512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.185190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.185794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.187168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.187768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.188365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.221998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:14:46.598677 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf56a96c-8735-4837-8a6f-bca836603d9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 1.038198 Oct 28 13:14:46.602451 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1512/2941] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:45 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:46.607738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:46.608450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:46.610002 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9b8c208f-3246-4d21-8864-41c8b6cdf122 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 204 len: 0 microversion: 2.1 time: 0.438314 Oct 28 13:14:46.614538 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1430/2942] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:14:46 2022] DELETE /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:14:46.623215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:46.624170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:46.624295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.624698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.625142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.625840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.626300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.626726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.631418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.632540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.633106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.634266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.634739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.635222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.748095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:46.756461 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6298b149-2475-45dc-8df4-b09c378a7606 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1275 microversion: 2.1 time: 0.137691 Oct 28 13:14:46.758106 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1431/2943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:46 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:46.762761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:46.764652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:46.769838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.770408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.770983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.771792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.772308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.773075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.820413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:46.829255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00161755-2e4c-4a61-a420-a7cd641e4ae7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1509 microversion: 2.1 time: 0.225449 Oct 28 13:14:46.830008 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1513/2944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:46 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:46.836349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:46.837203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:46.846297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.847185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.847788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.848492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:46.848940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:46.849362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:46.874384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:46.885457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b38d8eec-d0e8-4b05-9820-bbd8014736f2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1238 microversion: 2.1 time: 0.127103 Oct 28 13:14:46.886501 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1432/2945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:46 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1238 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:46.993631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:47.003727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef46e30d-0f3a-4bbc-9977-b1f901f566a1 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1680 microversion: 2.1 time: 0.172235 Oct 28 13:14:47.007213 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1514/2946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:46 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:47.195122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:47.196394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:47.205698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.206467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.207138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.208060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.209022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.209660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.493404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b3be6085-4750-4e30-8d27-173764826322 req-7f914064-071e-4733-a57f-a56f199b7a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045277a0-63fb-4041-b9b5-b0f275e6f17d", "name": "network-vif-unplugged", "status": "completed", "tag": "e05c1d1a-5545-436c-a9b0-a4a597fea3cc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:47.504299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:47.507978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b3be6085-4750-4e30-8d27-173764826322 req-7f914064-071e-4733-a57f-a56f199b7a66 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.508473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b3be6085-4750-4e30-8d27-173764826322 req-7f914064-071e-4733-a57f-a56f199b7a66 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.510108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b3be6085-4750-4e30-8d27-173764826322 req-7f914064-071e-4733-a57f-a56f199b7a66 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.519996 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f53054f-5e66-44ee-8170-929721576779 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1307 microversion: 2.1 time: 0.328167 Oct 28 13:14:47.519996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1433/2947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:47 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:47.522628 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b3be6085-4750-4e30-8d27-173764826322 req-7f914064-071e-4733-a57f-a56f199b7a66 service nova] Creating event network-vif-unplugged:e05c1d1a-5545-436c-a9b0-a4a597fea3cc for instance 045277a0-63fb-4041-b9b5-b0f275e6f17d on n-h2-862876-2 Oct 28 13:14:47.528131 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b3be6085-4750-4e30-8d27-173764826322 req-7f914064-071e-4733-a57f-a56f199b7a66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041070 Oct 28 13:14:47.529196 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1515/2948] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:47.611088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:47.617644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:47.620136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.620718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.621402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.621984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.622499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.622905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.784210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:47.785017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:47.791429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.791998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.792503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.793908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.794371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.794815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.812001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:47.871182 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eb268bde-dd72-4aa7-a8dd-17a513fa5b6a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 0.265145 Oct 28 13:14:47.871988 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1434/2949] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:47 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:47.878851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:47.879687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:47.898934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.899860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.900569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.905291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:47.905943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:47.907637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:47.986797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:47.994966 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-035dc983-8aa2-4ebb-baad-e49d50a52e43 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 0.215009 Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1516/2950] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:47 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.011073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.012336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.082917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:48.091610 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-42b1fe73-0575-4cbb-a000-c41d229b07ba tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1286 microversion: 2.1 time: 0.094953 Oct 28 13:14:48.092522 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1517/2951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:47 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:48.098050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:48.098860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:48.105029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.105625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.106068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.106773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.107241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.107755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.273099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:48.290348 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-58422477-41e3-46d1-a3e8-1e3246103fc5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1509 microversion: 2.1 time: 0.409360 Oct 28 13:14:48.303339 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1435/2952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:47 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1509 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:48.405062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:48.416203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-999dad57-b211-4220-894f-42330817b324 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1680 microversion: 2.1 time: 0.322605 Oct 28 13:14:48.416798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1518/2953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:48 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:48.546623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:48.549076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:48.572183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.574269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.581171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.582958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.583944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.584870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.883963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:48.886233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:48.897509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.899022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.899569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.900734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.901372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.901888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.903861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:48.915726 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1a98798-db4a-46b9-ada1-91b6f022c933 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1486 microversion: 2.1 time: 0.376948 Oct 28 13:14:48.916566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1436/2954] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:48 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1486 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:48.939993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:48.940732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:48.947636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.948123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.948591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.949717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:48.950327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:48.950937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:48.979546 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d6bea0ed-b5dc-4411-8184-324df54891a7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 0.099910 Oct 28 13:14:48.979881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:14:48.981727 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1519/2955] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:48 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:14:48.988737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:49.018317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:49.019049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:49.027823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.035799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.036486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.037857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.038496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.040377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.383856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:49.394237 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5941915-4f9a-47c1-860f-70984666c405 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 0.378186 Oct 28 13:14:49.403860 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1520/2956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:49 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:49.408701 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-deed24e9-543d-480f-9855-c3b94b80d6db tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 204 len: 0 microversion: 2.1 time: 0.472466 Oct 28 13:14:49.412395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1437/2957] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:14:48 2022] DELETE /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:14:49.413804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:49.414422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:49.420343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5e95ec1b-7854-465c-8091-1ee2c04d1736 req-1d49e404-573c-4b70-8854-491378f27ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d702bb-4b4a-4f62-8e5d-07168ac7c638", "tag": "5d96658b-89de-4d31-88b1-f6e80da77dab"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:49.426431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.433939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.433939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.433939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.433939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.433939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.449753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e95ec1b-7854-465c-8091-1ee2c04d1736 req-1d49e404-573c-4b70-8854-491378f27ecd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.450497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e95ec1b-7854-465c-8091-1ee2c04d1736 req-1d49e404-573c-4b70-8854-491378f27ecd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.450968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e95ec1b-7854-465c-8091-1ee2c04d1736 req-1d49e404-573c-4b70-8854-491378f27ecd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.475011 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5e95ec1b-7854-465c-8091-1ee2c04d1736 req-1d49e404-573c-4b70-8854-491378f27ecd service nova] Creating event network-changed:5d96658b-89de-4d31-88b1-f6e80da77dab for instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 on n-h1-862876-2 Oct 28 13:14:49.483211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5e95ec1b-7854-465c-8091-1ee2c04d1736 req-1d49e404-573c-4b70-8854-491378f27ecd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072211 Oct 28 13:14:49.484497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1438/2958] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:49.493771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:49.495120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:49.514290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.514290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.514290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.514290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.514290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.514290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.528866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:49.546880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ee47e913-a240-490b-b19c-bd097df9938c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1292 microversion: 2.1 time: 0.139605 Oct 28 13:14:49.548115 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1521/2959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:49 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:49.561256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:49.561886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:49.586968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.587872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.589070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.592031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.592937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.593600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.921861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:49.931078 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fbb6a528-8b22-4bed-91c6-358444deb7ac tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1492 microversion: 2.1 time: 0.380231 Oct 28 13:14:49.931887 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1522/2960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:49 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1492 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:49.936708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:49.937324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:49.941652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:49.943237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.943936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.944557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.945437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.946053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.946639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:49.958446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12a6c127-e660-4901-ac6f-12d30871322e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1452 microversion: 2.1 time: 0.471741 Oct 28 13:14:49.963372 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1439/2961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:49 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1452 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:49.965569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3e489a23-ef14-428b-a793-4199cf4dd2ab req-6f0b5b51-2c13-49fa-bccf-3b121297524c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddabee5d-0299-4cbc-8229-6d9b7094d711", "name": "network-vif-deleted", "tag": "02a72b35-1813-44ed-a9ec-b28228621ebb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:49.985594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3e489a23-ef14-428b-a793-4199cf4dd2ab req-6f0b5b51-2c13-49fa-bccf-3b121297524c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:49.986377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3e489a23-ef14-428b-a793-4199cf4dd2ab req-6f0b5b51-2c13-49fa-bccf-3b121297524c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:49.986986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3e489a23-ef14-428b-a793-4199cf4dd2ab req-6f0b5b51-2c13-49fa-bccf-3b121297524c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.005354 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3e489a23-ef14-428b-a793-4199cf4dd2ab req-6f0b5b51-2c13-49fa-bccf-3b121297524c service nova] Creating event network-vif-deleted:02a72b35-1813-44ed-a9ec-b28228621ebb for instance ddabee5d-0299-4cbc-8229-6d9b7094d711 on n-h2-862876-2 Oct 28 13:14:50.013027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3e489a23-ef14-428b-a793-4199cf4dd2ab req-6f0b5b51-2c13-49fa-bccf-3b121297524c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052329 Oct 28 13:14:50.013743 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1440/2962] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:50.024125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b89eeb21ebe45d8a33f5faa090b48df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f973a578f68f48978ec53c2e2cfe64d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:50.032591 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a15b9cf3-6bef-4ccb-9be2-0651ef2ed082 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 200 len: 1612 microversion: 2.1 time: 0.099507 Oct 28 13:14:50.033176 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1523/2963] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:49 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 1612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:50.036156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:50.045522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:50.050628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:50.058070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:50.066696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.067575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.068016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.069501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.069966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.070577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.072774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.073277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.074101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.075041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.075692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.077566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.129641 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-89c8bb02-bf2d-4c19-807f-bfe72a3e3233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 0.091672 Oct 28 13:14:50.130950 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1524/2964] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:50 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:50.420200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:50.420966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:50.428794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.429501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.430393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.431284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.431890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.432504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.438126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:50.446563 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0253eba-a6b0-4b1e-b933-26242d51827f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1452 microversion: 2.1 time: 0.431456 Oct 28 13:14:50.448927 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1441/2965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:50 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1452 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:50.535756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:50.536377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:50.549258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.549979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.550596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.551497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.552294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.552723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.588398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lazy-loading 'flavor' on Instance uuid 045277a0-63fb-4041-b9b5-b0f275e6f17d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:14:50.612178 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Cannot 'shelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state shelved_offloaded Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action HTTP/1.1 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 14 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: {"shelve": {}} Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'shelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state shelved_offloaded Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'shelve': {}}} Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:14:50.614370 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state shelved_offloaded Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state shelved_offloaded Oct 28 13:14:50.619388 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:50.621495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 409 to user: Cannot 'shelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state shelved_offloaded {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:14:50.622448 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ae6a0c0c-caba-48de-be4b-1f846977c716 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 409 len: 155 microversion: 2.1 time: 0.097127 Oct 28 13:14:50.623087 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1442/2966] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:50 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 155 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.646607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.648071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:50.720756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:50.731164 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-555c0950-84fd-462a-8688-341c980e4cbc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 0.317130 Oct 28 13:14:50.745269 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1525/2967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:50 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:50.751532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:50.752186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:50.759223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.759748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.760881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.761739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:50.762545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:50.763249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:50.811612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127793) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 13:14:51.266784 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10a17318-d0fa-4f7c-8d3e-1c94391522d0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 202 len: 0 microversion: 2.1 time: 0.519264 Oct 28 13:14:51.272657 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1526/2968] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:50 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:14:51.282479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:51.289381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:51.301189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.302059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.306445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.306445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.306445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.306445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.504890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:51.514058 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e1ff5b6-61db-45ae-a546-14f44f2c9efa tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.889598 Oct 28 13:14:51.514952 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1443/2969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:50 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:51.520691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:51.521579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:51.529113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.531254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.531943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.532868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.533490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.534060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.551601 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] HTTP exception thrown: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Request method failure captured: Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 HTTP/1.1 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UUceccGh0Nz8KUuL47K2ejkb2egKHIXqeJ-yaUai73zN_H05eDA4q0gtJAG7JfIt2CCnJxmOnMyoOD2pdLhg7WuTs4EHbBQgg8MRFU5Z8zxlVqEQTKK9WC5FGuNwQaO_Z3tnkRuTMG4Bo_nJk3RPgVmykaA2KdxBlwLnHhw0m3fz0 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f973a578f68f48978ec53c2e2cfe64d7 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f973a578f68f48978ec53c2e2cfe64d7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f973a578f68f48978ec53c2e2cfe64d7 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachSCSIVolumeTestJSON-279923899-project Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6b89eeb21ebe45d8a33f5faa090b48df Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-279923899-project Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'ddabee5d-0299-4cbc-8229-6d9b7094d711'} Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:51.553181 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Returning 404 to user: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0d4c0b0-9de7-4457-babf-3a8e3aaf6e76 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 404 len: 111 microversion: 2.1 time: 0.038344 Oct 28 13:14:51.558180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1444/2970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:51 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:14:51.562865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:51.565239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:51.571595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.572234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.572778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.573733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.574240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.574672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.613858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-df169870-4561-4036-9d64-1d63829299ed tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 0.056954 Oct 28 13:14:51.614960 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1445/2971] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:51 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:51.620571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:51.621580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:51.628865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.629363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.629803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.630522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:51.631197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:51.631855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:51.933048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:51.941724 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-89c5cce7-4d9f-467c-8ba3-2d6fa7b35aff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1460 microversion: 2.1 time: 0.325383 Oct 28 13:14:51.942301 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1446/2972] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:51 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1460 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:51.958075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:51.961353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2a8fc6a-9ea6-4128-830b-8a4e9602f421 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '.version_select at 0x7f27b8b29c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:51.972828 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b08fab4a-e205-44b5-b149-126dc231756d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1492 microversion: 2.1 time: 0.698808 Oct 28 13:14:51.973475 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1527/2973] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:51 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1492 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:51.988256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:51.992322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:51.993148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:52.000771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.001324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.001821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.002627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.003206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.003708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.109359 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2a8fc6a-9ea6-4128-830b-8a4e9602f421 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605127733" status: 202 len: 0 microversion: 2.1 time: 0.155093 Oct 28 13:14:52.111117 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1447/2974] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605127733 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:14:52.116784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1ba34fac-764b-497b-a262-749d43d5b11d req-a87bac5d-ff6b-43f4-909e-e75c392f0649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82658fb3-b6fd-453b-a042-49d19c006272", "tag": "3cd1254a-acf5-4144-9a00-0b364842bd10"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:52.146527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1ba34fac-764b-497b-a262-749d43d5b11d req-a87bac5d-ff6b-43f4-909e-e75c392f0649 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.147516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1ba34fac-764b-497b-a262-749d43d5b11d req-a87bac5d-ff6b-43f4-909e-e75c392f0649 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.150445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1ba34fac-764b-497b-a262-749d43d5b11d req-a87bac5d-ff6b-43f4-909e-e75c392f0649 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.172767 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1ba34fac-764b-497b-a262-749d43d5b11d req-a87bac5d-ff6b-43f4-909e-e75c392f0649 service nova] Creating event network-changed:3cd1254a-acf5-4144-9a00-0b364842bd10 for instance 82658fb3-b6fd-453b-a042-49d19c006272 on n-h2-862876-2 Oct 28 13:14:52.180948 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1ba34fac-764b-497b-a262-749d43d5b11d req-a87bac5d-ff6b-43f4-909e-e75c392f0649 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068058 Oct 28 13:14:52.182334 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1448/2975] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:52.337914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-300f49c1-1bed-4f5a-909d-89c3af8e55a7 req-a44933b4-f856-41f0-8f9b-946da8b4d304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf", "name": "network-vif-deleted", "tag": "7c9d3a5f-166c-483f-a5d4-dec8f355a54d"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:52.342476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-300f49c1-1bed-4f5a-909d-89c3af8e55a7 req-a44933b4-f856-41f0-8f9b-946da8b4d304 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.346813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-300f49c1-1bed-4f5a-909d-89c3af8e55a7 req-a44933b4-f856-41f0-8f9b-946da8b4d304 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.347438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-300f49c1-1bed-4f5a-909d-89c3af8e55a7 req-a44933b4-f856-41f0-8f9b-946da8b4d304 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.360624 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-300f49c1-1bed-4f5a-909d-89c3af8e55a7 req-a44933b4-f856-41f0-8f9b-946da8b4d304 service nova] Creating event network-vif-deleted:7c9d3a5f-166c-483f-a5d4-dec8f355a54d for instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf on n-h1-862876-2 Oct 28 13:14:52.366079 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-300f49c1-1bed-4f5a-909d-89c3af8e55a7 req-a44933b4-f856-41f0-8f9b-946da8b4d304 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039984 Oct 28 13:14:52.366984 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1449/2976] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:14:52.451453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:52.458093 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cd2041f3-667f-460b-af4f-6861842e0fcf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 0.483616 Oct 28 13:14:52.458965 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1528/2977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:51 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:52.541947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:52.542649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:52.559235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.559786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.560370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.561086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.563433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.566401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.628521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:52.631958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:52.639333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.640351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.640951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.641810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.642640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.643409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.711329 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f1cfe87-d2cd-4ceb-997f-2cfad049b9d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 0.088868 Oct 28 13:14:52.714865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1529/2978] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:52 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:14:52.962018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:52.967844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:52.968612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:52.976587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-949f9448-fbfb-4402-b61c-4f3ff26d4b0b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.442359 Oct 28 13:14:52.977539 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1450/2979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:52 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:52.982064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.983261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.987690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.988519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:52.989117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:52.990513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:52.999764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:53.000640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:53.013945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:53.014696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:53.015352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:53.016221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:53.016832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:53.017416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:53.153580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:53.162512 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31f5328d-82c5-4b3c-af7a-fb437471fedf tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 200 len: 1292 microversion: 2.1 time: 0.166620 Oct 28 13:14:53.165051 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1451/2980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:52 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 1292 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:53.467498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:53.482264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:53.482823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:53.489860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:53.490668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:53.491137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:53.491841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:53.492297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:53.492717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:53.494564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c74b193-a6fd-46e1-8f59-0f24bc8aaf0b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1460 microversion: 2.1 time: 0.528224 Oct 28 13:14:53.495689 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1530/2981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:52 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1460 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:53.646441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:53.656417 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2501ccb7-1ee2-4fd4-a1b4-51026930edc6 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 0.178258 Oct 28 13:14:53.657014 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1452/2982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:53 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:53.726373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:53.729174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:53.739086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:53.739616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:53.740056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:53.741354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:53.741997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:53.742737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.004605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:54.005850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:54.019928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.020430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.020870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.021596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.022054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.022593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.248808 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ccc9884d-898c-430d-ae69-07f9f0e851b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 14 microversion: 2.1 time: 0.517851 Oct 28 13:14:54.252474 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1531/2983] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:53 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 14 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:14:54.264362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:54.265074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:54.284966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.285474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.286138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.287158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.288649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.289336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.311691 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf HTTP/1.1 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf'} Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:14:54.315692 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:14:54.320908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:14:54.320908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:14:54.320908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:14:54.320908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:14:54.320908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:14:54.320908 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:14:54.320908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:14:54.322016 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ca24ee78-b98b-4576-8b28-6b815260806d tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 404 len: 111 microversion: 2.1 time: 0.068525 Oct 28 13:14:54.325956 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1532/2984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:54 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:14:54.328498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3ddefdd4-1db3-44ba-b2e8-ce5d72322ab4 req-1bbc7276-6a06-4157-b290-0ad5518a3bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a15c03-700a-4a6f-8ee3-7edae4920b25", "tag": "caf3b258-7c32-47dc-9e6a-0430cbac695f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:54.342298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ddefdd4-1db3-44ba-b2e8-ce5d72322ab4 req-1bbc7276-6a06-4157-b290-0ad5518a3bac service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.343141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ddefdd4-1db3-44ba-b2e8-ce5d72322ab4 req-1bbc7276-6a06-4157-b290-0ad5518a3bac service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.343577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ddefdd4-1db3-44ba-b2e8-ce5d72322ab4 req-1bbc7276-6a06-4157-b290-0ad5518a3bac service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.377894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3ddefdd4-1db3-44ba-b2e8-ce5d72322ab4 req-1bbc7276-6a06-4157-b290-0ad5518a3bac service nova] Creating event network-changed:caf3b258-7c32-47dc-9e6a-0430cbac695f for instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 on n-h1-862876-2 Oct 28 13:14:54.383485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:54.397045 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa6f91e3-0860-4b0f-b276-0de4f0f7de4d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.396364 Oct 28 13:14:54.401002 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3ddefdd4-1db3-44ba-b2e8-ce5d72322ab4 req-1bbc7276-6a06-4157-b290-0ad5518a3bac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077135 Oct 28 13:14:54.401341 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1453/2985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:53 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:54.404285 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1533/2986] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:54.410701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2e3ca641-8ba9-4027-a771-d0797d2937f3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8b29e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:54.518269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:54.519026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:54.535176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.536018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.539309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.540320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.541179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.541784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.755658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:54.782093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=12 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:54.847927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:54.850207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:54.859574 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4d763a08-4740-419f-a4b1-8839f4d8a3de tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1460 microversion: 2.1 time: 0.345591 Oct 28 13:14:54.860548 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1534/2987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:54 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1460 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:54.876290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:54.877274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:54.900932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.900932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.902843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:54.905929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:54.907092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:54.907848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:55.130522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:55.142941 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8d46e17-7b4c-4d61-b48c-4565dc632fec tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 0.280862 Oct 28 13:14:55.156434 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1535/2988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:54 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:55.260784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:55.264636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:55.285824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:55.285824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:55.285824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:55.285824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:55.285824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:55.285824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:55.378643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:55.549726 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-715afce9-aee7-461c-915e-427e3412ff58 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action" status: 200 len: 8205 microversion: 2.1 time: 0.294352 Oct 28 13:14:55.550409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1536/2989] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:55 2022] POST /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea/action => generated 8205 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:14:55.556067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:55.568098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:55.576702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:55.577446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:55.577975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:55.578940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:55.580492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:55.581089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:55.926484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:55.938266 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46e2e9a5-b538-4dfc-bbac-2e9f116d2b0e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.385679 Oct 28 13:14:55.939182 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1537/2990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:55 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:55.945095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:55.945960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:55.954803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:55.955608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:55.956284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:55.957272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:55.958146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:55.958987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:56.342389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:56.366733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e294a589-5be7-4135-86c5-23ba514ba9f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.425646 Oct 28 13:14:56.381001 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1538/2991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:55 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:56.393647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:56.394282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:56.422381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:56.424992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:56.424992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:56.428832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:56.429581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:56.431011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:56.598844 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2e3ca641-8ba9-4027-a771-d0797d2937f3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 204 len: 0 microversion: 2.1 time: 2.194604 Oct 28 13:14:56.599889 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1454/2992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:54 2022] DELETE /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 0 bytes in 2198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:14:56.605481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:56.606673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:56.623954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:56.626539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:56.627216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:56.630037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:56.630728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:56.631358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:56.829383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:56.838915 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d20b13bd-0955-4afb-a7af-afd6904ef5f2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.464863 Oct 28 13:14:56.840235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1539/2993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:56 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:56.845400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:56.846339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:56.876699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:56.878680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:56.879449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:56.881822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:56.888665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:56.889623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.258947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:57.270772 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dfe021ab-4c74-424d-a18b-3da8a7a019ca tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.428017 Oct 28 13:14:57.273940 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1540/2994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:56 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:57.284153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:57.285585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:57.307611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.308291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.311070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.319139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.320214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.320816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.340453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:57.347764 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4a28d02-94f0-45a7-8d7b-832a84cabbdf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 0.746509 Oct 28 13:14:57.354390 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1455/2995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:56 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:57.372192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:57.378848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:57.399144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.411518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.411982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.412732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.413196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.413621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.422535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:14:57.789056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:57.799810 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a10401cc-2e2a-48d8-82c2-ae2bbbf2c5e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.442842 Oct 28 13:14:57.813313 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1456/2996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:57 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:57.826322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:57.827590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:57.837834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.838345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.838815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.840191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.840813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.841259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.857622 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db1b6c5f-1aca-4a07-97f8-4d4cc9961ec2 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 204 len: 0 microversion: 2.1 time: 0.582156 Oct 28 13:14:57.858846 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1541/2997] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:14:57 2022] DELETE /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:14:57.890627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:57.891581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:57.901875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.920421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.921022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:57.927338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:57.928149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:57.928795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:58.112839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:58.121116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-846cf912-cae1-4e3f-8203-7321f1b06866 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.306576 Oct 28 13:14:58.136078 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1457/2998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:57 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:58.145271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1909360979", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "09db6954-888a-48c6-adf5-d40098ae89d9"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:58.245336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] validate_networks() for [('09db6954-888a-48c6-adf5-d40098ae89d9', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:14:58.385064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:58.401669 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7e1250f-138a-43ec-aefd-60b4e4632783 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.524351 Oct 28 13:14:58.402657 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1542/2999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:57 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:58.408565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:58.409187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:58.420290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:58.420777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:58.423713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:58.427036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:58.430200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:58.433094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:58.727986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:14:58.743623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f48bb8bb-aa74-4bb3-91d6-555c2e1ee53a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.338549 Oct 28 13:14:58.751471 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1543/3000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:58 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:14:58.762602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c665b078-029b-4f20-bb17-5a51e6ebbb53 req-5e8838e5-a483-4187-b537-68e3bb6a7c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d702bb-4b4a-4f62-8e5d-07168ac7c638", "name": "network-vif-plugged", "status": "completed", "tag": "5d96658b-89de-4d31-88b1-f6e80da77dab"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:58.792660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:58.802453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c665b078-029b-4f20-bb17-5a51e6ebbb53 req-5e8838e5-a483-4187-b537-68e3bb6a7c10 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:58.802453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c665b078-029b-4f20-bb17-5a51e6ebbb53 req-5e8838e5-a483-4187-b537-68e3bb6a7c10 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:58.802453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c665b078-029b-4f20-bb17-5a51e6ebbb53 req-5e8838e5-a483-4187-b537-68e3bb6a7c10 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:58.839050 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c665b078-029b-4f20-bb17-5a51e6ebbb53 req-5e8838e5-a483-4187-b537-68e3bb6a7c10 service nova] Creating event network-vif-plugged:5d96658b-89de-4d31-88b1-f6e80da77dab for instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 on n-h1-862876-2 Oct 28 13:14:58.856003 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c665b078-029b-4f20-bb17-5a51e6ebbb53 req-5e8838e5-a483-4187-b537-68e3bb6a7c10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101791 Oct 28 13:14:58.857458 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1544/3001] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:14:58.888958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:14:58.900083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:58.926549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:58.930914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:58.933490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:58.935075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:58.936211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:58.939596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:59.162171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:14:59.162656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:14:59.163118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:14:59.163533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:14:59.163946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:14:59.184782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:59.187468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:59.189289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:59.193122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:59.200589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:59.202218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:59.276731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:14:59.309415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Getting quotas for user a43aa3346a70490d9c5e489c8e39d91d and project 07be95c26df34d138ae295e3ac8c7f13. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:14:59.357783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:14:59.361100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:14:59.567660 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-818f1df8-95f2-4709-af72-a3c794460c6b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441085 Oct 28 13:14:59.593383 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1458/3002] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:14:59.598472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:14:59.599081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:14:59.629292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:59.636454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:59.637515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:59.638282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:14:59.638777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:14:59.639230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:14:59.704031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:14:59.955604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Locking {{(pid=127794) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 28 13:15:00.128038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:00.147850 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2138d3d-a08d-4c51-8871-12dba4c60f53 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1317 microversion: 2.1 time: 1.288736 Oct 28 13:15:00.151318 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1545/3003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:14:58 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1317 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:00.165056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:00.165997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:00.190657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:00.194130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:00.194636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:00.195678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:00.196283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:00.196941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:00.274776 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27828b07-d428-4bef-8ac4-5bd1f14b892b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.680070 Oct 28 13:15:00.275381 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1459/3004] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:14:59 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:00.281072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:00.281954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:00.305881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:00.307736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:00.322101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:00.323683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:00.327549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:00.328836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:00.726251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:00.739300 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-43198fb2-500b-4a3d-afbe-403565c23434 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.462401 Oct 28 13:15:00.740386 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1460/3005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:00 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:00.779460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-51058d48-4392-4ff1-8c03-de67ccaa1e8b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:00.786447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-51058d48-4392-4ff1-8c03-de67ccaa1e8b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:00.913371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-51058d48-4392-4ff1-8c03-de67ccaa1e8b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:00.931525 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-51058d48-4392-4ff1-8c03-de67ccaa1e8b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1208 microversion: 2.1 time: 0.189919 Oct 28 13:15:00.942955 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1461/3006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:00 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1208 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:00.942955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:00.942955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:00.956711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:00.957224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:00.957668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:00.958438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:00.963684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:00.965313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:01.279353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:01.302603 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-decd085c-fac0-4504-93b6-aad9f6d17e55 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 1.147787 Oct 28 13:15:01.316838 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1546/3007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:00 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:01.340791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:01.342038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:01.380564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:01.381115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:01.381610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:01.384290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:01.384290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:01.384893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:01.839322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:01.850354 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-19182723-940f-4418-b0d7-b3a4056f39e6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.915711 Oct 28 13:15:01.851444 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1462/3008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:00 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:01.856426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:01.857347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:01.864519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:01.865372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:01.866051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:01.867092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:01.867771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:01.868431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.030550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:02.041635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f242111c-91ae-4e86-9e64-bb4109542811 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 200 len: 1505 microversion: 2.1 time: 0.717336 Oct 28 13:15:02.071637 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1547/3009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:01 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 1505 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:02.086582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a0cb15a1-f51d-4cfd-8a12-fe408416324f req-a1ed78fd-077d-443d-8e2e-c70ac5c211c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82658fb3-b6fd-453b-a042-49d19c006272", "name": "network-vif-plugged", "status": "completed", "tag": "3cd1254a-acf5-4144-9a00-0b364842bd10"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:02.107723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a0cb15a1-f51d-4cfd-8a12-fe408416324f req-a1ed78fd-077d-443d-8e2e-c70ac5c211c2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.110389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a0cb15a1-f51d-4cfd-8a12-fe408416324f req-a1ed78fd-077d-443d-8e2e-c70ac5c211c2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.112146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a0cb15a1-f51d-4cfd-8a12-fe408416324f req-a1ed78fd-077d-443d-8e2e-c70ac5c211c2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.127163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a0cb15a1-f51d-4cfd-8a12-fe408416324f req-a1ed78fd-077d-443d-8e2e-c70ac5c211c2 service nova] Creating event network-vif-plugged:3cd1254a-acf5-4144-9a00-0b364842bd10 for instance 82658fb3-b6fd-453b-a042-49d19c006272 on n-h2-862876-2 Oct 28 13:15:02.133097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a0cb15a1-f51d-4cfd-8a12-fe408416324f req-a1ed78fd-077d-443d-8e2e-c70ac5c211c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058842 Oct 28 13:15:02.135189 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1548/3010] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:02.145501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:02.155652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.157222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.157737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.234655 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] HTTP exception thrown: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 is locked Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Request method failure captured: Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action HTTP/1.1 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 15 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SWT6BgvCZTXsOfv9Vyc6ioCnbTHbmj9JxEA_DdFhqusPsRbKCZrawNmdRxzkK22HS8opsxRx98Xdr1ZZc1ozXkmYWvMKboN94t84b0I0pk83XF1AdoTAzNYMExiAb3E3UnZGiSFcwiBCQm_wKk-bLTIJULP8dF0jtfx7J2TG8yxFE Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_524832a11bb148639788f80ef22b2865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/524832a11bb148639788f80ef22b2865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-115993337 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d70178138d974c20bb9598de42bd3294 Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: {"os-stop": {}} Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 is locked Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4ce0226a-6507-4449-92ec-3050830d72a1', 'body': {'os-stop': {}}} Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 is locked Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 is locked Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 is locked Oct 28 13:15:02.240394 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:02.244750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Returning 409 to user: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 is locked {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:02.244750 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d97d9b6-73aa-472e-a4f5-658a5ca42b6c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 409 len: 107 microversion: 2.1 time: 0.105463 Oct 28 13:15:02.247176 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1549/3011] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:02 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 107 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:02.258372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:02.266704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:02.274405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.274922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.275358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.285336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.285336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.285336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.441818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:02.465177 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b2e7666-36ca-4111-b407-6a274f91d288 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1260 microversion: 2.1 time: 0.206162 Oct 28 13:15:02.465177 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1550/3012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:02 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:02.475378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:02.475902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:02.492936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.493493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.493948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.498165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.498648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.499144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.805360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:02.808424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:02.834064 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17769145-2f4e-4a5a-bc2b-ba31d2a2daa8 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1317 microversion: 2.1 time: 0.368979 Oct 28 13:15:02.834064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1551/3013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:02 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:02.842880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:02.843518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:02.848195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:02.861381 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1cda0d1d-6332-41ae-88e8-3d66a4dd51ba tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 1.007400 Oct 28 13:15:02.863782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1463/3014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:01 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:02.866980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.867547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.868097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.869087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.869613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.870040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.889865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:02.890720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:02.902675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.903216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.903660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:02.904375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:02.904835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:02.905261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.132674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Unlocking {{(pid=127793) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 13:15:03.293436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:03.307964 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-29cd7f41-d8c5-4b75-955b-d9b0f9585422 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.435650 Oct 28 13:15:03.310468 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1464/3015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:02 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:03.327901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c79d5ab7-e7a1-4714-885f-19c20e9475bd req-e122f213-56b5-4977-a3ac-3971b762003d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3069cd51-a7b8-468d-98b4-74fda3e00ab8", "name": "network-vif-deleted", "tag": "d36b485d-13dc-42b8-b88a-f1839e31d629"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:03.367939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c79d5ab7-e7a1-4714-885f-19c20e9475bd req-e122f213-56b5-4977-a3ac-3971b762003d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.369736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c79d5ab7-e7a1-4714-885f-19c20e9475bd req-e122f213-56b5-4977-a3ac-3971b762003d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.377073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c79d5ab7-e7a1-4714-885f-19c20e9475bd req-e122f213-56b5-4977-a3ac-3971b762003d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.403876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c79d5ab7-e7a1-4714-885f-19c20e9475bd req-e122f213-56b5-4977-a3ac-3971b762003d service nova] Creating event network-vif-deleted:d36b485d-13dc-42b8-b88a-f1839e31d629 for instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 on n-h1-862876-2 Oct 28 13:15:03.414487 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c79d5ab7-e7a1-4714-885f-19c20e9475bd req-e122f213-56b5-4977-a3ac-3971b762003d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100664 Oct 28 13:15:03.415692 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1465/3016] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:03.483158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:03.483938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:03.493291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1bec350-8fb8-4eb8-9594-b05014d858d9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.662392 Oct 28 13:15:03.498297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1552/3017] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:02 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:03.505156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46fb858a-0c10-4235-9dec-deacdb777e1a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:03.509091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.512348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.512809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.513540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.514057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.514480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.523131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46fb858a-0c10-4235-9dec-deacdb777e1a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.526100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46fb858a-0c10-4235-9dec-deacdb777e1a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.526806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46fb858a-0c10-4235-9dec-deacdb777e1a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.580671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46fb858a-0c10-4235-9dec-deacdb777e1a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:15:03.752668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:03.786268 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0450dc7e-913a-452d-8ebf-fc8e047530aa tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1260 microversion: 2.1 time: 0.308051 Oct 28 13:15:03.788530 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1466/3018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:03 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1260 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:03.813048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:03.817569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:03.828155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.829040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.829743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.830687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.831376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.832007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.862920 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46fb858a-0c10-4235-9dec-deacdb777e1a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.362987 Oct 28 13:15:03.863933 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1553/3019] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:03 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:03.864806 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] HTTP exception thrown: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Request method failure captured: Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 HTTP/1.1 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UUceccGh0Nz8KUuL47K2ejkb2egKHIXqeJ-yaUai73zN_H05eDA4q0gtJAG7JfIt2CCnJxmOnMyoOD2pdLhg7WuTs4EHbBQgg8MRFU5Z8zxlVqEQTKK9WC5FGuNwQaO_Z3tnkRuTMG4Bo_nJk3RPgVmykaA2KdxBlwLnHhw0m3fz0 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f973a578f68f48978ec53c2e2cfe64d7 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f973a578f68f48978ec53c2e2cfe64d7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f973a578f68f48978ec53c2e2cfe64d7 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachSCSIVolumeTestJSON-279923899-project Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6b89eeb21ebe45d8a33f5faa090b48df Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-279923899-project Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'ddabee5d-0299-4cbc-8229-6d9b7094d711'} Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:03.868137 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:03.875460 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:03.877736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Returning 404 to user: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:03.878953 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49a9c55d-8441-45b9-bf92-49d5f39abf25 tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 404 len: 111 microversion: 2.1 time: 0.072932 Oct 28 13:15:03.879851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:03.880302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1467/3020] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:03 2022] DELETE /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:03.884208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:03.896397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.897052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:03.897322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.897794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.898485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:03.898602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.899014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.899495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.920076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.920956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.921605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:03.922577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:03.923164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:03.923663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.179456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:04.188794 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5cad219e-0ed2-4787-a52f-864ec2aff6bc tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1317 microversion: 2.1 time: 0.322164 Oct 28 13:15:04.193332 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1554/3021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:03 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:04.206847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:04.207823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] [instance: ddabee5d-0299-4cbc-8229-6d9b7094d711] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:04.215170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.217889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.221303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.226978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.226978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.226978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.244017 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] HTTP exception thrown: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Request method failure captured: Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 HTTP/1.1 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9UUceccGh0Nz8KUuL47K2ejkb2egKHIXqeJ-yaUai73zN_H05eDA4q0gtJAG7JfIt2CCnJxmOnMyoOD2pdLhg7WuTs4EHbBQgg8MRFU5Z8zxlVqEQTKK9WC5FGuNwQaO_Z3tnkRuTMG4Bo_nJk3RPgVmykaA2KdxBlwLnHhw0m3fz0 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f973a578f68f48978ec53c2e2cfe64d7 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f973a578f68f48978ec53c2e2cfe64d7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f973a578f68f48978ec53c2e2cfe64d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f973a578f68f48978ec53c2e2cfe64d7 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-279923899 Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachSCSIVolumeTestJSON-279923899-project Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6b89eeb21ebe45d8a33f5faa090b48df Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-279923899-project Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ddabee5d-0299-4cbc-8229-6d9b7094d711'} Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:04.246324 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] Returning 404 to user: Instance ddabee5d-0299-4cbc-8229-6d9b7094d711 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:04.250093 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35103cb0-e373-4c68-8615-80e81796ff6c tempest-AttachSCSIVolumeTestJSON-279923899 tempest-AttachSCSIVolumeTestJSON-279923899-project] 10.222.0.25 "GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711" status: 404 len: 111 microversion: 2.1 time: 0.052936 Oct 28 13:15:04.260531 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1555/3022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:04 2022] GET /compute/v2.1/servers/ddabee5d-0299-4cbc-8229-6d9b7094d711 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:04.277738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:04.279034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:04.293524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:04.298670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.299436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.299921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.300636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.301101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.306054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.311496 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdb2051d-a7a8-464f-949a-84ad9a072f9a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.429833 Oct 28 13:15:04.312102 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1468/3023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:03 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:04.317069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8e2d5fcf-5bae-4c2a-8370-959e2144775e req-50ecfe63-822c-443d-86ee-e52c07f3159c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a15c03-700a-4a6f-8ee3-7edae4920b25", "name": "network-vif-plugged", "status": "completed", "tag": "caf3b258-7c32-47dc-9e6a-0430cbac695f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:04.353647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e2d5fcf-5bae-4c2a-8370-959e2144775e req-50ecfe63-822c-443d-86ee-e52c07f3159c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.354463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e2d5fcf-5bae-4c2a-8370-959e2144775e req-50ecfe63-822c-443d-86ee-e52c07f3159c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.356133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e2d5fcf-5bae-4c2a-8370-959e2144775e req-50ecfe63-822c-443d-86ee-e52c07f3159c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.378589 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8e2d5fcf-5bae-4c2a-8370-959e2144775e req-50ecfe63-822c-443d-86ee-e52c07f3159c service nova] Creating event network-vif-plugged:caf3b258-7c32-47dc-9e6a-0430cbac695f for instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 on n-h1-862876-2 Oct 28 13:15:04.387488 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8e2d5fcf-5bae-4c2a-8370-959e2144775e req-50ecfe63-822c-443d-86ee-e52c07f3159c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073543 Oct 28 13:15:04.388420 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1469/3024] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:04.395203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:04.396358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:04.406036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.406914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.407527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.408470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.409102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.409702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.677140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:04.688385 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c22e174-ce6f-4204-bcd7-75ee0d57dac4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.298480 Oct 28 13:15:04.699259 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1470/3025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:04 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:04.817515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:04.818140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:04.825321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.826236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.827059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.828115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:04.828795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:04.829411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:04.966242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:04.977829 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9cfab370-f3d8-47ad-b4cb-d5031c4a4992 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.713311 Oct 28 13:15:04.981063 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1556/3026] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:04 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:05.076953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:05.097731 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f4d57cf-792a-48dc-8931-b8e619c62e9f tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1260 microversion: 2.1 time: 0.284076 Oct 28 13:15:05.100658 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1471/3027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:04 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:05.216837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:05.217416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:05.224457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:05.225421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:05.226164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:05.227074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:05.237501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:05.242281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:05.338323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:05.339191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:05.351067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:05.359271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:05.360101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:05.361018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:05.361676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:05.362256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:05.524491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:05.546889 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f04275a-ca3f-47d1-9968-ddab42a37e40 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1317 microversion: 2.1 time: 0.326001 Oct 28 13:15:05.559271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1557/3028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:05 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:05.714059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:05.715116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:05.724682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:05.725183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:05.725626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:05.726336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:05.731086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:05.731676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:05.813755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:05.822719 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-64df80a4-750a-452c-a6e3-9d02b73ac437 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.488935 Oct 28 13:15:05.827336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1472/3029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:05 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:06.002166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:06.003124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:06.009744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.010461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.011121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.012027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.012651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.013241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.050314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:06.061515 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0e03f885-f27c-4b79-b927-e30b6aa77ae8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1360 microversion: 2.1 time: 0.351320 Oct 28 13:15:06.063515 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1558/3030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:05 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1360 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:06.127341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:06.128196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:06.139891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.140525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.141025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.141797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.143419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.144626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.219581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:06.235114 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fbbde832-ec84-45a9-94eb-04e1ee495482 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1260 microversion: 2.1 time: 0.111685 Oct 28 13:15:06.235920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1559/3031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:06 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1260 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:06.407114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:06.421880 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5838eaf-89ca-4446-8bc1-802e4855aa78 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.423467 Oct 28 13:15:06.427002 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1473/3032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:05 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:06.573502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:06.574635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:06.590305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.594951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.595904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.596747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.597332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.600454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.852475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:06.853391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:06.869931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.871903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.874257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.877870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:06.878438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:06.880159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:06.948166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:06.969049 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-053caac7-4678-40f3-ad42-b7db83bef6c3 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1317 microversion: 2.1 time: 0.399767 Oct 28 13:15:06.969642 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1560/3033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:06 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:07.093696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:07.094346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:07.101565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.102063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.102502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:07.103269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.103734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.104163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:07.470049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:07.484066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-95bca57c-d4d3-4d63-9143-3143618fcdc8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1544 microversion: 2.1 time: 0.395463 Oct 28 13:15:07.484919 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1561/3034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:07 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1544 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:07.494432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:07.495927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:07.581890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.581890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.581890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:07.581890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.581890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.581890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:07.716108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:07.726255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-332ffcb0-b708-4b79-a34c-64082175eaa3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1268 microversion: 2.1 time: 0.239976 Oct 28 13:15:07.752135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1562/3035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:07 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1268 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:07.757241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:07.762091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:07.779230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.780273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.780754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:07.781495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.781951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.782405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:07.802706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:07.814356 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47a7698c-40d0-404d-baed-a635e9a02ed8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.966745 Oct 28 13:15:07.828717 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1474/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:06 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:07.839820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:07.840618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:07.847270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.848062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.848669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:07.850182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:07.850872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:07.851461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:08.272172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:08.290672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b90f5f3-2759-49f6-9beb-09db8c6afab7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.537243 Oct 28 13:15:08.294334 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1563/3037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:07 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:08.327411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:08.328984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:08.361797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:08.366249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:08.366249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:08.369889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:08.370699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:08.372518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:08.604721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47562071-ec66-411d-833a-a53fbdad48f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.774350 Oct 28 13:15:08.605639 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1475/3038] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:15:07 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-interface => generated 285 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:08.769553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:08.770541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:08.785031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:08.785540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:08.788177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:08.788920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:08.789391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:08.793007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:08.831196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:08.854673 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a867766f-8c74-42d1-810e-5b61a30a8548 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1506 microversion: 2.1 time: 0.548012 Oct 28 13:15:08.855799 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1564/3039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:08 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:08.877906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:08.878519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:08.926390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:08.959256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:08.959256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:08.959256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:08.959256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:08.959256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:08.979564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:09.148452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:09.151012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:09.164224 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1fd8d805-078b-4a15-a49a-36a07e10e50a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1266 microversion: 2.1 time: 0.406107 Oct 28 13:15:09.168720 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1476/3040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:08 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1266 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:09.173908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:09.178136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:09.216718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:09.219683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:09.220322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:09.226401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:09.227025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:09.227609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:09.234638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:09.274003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:15:09.298738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:09.307815 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2045579-9445-4bb0-840c-ea54d1cac20c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.447661 Oct 28 13:15:09.308933 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1565/3041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:08 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:09.318605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:09.322393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:09.338494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:09.341745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:09.343571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:09.344522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:09.345352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:09.345962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:09.696034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:09.704688 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e11bb7e0-0ec3-484e-9b38-bcb99d220b1c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.389788 Oct 28 13:15:09.729681 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1566/3042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:09 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:09.744639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-855968a6-90e7-4794-b49b-0849ba54744e tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 204 len: 0 microversion: 2.1 time: 0.574173 Oct 28 13:15:09.748496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1477/3043] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:09 2022] DELETE /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:15:09.754445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:09.755153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:09.772151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:09.779489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:09.785220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:09.785220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:09.785220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:09.785220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:09.852003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:15:10.195962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7034a7fa-a04e-44d7-858a-3f26a1336762 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/ips" status: 200 len: 151 microversion: 2.1 time: 0.049404 Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1478/3044] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:15:10 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.315865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.316982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.316982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.316982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.316982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.374484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f9c4245c-57d6-423a-872a-875299cb4615 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 204 len: 0 microversion: 2.1 time: 0.624190 Oct 28 13:15:10.377229 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1567/3045] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:09 2022] DELETE /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:15:10.384424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:10.385145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:10.405558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.430010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.435178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.473595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.473595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.473595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.530705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:10.540019 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4bd934e-81cd-4866-a642-8b0b0ade6052 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1266 microversion: 2.1 time: 0.297717 Oct 28 13:15:10.544313 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1479/3046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:10 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:10.564666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:10.566808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:10.578702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.579226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.579736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.580582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:10.581161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:10.581806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:10.919786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:11.118538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:11.130684 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aebc8698-1c95-464a-add9-b86b77b0daee tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.750254 Oct 28 13:15:11.136797 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1568/3047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:10 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:11.141035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:11.141900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:11.151098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:11.152440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:11.153104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:11.154055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:11.155370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:11.156015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:11.350203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:11.382228 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a2d54ae5-dcc3-49a2-8deb-1cada3ab7de9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1512 microversion: 2.1 time: 0.827821 Oct 28 13:15:11.384197 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1480/3048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:10 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1512 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:11.477574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:11.505194 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3f3a888d-a412-45a7-a808-4c4a21cf8bb9 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.371043 Oct 28 13:15:11.512421 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1569/3049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:11 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:11.569059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:11.570588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:11.579586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:11.580735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:11.583223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:11.584479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:11.585751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:11.586418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:12.161705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:12.163636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:12.212833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:12.218659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:12.223762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:12.228242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:12.229039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:12.230757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:12.648389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:12.660644 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97b3b3c1-2b07-4223-8147-7f80dcdd4005 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 1.097347 Oct 28 13:15:12.663603 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1481/3050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:11 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:12.670689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:12.671623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:12.679916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:12.680706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:12.681318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:12.682205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:12.683690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:12.684331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:12.925752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:12.935221 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa1f8a7e-94ec-43ac-a327-13107b45c024 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.779293 Oct 28 13:15:12.940918 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1570/3051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:12 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:12.951292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:12.959850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:12.967153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:12.967925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:12.969338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:12.970238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:12.971135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:12.972548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:13.254657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:13.268072 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3273fcff-861d-48ee-b740-9a3f9dc50304 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1512 microversion: 2.1 time: 0.603153 Oct 28 13:15:13.283814 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1482/3052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:12 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1512 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:13.292317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da28399c-6e96-46e9-9fce-16882a1d130c"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:13.297652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:13.305319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:13.306104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:13.306712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:13.308261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:13.309093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:13.309696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:13.557987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:13.567042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-08aea92b-330c-4fe0-a564-5c405f35ba2b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.624581 Oct 28 13:15:13.593011 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1571/3053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:12 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:13.598540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-bb21d297-f30c-4b39-9696-807a201ed9c1 req-985f2d43-a873-4fd9-abf8-3f1c9ee11216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a15c03-700a-4a6f-8ee3-7edae4920b25", "tag": "caf3b258-7c32-47dc-9e6a-0430cbac695f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:13.633185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bb21d297-f30c-4b39-9696-807a201ed9c1 req-985f2d43-a873-4fd9-abf8-3f1c9ee11216 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:13.634169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bb21d297-f30c-4b39-9696-807a201ed9c1 req-985f2d43-a873-4fd9-abf8-3f1c9ee11216 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:13.634796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bb21d297-f30c-4b39-9696-807a201ed9c1 req-985f2d43-a873-4fd9-abf8-3f1c9ee11216 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:13.648030 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-bb21d297-f30c-4b39-9696-807a201ed9c1 req-985f2d43-a873-4fd9-abf8-3f1c9ee11216 service nova] Creating event network-changed:caf3b258-7c32-47dc-9e6a-0430cbac695f for instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 on n-h1-862876-2 Oct 28 13:15:13.654227 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-bb21d297-f30c-4b39-9696-807a201ed9c1 req-985f2d43-a873-4fd9-abf8-3f1c9ee11216 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059594 Oct 28 13:15:13.655560 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1572/3054] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:13.687628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:13.688828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:13.695803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:13.696873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:13.697790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:13.699520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:13.700253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:13.700838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:14.156257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:14.167097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f1218ab-0888-4b79-9cd4-f5d2281eb43b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 0.485110 Oct 28 13:15:14.168482 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1573/3055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:13 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:14.180415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:14.181237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:14.195493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:14.198119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:14.199082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:14.200069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:14.202608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:14.203255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:14.485567 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdbcf83c-8688-4d6a-81ff-8e63d50c08f9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.199477 Oct 28 13:15:14.486555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1483/3056] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:15:13 2022] POST /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 194 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:14.500580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6728a1e7-283d-439f-b6cf-f28b24b0fff7 req-c787d76c-048c-4c85-adc0-b90bb7ddf1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d702bb-4b4a-4f62-8e5d-07168ac7c638", "name": "network-vif-deleted", "tag": "5d96658b-89de-4d31-88b1-f6e80da77dab"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:14.517105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6728a1e7-283d-439f-b6cf-f28b24b0fff7 req-c787d76c-048c-4c85-adc0-b90bb7ddf1e6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:14.519337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6728a1e7-283d-439f-b6cf-f28b24b0fff7 req-c787d76c-048c-4c85-adc0-b90bb7ddf1e6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:14.521554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6728a1e7-283d-439f-b6cf-f28b24b0fff7 req-c787d76c-048c-4c85-adc0-b90bb7ddf1e6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:14.550483 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6728a1e7-283d-439f-b6cf-f28b24b0fff7 req-c787d76c-048c-4c85-adc0-b90bb7ddf1e6 service nova] Creating event network-vif-deleted:5d96658b-89de-4d31-88b1-f6e80da77dab for instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 on n-h1-862876-2 Oct 28 13:15:14.560357 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6728a1e7-283d-439f-b6cf-f28b24b0fff7 req-c787d76c-048c-4c85-adc0-b90bb7ddf1e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072177 Oct 28 13:15:14.561633 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1484/3057] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:14.567338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:14.568309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:14.576355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:14.577123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:14.577779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:14.578713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:14.579658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:14.580316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:14.720526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:14.730441 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bab03da0-6007-42e7-b4c0-e39aee9e92c9 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1470 microversion: 2.1 time: 0.165576 Oct 28 13:15:14.732890 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1485/3058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:14 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:14.740556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:14.744731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:14.763288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:14.763288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:14.763288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:14.763288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:14.767618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:14.769007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:14.770385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:15.342667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:15.350934 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dbd17d4c-3766-4029-80a5-2cadfd4af351 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.614729 Oct 28 13:15:15.361042 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1486/3059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:14 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:15.374371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:15.381142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:15.392886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:15.393632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:15.396793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:15.397757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:15.398398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:15.399020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:15.600296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:15.610784 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9583015-486d-4c78-a344-5142566c5934 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 1.440332 Oct 28 13:15:15.619905 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1574/3060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:14 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:15.759878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:15.760894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:15.771564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:15.772192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:15.772815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:15.773897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:15.775094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:15.775663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:15.855927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:15.856417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:15.856850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:15.859181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:15.859630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lazy-loading 'fault' on Instance uuid 82658fb3-b6fd-453b-a042-49d19c006272 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:15:15.867000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23a6f2ba-20e7-4a33-a980-f10b040c17e6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 0.502506 Oct 28 13:15:15.867604 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1487/3061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:15 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:15.976447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49876703e4b4b08a78fba7500764f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c5269fb91904a768882033082d150a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:15.986068 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a717cb45-30d2-4771-b46f-d459be2cdee0 tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 200 len: 1307 microversion: 2.1 time: 0.230349 Oct 28 13:15:15.987405 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1575/3062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:15 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:16.008183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d0f4d795-753a-419f-b458-d17bee3adf68 req-92973003-5ea1-4dec-bb29-94728d166b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55c058b-46e6-4edd-82eb-03da4ca8eea1", "tag": "19bd72a4-59ba-4bb7-a662-741608eca004"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:16.019521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0f4d795-753a-419f-b458-d17bee3adf68 req-92973003-5ea1-4dec-bb29-94728d166b7a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:16.020306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0f4d795-753a-419f-b458-d17bee3adf68 req-92973003-5ea1-4dec-bb29-94728d166b7a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:16.021216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0f4d795-753a-419f-b458-d17bee3adf68 req-92973003-5ea1-4dec-bb29-94728d166b7a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:16.037659 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d0f4d795-753a-419f-b458-d17bee3adf68 req-92973003-5ea1-4dec-bb29-94728d166b7a service nova] Creating event network-changed:19bd72a4-59ba-4bb7-a662-741608eca004 for instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 on n-h2-862876-2 Oct 28 13:15:16.048470 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d0f4d795-753a-419f-b458-d17bee3adf68 req-92973003-5ea1-4dec-bb29-94728d166b7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044008 Oct 28 13:15:16.051095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1488/3063] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:16.377998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:16.386633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:16.392616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:16.394003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:16.395281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:16.397932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:16.398561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:16.399197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:16.655156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:16.656355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:16.677685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:16.678191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:16.682598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:16.684082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:16.685335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:16.685785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:16.899167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:16.909675 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7baf43b9-02b9-4588-9624-1668a2b99093 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.535852 Oct 28 13:15:16.931155 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1576/3064] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:16 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:16.936616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b7a689d0-a2ea-42d0-870b-c26d8bfd9198 req-b6c9e4d6-5216-44bc-8f5b-31ee29f485e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82658fb3-b6fd-453b-a042-49d19c006272", "name": "network-vif-deleted", "tag": "3cd1254a-acf5-4144-9a00-0b364842bd10"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:16.965632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b7a689d0-a2ea-42d0-870b-c26d8bfd9198 req-b6c9e4d6-5216-44bc-8f5b-31ee29f485e1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:16.966479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b7a689d0-a2ea-42d0-870b-c26d8bfd9198 req-b6c9e4d6-5216-44bc-8f5b-31ee29f485e1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:16.967123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b7a689d0-a2ea-42d0-870b-c26d8bfd9198 req-b6c9e4d6-5216-44bc-8f5b-31ee29f485e1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:16.999594 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b7a689d0-a2ea-42d0-870b-c26d8bfd9198 req-b6c9e4d6-5216-44bc-8f5b-31ee29f485e1 service nova] Creating event network-vif-deleted:3cd1254a-acf5-4144-9a00-0b364842bd10 for instance 82658fb3-b6fd-453b-a042-49d19c006272 on n-h2-862876-2 Oct 28 13:15:17.005717 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b7a689d0-a2ea-42d0-870b-c26d8bfd9198 req-b6c9e4d6-5216-44bc-8f5b-31ee29f485e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072752 Oct 28 13:15:17.019908 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1577/3065] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:17.025559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:17.027529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:17.043376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.044162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.044776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:17.045668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.046301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.046923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:17.280570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:17.298440 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a2209c74-a089-4267-897e-3e20db369fd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.654936 Oct 28 13:15:17.299061 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1489/3066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:16 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:17.304037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:17.304652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: 82658fb3-b6fd-453b-a042-49d19c006272] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:17.319645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.320152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.320587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:17.321583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.322217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.322846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:17.338300 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] HTTP exception thrown: Instance 82658fb3-b6fd-453b-a042-49d19c006272 could not be found. Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Request method failure captured: Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 HTTP/1.1 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9WNNF9ZcAByf7mBmVSGki7XFPxO5kGPeaR7HJLlJxdlutdPWc-LIGX-DsGWt46JVKLQcPWebPZRg88VzmeMR5aRkH7u0cAMrgD7nTjTvC1bHB9BVv1HI9l2i-yGh1loKk_uG9rw7_Xu4rh3xJAjqTacJVAB1x2GW1bPGA7Aq_x9FYo Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 4c5269fb91904a768882033082d150a8 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-MultipleCreateTestJSON-1922807944 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c5269fb91904a768882033082d150a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c5269fb91904a768882033082d150a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c5269fb91904a768882033082d150a8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c5269fb91904a768882033082d150a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-MultipleCreateTestJSON-1922807944 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 4c5269fb91904a768882033082d150a8 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1922807944 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-MultipleCreateTestJSON-1922807944-project Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e49876703e4b4b08a78fba7500764f16 Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-MultipleCreateTestJSON-1922807944-project Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 82658fb3-b6fd-453b-a042-49d19c006272 could not be found. Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '82658fb3-b6fd-453b-a042-49d19c006272'} Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82658fb3-b6fd-453b-a042-49d19c006272 could not be found. Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82658fb3-b6fd-453b-a042-49d19c006272 could not be found. Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:17.340844 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.345786 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:17.345786 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:17.345786 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:17.345786 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:17.345786 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:17.345786 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82658fb3-b6fd-453b-a042-49d19c006272 could not be found. Oct 28 13:15:17.345786 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.347392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Returning 404 to user: Instance 82658fb3-b6fd-453b-a042-49d19c006272 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:17.348424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87c796f1-fa8d-46ac-b79b-ac7f6428e5cf tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272" status: 404 len: 111 microversion: 2.1 time: 0.048246 Oct 28 13:15:17.349489 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1490/3067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:17 2022] GET /compute/v2.1/servers/82658fb3-b6fd-453b-a042-49d19c006272 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:17.357615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:17.358499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] [instance: e9d702bb-4b4a-4f62-8e5d-07168ac7c638] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:17.365349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.366068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.366666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:17.367819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.368488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.369102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:17.386544 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] HTTP exception thrown: Instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 could not be found. Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Request method failure captured: Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 HTTP/1.1 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9WNNF9ZcAByf7mBmVSGki7XFPxO5kGPeaR7HJLlJxdlutdPWc-LIGX-DsGWt46JVKLQcPWebPZRg88VzmeMR5aRkH7u0cAMrgD7nTjTvC1bHB9BVv1HI9l2i-yGh1loKk_uG9rw7_Xu4rh3xJAjqTacJVAB1x2GW1bPGA7Aq_x9FYo Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 4c5269fb91904a768882033082d150a8 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-MultipleCreateTestJSON-1922807944 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c5269fb91904a768882033082d150a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4c5269fb91904a768882033082d150a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4c5269fb91904a768882033082d150a8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4c5269fb91904a768882033082d150a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-MultipleCreateTestJSON-1922807944 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 4c5269fb91904a768882033082d150a8 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1922807944 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-MultipleCreateTestJSON-1922807944-project Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e49876703e4b4b08a78fba7500764f16 Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-MultipleCreateTestJSON-1922807944-project Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 could not be found. Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'e9d702bb-4b4a-4f62-8e5d-07168ac7c638'} Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 could not be found. Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 could not be found. Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:17.389317 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.394042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:17.394042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:17.394042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:17.394042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:17.394042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:17.394042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 could not be found. Oct 28 13:15:17.394042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:17.396174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] Returning 404 to user: Instance e9d702bb-4b4a-4f62-8e5d-07168ac7c638 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:17.397388 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-227a8066-9195-4f3e-b6e8-d70edf1b34ce tempest-MultipleCreateTestJSON-1922807944 tempest-MultipleCreateTestJSON-1922807944-project] 10.222.0.25 "GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638" status: 404 len: 111 microversion: 2.1 time: 0.043934 Oct 28 13:15:17.398276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1491/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:17 2022] GET /compute/v2.1/servers/e9d702bb-4b4a-4f62-8e5d-07168ac7c638 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:15:17.563349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:17.582938 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0190d3d-3113-4703-9ffe-36c9426427a6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 0.561045 Oct 28 13:15:17.585952 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1578/3069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:17 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:17.939813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:17.940442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:17.972580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.976483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.981846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:17.981846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:17.981846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:17.981846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:18.331213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:18.331213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:18.342316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:18.343243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:18.343601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:18.344318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:18.344768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:18.345192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:18.882093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:18.895056 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f682266e-d6c1-4676-903d-f045db9b37cf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.959258 Oct 28 13:15:18.908726 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1492/3070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:17 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:18.926210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:18.928103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:18.941630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:18.942397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:18.944337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:18.945281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:18.947674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:18.948277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:19.001390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:19.116260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:19.125605 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf6953b2-149e-4b6c-b902-72d674355a30 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.800343 Oct 28 13:15:19.126519 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1579/3071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:18 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:19.141727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-efc1e7bf-f296-483d-8ad8-9693dacce4a0 req-d8bd5541-85f6-4b83-b8a3-64c39a8bd590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045277a0-63fb-4041-b9b5-b0f275e6f17d", "name": "network-vif-plugged", "status": "completed", "tag": "e05c1d1a-5545-436c-a9b0-a4a597fea3cc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:19.162463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efc1e7bf-f296-483d-8ad8-9693dacce4a0 req-d8bd5541-85f6-4b83-b8a3-64c39a8bd590 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:19.163320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efc1e7bf-f296-483d-8ad8-9693dacce4a0 req-d8bd5541-85f6-4b83-b8a3-64c39a8bd590 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:19.164004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-efc1e7bf-f296-483d-8ad8-9693dacce4a0 req-d8bd5541-85f6-4b83-b8a3-64c39a8bd590 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:19.188974 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-efc1e7bf-f296-483d-8ad8-9693dacce4a0 req-d8bd5541-85f6-4b83-b8a3-64c39a8bd590 service nova] Creating event network-vif-plugged:e05c1d1a-5545-436c-a9b0-a4a597fea3cc for instance 045277a0-63fb-4041-b9b5-b0f275e6f17d on n-h2-862876-2 Oct 28 13:15:19.212156 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-efc1e7bf-f296-483d-8ad8-9693dacce4a0 req-d8bd5541-85f6-4b83-b8a3-64c39a8bd590 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084101 Oct 28 13:15:19.228367 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1580/3072] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:19.935439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:19.937406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:19.951579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:19.952337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:19.962338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:19.967450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:19.969929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:19.971103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:20.163508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:20.172157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-757a651f-15ed-48d2-99e4-962cacc0f238 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 1.256614 Oct 28 13:15:20.186026 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1493/3073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:18 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:20.192141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:20.192486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:20.212611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:20.213108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:20.213541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:20.214465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:20.214947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:20.215374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:20.768141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:20.782092 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e181d635-7a1f-4ea7-b08a-b6052c7348a5 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.859678 Oct 28 13:15:20.794771 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1581/3074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:19 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:20.826869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:20.834816 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27488244-f372-431d-89cb-1b3ab823044f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.656279 Oct 28 13:15:20.837550 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1494/3075] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:20 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:21.201671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:21.202275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:21.213121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:21.216717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:21.217153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:21.218946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:21.219421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:21.220907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:21.233858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:21.734646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:21.744924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9db051a3-103a-4adc-9768-45816e473a36 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 0.546471 Oct 28 13:15:21.761250 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1582/3076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:21 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:21.810302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:21.811540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:21.826286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:21.827121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:21.827733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:21.828612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:21.829223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:21.833377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:21.860496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:21.861433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:21.876587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:21.877675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:21.878076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:21.902905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:21.903560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:21.905551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:22.324139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:22.335829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0281c849-cee9-4938-b921-1f2a8e2bb38c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.530075 Oct 28 13:15:22.341931 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1495/3077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:21 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:22.453364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:22.469832 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c4e06674-9b26-493b-abb5-d116e95b34c9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.605993 Oct 28 13:15:22.473496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1583/3078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:21 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:22.769180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:22.770145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:22.781940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:22.784643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:22.788548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:22.790084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:22.791331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:22.792895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:23.284670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:23.293681 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3409a861-b2cf-46ad-a0be-544d06d38769 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 0.528645 Oct 28 13:15:23.294268 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1496/3079] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:22 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:23.361981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:23.362699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:23.375495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:23.377276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:23.377873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:23.378738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:23.379696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:23.380638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:23.498505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:23.501312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:23.506102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:23.507440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:23.507920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:23.508639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:23.509826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:23.511654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:23.675136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:23.695650 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5ca65fa-6b98-4807-b235-562699299dbf tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1518 microversion: 2.1 time: 0.338877 Oct 28 13:15:23.696530 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1584/3080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:23 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1518 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:23.837450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:23.846446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-39c1a9f1-2feb-4b95-b919-d10155b07550 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.354950 Oct 28 13:15:23.858920 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1497/3081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:23 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:24.322511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:24.323278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:24.333413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.337641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.338690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.340236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.341661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.343141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.557288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:24.566891 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73d669db-4b2b-45ba-ac03-e0da2005b78b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 0.248971 Oct 28 13:15:24.582023 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1585/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:24 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:24.711198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-43fb1548-bf86-402f-bfe5-42a628e40406 req-4be6f108-dc88-41b4-b27d-12cf0a33e5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55c058b-46e6-4edd-82eb-03da4ca8eea1", "name": "network-vif-plugged", "status": "completed", "tag": "19bd72a4-59ba-4bb7-a662-741608eca004"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:24.721607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:24.722418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:24.730700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.731510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.732032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.732939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.733594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.734118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.736313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43fb1548-bf86-402f-bfe5-42a628e40406 req-4be6f108-dc88-41b4-b27d-12cf0a33e5d3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.736817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43fb1548-bf86-402f-bfe5-42a628e40406 req-4be6f108-dc88-41b4-b27d-12cf0a33e5d3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.741285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43fb1548-bf86-402f-bfe5-42a628e40406 req-4be6f108-dc88-41b4-b27d-12cf0a33e5d3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.761711 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-43fb1548-bf86-402f-bfe5-42a628e40406 req-4be6f108-dc88-41b4-b27d-12cf0a33e5d3 service nova] Creating event network-vif-plugged:19bd72a4-59ba-4bb7-a662-741608eca004 for instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 on n-h2-862876-2 Oct 28 13:15:24.766821 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-43fb1548-bf86-402f-bfe5-42a628e40406 req-4be6f108-dc88-41b4-b27d-12cf0a33e5d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062858 Oct 28 13:15:24.770056 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1498/3083] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:24.874799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:24.874799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:24.885391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.887427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.888042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.894312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.894312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.894312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.930328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:24.938446 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50d87b66-5534-445f-98e1-06d8eeea7940 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.221526 Oct 28 13:15:24.939262 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1586/3084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:24 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:24.964699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:24.965317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:24.972535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.973035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.973466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:24.974167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:24.974615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:24.975085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.256202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:25.273004 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e1d10cb-f741-41af-90cd-81522307bf34 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.314653 Oct 28 13:15:25.274196 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1587/3085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:24 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:25.307532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:25.308423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:25.315417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.322207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.322207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.322207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.322207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.322207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.395820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:25.411234 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-238bf355-8b9d-4c11-a72d-1310613c89ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.543060 Oct 28 13:15:25.420909 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1499/3086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:24 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:25.497698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:25.506340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5821a7b0-01ba-446d-94ee-30e2c800bc67 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.202677 Oct 28 13:15:25.507271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1588/3087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:25 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:25.530734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-510ec863-16ff-4131-844a-f0d27a45e0dd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:25.537178 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-510ec863-16ff-4131-844a-f0d27a45e0dd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 38e0065c-35b6-4c7a-9c06-9008699e0129 has no mapping to a cell. Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-510ec863-16ff-4131-844a-f0d27a45e0dd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/38e0065c-35b6-4c7a-9c06-9008699e0129/action HTTP/1.1 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 15 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: {"os-stop": {}} Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 38e0065c-35b6-4c7a-9c06-9008699e0129 has no mapping to a cell. Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '38e0065c-35b6-4c7a-9c06-9008699e0129', 'body': {'os-stop': {}}} Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 38e0065c-35b6-4c7a-9c06-9008699e0129 has no mapping to a cell. Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:25.554861 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e0065c-35b6-4c7a-9c06-9008699e0129 has no mapping to a cell. Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e0065c-35b6-4c7a-9c06-9008699e0129 has no mapping to a cell. Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-510ec863-16ff-4131-844a-f0d27a45e0dd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 38e0065c-35b6-4c7a-9c06-9008699e0129 has no mapping to a cell. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-510ec863-16ff-4131-844a-f0d27a45e0dd tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/38e0065c-35b6-4c7a-9c06-9008699e0129/action" status: 404 len: 117 microversion: 2.1 time: 0.026332 Oct 28 13:15:25.560374 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1500/3088] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:25 2022] POST /compute/v2.1/servers/38e0065c-35b6-4c7a-9c06-9008699e0129/action => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:25.570510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:25.571335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:25.580938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.581357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.581966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.585101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.586363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.587343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.592164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:25.595126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:25.613592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.614293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.614941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.615855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.616985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.617583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.800718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:25.823835 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-166a2c1f-d172-4489-80a3-be5e2673c7c4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.260245 Oct 28 13:15:25.849074 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1589/3089] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:25 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:25.857341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:25.863998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:25.865539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:25.868536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.869596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.870194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.871970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:25.872637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:25.873188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:25.959048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:25.970342 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f99d52da-6fe3-48e2-9135-5f192e1b7148 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1308 microversion: 2.1 time: 0.382617 Oct 28 13:15:25.976513 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1501/3090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:25 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:26.045508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:26.053284 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3f45b35f-8d2b-4a94-816c-8f88234f61f7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.202914 Oct 28 13:15:26.053879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1590/3091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:25 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:26.075605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be9ced22-41c9-48c8-8f25-3c966916328c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:26.076481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be9ced22-41c9-48c8-8f25-3c966916328c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 7ebcc6e7-b506-40a7-82d9-18a763cc6b66] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:26.082140 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-be9ced22-41c9-48c8-8f25-3c966916328c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 7ebcc6e7-b506-40a7-82d9-18a763cc6b66 could not be found. Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be9ced22-41c9-48c8-8f25-3c966916328c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/7ebcc6e7-b506-40a7-82d9-18a763cc6b66/action HTTP/1.1 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 15 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: {"suspend": {}} Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7ebcc6e7-b506-40a7-82d9-18a763cc6b66 could not be found. Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7ebcc6e7-b506-40a7-82d9-18a763cc6b66', 'body': {'suspend': {}}} Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebcc6e7-b506-40a7-82d9-18a763cc6b66 could not be found. Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebcc6e7-b506-40a7-82d9-18a763cc6b66 could not be found. Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:26.084202 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:26.088747 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:26.088747 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:26.088747 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebcc6e7-b506-40a7-82d9-18a763cc6b66 could not be found. Oct 28 13:15:26.088747 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:26.088747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be9ced22-41c9-48c8-8f25-3c966916328c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 7ebcc6e7-b506-40a7-82d9-18a763cc6b66 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:26.088747 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be9ced22-41c9-48c8-8f25-3c966916328c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/7ebcc6e7-b506-40a7-82d9-18a763cc6b66/action" status: 404 len: 111 microversion: 2.1 time: 0.014225 Oct 28 13:15:26.088747 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1502/3092] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:26 2022] POST /compute/v2.1/servers/7ebcc6e7-b506-40a7-82d9-18a763cc6b66/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:26.095760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:26.096418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:26.103305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.103798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.104470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.105660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.106115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.106703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.369828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:26.380070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4507005f-4450-4bf3-ad58-692c537efba7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.288273 Oct 28 13:15:26.390118 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1591/3093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:26 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:26.407612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:26.408647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:26.419903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.420393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.423533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.424344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.424823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.425264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.438873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:26.439624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:26.454159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.454159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.454159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.454159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.454159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.454159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.623767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:26.631564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-256ddf57-40fb-43d2-90fd-5565dceee15b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.197504 Oct 28 13:15:26.632150 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1592/3094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:26 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:26.646671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:26.655876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a3fb5152-147c-46df-858c-a06d4ca908d7 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.252226 Oct 28 13:15:26.656630 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1503/3095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:26 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:26.681805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:26.683696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:26.690567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.691127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.691559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.692250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:26.692873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:26.693300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:26.718444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lazy-loading 'flavor' on Instance uuid 045277a0-63fb-4041-b9b5-b0f275e6f17d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:15:26.996603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:26.997332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:27.004815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.005457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.006202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.007386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.007797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.008431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.043916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea9a2599-0336-4dc7-9d12-3e3036de9d7c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 202 len: 0 microversion: 2.1 time: 0.362586 Oct 28 13:15:27.054402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1593/3096] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:26 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:27.065146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:27.065414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:27.075447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.076261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.076888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.077782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.078397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.079027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.182381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:27.190966 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42cfdbe6-897d-4ccb-a2c0-0f8f0a67557b tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1486 microversion: 2.1 time: 0.199804 Oct 28 13:15:27.191672 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1504/3097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:26 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1486 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:27.219597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-319392287"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:27.220654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:27.222297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:27.228253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.228405 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ace99ca5-d435-46df-bf17-cfd76317d01f tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1513 microversion: 2.1 time: 0.171692 Oct 28 13:15:27.228740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.229166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.229328 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1594/3098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:27 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:27.230702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.231184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.231607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.657041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:27.657656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:27.664423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.664910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.665346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.666035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.666495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.667667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.780617 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fea0af73-87c7-471c-8f39-2c66bec3f797 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "POST /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1/action" status: 202 len: 0 microversion: 2.1 time: 0.564792 Oct 28 13:15:27.787420 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1505/3099] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:27 2022] POST /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 28 13:15:27.794606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c3cab2d-c604-4fa4-9e2b-dd3663862380 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8a3f310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:27.863034 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c3cab2d-c604-4fa4-9e2b-dd3663862380 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889" status: 200 len: 1411 microversion: 2.1 time: 0.074013 Oct 28 13:15:27.870732 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1506/3100] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:15:27 2022] GET /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:27.879146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14f90409-dee7-4a6d-b9ec-fe8475f6b160 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8a59c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:27.882329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:27.896550 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9715887b-72e2-427d-b1e8-ff23f4dd6260 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1654 microversion: 2.1 time: 0.243378 Oct 28 13:15:27.907871 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1595/3101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:27 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1654 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:27.922827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c81d314-10cb-4ad5-a878-36ca426d22d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:27.932579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81d314-10cb-4ad5-a878-36ca426d22d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:27.933935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81d314-10cb-4ad5-a878-36ca426d22d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:27.934650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81d314-10cb-4ad5-a878-36ca426d22d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:27.954259 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14f90409-dee7-4a6d-b9ec-fe8475f6b160 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889" status: 200 len: 1411 microversion: 2.1 time: 0.079240 Oct 28 13:15:27.965294 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1507/3102] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:15:27 2022] GET /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:27.965419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1c81d314-10cb-4ad5-a878-36ca426d22d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Going to try to start instance {{(pid=127793) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 13:15:27.990428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:27.991124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-264b4891-2c66-4707-ad01-bbbd7f895e8a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8a3f700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:28.199294 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c81d314-10cb-4ad5-a878-36ca426d22d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.279981 Oct 28 13:15:28.201912 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1596/3103] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:27 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:15:28.220226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:28.220920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:28.234856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.235769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.237202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.238089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.238706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.239301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.407411 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-264b4891-2c66-4707-ad01-bbbd7f895e8a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889" status: 204 len: 0 microversion: 2.1 time: 0.428694 Oct 28 13:15:28.408403 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1508/3104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:27 2022] DELETE /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:15:28.419195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:28.419812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:28.420801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:28.427491 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3fd317b-1447-4754-8564-f32125edca9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1663 microversion: 2.1 time: 0.211283 Oct 28 13:15:28.428924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.430153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.430861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.434508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.435695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.437030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.443797 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1597/3105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:28 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1663 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:28.451831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b089025-314b-4e63-9751-530845485d29 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b8587040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:28.487225 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1b089025-314b-4e63-9751-530845485d29 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Image not found. Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b089025-314b-4e63-9751-530845485d29 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889 HTTP/1.1 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '582e269d-8734-446f-9248-3ff8e798f889'} Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 582e269d-8734-446f-9248-3ff8e798f889 Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:15:28.489925 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 582e269d-8734-446f-9248-3ff8e798f889 could not be found. Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b089025-314b-4e63-9751-530845485d29 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b089025-314b-4e63-9751-530845485d29 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889" status: 404 len: 62 microversion: 2.1 time: 0.046379 Oct 28 13:15:28.498671 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1598/3106] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:15:28 2022] GET /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:28.518169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:28.518169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:28.531413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.537199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.537199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.537199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.537199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.537199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.726717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:28.747162 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e4539dc6-987f-46fc-8676-601770700527 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1498 microversion: 2.1 time: 0.243987 Oct 28 13:15:28.750696 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1599/3107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:28 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:28.890013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:28.903494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-79d55aa8-bfc2-4af0-b4bd-8189ef27d160 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1496 microversion: 2.1 time: 0.493820 Oct 28 13:15:28.904433 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1509/3108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:28 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1496 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:28.931623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:28.932158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:28.939262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.940140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.940759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.941863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:28.942549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:28.943302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:28.973651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lazy-loading 'flavor' on Instance uuid 045277a0-63fb-4041-b9b5-b0f275e6f17d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:15:28.992013 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Cannot 'suspend' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state suspended Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action HTTP/1.1 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 15 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: {"suspend": {}} Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: exception: Cannot 'suspend' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state suspended Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'suspend': {}}} Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d in vm_state suspended. Cannot suspend while the instance is in this state. Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 28 13:15:28.995500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state suspended Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state suspended Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 409 to user: Cannot 'suspend' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state suspended {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5c5cba2-3d78-4fc3-9ea3-01cfa311198b tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 409 len: 148 microversion: 2.1 time: 0.069954 Oct 28 13:15:29.004109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1600/3109] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:28 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 148 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:29.013157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:29.014012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:29.024786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.024786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.024786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.025524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.026143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.027609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.257235 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-922acc4e-30b3-4a56-bbee-e44f888f0ec4 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 202 len: 0 microversion: 2.1 time: 0.248599 Oct 28 13:15:29.261932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1510/3110] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:29 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:29.268884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:29.273220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:29.284439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.285306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.285971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.286995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.287695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.288354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.421128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-22df3a26-242f-4b83-a9df-cae378f1e3b3 tempest-ListImagesTestJSON-443929723 tempest-ListImagesTestJSON-443929723-project] Calling method '.version_select at 0x7f27b86a0430>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:29.480480 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-22df3a26-242f-4b83-a9df-cae378f1e3b3 tempest-ListImagesTestJSON-443929723 tempest-ListImagesTestJSON-443929723-project] 10.222.0.25 "GET /compute/v2.1/images/65e1a51d-1f44-4651-86a6-90233a26cd48" status: 200 len: 784 microversion: 2.1 time: 0.402931 Oct 28 13:15:29.482444 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1601/3111] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:15:29 2022] GET /compute/v2.1/images/65e1a51d-1f44-4651-86a6-90233a26cd48 => generated 784 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:15:29.489825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:29.492236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:29.502721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.503460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.504049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.504908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.505516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.506116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.565989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:29.579512 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60ce1283-8520-4319-b87a-f2686cffd508 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1502 microversion: 2.1 time: 0.315763 Oct 28 13:15:29.598072 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1511/3112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:29 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1502 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:29.603637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7e69496-5816-4bf9-b0ae-728ccda3df69 tempest-ListImagesTestJSON-443929723 tempest-ListImagesTestJSON-443929723-project] Calling method '.version_select at 0x7f27b966ad30>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:29.660666 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7e69496-5816-4bf9-b0ae-728ccda3df69 tempest-ListImagesTestJSON-443929723 tempest-ListImagesTestJSON-443929723-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.061292 Oct 28 13:15:29.661242 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1512/3113] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Oct 28 13:15:29 2022] GET /compute/v2.1/images => generated 445 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:29.674991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37ffd263-38d0-46fc-a7e5-ca8ed7ee77b9 tempest-ListImagesTestJSON-443929723 tempest-ListImagesTestJSON-443929723-project] Calling method '.version_select at 0x7f27b954eb80>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:29.744903 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37ffd263-38d0-46fc-a7e5-ca8ed7ee77b9 tempest-ListImagesTestJSON-443929723 tempest-ListImagesTestJSON-443929723-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.073916 Oct 28 13:15:29.746054 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1513/3114] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:15:29 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:29.778146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:29.780851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:29.792983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.796081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.796531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.797267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:29.797737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:29.798173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:29.952729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:29.962668 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e1514667-dc51-4787-a467-a77917649ba7 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1504 microversion: 2.1 time: 0.189055 Oct 28 13:15:29.963722 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1514/3115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:29 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:30.024848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:30.035811 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dbd22be8-5fe5-47c5-88b7-fe878f1dabf4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1663 microversion: 2.1 time: 0.552224 Oct 28 13:15:30.041662 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1602/3116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:29 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1663 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:30.311077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da28399c-6e96-46e9-9fce-16882a1d130c"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:30.313626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:30.330611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:30.331202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:30.331649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:30.332393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:30.332853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:30.336432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:30.369189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:30.555150 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Invalid volume: volume da28399c-6e96-46e9-9fce-16882a1d130c is already attached to instances: 2947206d-44a2-41bb-af6a-75fed884b370 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments HTTP/1.1 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 74 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: {"volumeAttachment": {"volumeId": "da28399c-6e96-46e9-9fce-16882a1d130c"}} Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid volume: volume da28399c-6e96-46e9-9fce-16882a1d130c is already attached to instances: 2947206d-44a2-41bb-af6a-75fed884b370 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '2947206d-44a2-41bb-af6a-75fed884b370', 'body': {'volumeAttachment': {'volumeId': 'da28399c-6e96-46e9-9fce-16882a1d130c'}}} Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume da28399c-6e96-46e9-9fce-16882a1d130c is already attached to instances: 2947206d-44a2-41bb-af6a-75fed884b370 Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:30.556895 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume da28399c-6e96-46e9-9fce-16882a1d130c is already attached to instances: 2947206d-44a2-41bb-af6a-75fed884b370 Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume da28399c-6e96-46e9-9fce-16882a1d130c is already attached to instances: 2947206d-44a2-41bb-af6a-75fed884b370 Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 400 to user: Invalid volume: volume da28399c-6e96-46e9-9fce-16882a1d130c is already attached to instances: 2947206d-44a2-41bb-af6a-75fed884b370 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:30.562228 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4d92ff30-381b-4e67-b54d-0def226e5d27 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.255890 Oct 28 13:15:30.564326 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1515/3117] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:15:30 2022] POST /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 174 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:15:30.605670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:30.606436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:30.625932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:30.626618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:30.628638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:30.631219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:30.634588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:30.640632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:30.734796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:30.735347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:30.746857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:30.747579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:30.748171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:30.749049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:30.750667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:30.756974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:30.890698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lazy-loading 'services' on Instance uuid 2947206d-44a2-41bb-af6a-75fed884b370 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:15:31.158544 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9059a39-1569-4979-ad15-0a84db422b42 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments/da28399c-6e96-46e9-9fce-16882a1d130c" status: 202 len: 0 microversion: 2.1 time: 0.431638 Oct 28 13:15:31.159796 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1516/3118] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:15:30 2022] DELETE /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments/da28399c-6e96-46e9-9fce-16882a1d130c => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:31.169069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:31.170039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:31.184189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.184189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.184189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:31.184958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.185629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.186441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:31.278508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:31.300381 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6583cb2-827b-457c-af8b-76497c1d7439 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1502 microversion: 2.1 time: 0.699542 Oct 28 13:15:31.302164 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1603/3119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:30 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1502 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:31.311482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:31.313769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:31.331037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.331780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.334885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:31.336607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.357248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.358194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:31.411395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:31.420300 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0102d176-e74d-47d3-8b87-b626355e2d9c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1499 microversion: 2.1 time: 0.258861 Oct 28 13:15:31.420882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1517/3120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:31 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1499 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:31.435258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:31.440855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:31.450443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.450896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.452750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:31.452750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.452750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.453214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:31.487685 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26e749f2-e600-4206-8c6f-6511f0ef02aa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065753 Oct 28 13:15:31.488701 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1518/3121] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:15:31 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:31.825277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:31.842303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1f3dffb-ff97-4cab-b976-b3db954f6a29 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.537809 Oct 28 13:15:31.859842 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1604/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:31 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:31.867800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:31.869739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:31.879951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.880934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.886207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:31.886207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:31.886207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:31.886207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.089838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:32.097608 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e1936f76-831a-4f86-867d-f80db8e14c48 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.234106 Oct 28 13:15:32.098181 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1519/3123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:31 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:32.121916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:32.122578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:32.130001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.131031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.132265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.133379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.134261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.135530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.330045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:32.332682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Unlocking {{(pid=127793) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 13:15:32.340093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:32.358846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.359474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.360010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.360852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.361604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.362162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.633557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:32.645582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6742f10e-76e1-4e87-b548-638059797b2c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1502 microversion: 2.1 time: 0.323815 Oct 28 13:15:32.657784 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1520/3124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:32 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:32.659654 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3697d354-39b0-4aaa-a834-c1843827ddf7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.542484 Oct 28 13:15:32.660906 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1605/3125] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:32 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:15:32.667884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:32.671042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:32.705473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:32.707405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:32.717316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.717814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.718256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.719015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.726130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.729671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.730446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.733374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.734306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.734972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.737909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.738681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.861788 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f279cb5-114c-4047-89ce-c5b4758c53a6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199523 Oct 28 13:15:32.862428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1606/3126] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:15:32 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:32.881851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:32.883368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:32.906469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.907051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.907784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:32.908528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:32.908995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:32.913134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.030884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:33.039143 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a497f76-0701-4ca6-ad2e-22efd0daa535 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1486 microversion: 2.1 time: 0.373397 Oct 28 13:15:33.040535 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1521/3127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:32 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1486 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:33.049932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e2eceb90-fa1b-49e4-87ea-1b8bd0ebd591 req-181900ab-f24d-4ba7-aa37-d46190a388c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55c058b-46e6-4edd-82eb-03da4ca8eea1", "name": "network-vif-plugged", "status": "completed", "tag": "19bd72a4-59ba-4bb7-a662-741608eca004"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:33.073637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2eceb90-fa1b-49e4-87ea-1b8bd0ebd591 req-181900ab-f24d-4ba7-aa37-d46190a388c7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.074990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2eceb90-fa1b-49e4-87ea-1b8bd0ebd591 req-181900ab-f24d-4ba7-aa37-d46190a388c7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.075598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2eceb90-fa1b-49e4-87ea-1b8bd0ebd591 req-181900ab-f24d-4ba7-aa37-d46190a388c7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.102645 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e2eceb90-fa1b-49e4-87ea-1b8bd0ebd591 req-181900ab-f24d-4ba7-aa37-d46190a388c7 service nova] Creating event network-vif-plugged:19bd72a4-59ba-4bb7-a662-741608eca004 for instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 on n-h2-862876-2 Oct 28 13:15:33.113462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e2eceb90-fa1b-49e4-87ea-1b8bd0ebd591 req-181900ab-f24d-4ba7-aa37-d46190a388c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071288 Oct 28 13:15:33.132253 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1522/3128] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:33.243260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:33.250171 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-95692f15-9371-47fe-b5ff-5f15b74ed272 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.381854 Oct 28 13:15:33.250885 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1607/3129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:32 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:33.267573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:33.268695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:33.276742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.277602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.278394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.279319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.279930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.280509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.314525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:15:33.334762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-032444ca-d5ba-4c18-b32a-9cbf613fed7c tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b8baf430>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0G41/pxiQgLlLeMd5ZyOpllKl30cHJnVE41es4KhAhy2Gr31oW+39IvM4aCkrjXP3uhJzb1uKNNdnuL+xexd0PS9Q7CfNIaIPeC+9nZ2LOdQAnSAvVUHJQ7BT98vPbcA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-032444ca-d5ba-4c18-b32a-9cbf613fed7c tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 257 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0G41/pxiQgLlLeMd5ZyOpllKl30cHJnVE41es4KhAhy2Gr31oW+39IvM4aCkrjXP3uhJzb1uKNNdnuL+xexd0PS9Q7CfNIaIPeC+9nZ2LOdQAnSAvVUHJQ7BT98vPbcA=="}} Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0G41/pxiQgLlLeMd5ZyOpllKl30cHJnVE41es4KhAhy2Gr31oW+39IvM4aCkrjXP3uhJzb1uKNNdnuL+xexd0PS9Q7CfNIaIPeC+9nZ2LOdQAnSAvVUHJQ7BT98vPbcA=='}}} Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 28 13:15:33.340098 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 13:15:33.345047 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.348320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-032444ca-d5ba-4c18-b32a-9cbf613fed7c tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:33.349192 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-032444ca-d5ba-4c18-b32a-9cbf613fed7c tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.228187 Oct 28 13:15:33.349780 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1523/3130] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:15:33 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:15:33.361745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:33.364468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:33.376501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.376996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.377437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.378401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.378893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.379339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.636771 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2074fdfe-1412-4dda-a97e-e9bfe7942f6a tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 204 len: 0 microversion: 2.1 time: 0.383496 Oct 28 13:15:33.637526 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1608/3131] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:33 2022] DELETE /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:15:33.649651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04bf0dc0-8b63-4b54-8744-87a18bbc7fe2 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b85445e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-169027375", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:33.668993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-04bf0dc0-8b63-4b54-8744-87a18bbc7fe2 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:15:33.675431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-04bf0dc0-8b63-4b54-8744-87a18bbc7fe2 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for user 5d7e026532924c89888c785f1d1e3a48 and project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:15:33.717891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:33.727640 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-53aeb8e4-526f-43bf-a597-0020648a15f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.376524 Oct 28 13:15:33.739130 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1524/3132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:33 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:33.743940 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-04bf0dc0-8b63-4b54-8744-87a18bbc7fe2 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:33.744689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8680aecd-6834-4df1-a7ff-7577d132f057 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b954e280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04bf0dc0-8b63-4b54-8744-87a18bbc7fe2 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 2166 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-169027375", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:15:33.779208 n-d-862876-2 devstack@n-api.service[127793]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-169027375', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:33.790058 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04bf0dc0-8b63-4b54-8744-87a18bbc7fe2 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-04bf0dc0-8b63-4b54-8744-87a18bbc7fe2 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.140478 Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1609/3133] 10.222.0.25 () {60 vars in 1160 bytes} [Fri Oct 28 13:15:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:33.792613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:33.797399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.797897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.798335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.799078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.800067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.801566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.817835 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8680aecd-6834-4df1-a7ff-7577d132f057 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Image not found. Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8680aecd-6834-4df1-a7ff-7577d132f057 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889 HTTP/1.1 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: exception: Image not found. Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '582e269d-8734-446f-9248-3ff8e798f889'} Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 582e269d-8734-446f-9248-3ff8e798f889 to delete Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 582e269d-8734-446f-9248-3ff8e798f889 could not be found. Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.819674 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8680aecd-6834-4df1-a7ff-7577d132f057 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Image not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8680aecd-6834-4df1-a7ff-7577d132f057 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889" status: 404 len: 62 microversion: 2.1 time: 0.080718 Oct 28 13:15:33.824790 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1525/3134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:33 2022] DELETE /compute/v2.1/images/582e269d-8734-446f-9248-3ff8e798f889 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:33.829425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:33.830042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:33.845391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.847337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.848147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:33.849171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:33.849862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:33.850502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.101423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:34.112344 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d69d96cc-6e39-492d-803a-33d8202b0610 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.289364 Oct 28 13:15:34.113221 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1526/3135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:33 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:34.137381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8493b651-ebb1-4d30-928f-11b8bf4a77fe tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b8a8ef70>, body: {"keypair": {"name": "tempest-keypair-285121737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDZcHB3hKKXgx2safWXOSa0VAmSnnZkUlV6lnsC1PVtBWMpWxNds81n+WhFQh2Ids1QvlTpj9aTp4rqmPr6eJNXoMQQVAWXjJ1f637nzUjOsjEWJbRa++pyjE4arZfxfQ=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:34.144595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:34.153280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb886f70-a21f-42f3-9dc3-63be9d4660e1 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.370322 Oct 28 13:15:34.153860 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1610/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:33 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:34.174333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:34.174903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:34.188380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.188899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.191077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.191417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-8493b651-ebb1-4d30-928f-11b8bf4a77fe tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:15:34.193453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.194389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.196951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.203730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-8493b651-ebb1-4d30-928f-11b8bf4a77fe tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for user 5d7e026532924c89888c785f1d1e3a48 and project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:15:34.227541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:15:34.231890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=90,nova_cell1:INSERT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:34.285197 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8493b651-ebb1-4d30-928f-11b8bf4a77fe tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156081 Oct 28 13:15:34.296735 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1527/3137] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:15:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:34.303060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:34.306076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:34.313909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.314612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.315257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.316219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.317236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.317911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.364828 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.api [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Instance is already in deleting state, ignoring this request Oct 28 13:15:34.365840 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a1f3a09-fb2c-4c15-9490-b8105dc020e3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 204 len: 0 microversion: 2.1 time: 0.207631 Oct 28 13:15:34.371968 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1611/3138] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:34 2022] DELETE /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:15:34.379809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:34.380381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:34.391833 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a067801c-7434-4325-b5bc-23147fbe6c26 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093694 Oct 28 13:15:34.395565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.396240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.396689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.397391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.398126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1528/3139] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:15:34 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:34.402723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.403212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.414517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:34.415676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:34.423669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.424921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.426271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.427417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.428181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.428792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.697285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:34.706045 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f945e56-85f9-41ad-bd30-46cae8602dff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.304879 Oct 28 13:15:34.706912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1529/3140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:34 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:34.712199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154fcab1-70a6-4aba-b590-dd1979d058a4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b954eca0>, body: {"keypair": {"name": "tempest-keypair-285121737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZUUn4EBGWJ1kpaYAPVC1ovQosQw9YYvOdfR3GYdXFQrrAGUYWnb8UvhlkPrYBfQbw5bKnLAePhf4qNJLQMnemZ56lO+J4RHZ7OU/cZOLsfK57KoaRJXzHEmw7pApIqXw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:34.734386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-154fcab1-70a6-4aba-b590-dd1979d058a4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:15:34.741380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-154fcab1-70a6-4aba-b590-dd1979d058a4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for user 5d7e026532924c89888c785f1d1e3a48 and project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:15:34.759624 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aecd6214-e9ce-4fcf-9378-db65883d8067 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.385935 Oct 28 13:15:34.761038 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1612/3141] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:34 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:34.768258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:34.768956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:34.775395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.775876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.776871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.777560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.778007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.778420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.831928 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-154fcab1-70a6-4aba-b590-dd1979d058a4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] HTTP exception thrown: Key pair 'tempest-keypair-285121737' already exists. Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154fcab1-70a6-4aba-b590-dd1979d058a4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 272 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: {"keypair": {"name": "tempest-keypair-285121737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZUUn4EBGWJ1kpaYAPVC1ovQosQw9YYvOdfR3GYdXFQrrAGUYWnb8UvhlkPrYBfQbw5bKnLAePhf4qNJLQMnemZ56lO+J4RHZ7OU/cZOLsfK57KoaRJXzHEmw7pApIqXw=="}} Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: exception: Key pair 'tempest-keypair-285121737' already exists. Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-285121737', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZUUn4EBGWJ1kpaYAPVC1ovQosQw9YYvOdfR3GYdXFQrrAGUYWnb8UvhlkPrYBfQbw5bKnLAePhf4qNJLQMnemZ56lO+J4RHZ7OU/cZOLsfK57KoaRJXzHEmw7pApIqXw=='}}} Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result.read() Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5d7e026532924c89888c785f1d1e3a48-tempest-keypair-285121737' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 13:15:34.906590 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result.read() Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 13:15:34.912208 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5d7e026532924c89888c785f1d1e3a48-tempest-keypair-285121737' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 13, 15, 34, 770924), 'updated_at': None, 'name': 'tempest-keypair-285121737', 'user_id': '5d7e026532924c89888c785f1d1e3a48', 'fingerprint': '82:cc:35:0b:b3:55:fd:be:8d:64:46:e8:77:bb:55:08', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZUUn4EBGWJ1kpaYAPVC1ovQosQw9YYvOdfR3GYdXFQrrAGUYWnb8UvhlkPrYBfQbw5bKnLAePhf4qNJLQMnemZ56lO+J4RHZ7OU/cZOLsfK57KoaRJXzHEmw7pApIqXw==', 'type': 'ssh'}] Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi keypair.create() Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._create() Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-285121737' already exists. Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 28 13:15:34.916692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-285121737' already exists. Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-285121737' already exists. Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154fcab1-70a6-4aba-b590-dd1979d058a4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 409 to user: Key pair 'tempest-keypair-285121737' already exists. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-154fcab1-70a6-4aba-b590-dd1979d058a4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.200405 Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1530/3142] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:15:34 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6f18794-d983-4f6f-b8c1-f1254b9e4105 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:34.920804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6f18794-d983-4f6f-b8c1-f1254b9e4105 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: a899ac15-66e2-425f-bd48-45646ab6f600] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:34.928367 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d6f18794-d983-4f6f-b8c1-f1254b9e4105 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance a899ac15-66e2-425f-bd48-45646ab6f600 could not be found. Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6f18794-d983-4f6f-b8c1-f1254b9e4105 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/a899ac15-66e2-425f-bd48-45646ab6f600/action HTTP/1.1 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 15 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: {"unpause": {}} Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance a899ac15-66e2-425f-bd48-45646ab6f600 could not be found. Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a899ac15-66e2-425f-bd48-45646ab6f600', 'body': {'unpause': {}}} Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a899ac15-66e2-425f-bd48-45646ab6f600 could not be found. Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a899ac15-66e2-425f-bd48-45646ab6f600 could not be found. Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:34.933342 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:34.939497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:34.939497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:34.939497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a899ac15-66e2-425f-bd48-45646ab6f600 could not be found. Oct 28 13:15:34.939497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:34.939497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6f18794-d983-4f6f-b8c1-f1254b9e4105 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance a899ac15-66e2-425f-bd48-45646ab6f600 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:34.939497 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6f18794-d983-4f6f-b8c1-f1254b9e4105 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/a899ac15-66e2-425f-bd48-45646ab6f600/action" status: 404 len: 111 microversion: 2.1 time: 0.026784 Oct 28 13:15:34.939497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1531/3143] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:34 2022] POST /compute/v2.1/servers/a899ac15-66e2-425f-bd48-45646ab6f600/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:34.950400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:34.959258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:34.973127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.973948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.975487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:34.976640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:34.978075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:34.978707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:35.008620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:35.020483 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5994bd10-a0e6-440a-9ff6-e3344e23dd99 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1492 microversion: 2.1 time: 0.257681 Oct 28 13:15:35.021963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1613/3144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:34 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1492 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:35.034549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-775b24b0-ac40-445c-ba45-ce8f2d74c4ae tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Calling method '.version_select at 0x7f27b85c25e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:35.134576 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-775b24b0-ac40-445c-ba45-ce8f2d74c4ae tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-285121737" status: 202 len: 0 microversion: 2.1 time: 0.108329 Oct 28 13:15:35.137202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1614/3145] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:15:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-285121737 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:35.150060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:35.152322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:35.163042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:35.175557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:35.178419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:35.179476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:35.182106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:35.184957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:35.272565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:35.282964 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5e491ea-69e8-43a7-b5b3-d47a471e88fa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1672 microversion: 2.1 time: 0.344032 Oct 28 13:15:35.283552 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1532/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:34 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1672 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:35.290211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ac2ce1b9-3c4a-48bf-8117-a4679cf64695 req-0e98135f-fe4c-4643-8a7a-3716136ef9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55c058b-46e6-4edd-82eb-03da4ca8eea1", "name": "network-vif-unplugged", "status": "completed", "tag": "19bd72a4-59ba-4bb7-a662-741608eca004"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:35.301950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:35.323452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ac2ce1b9-3c4a-48bf-8117-a4679cf64695 req-0e98135f-fe4c-4643-8a7a-3716136ef9c4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:35.324013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ac2ce1b9-3c4a-48bf-8117-a4679cf64695 req-0e98135f-fe4c-4643-8a7a-3716136ef9c4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:35.325015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ac2ce1b9-3c4a-48bf-8117-a4679cf64695 req-0e98135f-fe4c-4643-8a7a-3716136ef9c4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:35.353270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ac2ce1b9-3c4a-48bf-8117-a4679cf64695 req-0e98135f-fe4c-4643-8a7a-3716136ef9c4 service nova] Creating event network-vif-unplugged:19bd72a4-59ba-4bb7-a662-741608eca004 for instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 on n-h2-862876-2 Oct 28 13:15:35.365322 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ac2ce1b9-3c4a-48bf-8117-a4679cf64695 req-0e98135f-fe4c-4643-8a7a-3716136ef9c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080515 Oct 28 13:15:35.370973 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1533/3147] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:35.383274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a931a558-8606-40e7-9fb5-521dbc3ab8e9 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b9428670>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBDuFJJjsA7bdxxCnuYFd6wTnwMS3VJuyjXz3PHuTziyqA//TEFQnDqPR8bRs0nMiKpl3SuXYvCV127H1SQgB+jIku+/JmtDTHYHnPn5DzsCuHolVoRGken9Xt8aJQzKA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a931a558-8606-40e7-9fb5-521dbc3ab8e9 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 247 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBDuFJJjsA7bdxxCnuYFd6wTnwMS3VJuyjXz3PHuTziyqA//TEFQnDqPR8bRs0nMiKpl3SuXYvCV127H1SQgB+jIku+/JmtDTHYHnPn5DzsCuHolVoRGken9Xt8aJQzKA=="}} Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBDuFJJjsA7bdxxCnuYFd6wTnwMS3VJuyjXz3PHuTziyqA//TEFQnDqPR8bRs0nMiKpl3SuXYvCV127H1SQgB+jIku+/JmtDTHYHnPn5DzsCuHolVoRGken9Xt8aJQzKA=='}}} Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '' Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:15:35.387690 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a931a558-8606-40e7-9fb5-521dbc3ab8e9 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a931a558-8606-40e7-9fb5-521dbc3ab8e9 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016923 Oct 28 13:15:35.395778 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1534/3148] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:15:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:15:35.404414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-40a8f920-a56c-4fb3-bfa3-79226eee98f4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b8ad8ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1501407593", "public_key": " "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:35.430210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-40a8f920-a56c-4fb3-bfa3-79226eee98f4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:15:35.439208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-40a8f920-a56c-4fb3-bfa3-79226eee98f4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for user 5d7e026532924c89888c785f1d1e3a48 and project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:15:35.458511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-40a8f920-a56c-4fb3-bfa3-79226eee98f4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-40a8f920-a56c-4fb3-bfa3-79226eee98f4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 95 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1501407593", "public_key": " "}} Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1501407593', 'public_key': ' '}}} Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.461672 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.466591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.469438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-40a8f920-a56c-4fb3-bfa3-79226eee98f4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:35.470469 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-40a8f920-a56c-4fb3-bfa3-79226eee98f4 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.070989 Oct 28 13:15:35.471859 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1535/3149] 10.222.0.25 () {60 vars in 1158 bytes} [Fri Oct 28 13:15:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:15:35.478614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:35.488556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:35.491319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:35.492256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:35.492840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:35.493722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:35.494329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:35.496332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:35.537605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-825f2a5b-32af-47a1-b192-4da712fbd8eb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064260 Oct 28 13:15:35.543863 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1536/3150] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:15:35 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:35.566204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9b162526-82d4-402c-a57a-81ca7060f552 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b8aa3d30>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzLu63m/UG/KXYSdPN1jyY5JI7stCVVyjRjR6VE+hCq6iKNjf06uMcpG74IuUy07o23f6pQGQq+bjUETh9Mgyko/CB5M+sD71s1Jch/TZz1W2hFMHXWw33wqnTMtycKsw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9b162526-82d4-402c-a57a-81ca7060f552 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 507 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzLu63m/UG/KXYSdPN1jyY5JI7stCVVyjRjR6VE+hCq6iKNjf06uMcpG74IuUy07o23f6pQGQq+bjUETh9Mgyko/CB5M+sD71s1Jch/TZz1W2hFMHXWw33wqnTMtycKsw=="}} Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzLu63m/UG/KXYSdPN1jyY5JI7stCVVyjRjR6VE+hCq6iKNjf06uMcpG74IuUy07o23f6pQGQq+bjUETh9Mgyko/CB5M+sD71s1Jch/TZz1W2hFMHXWw33wqnTMtycKsw=='}}} Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 13:15:35.571726 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9b162526-82d4-402c-a57a-81ca7060f552 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9b162526-82d4-402c-a57a-81ca7060f552 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.028447 Oct 28 13:15:35.582847 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1537/3151] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:15:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:15:35.592295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00d8a420-90bc-495b-89d8-7cc196011459 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Action: 'create', calling method: .version_select at 0x7f27b8a3ff70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-425225920", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:35.612723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-00d8a420-90bc-495b-89d8-7cc196011459 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:15:35.620818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-00d8a420-90bc-495b-89d8-7cc196011459 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Getting quotas for user 5d7e026532924c89888c785f1d1e3a48 and project 0d9d53e66cf5422f9e0d7feaa4880438. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:15:35.644272 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-00d8a420-90bc-495b-89d8-7cc196011459 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00d8a420-90bc-495b-89d8-7cc196011459 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 117 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-425225920", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-425225920', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 13:15:35.647607 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 13:15:35.653644 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.656110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00d8a420-90bc-495b-89d8-7cc196011459 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:35.657114 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00d8a420-90bc-495b-89d8-7cc196011459 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.069457 Oct 28 13:15:35.657810 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1538/3152] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:15:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:15:35.669277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbfc1ecc-bcc2-4944-a220-167cf62b4927 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Calling method '.version_select at 0x7f27b8a3fee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:35.683205 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-cbfc1ecc-bcc2-4944-a220-167cf62b4927 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2063471342 not found for user 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbfc1ecc-bcc2-4944-a220-167cf62b4927 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Request method failure captured: Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2063471342 HTTP/1.1 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9X0FpL3iT3gKfdorE1RVjfbhr37AL1yCgycmk4V4Aiz0vBRyBEc8nSnX_Ve8GsPs6J4FKT97XCTvl3NbEuvD7mpSwQEK48d7Lf-3oM7KkfKw7QutbinPxX-OiyzhSDlGJxOuRzqNMTA3Lu_w2ELhQaIcAqTVt52Iil5WPMFX95BAoQ Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d9d53e66cf5422f9e0d7feaa4880438", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d9d53e66cf5422f9e0d7feaa4880438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0d9d53e66cf5422f9e0d7feaa4880438 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1142894222 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1142894222-project Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: exception: Keypair tempest-keypair-non-existent-2063471342 not found for user 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'tempest-keypair-non-existent-2063471342'} Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2063471342 not found for user 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.686583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2063471342 not found for user 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2063471342 not found for user 5d7e026532924c89888c785f1d1e3a48 Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbfc1ecc-bcc2-4944-a220-167cf62b4927 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2063471342 not found for user 5d7e026532924c89888c785f1d1e3a48 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:35.692716 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cbfc1ecc-bcc2-4944-a220-167cf62b4927 tempest-KeyPairsNegativeTestJSON-1142894222 tempest-KeyPairsNegativeTestJSON-1142894222-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2063471342" status: 404 len: 145 microversion: 2.1 time: 0.025041 Oct 28 13:15:35.695210 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1539/3153] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 13:15:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2063471342 => generated 145 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:15:36.015247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:36.024541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d758bd4-b193-4cd1-863b-18f89ae7b322 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.882656 Oct 28 13:15:36.025778 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1615/3154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:35 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:36.052074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:36.053892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:36.054296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:36.055353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:36.062032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.062821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.066945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.066945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.066945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.066945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.075251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.075914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.079861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.080763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.081348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.081890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.408145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:36.417958 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fbd056bb-5873-40c7-8efc-da0b512dd4c3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1492 microversion: 2.1 time: 0.373067 Oct 28 13:15:36.419193 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1540/3155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:36 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1492 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:36.428676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:36.428676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:36.439528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.442390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.444724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.447628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.448886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.449675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.503753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:36.519388 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ebb11e11-0c96-4ef7-8956-d8e281191868 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.471116 Oct 28 13:15:36.520327 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1616/3156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:36 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:36.543069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:36.543807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:36.551425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.552726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.553332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.554191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.554832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.555443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.583159 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Cannot 'unpause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action HTTP/1.1 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 15 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: {"unpause": {}} Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: exception: Cannot 'unpause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'unpause': {}}} Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d in vm_state active. Cannot unpause while the instance is in this state. Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:36.585067 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:36.589837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:36.589837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:36.589837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:36.589837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:36.589837 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:36.591198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 409 to user: Cannot 'unpause' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:36.592231 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b64b932-e185-45a6-add1-4aa2f5b39349 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 409 len: 145 microversion: 2.1 time: 0.053734 Oct 28 13:15:36.597069 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1617/3157] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:36 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:15:36.602522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:36.605084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:36.611506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.612232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.612911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.613768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.614379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.615041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.655512 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-865de474-e99b-46a8-b563-2f50ef19beb8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057016 Oct 28 13:15:36.657794 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1618/3158] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:15:36 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:36.670720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:36.671692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:36.689878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.693868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.693868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:36.693868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:36.693868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:36.693868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.000786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:37.013282 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-460e5072-07fc-42bd-8fd8-89bd57873dd4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1652 microversion: 2.1 time: 0.592597 Oct 28 13:15:37.016095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1541/3159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:36 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1652 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:37.042491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:37.043101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:37.056423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.057102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.062487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.063672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.064443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.065146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.134883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:37.332472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:37.344312 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aef55988-d06b-4c3c-9935-4314c4def788 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.685231 Oct 28 13:15:37.349008 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1619/3160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:36 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:37.382381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:37.383401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:37.403229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.405593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.406253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.408035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.409040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.412408 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8466face-9527-4a46-8918-687d10841690 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.374922 Oct 28 13:15:37.417559 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1542/3161] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:37 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:37.417683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.425872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:37.428633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:37.461431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.463519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.464756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.468871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.468871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.469233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.906207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:37.917242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84c1b7e6-4a7f-429a-a73f-9a2033eff334 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.540229 Oct 28 13:15:37.917834 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1620/3162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:37 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:37.933953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:37.939607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:37.952054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.952782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.953651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.955180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:37.957170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:37.962457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:37.973784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:37.983668 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5d47c1f3-27be-4c49-8191-34dacb29df7c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1659 microversion: 2.1 time: 0.562697 Oct 28 13:15:38.001542 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1543/3163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:37 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1659 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:38.011847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:38.015599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:38.026864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.027803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.028491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.029565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.030262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.031097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.080439 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-699a2d1a-50d7-4ecd-8f51-9a357a0b22e7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076916 Oct 28 13:15:38.082254 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1544/3164] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:15:38 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:38.087956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-dd84372d-d43a-414b-b26a-1cbecd914dbc req-4d58398b-ade3-44b0-8081-cb02c78475bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55c058b-46e6-4edd-82eb-03da4ca8eea1", "name": "network-vif-deleted", "tag": "19bd72a4-59ba-4bb7-a662-741608eca004"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:38.100277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dd84372d-d43a-414b-b26a-1cbecd914dbc req-4d58398b-ade3-44b0-8081-cb02c78475bb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.100584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dd84372d-d43a-414b-b26a-1cbecd914dbc req-4d58398b-ade3-44b0-8081-cb02c78475bb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.104221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dd84372d-d43a-414b-b26a-1cbecd914dbc req-4d58398b-ade3-44b0-8081-cb02c78475bb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.124264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-dd84372d-d43a-414b-b26a-1cbecd914dbc req-4d58398b-ade3-44b0-8081-cb02c78475bb service nova] Creating event network-vif-deleted:19bd72a4-59ba-4bb7-a662-741608eca004 for instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 on n-h2-862876-2 Oct 28 13:15:38.134901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-dd84372d-d43a-414b-b26a-1cbecd914dbc req-4d58398b-ade3-44b0-8081-cb02c78475bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050735 Oct 28 13:15:38.137358 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1545/3165] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:38.143259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1db09ae1-5545-444b-9ac8-591685543839 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:38.143936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1db09ae1-5545-444b-9ac8-591685543839 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b2a5e07b-4645-4de8-84b5-b3b78baba400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:38.149817 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-1db09ae1-5545-444b-9ac8-591685543839 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance b2a5e07b-4645-4de8-84b5-b3b78baba400 could not be found. Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1db09ae1-5545-444b-9ac8-591685543839 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/b2a5e07b-4645-4de8-84b5-b3b78baba400/action HTTP/1.1 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 18 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: {"unshelve": null} Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b2a5e07b-4645-4de8-84b5-b3b78baba400 could not be found. Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b2a5e07b-4645-4de8-84b5-b3b78baba400', 'body': {'unshelve': None}} Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a5e07b-4645-4de8-84b5-b3b78baba400 could not be found. Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a5e07b-4645-4de8-84b5-b3b78baba400 could not be found. Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.151824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a5e07b-4645-4de8-84b5-b3b78baba400 could not be found. Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1db09ae1-5545-444b-9ac8-591685543839 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance b2a5e07b-4645-4de8-84b5-b3b78baba400 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:38.155992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1db09ae1-5545-444b-9ac8-591685543839 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/b2a5e07b-4645-4de8-84b5-b3b78baba400/action" status: 404 len: 111 microversion: 2.1 time: 0.014650 Oct 28 13:15:38.157577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1546/3166] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:38 2022] POST /compute/v2.1/servers/b2a5e07b-4645-4de8-84b5-b3b78baba400/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:38.162263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:38.162932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:38.170929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.171421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.180359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.180359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.180359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.180359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.231294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43aa3346a70490d9c5e489c8e39d91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07be95c26df34d138ae295e3ac8c7f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:38.246088 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dd5fc6e9-7b0b-43b4-80e9-f32bb5f8a973 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 200 len: 1450 microversion: 2.1 time: 0.327190 Oct 28 13:15:38.247913 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1621/3167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:37 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 1450 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:38.504240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:38.515557 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06a215dd-bb09-4a14-ad7e-c510a5632b1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.356816 Oct 28 13:15:38.516665 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1547/3168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:38 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:38.545541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:38.546364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:38.553800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.554528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.555149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.557120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.557120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.557120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.785433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:38.797727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10f3d9d3-f057-4420-91d4-5485bce8003d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.256351 Oct 28 13:15:38.811759 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1622/3169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:38 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:38.824908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:38.825630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:38.851182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.852319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.855489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.856339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.856920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.857359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.894925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Cannot 'unshelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action HTTP/1.1 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 18 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: {"unshelve": null} Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'unshelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'unshelve': None}} Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d in vm_state active. Cannot unshelve while the instance is in this state. Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:15:38.902253 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 409 to user: Cannot 'unshelve' instance 045277a0-63fb-4041-b9b5-b0f275e6f17d while it is in vm_state active {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f7e9797-59be-4a31-9e6b-16d782e8525c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action" status: 409 len: 146 microversion: 2.1 time: 0.086262 Oct 28 13:15:38.906877 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1548/3170] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:15:38 2022] POST /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d/action => generated 146 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:38.915736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:38.916367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:38.924525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.925231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.926093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:38.926365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:38.928176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:38.928631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.014481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:39.015430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:39.023540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.024396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.025189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.026128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.026780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.027552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.324669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:39.333731 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7aac72d5-8f3d-4cff-964d-2ffda7f1c01c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.324224 Oct 28 13:15:39.339242 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1549/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:39 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:39.350961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:39.358663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:39.381238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.381996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.382604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.383539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.384426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.387277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.451802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:39.466849 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c7a7717-9cc9-41f8-94b3-510fa7c4b7c0 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.557497 Oct 28 13:15:39.471014 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1623/3172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:38 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:39.477305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8e306ee-bb68-4429-b5c2-b965675044ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.138523 Oct 28 13:15:39.478529 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1550/3173] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:15:39 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:15:39.495500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:39.496158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: e55c058b-46e6-4edd-82eb-03da4ca8eea1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:39.505445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:39.505445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:39.522103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.525248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.525745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.526214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.526484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.526950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.527400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.528029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.529299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.531502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.534114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.538890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.603261 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 could not be found. Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 HTTP/1.1 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 could not be found. Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'e55c058b-46e6-4edd-82eb-03da4ca8eea1'} Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 could not be found. Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 could not be found. Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:39.606161 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:39.610272 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:39.610272 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:39.610272 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:39.610272 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:39.610272 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 could not be found. Oct 28 13:15:39.610272 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:39.616942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance e55c058b-46e6-4edd-82eb-03da4ca8eea1 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:39.625367 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2840a898-546b-4b28-9083-8e499ff780d1 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1" status: 404 len: 111 microversion: 2.1 time: 0.152372 Oct 28 13:15:39.628939 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1624/3174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:39 2022] GET /compute/v2.1/servers/e55c058b-46e6-4edd-82eb-03da4ca8eea1 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:39.642065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:39.646032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:39.669615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.670223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.670891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.671778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:39.672637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:39.673126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:39.991187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:39.999994 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b75d525c-8789-46d1-b0a9-3d09f042ea17 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.369852 Oct 28 13:15:40.000580 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1625/3175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:39 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:40.010866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.024021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:40.037593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.038807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.039763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.040853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.041520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.042709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.064250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:40.067245 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf HTTP/1.1 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf'} Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:40.069882 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.073812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.076573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:40.077762 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23bb7f39-c8e6-446d-b484-4b176ef15458 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 404 len: 111 microversion: 2.1 time: 0.071113 Oct 28 13:15:40.081284 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1626/3176] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:40 2022] DELETE /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:40.084262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.084776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:40.088312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b0fa5c0-d666-47da-85c6-6ca06096f72e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.608037 Oct 28 13:15:40.091997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.092493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.092931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.093692 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1551/3177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:39 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:40.107578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.108437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.108751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.111304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c48627f-e0de-4e6d-ac56-039ce1879b2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1400473385_updated"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:40.121750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c48627f-e0de-4e6d-ac56-039ce1879b2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: adc4c5af-b9b1-4193-91eb-874c85c6a185] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:40.131312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2c48627f-e0de-4e6d-ac56-039ce1879b2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance adc4c5af-b9b1-4193-91eb-874c85c6a185 could not be found. Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c48627f-e0de-4e6d-ac56-039ce1879b2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/servers/adc4c5af-b9b1-4193-91eb-874c85c6a185 HTTP/1.1 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 81 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1400473385_updated"}} Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance adc4c5af-b9b1-4193-91eb-874c85c6a185 could not be found. Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'adc4c5af-b9b1-4193-91eb-874c85c6a185', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1400473385_updated'}}} Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc4c5af-b9b1-4193-91eb-874c85c6a185 could not be found. Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 13:15:40.135650 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc4c5af-b9b1-4193-91eb-874c85c6a185 could not be found. Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc4c5af-b9b1-4193-91eb-874c85c6a185 could not be found. Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c48627f-e0de-4e6d-ac56-039ce1879b2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance adc4c5af-b9b1-4193-91eb-874c85c6a185 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:40.143392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c48627f-e0de-4e6d-ac56-039ce1879b2d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "PUT /compute/v2.1/servers/adc4c5af-b9b1-4193-91eb-874c85c6a185" status: 404 len: 111 microversion: 2.1 time: 0.044659 Oct 28 13:15:40.146924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:15:40.147103 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1552/3178] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:15:40 2022] PUT /compute/v2.1/servers/adc4c5af-b9b1-4193-91eb-874c85c6a185 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:40.154280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.154940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:40.176041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.176361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.182525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.185194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.185800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.186993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.187906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:40.233539 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf HTTP/1.1 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf'} Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.235205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance 7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:40.240392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4de339f-9632-40a6-ac85-5686fea10cc5 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf" status: 404 len: 111 microversion: 2.1 time: 0.091004 Oct 28 13:15:40.242885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1553/3179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:40 2022] GET /compute/v2.1/servers/7d36b76d-afbb-4fc9-b77e-a0fa3edac4bf => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:40.247450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.248319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:40.254688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.255211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.257397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.257397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.257397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.257947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.472649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:40.482927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-527cca2d-e8ad-42d9-a387-37ccf69474b8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.239638 Oct 28 13:15:40.483620 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1554/3180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:40 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:40.488974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.493789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:40.498172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.498963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.499683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.500712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.501407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.502304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.539160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de265649-9572-4f01-a3b2-5a2d53480bd8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 204 len: 0 microversion: 2.1 time: 0.459135 Oct 28 13:15:40.540370 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1627/3181] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:40 2022] DELETE /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:15:40.548140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff9eb0ab-05e5-46cc-af0b-45c865161b08 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b85444c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.577039 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ff9eb0ab-05e5-46cc-af0b-45c865161b08 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Image not found. Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff9eb0ab-05e5-46cc-af0b-45c865161b08 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 HTTP/1.1 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'c96643a0-1f39-4d21-afd3-45e946111f92'} Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c96643a0-1f39-4d21-afd3-45e946111f92 to delete Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c96643a0-1f39-4d21-afd3-45e946111f92 could not be found. Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.579295 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:15:40.584090 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:40.587920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff9eb0ab-05e5-46cc-af0b-45c865161b08 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:40.589465 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff9eb0ab-05e5-46cc-af0b-45c865161b08 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92" status: 404 len: 62 microversion: 2.1 time: 0.046663 Oct 28 13:15:40.590509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1628/3182] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:40 2022] DELETE /compute/v2.1/images/c96643a0-1f39-4d21-afd3-45e946111f92 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:40.694368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:40.713387 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-45bace3b-cfa2-4669-935f-be59f740ba6d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.228372 Oct 28 13:15:40.715822 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1555/3183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:40 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:40.728930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.736893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:40.757112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.761754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.761754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.762573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:40.763251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:40.763892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:40.834581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1480369039", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:40.906706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] validate_networks() for [('dd6566b8-2ff4-4880-84e7-4468a87bad78', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:15:40.977650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:40.986911 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-735c4124-954a-49c9-92a9-3760843d96c2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.267458 Oct 28 13:15:40.987477 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1556/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:40 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:40.992221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:40.992833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:41.000136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.000723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.001150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.002141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.003085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.003701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.143573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:41.153116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd5548d1-c0d9-4b88-b10b-0e03323a9fe7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1682 microversion: 2.1 time: 0.164594 Oct 28 13:15:41.163215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1557/3185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:40 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:41.172621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:41.172621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:41.178661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.179203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.179642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.180342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.180876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.181481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.201100 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 HTTP/1.1 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '3069cd51-a7b8-468d-98b4-74fda3e00ab8'} Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:41.202619 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8d9b92e-9287-4e24-9a08-27d4e2c992d8 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 404 len: 111 microversion: 2.1 time: 0.049106 Oct 28 13:15:41.210351 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1558/3186] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:41 2022] DELETE /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:41.212954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:41.214215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:41.222507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.223036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.223593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.225143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.226180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.226180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.451387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:41.464318 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5f00e5d-c4cc-4c95-9bfe-583b1bacf097 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.257809 Oct 28 13:15:41.470006 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1559/3187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:41 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:41.476729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:41.480544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:41.491315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.496382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.497065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.497960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.498571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.499223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.749584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:15:41.750115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:15:41.751024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:15:41.751538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:15:41.752642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:15:41.762823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.763451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.764012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.765022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.765554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.766048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.785091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Getting quotas for project 0f756dcc3ef24ca98d40410e48639a7b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:15:41.790389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:41.791727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Getting quotas for user 0586c49d75e94228bb59d3e482ee4379 and project 0f756dcc3ef24ca98d40410e48639a7b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:15:41.803213 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-21a1141f-9401-497f-9dbb-a78118ecca26 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1814 microversion: 2.1 time: 0.331684 Oct 28 13:15:41.804826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1560/3188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:41 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1814 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:41.806214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:15:41.808939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:15:41.813630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:41.816880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:41.830583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.831467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.832142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.833057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.833755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.834428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.912936 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f7bc9942-a28a-4242-b57c-1082995c9089 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.320684 Oct 28 13:15:41.914302 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1629/3189] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:15:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:15:41.919834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:41.920805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 3069cd51-a7b8-468d-98b4-74fda3e00ab8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:41.927245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.928727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.929387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.930302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.931027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.931695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.950812 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 HTTP/1.1 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '3069cd51-a7b8-468d-98b4-74fda3e00ab8'} Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.952539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.957320 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:41.957320 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:41.957320 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:41.957320 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:41.957320 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. Oct 28 13:15:41.957320 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.957320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance 3069cd51-a7b8-468d-98b4-74fda3e00ab8 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:41.958287 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc1c21cc-f049-40be-a912-9f6214be0016 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8" status: 404 len: 111 microversion: 2.1 time: 0.042595 Oct 28 13:15:41.959224 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1630/3190] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:41 2022] GET /compute/v2.1/servers/3069cd51-a7b8-468d-98b4-74fda3e00ab8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:41.964861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9330748-45fc-4491-845c-cfbf9a551ee2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9330748-45fc-4491-845c-cfbf9a551ee2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d HTTP/1.1 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 280 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.968942 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:41.972823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9330748-45fc-4491-845c-cfbf9a551ee2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:41.975385 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f9330748-45fc-4491-845c-cfbf9a551ee2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "PUT /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 400 len: 619 microversion: 2.1 time: 0.015283 Oct 28 13:15:41.979294 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1631/3191] 10.222.0.25 () {60 vars in 1257 bytes} [Fri Oct 28 13:15:41 2022] PUT /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:15:41.981077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:41.985620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.986227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.986783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:41.987670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:41.988250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:41.988812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.015900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-edbad0e9-3597-40a8-892c-deaef3c129e2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038420 Oct 28 13:15:42.016985 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1632/3192] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:15:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:42.021766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58ca2d97-6e4b-41d1-9145-0280169bf4de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.024122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58ca2d97-6e4b-41d1-9145-0280169bf4de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:42.098092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58ca2d97-6e4b-41d1-9145-0280169bf4de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:42.106567 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58ca2d97-6e4b-41d1-9145-0280169bf4de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1223 microversion: 2.1 time: 0.088397 Oct 28 13:15:42.109537 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1633/3193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:42.115651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70fabe91-3a6e-4490-b47d-e31ef49805b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b85a29d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.150597 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-70fabe91-3a6e-4490-b47d-e31ef49805b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Image not found. Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70fabe91-3a6e-4490-b47d-e31ef49805b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc HTTP/1.1 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6a54750c-d9e4-4543-8932-4a22957039fc'} Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6a54750c-d9e4-4543-8932-4a22957039fc to delete Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a54750c-d9e4-4543-8932-4a22957039fc could not be found. Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.152577 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70fabe91-3a6e-4490-b47d-e31ef49805b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70fabe91-3a6e-4490-b47d-e31ef49805b4 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc" status: 404 len: 62 microversion: 2.1 time: 0.042344 Oct 28 13:15:42.157357 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1634/3194] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] DELETE /compute/v2.1/images/6a54750c-d9e4-4543-8932-4a22957039fc => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:42.165544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.167861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:42.187647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.188160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.188602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.189558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.190182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.190614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.388918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:42.400422 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c1bd9d1-02a5-44a0-9ab9-5b2153298d1d tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.242095 Oct 28 13:15:42.413068 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1635/3195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:42.422778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.424279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:42.434126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.434972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.437989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.439013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.440753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.442780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.467085 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f HTTP/1.1 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f23c46ff-706a-4918-8cf5-a16d7f29617f'} Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:42.469895 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f95fe2ab-cf2c-48b8-8836-281609936deb tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 404 len: 111 microversion: 2.1 time: 0.058069 Oct 28 13:15:42.474547 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1636/3196] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:42 2022] DELETE /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:42.481519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.482136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:42.489045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.489519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.489950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.490735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.491288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.491675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.654972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:42.663925 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0665234f-fe42-4dc2-8e59-05c2615a0b69 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1682 microversion: 2.1 time: 0.189356 Oct 28 13:15:42.664725 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1637/3197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:42.670573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.671205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:42.680788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.681278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.682026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.683486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.684317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.684907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.846717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:42.855915 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-21742199-207b-4588-8e15-5af4031dfca2 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.189532 Oct 28 13:15:42.877028 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1638/3198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:42.882482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.883615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: f23c46ff-706a-4918-8cf5-a16d7f29617f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:42.891506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.892228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.892892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.893827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:42.894514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:42.895259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:42.913193 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f HTTP/1.1 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f23c46ff-706a-4918-8cf5-a16d7f29617f'} Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.915100 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.920847 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.920847 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.920847 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:42.920847 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:42.920847 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. Oct 28 13:15:42.920847 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.922508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance f23c46ff-706a-4918-8cf5-a16d7f29617f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:42.923626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f5bf3259-312a-40f9-9b54-cd7619a9cab3 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f" status: 404 len: 111 microversion: 2.1 time: 0.045236 Oct 28 13:15:42.924706 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1639/3199] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] GET /compute/v2.1/servers/f23c46ff-706a-4918-8cf5-a16d7f29617f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:42.930077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:42.930724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29765406-4dd6-43b4-b22d-d31ae9b8ee4e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29765406-4dd6-43b4-b22d-d31ae9b8ee4e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: request: PUT /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d HTTP/1.1 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 24 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: {"server": {"name": ""}} Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d', 'body': {'server': {'name': ''}}} Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi '' Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:15:42.934584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 13:15:42.938606 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.941569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29765406-4dd6-43b4-b22d-d31ae9b8ee4e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:42.941711 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ae0bca7f-44ea-433e-8d8b-a65ebcc3a224 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 1.133233 Oct 28 13:15:42.942773 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-29765406-4dd6-43b4-b22d-d31ae9b8ee4e tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "PUT /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 400 len: 108 microversion: 2.1 time: 0.016993 Oct 28 13:15:42.946962 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1640/3200] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:15:42 2022] PUT /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:15:42.953271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d602d0e7-3274-4ead-9afb-5cac154c86f6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b865c940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.964263 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1561/3201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:41 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:42.977683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.980199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:42.984224 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d602d0e7-3274-4ead-9afb-5cac154c86f6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Image not found. Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d602d0e7-3274-4ead-9afb-5cac154c86f6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 HTTP/1.1 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '2a92b504-9932-48cd-8348-bcb2814f84b4'} Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2a92b504-9932-48cd-8348-bcb2814f84b4 to delete Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a92b504-9932-48cd-8348-bcb2814f84b4 could not be found. Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.987491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d602d0e7-3274-4ead-9afb-5cac154c86f6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d602d0e7-3274-4ead-9afb-5cac154c86f6 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4" status: 404 len: 62 microversion: 2.1 time: 0.038113 Oct 28 13:15:42.992821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1641/3202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] DELETE /compute/v2.1/images/2a92b504-9932-48cd-8348-bcb2814f84b4 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:42.998826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:42.999637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:43.003157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.003663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.004111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.004890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.006346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.006968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.007494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.008294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.008834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.009735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.011657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.016185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.206230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:43.221397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bbc0010-849e-478e-aa35-bb4586a2c1b1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.227446 Oct 28 13:15:43.222029 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1642/3203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:43.237015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:43.237533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:43.244636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.245590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.246055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.247884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.247884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.248806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.308761 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 HTTP/1.1 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ac1d7297-bb28-443a-b7fe-c8c4d0c3e517'} Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:43.311224 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.316373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:43.318127 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5cfad93b-8874-4d5e-96e3-70387d4a3f3c tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 404 len: 111 microversion: 2.1 time: 0.092667 Oct 28 13:15:43.324228 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1643/3204] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:43 2022] DELETE /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:43.334053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e8bac25e-8450-4a61-82ea-b891e530c37d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:43.335241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e8bac25e-8450-4a61-82ea-b891e530c37d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:43.421588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e8bac25e-8450-4a61-82ea-b891e530c37d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:43.432615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e8bac25e-8450-4a61-82ea-b891e530c37d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1223 microversion: 2.1 time: 0.105917 Oct 28 13:15:43.435334 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1644/3205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:43 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:43.441721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:43.442358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: ac1d7297-bb28-443a-b7fe-c8c4d0c3e517] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:43.451318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.452072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.452675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.453586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.454279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.454716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.470454 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 HTTP/1.1 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ac1d7297-bb28-443a-b7fe-c8c4d0c3e517'} Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.472104 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:43.476521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-26087cbd-8c30-46e4-a319-87fcbfaf6156 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517" status: 404 len: 111 microversion: 2.1 time: 0.037067 Oct 28 13:15:43.478051 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1645/3206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:43 2022] GET /compute/v2.1/servers/ac1d7297-bb28-443a-b7fe-c8c4d0c3e517 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:43.482133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79f05a1e-c4f6-42f5-bdc0-449b7bae2f24 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '.version_select at 0x7f27b86a0430>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:43.504365 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-79f05a1e-c4f6-42f5-bdc0-449b7bae2f24 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Image not found. Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79f05a1e-c4f6-42f5-bdc0-449b7bae2f24 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 HTTP/1.1 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5'} Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 to delete Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 could not be found. Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.506608 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79f05a1e-c4f6-42f5-bdc0-449b7bae2f24 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79f05a1e-c4f6-42f5-bdc0-449b7bae2f24 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5" status: 404 len: 62 microversion: 2.1 time: 0.029389 Oct 28 13:15:43.514264 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1646/3207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:43 2022] DELETE /compute/v2.1/images/ee55d2c3-a6e3-4d6f-86e3-9c69c977baf5 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:15:43.517983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:43.519104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:43.525356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.525849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.526879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.527593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.528050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.528474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.542682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:43.545641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:43.552177 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 HTTP/1.1 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '151c2d94-029f-4353-8f82-06ac9f8d4fa4'} Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:43.553824 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.558410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:43.560917 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-39a908d9-e5de-4469-bffa-6685173aeb63 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1505 microversion: 2.1 time: 0.588973 Oct 28 13:15:43.561023 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cfe9ee45-e6dd-45a2-a134-875013d1c770 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "DELETE /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 404 len: 111 microversion: 2.1 time: 0.041945 Oct 28 13:15:43.561023 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1647/3208] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:43 2022] DELETE /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:43.563119 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1562/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:42 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:43.563855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:43.564772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] [instance: 151c2d94-029f-4353-8f82-06ac9f8d4fa4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:43.572308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.573489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.573932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.574640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.575567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.575567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.591645 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] HTTP exception thrown: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Request method failure captured: Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 HTTP/1.1 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SB0M9IQgSMHx2z6fN1yJYXBEuCkzqBOadNs6CAyoWbr8xRop17XGM8lk5ixMUkWrkDsekGIyBzL5bRAUzR6H0O25fe5AnJLs7hS-8jkrk-DRQlSiu3Qlwu8SF_mDyBZCaDTmFvbU8UI4emPRRNE_-_IF222Jhl_tU37bpB3EFv4XU Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07be95c26df34d138ae295e3ac8c7f13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07be95c26df34d138ae295e3ac8c7f13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 07be95c26df34d138ae295e3ac8c7f13 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesTestJSON-470592290 Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a43aa3346a70490d9c5e489c8e39d91d Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesTestJSON-470592290-project Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '151c2d94-029f-4353-8f82-06ac9f8d4fa4'} Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.593504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] Returning 404 to user: Instance 151c2d94-029f-4353-8f82-06ac9f8d4fa4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25085e2c-8053-4ef1-a318-faea8f7aaf05 tempest-ImagesTestJSON-470592290 tempest-ImagesTestJSON-470592290-project] 10.222.0.25 "GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4" status: 404 len: 111 microversion: 2.1 time: 0.036747 Oct 28 13:15:43.603284 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1648/3210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:43 2022] GET /compute/v2.1/servers/151c2d94-029f-4353-8f82-06ac9f8d4fa4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:43.694199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:43.695279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:43.710532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.716116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.716979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:43.718441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:43.719527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:43.722161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:44.256524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:44.270373 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d50d9e8-5982-4fc1-b88e-8fb1f387b31b tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1682 microversion: 2.1 time: 0.586291 Oct 28 13:15:44.290198 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1563/3211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:43 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1682 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:44.460766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:44.461997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:44.476279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:44.477064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:44.477736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:44.478625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:44.479948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:44.480858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:44.756935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:44.760090 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cda9f700-b380-4add-8300-bd343cea82d9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1219 microversion: 2.1 time: 0.303074 Oct 28 13:15:44.773810 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1649/3212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:44 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1219 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:45.185889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-230045b0-cea0-43c0-83a0-45d9d7444ec6 req-12a51dc1-8c29-4515-99d4-4d4de35cc621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2947206d-44a2-41bb-af6a-75fed884b370", "name": "network-vif-deleted", "tag": "a493248d-69d2-46c2-ba4f-9cad741c0946"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:45.220999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-230045b0-cea0-43c0-83a0-45d9d7444ec6 req-12a51dc1-8c29-4515-99d4-4d4de35cc621 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:45.225067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-230045b0-cea0-43c0-83a0-45d9d7444ec6 req-12a51dc1-8c29-4515-99d4-4d4de35cc621 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:45.225809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-230045b0-cea0-43c0-83a0-45d9d7444ec6 req-12a51dc1-8c29-4515-99d4-4d4de35cc621 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:45.285016 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-230045b0-cea0-43c0-83a0-45d9d7444ec6 req-12a51dc1-8c29-4515-99d4-4d4de35cc621 service nova] Creating event network-vif-deleted:a493248d-69d2-46c2-ba4f-9cad741c0946 for instance 2947206d-44a2-41bb-af6a-75fed884b370 on n-h1-862876-2 Oct 28 13:15:45.295121 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-230045b0-cea0-43c0-83a0-45d9d7444ec6 req-12a51dc1-8c29-4515-99d4-4d4de35cc621 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113117 Oct 28 13:15:45.296867 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1564/3213] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:45.312634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:45.314476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:45.359152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:45.360050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:45.360623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:45.361672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:45.362282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:45.365590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:45.770352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:45.779487 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-edcb0335-0998-4fcf-ae84-c184b3360f8d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1615 microversion: 2.1 time: 0.473659 Oct 28 13:15:45.780087 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1650/3214] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:45 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1615 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:45.804789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:45.805648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:45.819197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=16 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:45.820897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:45.821389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:45.822081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:45.824256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:45.837812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:45.846476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:46.199391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:46.218006 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d014217e-6a2a-47f3-9c2c-a8f85649f1ad tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1283 microversion: 2.1 time: 0.419796 Oct 28 13:15:46.219156 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1565/3215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:45 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1283 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:46.340163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c10171bd-b471-4dde-895b-eb02963952c9", "device": "/dev/xvdb"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:46.343213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:46.365150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:46.366554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:46.366554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:46.366807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:46.367253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:46.379429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:46.806730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:46.808196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:46.822024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:46.822024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:46.822024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:46.822024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:46.822390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:46.822624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:46.892350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:46.892882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:46.893331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:46.893799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lazy-loading 'fault' on Instance uuid 2947206d-44a2-41bb-af6a-75fed884b370 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:15:47.188961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:47.200770 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4fd95aa0-e4d5-4bb6-8eba-e45011364f3d tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 200 len: 1331 microversion: 2.1 time: 0.397354 Oct 28 13:15:47.215123 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1566/3216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:46 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 1331 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:47.244562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:47.245261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:47.260963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:47.264106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:47.264705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:47.265524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:47.267836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:47.268359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:47.484760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:47.509011 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52ec0f3d-1fd4-4059-b140-c46b3dc1e576 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1281 microversion: 2.1 time: 0.268274 Oct 28 13:15:47.515329 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1567/3217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:47 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1281 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:47.589971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0c1a32e-c7da-4ce9-ad22-4d498d23ab63 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "POST /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254066 Oct 28 13:15:47.597754 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1651/3218] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:15:46 2022] POST /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 194 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:48.539661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:48.540481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:48.564834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:48.567348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:48.567348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:48.573941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:48.577531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:48.578130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:48.820552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:48.822249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:48.847619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:48.848722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:48.851997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:48.856881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:48.856881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:48.856881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:48.933707 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 HTTP/1.1 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2947206d-44a2-41bb-af6a-75fed884b370'} Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:48.939871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:48.945046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:48.945046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:48.945046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:48.945046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:48.945046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:48.945046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:15:48.945046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:48.949632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:48.950886 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2293f393-d124-4d4b-8ad1-bc6049c5b960 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 404 len: 111 microversion: 2.1 time: 0.719090 Oct 28 13:15:48.953161 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1568/3219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:48 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 111 bytes in 722 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:48.969135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e3add86-abd7-456f-bd31-fc3cf79680a7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '.version_select at 0x7f27b9422670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:49.005078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:49.017800 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00d9be70-fe12-4f36-bd77-13d261d1856a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1281 microversion: 2.1 time: 0.481425 Oct 28 13:15:49.022710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1652/3220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:48 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1281 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:49.128284 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e3add86-abd7-456f-bd31-fc3cf79680a7 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503398557" status: 202 len: 0 microversion: 2.1 time: 0.171841 Oct 28 13:15:49.129577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1569/3221] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503398557 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:15:50.050915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:50.052615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:50.076315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:50.076890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:50.077350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:50.078096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:50.078560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:50.079016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:51.486942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:51.502033 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-22517059-21bd-4e38-ab17-dae11842b143 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 1.457644 Oct 28 13:15:51.503314 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1653/3222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:50 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:52.531903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:52.532584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:52.552004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:52.554154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:52.554801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:52.565247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:52.565840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:52.566286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:53.359092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9e54ea08-8e33-4ebb-adef-30981c03ab14 req-704efcb8-4587-433e-b72a-01257e628ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b434829f-6f49-4804-af96-4061126f70a2", "tag": "042506e5-8b9e-46ff-8274-a344e5960077"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:53.393590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:53.400570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e54ea08-8e33-4ebb-adef-30981c03ab14 req-704efcb8-4587-433e-b72a-01257e628ae3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:53.404669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e54ea08-8e33-4ebb-adef-30981c03ab14 req-704efcb8-4587-433e-b72a-01257e628ae3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:53.405145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e54ea08-8e33-4ebb-adef-30981c03ab14 req-704efcb8-4587-433e-b72a-01257e628ae3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:53.469138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=14 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:53.471593 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9e54ea08-8e33-4ebb-adef-30981c03ab14 req-704efcb8-4587-433e-b72a-01257e628ae3 service nova] Creating event network-changed:042506e5-8b9e-46ff-8274-a344e5960077 for instance b434829f-6f49-4804-af96-4061126f70a2 on n-h1-862876-2 Oct 28 13:15:53.489916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9e54ea08-8e33-4ebb-adef-30981c03ab14 req-704efcb8-4587-433e-b72a-01257e628ae3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144698 Oct 28 13:15:53.490798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1654/3223] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:53.694580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:53.704337 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6aa6546c-17e1-4225-a873-03f90d74ab4c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 1.178084 Oct 28 13:15:53.713739 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1570/3224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:52 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:54.419132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d80a94f9-16bb-48dd-aa31-428e12232366 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: .version_select at 0x7f27b8503040>, body: {"keypair": {"name": "tempest-keypair-29297614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDafJgeLujd2MfWZfKyWVDEfH5/KQHhGOqIkOyiv6ZnDuP0axNR7pLiN3WLq0JwRvVD1UYzQrT6SSeyHMuPOw0bMMG+NBHJJnpR739RPdj1qDoGdFjAJpbwuYp6aROVkpg=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:54.470692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d80a94f9-16bb-48dd-aa31-428e12232366 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:15:54.494559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d80a94f9-16bb-48dd-aa31-428e12232366 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:15:54.592614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:54.593215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:54.603482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.604556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.604994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.612531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.616784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.617254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.648732 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d80a94f9-16bb-48dd-aa31-428e12232366 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.234715 Oct 28 13:15:54.649598 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1655/3225] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:15:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:54.669562 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 HTTP/1.1 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b99289a7-5b75-40b8-b832-8d1f1223ddd3'} Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:54.675350 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:54.683389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee96919b-87d1-491b-ad96-cb741e2416ff tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 404 len: 111 microversion: 2.1 time: 0.097342 Oct 28 13:15:54.689675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:54.693038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: b99289a7-5b75-40b8-b832-8d1f1223ddd3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:54.700217 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1571/3226] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:54 2022] DELETE /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:15:54.703939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.704662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.708123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.709073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.709704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.710287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.737075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:54.737996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:54.746726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.757119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.763788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.764958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.765628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.766243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.772267 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 HTTP/1.1 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b99289a7-5b75-40b8-b832-8d1f1223ddd3'} Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:54.774355 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.779371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:54.779371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:54.779371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:54.779371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:54.779371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:54.779371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. Oct 28 13:15:54.779371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:54.780689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance b99289a7-5b75-40b8-b832-8d1f1223ddd3 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:54.784808 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-965d4fc1-ff85-4f0b-9199-6202ff6213e8 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3" status: 404 len: 111 microversion: 2.1 time: 0.099046 Oct 28 13:15:54.792358 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1656/3227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:54 2022] GET /compute/v2.1/servers/b99289a7-5b75-40b8-b832-8d1f1223ddd3 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:15:54.798165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:54.808213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:54.821366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.824998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.825630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.826529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:54.827248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:54.835248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:54.889043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:15:54.969901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:15:55.328136 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20966743-6dc8-483f-b3e7-2a36ef844d15 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 204 len: 0 microversion: 2.1 time: 0.533267 Oct 28 13:15:55.328720 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1657/3228] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:15:54 2022] DELETE /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:15:55.337527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:55.340493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:55.350637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:55.355761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:55.356418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:55.357345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:55.357968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:55.358626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:55.593278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:55.601473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4036e98-6cf8-4a9e-84cf-b586987460d8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 0.868337 Oct 28 13:15:55.602084 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1572/3229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:54 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:56.091872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:56.109411 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a6aa05d-59c4-492a-9b86-693fa158af4c tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.771754 Oct 28 13:15:56.112858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1658/3230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:55 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:56.625519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:56.626207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:56.643296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:56.655529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:56.655529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:56.655529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:56.655529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:56.655529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:57.141243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:57.142449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:57.158211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:57.159007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:57.159620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:57.160474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:57.161086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:57.161666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:57.203016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:57.216158 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8fea7602-d1df-4737-81c8-797ff596ec49 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 0.594366 Oct 28 13:15:57.217844 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1573/3231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:56 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:57.772790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:57.781697 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99fb00f6-e4a9-44d3-a638-e149aba14729 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1511 microversion: 2.1 time: 0.644710 Oct 28 13:15:57.786011 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1659/3232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:57 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1511 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:15:57.814425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-20ad4673-5890-4dec-969b-54c7f6abe010 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27bdadef70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1438137708", "description": "tempest-description-117802207"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:58.248248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:58.249524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:58.267701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:58.269569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:58.270294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:58.271825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:58.272794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:58.273408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:58.685395 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-20ad4673-5890-4dec-969b-54c7f6abe010 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.977905 Oct 28 13:15:58.697710 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1574/3233] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:15:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:58.706095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8cef7c5c-ef57-4164-bd68-7e756d7bbf13 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b9386310>, body: {"security_group_rule": {"parent_group_id": "04db38b4-5b99-4da8-a578-3252d01cf655", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:59.140449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:59.152913 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff568989-7f52-4ef4-ab02-6f75acd697e9 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 0.911874 Oct 28 13:15:59.154160 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1660/3234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:58 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:59.162081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:59.162699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:15:59.169505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:59.170440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:59.171161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:59.171884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:59.172343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:59.172767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:59.318963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369a322f683e4c669d99eb762b7137ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f2a1ab0afa467e9b9c6ec8cf78614c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:15:59.328903 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c2151fe-bebd-40b5-87cc-2353cc198454 tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 200 len: 1469 microversion: 2.1 time: 0.173428 Oct 28 13:15:59.329494 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1661/3235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:15:59 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:15:59.424052 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8cef7c5c-ef57-4164-bd68-7e756d7bbf13 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.717260 Oct 28 13:15:59.424052 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1575/3236] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:15:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:15:59.436053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd0184e7-282b-402f-beba-b7fccb74680f tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b8523c10>, body: {"security_group_rule": {"parent_group_id": "04db38b4-5b99-4da8-a578-3252d01cf655", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:59.561374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b10c5cff-f33e-4af1-9ee6-f4ce4b38d2e0 req-1110016d-d101-4b37-898a-37035cd25916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045277a0-63fb-4041-b9b5-b0f275e6f17d", "name": "network-vif-deleted", "tag": "e05c1d1a-5545-436c-a9b0-a4a597fea3cc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:15:59.578852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b10c5cff-f33e-4af1-9ee6-f4ce4b38d2e0 req-1110016d-d101-4b37-898a-37035cd25916 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:15:59.581568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b10c5cff-f33e-4af1-9ee6-f4ce4b38d2e0 req-1110016d-d101-4b37-898a-37035cd25916 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:15:59.583121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b10c5cff-f33e-4af1-9ee6-f4ce4b38d2e0 req-1110016d-d101-4b37-898a-37035cd25916 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:15:59.623477 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b10c5cff-f33e-4af1-9ee6-f4ce4b38d2e0 req-1110016d-d101-4b37-898a-37035cd25916 service nova] Creating event network-vif-deleted:e05c1d1a-5545-436c-a9b0-a4a597fea3cc for instance 045277a0-63fb-4041-b9b5-b0f275e6f17d on n-h2-862876-2 Oct 28 13:15:59.627781 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-fd0184e7-282b-402f-beba-b7fccb74680f tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: This rule already exists in group 04db38b4-5b99-4da8-a578-3252d01cf655 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd0184e7-282b-402f-beba-b7fccb74680f tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 138 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: {"security_group_rule": {"parent_group_id": "04db38b4-5b99-4da8-a578-3252d01cf655", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: exception: This rule already exists in group 04db38b4-5b99-4da8-a578-3252d01cf655 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'security_group_rule': {'parent_group_id': '04db38b4-5b99-4da8-a578-3252d01cf655', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 04db38b4-5b99-4da8-a578-3252d01cf655 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 04db38b4-5b99-4da8-a578-3252d01cf655 Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:15:59.633340 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:15:59.642412 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:15:59.642412 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:15:59.642412 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 04db38b4-5b99-4da8-a578-3252d01cf655 Oct 28 13:15:59.642412 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:15:59.642412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd0184e7-282b-402f-beba-b7fccb74680f tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 400 to user: This rule already exists in group 04db38b4-5b99-4da8-a578-3252d01cf655 {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:15:59.642412 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd0184e7-282b-402f-beba-b7fccb74680f tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.207073 Oct 28 13:15:59.642412 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1662/3237] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:15:59 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:15:59.649584 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b10c5cff-f33e-4af1-9ee6-f4ce4b38d2e0 req-1110016d-d101-4b37-898a-37035cd25916 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091910 Oct 28 13:15:59.649996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed059cd2-6c3e-451a-9ab7-ddece975b74b tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Calling method '.version_select at 0x7f27b852a940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:15:59.652097 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1576/3238] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:00.189487 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed059cd2-6c3e-451a-9ab7-ddece975b74b tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/f355eb10-9c9f-487e-b26f-5f033a5572fe" status: 202 len: 0 microversion: 2.1 time: 0.548187 Oct 28 13:16:00.190357 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1663/3239] 10.222.0.25 () {58 vars in 1287 bytes} [Fri Oct 28 13:15:59 2022] DELETE /compute/v2.1/os-security-group-rules/f355eb10-9c9f-487e-b26f-5f033a5572fe => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:00.198965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:00.199742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:00.216560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:00.219393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:00.219905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:00.220431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:00.221061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:00.221519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:00.221938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:00.223086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9dd5d969-1c37-46b3-8a7c-bdef7216f91c tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b84be0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-744123758", "description": "tempest-description-1613159412"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:00.542279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:00.551040 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c317bedf-758a-41ce-b14c-c7adc3a36be8 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 0.373224 Oct 28 13:16:00.551624 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1577/3240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:00 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:00.556100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:00.556709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] [instance: 045277a0-63fb-4041-b9b5-b0f275e6f17d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:00.564440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:00.564939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:00.565351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:00.566043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:00.566496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:00.567071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:00.592829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] HTTP exception thrown: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d could not be found. Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Request method failure captured: Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d HTTP/1.1 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ULes0JQrFd8ialP8YlGVg1zIbvkd9ixtBM6s_9_Ld5-lTn7tthGTi1zGdGerpV1fPsS5fM3P_S3L43PEPkZQVRzPtzAN19bhB0aAcYHFZCH2oc_ntI2jvRmmj-2oPp_bt47Zu_x4Sx4cMMzBdGDXznXvHaEtRtWuUCxIH0eU1Un00 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_49f2a1ab0afa467e9b9c6ec8cf78614c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/49f2a1ab0afa467e9b9c6ec8cf78614c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 49f2a1ab0afa467e9b9c6ec8cf78614c Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-189285712 Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 369a322f683e4c669d99eb762b7137ec Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-189285712-project Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d could not be found. Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '045277a0-63fb-4041-b9b5-b0f275e6f17d'} Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d could not be found. Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d could not be found. Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:00.594539 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d could not be found. Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] Returning 404 to user: Instance 045277a0-63fb-4041-b9b5-b0f275e6f17d could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:00.598985 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dd924a36-b077-43e3-9217-9467456dfebc tempest-ServersNegativeTestJSON-189285712 tempest-ServersNegativeTestJSON-189285712-project] 10.222.0.25 "GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d" status: 404 len: 111 microversion: 2.1 time: 0.043459 Oct 28 13:16:00.602687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1578/3241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:00 2022] GET /compute/v2.1/servers/045277a0-63fb-4041-b9b5-b0f275e6f17d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:01.063276 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9dd5d969-1c37-46b3-8a7c-bdef7216f91c tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.866968 Oct 28 13:16:01.064236 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1664/3242] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:01.079489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-922d6576-a3b7-4a63-a21c-e6554e96ffd0 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b960a040>, body: {"security_group_rule": {"parent_group_id": "8c3fee3d-659b-4fa2-9e2f-f88fb8162129", "ip_protocol": "tcp", "from_port": 257994199, "to_port": 22}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:01.385461 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-922d6576-a3b7-4a63-a21c-e6554e96ffd0 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: Invalid port range 257994199:22. Former value cannot be greater than the later Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-922d6576-a3b7-4a63-a21c-e6554e96ffd0 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 145 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: {"security_group_rule": {"parent_group_id": "8c3fee3d-659b-4fa2-9e2f-f88fb8162129", "ip_protocol": "tcp", "from_port": 257994199, "to_port": 22}} Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid port range 257994199:22. Former value cannot be greater than the later Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8c3fee3d-659b-4fa2-9e2f-f88fb8162129', 'ip_protocol': 'tcp', 'from_port': 257994199, 'to_port': 22}}} Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 257994199:22. Former value cannot be greater than the later Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 257994199:22. Former value cannot be greater than the later Oct 28 13:16:01.390220 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 257994199:22. Former value cannot be greater than the later Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.397144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-922d6576-a3b7-4a63-a21c-e6554e96ffd0 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 400 to user: Invalid port range 257994199:22. Former value cannot be greater than the later {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:01.399676 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-922d6576-a3b7-4a63-a21c-e6554e96ffd0 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.325690 Oct 28 13:16:01.400715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1579/3243] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:16:01 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 328 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:16:01.411989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19c81f45-a518-41c0-883b-0b62ab124d22 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b84be310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1163137664", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:01.413969 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-19c81f45-a518-41c0-883b-0b62ab124d22 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: Security group id should be uuid Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19c81f45-a518-41c0-883b-0b62ab124d22 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 131 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1163137664", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: exception: Security group id should be uuid Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1163137664', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:01.415461 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:01.421800 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 28 13:16:01.421800 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:01.430714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19c81f45-a518-41c0-883b-0b62ab124d22 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 400 to user: Security group id should be uuid {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:01.440710 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19c81f45-a518-41c0-883b-0b62ab124d22 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028975 Oct 28 13:16:01.441698 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1665/3244] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:16:01 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 28 13:16:01.452721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-589837c8-e982-4ac5-839a-135319be7e08 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b93a4ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1665505539", "description": "tempest-description-1576611461"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:01.578017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:01.582261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:01.600460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:01.601463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:01.602431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:01.605112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:01.605885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:01.606693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:01.968898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:01.979247 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce7d98bd-ee85-4fe4-b977-4b7d09bfbf62 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 0.407563 Oct 28 13:16:01.979949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1666/3245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:01 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:01.993163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-212832861", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53d6a3ea-bd12-4a26-b93d-1b74de68c817"}], "security_groups": [{"name": "tempest-securitygroup--861369457"}], "key_name": "tempest-keypair-29297614", "user_data": "}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:02.175114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] validate_networks() for [('53d6a3ea-bd12-4a26-b93d-1b74de68c817', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:16:02.513634 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-589837c8-e982-4ac5-839a-135319be7e08 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.066030 Oct 28 13:16:02.514313 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1580/3246] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:01 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:02.527523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-dab0dbc7-1e7c-4ba3-a6e3-ae068faea7ec req-b4d5fbc4-7f71-423d-8688-d8804e06839c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b434829f-6f49-4804-af96-4061126f70a2", "name": "network-vif-plugged", "status": "completed", "tag": "042506e5-8b9e-46ff-8274-a344e5960077"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:02.539929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dab0dbc7-1e7c-4ba3-a6e3-ae068faea7ec req-b4d5fbc4-7f71-423d-8688-d8804e06839c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:02.540596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dab0dbc7-1e7c-4ba3-a6e3-ae068faea7ec req-b4d5fbc4-7f71-423d-8688-d8804e06839c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:02.541806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dab0dbc7-1e7c-4ba3-a6e3-ae068faea7ec req-b4d5fbc4-7f71-423d-8688-d8804e06839c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:02.554196 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-dab0dbc7-1e7c-4ba3-a6e3-ae068faea7ec req-b4d5fbc4-7f71-423d-8688-d8804e06839c service nova] Creating event network-vif-plugged:042506e5-8b9e-46ff-8274-a344e5960077 for instance b434829f-6f49-4804-af96-4061126f70a2 on n-h1-862876-2 Oct 28 13:16:02.562032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-dab0dbc7-1e7c-4ba3-a6e3-ae068faea7ec req-b4d5fbc4-7f71-423d-8688-d8804e06839c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045084 Oct 28 13:16:02.562638 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1581/3247] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:02.571448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-727d9bd5-c2c2-441f-b66d-65e4035b3470 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b93a41f0>, body: {"security_group_rule": {"parent_group_id": "520ff361-7d5c-4026-8317-a8d9ffa510e0", "ip_protocol": "tempest-999-315038437", "from_port": 22, "to_port": 22}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:02.781801 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-727d9bd5-c2c2-441f-b66d-65e4035b3470 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: Invalid IP protocol tempest-999-315038437. Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-727d9bd5-c2c2-441f-b66d-65e4035b3470 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 156 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: {"security_group_rule": {"parent_group_id": "520ff361-7d5c-4026-8317-a8d9ffa510e0", "ip_protocol": "tempest-999-315038437", "from_port": 22, "to_port": 22}} Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid IP protocol tempest-999-315038437. Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'security_group_rule': {'parent_group_id': '520ff361-7d5c-4026-8317-a8d9ffa510e0', 'ip_protocol': 'tempest-999-315038437', 'from_port': 22, 'to_port': 22}}} Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-315038437. Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-315038437. Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:02.783847 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-315038437. Oct 28 13:16:02.787858 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:02.789923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-727d9bd5-c2c2-441f-b66d-65e4035b3470 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 400 to user: Invalid IP protocol tempest-999-315038437. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:02.791041 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-727d9bd5-c2c2-441f-b66d-65e4035b3470 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.227174 Oct 28 13:16:02.798232 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1582/3248] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:16:02 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 13:16:02.805219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9aeeee48-f4c2-4073-9401-c17555a4c384 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b9b2e310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-379770003", "description": "tempest-description-1139584699"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:02.821753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:16:02.828604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:16:02.829266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:16:02.829689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:16:02.830395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:16:02.841886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:02.842467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:02.843006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:02.843809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:02.844346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:02.844848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:02.876054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:16:02.882449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Getting quotas for user e078236549214dddb42cabe996363a24 and project 7f68daf1ebe84ac6844d1658e33b5c3a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:16:02.898247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:02.903508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:16:02.906164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:16:03.074190 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1a8d9797-15ee-4142-a0e9-0f5c8cdd75ad tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.092785 Oct 28 13:16:03.076349 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1667/3249] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:16:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:16:03.081641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:03.082382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:03.093400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:03.094312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:03.094994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:03.095919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:03.096571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:03.097195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:03.374875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:03.393387 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e403c2b5-2dd1-4d47-be3e-bc7bfa1c0cba tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 0.315137 Oct 28 13:16:03.394199 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1668/3250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:03 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:03.401105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac1562fe-839a-4294-a95d-89e3b4726533 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:03.402102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac1562fe-839a-4294-a95d-89e3b4726533 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:03.512300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac1562fe-839a-4294-a95d-89e3b4726533 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:03.525575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac1562fe-839a-4294-a95d-89e3b4726533 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1239 microversion: 2.1 time: 0.130036 Oct 28 13:16:03.528199 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1669/3251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:03 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1239 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:03.797158 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9aeeee48-f4c2-4073-9401-c17555a4c384 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.996960 Oct 28 13:16:03.797657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1583/3252] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:02 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:03.812749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e2753ba3-367f-4602-a794-a7d53c52ccbd tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b85a3280>, body: {"security_group_rule": {"parent_group_id": "2bc8508a-7a3f-47ae-9bc8-a3a0c786b296", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:03.889020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-e2753ba3-367f-4602-a794-a7d53c52ccbd tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e2753ba3-367f-4602-a794-a7d53c52ccbd tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 138 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: {"security_group_rule": {"parent_group_id": "2bc8508a-7a3f-47ae-9bc8-a3a0c786b296", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2bc8508a-7a3f-47ae-9bc8-a3a0c786b296', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 13:16:03.895975 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e2753ba3-367f-4602-a794-a7d53c52ccbd tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e2753ba3-367f-4602-a794-a7d53c52ccbd tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.086493 Oct 28 13:16:03.900287 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1670/3253] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:16:03 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:16:03.907452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2587e341-3d8a-42b3-a958-263a5b6a86ce tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27b93d4b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-769412773", "description": "tempest-description-1061305965"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:04.420919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:04.422361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:04.428979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:04.429773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:04.431094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:04.433093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:04.433786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:04.434605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:04.871845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:04.881979 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-41cf0d90-b54b-4554-bdd0-35aad1c88342 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1323 microversion: 2.1 time: 0.467155 Oct 28 13:16:04.886520 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1671/3254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:04 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1323 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:04.895851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:04.896794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:04.906532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:04.907265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:04.907712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:04.908453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:04.908918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:04.909347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:04.967939 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2587e341-3d8a-42b3-a958-263a5b6a86ce tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.064384 Oct 28 13:16:04.969077 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1584/3255] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:03 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:04.983739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aff8cda5-6908-406f-ada6-bfe7ec987ade tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27bdb08700>, body: {"security_group_rule": {"parent_group_id": "89722910-8696-4b21-8422-01d5ddcb5750", "ip_protocol": "tcp", "from_port": 22, "to_port": 1560979212}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:05.059390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:05.087111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-aff8cda5-6908-406f-ada6-bfe7ec987ade tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: Invalid port range 22:1560979212. Valid TCP ports should be between 1-65535 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aff8cda5-6908-406f-ada6-bfe7ec987ade tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 146 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: {"security_group_rule": {"parent_group_id": "89722910-8696-4b21-8422-01d5ddcb5750", "ip_protocol": "tcp", "from_port": 22, "to_port": 1560979212}} Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid port range 22:1560979212. Valid TCP ports should be between 1-65535 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'security_group_rule': {'parent_group_id': '89722910-8696-4b21-8422-01d5ddcb5750', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1560979212}}} Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1560979212. Valid TCP ports should be between 1-65535 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1560979212. Valid TCP ports should be between 1-65535 Oct 28 13:16:05.089729 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1560979212. Valid TCP ports should be between 1-65535 Oct 28 13:16:05.094111 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.094676 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5694ab60-f7c4-4b13-ae5f-1f814ee564ac tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1243 microversion: 2.1 time: 0.199060 Oct 28 13:16:05.095995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aff8cda5-6908-406f-ada6-bfe7ec987ade tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 400 to user: Invalid port range 22:1560979212. Valid TCP ports should be between 1-65535 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:05.097073 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aff8cda5-6908-406f-ada6-bfe7ec987ade tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.119087 Oct 28 13:16:05.098154 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1585/3256] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:16:04 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:16:05.120592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4527a86b-fb7d-410c-8b28-6bb86287a000 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Action: 'create', calling method: .version_select at 0x7f27bdb054c0>, body: {"security_group_rule": {"parent_group_id": "371cbb96-ee72-484b-903e-3d975ddf7373", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:05.124949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1672/3257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:04 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1243 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:05.207419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-4527a86b-fb7d-410c-8b28-6bb86287a000 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:16:05.208031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-4527a86b-fb7d-410c-8b28-6bb86287a000 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Neutron security group 371cbb96-ee72-484b-903e-3d975ddf7373 not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:16:05.208613 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4527a86b-fb7d-410c-8b28-6bb86287a000 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist Oct 28 13:16:05.208613 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-ff9ce357-c853-4807-a050-42a8986e9108'] Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4527a86b-fb7d-410c-8b28-6bb86287a000 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 138 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: {"security_group_rule": {"parent_group_id": "371cbb96-ee72-484b-903e-3d975ddf7373", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-ff9ce357-c853-4807-a050-42a8986e9108'] Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'security_group_rule': {'parent_group_id': '371cbb96-ee72-484b-903e-3d975ddf7373', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:16:05.210484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9ce357-c853-4807-a050-42a8986e9108'] Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9ce357-c853-4807-a050-42a8986e9108'] Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9ce357-c853-4807-a050-42a8986e9108'] Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9ce357-c853-4807-a050-42a8986e9108'] Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4527a86b-fb7d-410c-8b28-6bb86287a000 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 404 to user: Security group 371cbb96-ee72-484b-903e-3d975ddf7373 does not exist Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-ff9ce357-c853-4807-a050-42a8986e9108'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4527a86b-fb7d-410c-8b28-6bb86287a000 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.095874 Oct 28 13:16:05.216076 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1586/3258] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:16:05 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:05.224825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d056ee1a-7b8b-4a2f-917b-7c566032e670 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Calling method '.version_select at 0x7f27b853ed30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:05.305426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-d056ee1a-7b8b-4a2f-917b-7c566032e670 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:16:05.306240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.security_group_api [None req-d056ee1a-7b8b-4a2f-917b-7c566032e670 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Neutron security group rule eb4d5317-571a-45e4-9c67-47936c808a30 not found {{(pid=127793) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 28 13:16:05.308985 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d056ee1a-7b8b-4a2f-917b-7c566032e670 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] HTTP exception thrown: Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist Oct 28 13:16:05.308985 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-4974d47d-fdad-49e8-b7c7-a7826df03e5f'] Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d056ee1a-7b8b-4a2f-917b-7c566032e670 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Request method failure captured: Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-security-group-rules/eb4d5317-571a-45e4-9c67-47936c808a30 HTTP/1.1 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YN1ntOUV-IBfwqIwVBb5NtkAGaKK0jiP8RSZkWt5XmM8FdLlJHnID7GLLzEiGsPd0tpyvoRvsbgG5_zLJpt-vTCWH1qHdpRbhCLHJAoaUJca-buyrddBSQSCZsuITK4S5RNihU_m7Gc2obp09ZP85CiBQRlAXMK-Gi_Wv4ZNsDeqg Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f0a5595434b14d6e85a118dfd9aa17b9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f0a5595434b14d6e85a118dfd9aa17b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: f0a5595434b14d6e85a118dfd9aa17b9 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6b8634fecbde418b99e8b226e701726d Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: exception: Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-4974d47d-fdad-49e8-b7c7-a7826df03e5f'] Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'eb4d5317-571a-45e4-9c67-47936c808a30'} Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:16:05.314004 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4974d47d-fdad-49e8-b7c7-a7826df03e5f'] Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4974d47d-fdad-49e8-b7c7-a7826df03e5f'] Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4974d47d-fdad-49e8-b7c7-a7826df03e5f'] Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4974d47d-fdad-49e8-b7c7-a7826df03e5f'] Oct 28 13:16:05.318168 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:05.324388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d056ee1a-7b8b-4a2f-917b-7c566032e670 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Returning 404 to user: Security group rule eb4d5317-571a-45e4-9c67-47936c808a30 does not exist Oct 28 13:16:05.324388 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-4974d47d-fdad-49e8-b7c7-a7826df03e5f'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:05.325508 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d056ee1a-7b8b-4a2f-917b-7c566032e670 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/eb4d5317-571a-45e4-9c67-47936c808a30" status: 404 len: 199 microversion: 2.1 time: 0.104554 Oct 28 13:16:05.338473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-01ab74aa-06d9-4484-bea0-756f8f3ffdbe tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Calling method '.version_select at 0x7f27bdb05e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:05.353941 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1673/3259] 10.222.0.25 () {58 vars in 1287 bytes} [Fri Oct 28 13:16:05 2022] DELETE /compute/v2.1/os-security-group-rules/eb4d5317-571a-45e4-9c67-47936c808a30 => generated 199 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:05.889132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:05.896075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:05.918985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:05.919490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:05.934083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:05.937084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:05.938333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:05.939129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:06.210278 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-38437c42-ea7d-4fc4-b593-ed8ad0af7b3f tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1860 microversion: 2.1 time: 0.334173 Oct 28 13:16:06.210884 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1674/3260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:05 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1860 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:06.220555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:06.221523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:06.232672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:06.233180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:06.233613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:06.234312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:06.234785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:06.239961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:06.262724 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-01ab74aa-06d9-4484-bea0-756f8f3ffdbe tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/89722910-8696-4b21-8422-01d5ddcb5750" status: 202 len: 0 microversion: 2.1 time: 0.930279 Oct 28 13:16:06.263636 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1587/3261] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:05 2022] DELETE /compute/v2.1/os-security-groups/89722910-8696-4b21-8422-01d5ddcb5750 => generated 0 bytes in 932 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:06.269750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:06.270490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:06.301231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:06.311096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:06.311838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:06.312625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:06.313118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:06.313554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:06.411619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:06.420037 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8f60294-cdfb-4405-91fe-b282b8d37980 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1299 microversion: 2.1 time: 0.155186 Oct 28 13:16:06.420673 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1588/3262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:06 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:06.430637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862876-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:06.434768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:06.441070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:06.441630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:06.442195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:06.443110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:06.443725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:06.445556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:06.520156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lazy-loading 'flavor' on Instance uuid 15a15c03-700a-4a6f-8ee3-7edae4920b25 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:16:06.536292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Going to try to live migrate instance to n-h2-862876-2 {{(pid=127794) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:16:06.796056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:06.810528 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2ea1e58-7d50-42ad-86d2-9881c01ccb67 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1517 microversion: 2.1 time: 0.596401 Oct 28 13:16:06.828071 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1675/3263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:06 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1517 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:06.833553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e03bc14-cc75-414e-b4b5-c01717032f2c tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Calling method '.version_select at 0x7f27b8528ee0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:08.127894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e03bc14-cc75-414e-b4b5-c01717032f2c tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2bc8508a-7a3f-47ae-9bc8-a3a0c786b296" status: 202 len: 0 microversion: 2.1 time: 1.298351 Oct 28 13:16:08.128923 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1676/3264] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:06 2022] DELETE /compute/v2.1/os-security-groups/2bc8508a-7a3f-47ae-9bc8-a3a0c786b296 => generated 0 bytes in 1300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:08.155498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:08.173219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:08.184791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:08.185543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:08.186247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:08.188518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:08.189264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:08.189881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:08.222501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lazy-loading 'flavor' on Instance uuid b434829f-6f49-4804-af96-4061126f70a2 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:16:08.668707 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-becee98b-4e55-4bf1-9add-af7e4231449e tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action" status: 200 len: 32 microversion: 2.1 time: 0.538494 Oct 28 13:16:08.672064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1677/3265] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:08 2022] POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action => generated 32 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:16:08.678946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:08.683094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:08.699037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:08.700381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:08.707145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:08.708680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:08.709410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:08.710303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:08.989077 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50ba489f-2077-44d1-a296-959f9c3ca7f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.314726 Oct 28 13:16:08.990597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1678/3266] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:08 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:09.024483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:09.027686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:09.040811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:09.042234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:09.042985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:09.044077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:09.047932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:09.052441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:09.074715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:09.544200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:09.557148 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1db51876-7cbb-4e51-9838-031ef0bb19bb tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.563106 Oct 28 13:16:09.557148 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1679/3267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:08 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:09.581984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4748dbfe-f2e8-4358-950c-187b8affae9b tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Calling method '.version_select at 0x7f27b85fae50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:10.670373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4748dbfe-f2e8-4358-950c-187b8affae9b tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/520ff361-7d5c-4026-8317-a8d9ffa510e0" status: 202 len: 0 microversion: 2.1 time: 1.113384 Oct 28 13:16:10.673368 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1680/3268] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:09 2022] DELETE /compute/v2.1/os-security-groups/520ff361-7d5c-4026-8317-a8d9ffa510e0 => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:10.682166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:10.683033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:10.690091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:10.690773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:10.698069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:10.706074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:10.706981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:10.707614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:11.014784 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54c5e2c0-1c46-40ae-8e2d-293310b7e345 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/action" status: 202 len: 0 microversion: 2.1 time: 4.590780 Oct 28 13:16:11.015497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1589/3269] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:06 2022] POST /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/action => generated 0 bytes in 4594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:11.020946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:11.025273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:11.029734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:11.030222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:11.030670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:11.032721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:11.033528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:11.034135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:11.084580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:11.093600 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1345e60b-57a9-4519-98d1-c9e1a6bb5689 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.418875 Oct 28 13:16:11.114933 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1681/3270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:10 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:11.121004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:11.121623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:11.139614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:11.140107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:11.145064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:11.145967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:11.146437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:11.146893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:11.385377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:11.395194 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-acb494b5-ce59-4e49-8586-7d494ce21887 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1674 microversion: 2.1 time: 0.378712 Oct 28 13:16:11.397062 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1590/3271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:11 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1674 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:11.409222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-206f6735-b540-4bda-9550-ae80075f9c15 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Calling method '.version_select at 0x7f27b93c5b80>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:11.525010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:11.557420 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d7fa986-685a-4914-9afc-7f43e12244b5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.440899 Oct 28 13:16:11.558272 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1682/3272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:11 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:11.567674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:11.569859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:11.597244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:11.599291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:11.599847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:11.601609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:11.604833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:11.605386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:11.945009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:11.960963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c98c4c6f-13fe-4e80-9d52-de41648c0a7b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.401087 Oct 28 13:16:11.961880 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1683/3273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:11 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:12.122843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d60f3322-e777-46e5-b395-5af222b4ba15 req-a2315e79-8e6a-4948-8ecd-62c708defeaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c14e187-e2eb-4d72-b691-11b64a2772f3", "tag": "98cd6877-0115-4f83-9f8d-0ea86451adf4"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:12.141799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d60f3322-e777-46e5-b395-5af222b4ba15 req-a2315e79-8e6a-4948-8ecd-62c708defeaf service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:12.142287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d60f3322-e777-46e5-b395-5af222b4ba15 req-a2315e79-8e6a-4948-8ecd-62c708defeaf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:12.142717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d60f3322-e777-46e5-b395-5af222b4ba15 req-a2315e79-8e6a-4948-8ecd-62c708defeaf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:12.175239 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d60f3322-e777-46e5-b395-5af222b4ba15 req-a2315e79-8e6a-4948-8ecd-62c708defeaf service nova] Creating event network-changed:98cd6877-0115-4f83-9f8d-0ea86451adf4 for instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 on n-h2-862876-2 Oct 28 13:16:12.187880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d60f3322-e777-46e5-b395-5af222b4ba15 req-a2315e79-8e6a-4948-8ecd-62c708defeaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068579 Oct 28 13:16:12.192140 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1684/3274] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:16:12.207680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:12.208530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:12.225671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:12.226171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:12.226685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:12.227428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:12.227915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:12.228307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:12.333240 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-206f6735-b540-4bda-9550-ae80075f9c15 tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/8c3fee3d-659b-4fa2-9e2f-f88fb8162129" status: 202 len: 0 microversion: 2.1 time: 0.934885 Oct 28 13:16:12.333909 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1591/3275] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:11 2022] DELETE /compute/v2.1/os-security-groups/8c3fee3d-659b-4fa2-9e2f-f88fb8162129 => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:12.533948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5e4495f6-a46e-432f-97ae-be736e457bcd tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Action: 'create', calling method: .version_select at 0x7f27b93c5d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1665274540"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:12.858967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:13.007454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:13.024378 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fa811ae-d702-471d-b071-be6ff093fbea tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.830696 Oct 28 13:16:13.026227 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1685/3276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:12 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:13.032104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-079c3385-ecd5-47ac-8081-ba2ce07df6cb tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] Calling method '.version_select at 0x7f27b84d1e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:13.424303 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5e4495f6-a46e-432f-97ae-be736e457bcd tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.089342 Oct 28 13:16:13.425947 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1592/3277] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Oct 28 13:16:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1091 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 13:16:13.431130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:13.432756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:13.445458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:13.451492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:13.453086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:13.455901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:13.462067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:13.464637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:13.520116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:13.738734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:13.749780 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dc21d220-c0a2-4900-931c-c0d18713b874 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.322160 Oct 28 13:16:13.750387 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1593/3278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:13 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:13.766058 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-079c3385-ecd5-47ac-8081-ba2ce07df6cb tempest-SecurityGroupRulesNegativeTestJSON-1187960864 tempest-SecurityGroupRulesNegativeTestJSON-1187960864-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/04db38b4-5b99-4da8-a578-3252d01cf655" status: 202 len: 0 microversion: 2.1 time: 0.737977 Oct 28 13:16:13.766984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:13.767363 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1686/3279] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:13 2022] DELETE /compute/v2.1/os-security-groups/04db38b4-5b99-4da8-a578-3252d01cf655 => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:13.767759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:13.772762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:13.774607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:13.790443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:13.791545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:13.796081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:13.796081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:13.796081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:13.796081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:13.799581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:13.800097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:13.800554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:13.801280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:13.804192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:13.805789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:13.811518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:14.490160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:14.498997 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef93d7fa-d5d9-4e46-a415-1879bebda0d5 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.747000 Oct 28 13:16:14.499579 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1594/3280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:13 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:14.504395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea257244-d42f-4865-8b51-14f18cee0e6d tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b93c5f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:14.564656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:14.579376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-123a1583-3d1a-4bd0-8b76-cf7f7ffe3601 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.808604 Oct 28 13:16:14.579376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1687/3281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:13 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:14.585382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:14.589928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:14.597954 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea257244-d42f-4865-8b51-14f18cee0e6d tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 200 len: 345 microversion: 2.1 time: 0.097239 Oct 28 13:16:14.598830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1595/3282] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:16:14 2022] GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:14.629809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:14.629809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:14.629809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:14.629809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:14.629809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:14.629809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:14.685662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-89702d55-648c-4d6e-b44c-ac591fb16589 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27b8baf280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1357146543", "description": "tempest-description-1262776332"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:14.898432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:14.909237 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fab003b4-2c54-4bb3-9187-65d7eec70358 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.330123 Oct 28 13:16:14.911146 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1688/3283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:14 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:15.526193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:15.527227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:15.554903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:15.557638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:15.558316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:15.559380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:15.560071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:15.560709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:15.572933 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-89702d55-648c-4d6e-b44c-ac591fb16589 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.972799 Oct 28 13:16:15.573530 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1596/3284] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:15.597054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-55612fbb-0f28-4679-9d0d-d16b54eb15f5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27b93d4ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2142068437", "description": "tempest-description-1788454445"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:15.772358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:15.803496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ddca47b4-f700-4804-84fc-50e1f2527128 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.266525 Oct 28 13:16:15.803496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1689/3285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:15 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:15.803496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:15.806365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:15.839713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:15.840499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:15.841448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:15.842389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:15.844212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:15.845027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:16.288307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:16.298678 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-71ae5996-a12e-4756-b0f3-08b84f6f653c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.505235 Oct 28 13:16:16.307332 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1690/3286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:15 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:16.314669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48ea190e-276e-4b21-8be9-920eb5d5b974 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b85ef430>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:16.434524 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48ea190e-276e-4b21-8be9-920eb5d5b974 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 200 len: 346 microversion: 2.1 time: 0.129113 Oct 28 13:16:16.435724 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1691/3287] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:16:16 2022] GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:16.440710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:16.441527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:16.452189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:16.453045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:16.454100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:16.455035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:16.455656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:16.456271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:16.719108 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-55612fbb-0f28-4679-9d0d-d16b54eb15f5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.135826 Oct 28 13:16:16.720456 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1597/3288] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:15 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:16:16.731975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-758d467b-afe3-4ad9-b1b7-9f623a4dc430 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Action: 'create', calling method: .version_select at 0x7f27b8a59b80>, body: {"snapshot": {"volume_id": "4046cf65-f0e5-40f1-9746-d7c47f987825", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-207316289"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:16.763517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:16.788519 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b896da00-c298-4e7b-b9aa-202227f966de tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.338170 Oct 28 13:16:16.793485 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1692/3289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:16 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:16.811750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-401094474", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "858747b8-588f-4333-9d4c-f65e84504d5e"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:16.906325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] validate_networks() for [('858747b8-588f-4333-9d4c-f65e84504d5e', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:16:17.435280 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-758d467b-afe3-4ad9-b1b7-9f623a4dc430 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.713248 Oct 28 13:16:17.442782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1598/3290] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Oct 28 13:16:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:17.450273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:17.450972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:17.459332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:17.461018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:17.468069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:17.472467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:17.472467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:17.473517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:17.734354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:16:17.734912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:16:17.735621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:16:17.735902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:16:17.736482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:16:17.756620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:17.757965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:17.758525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:17.761194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:17.761674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:17.762109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:17.810984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Getting quotas for project 56d4361acebe4e51b86153651a68b957. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:16:17.829421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Getting quotas for user 47a3edc69b5e426b9e4434a60d95ab4c and project 56d4361acebe4e51b86153651a68b957. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:16:17.860151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:16:17.869470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:16:18.109784 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f524012-eb19-4a87-834f-4aab7c24031c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302204 Oct 28 13:16:18.113249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1693/3291] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:16:18.135290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:18.135290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:18.167796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:18.170070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:18.171223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:18.172973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:18.175590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:18.176223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:18.355366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:18.377364 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7494dca-119a-4a0f-93c4-e8afd37b07b8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.919981 Oct 28 13:16:18.377364 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1599/3292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:17 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:18.396059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad28679e-f2ed-4a44-8b19-64ad7c2fa6f0 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b9427700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:18.475276 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad28679e-f2ed-4a44-8b19-64ad7c2fa6f0 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 200 len: 286 microversion: 2.1 time: 0.102381 Oct 28 13:16:18.476277 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1600/3293] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:18 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:18.481747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:18.485553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:18.522509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:18.527428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:18.528405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:18.530808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:18.533341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:18.533895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:18.596724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:18.615485 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79e656e6-f1fc-4194-be2a-6c416b7fde76 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.497273 Oct 28 13:16:18.616479 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1694/3294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:18 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:18.625582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6bcc141-c833-463f-a261-654407981912 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:18.628739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6bcc141-c833-463f-a261-654407981912 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:18.748818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6bcc141-c833-463f-a261-654407981912 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:18.756170 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6bcc141-c833-463f-a261-654407981912 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1215 microversion: 2.1 time: 0.138108 Oct 28 13:16:18.761835 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1695/3295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:18 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:18.767486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07abffe5-082a-4f00-8925-34fbb62d6bcf tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b84d15e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:18.863438 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07abffe5-082a-4f00-8925-34fbb62d6bcf tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.100289 Oct 28 13:16:18.871028 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1696/3296] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Oct 28 13:16:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:18.876138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab1a4edd-eab5-4fdd-bd4b-e092baf2c640 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b8528f70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:18.924675 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab1a4edd-eab5-4fdd-bd4b-e092baf2c640 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 200 len: 286 microversion: 2.1 time: 0.052167 Oct 28 13:16:18.932314 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1697/3297] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:18 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:18.955513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:18.967371 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0defcdc7-ba0b-4533-92a2-43db1417794d tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.489861 Oct 28 13:16:18.990900 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1601/3298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:18 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:19.398522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:19.399189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:19.407515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:19.408843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:19.409505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:19.410381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:19.411131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:19.411727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:19.597439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:19.610858 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-97119d70-b9cc-4f8e-aed0-605afb2fe0d6 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.216286 Oct 28 13:16:19.611865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1698/3299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:19 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:19.642094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:19.643498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:19.652458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:19.653183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:19.653925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:19.655484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:19.656552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:19.657145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:19.781582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-672e44c2-58f9-4c4e-a61b-85bbf05d5acf tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:19.782212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-672e44c2-58f9-4c4e-a61b-85bbf05d5acf tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:19.862334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-672e44c2-58f9-4c4e-a61b-85bbf05d5acf tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:19.871520 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-672e44c2-58f9-4c4e-a61b-85bbf05d5acf tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1215 microversion: 2.1 time: 0.094383 Oct 28 13:16:19.875928 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1699/3300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:19 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:19.942333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0663d360-e216-4b8c-8c0c-955ca4a6d0c9 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b8528b80>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:20.003820 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0663d360-e216-4b8c-8c0c-955ca4a6d0c9 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 200 len: 286 microversion: 2.1 time: 0.070125 Oct 28 13:16:20.005469 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1700/3301] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:19 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:16:20.019331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:20.020040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:20.029997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:20.030683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:20.031373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:20.041554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:20.047730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:20.049971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:20.460868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:20.476424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-79c267d5-dfb6-46f7-b71c-d987f3be3047 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.838598 Oct 28 13:16:20.481962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1602/3302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:19 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:20.505876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:20.518904 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d1754215-ab61-4032-bff6-bc3cdc00c2d5 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.503536 Oct 28 13:16:20.520198 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1701/3303] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:20 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:20.651628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:20.651628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:20.651628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:20.651628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:20.651628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:20.654560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:20.655163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:20.655677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:20.907127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:20.907736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:20.919359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:20.919783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:20.920237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:20.920916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:20.921370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:20.925889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:21.015621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:21.033051 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d7a3087-f910-40b1-bf66-630e587f2521 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1211 microversion: 2.1 time: 0.128146 Oct 28 13:16:21.033947 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1702/3304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:20 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:21.045072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d403475-41e5-4406-8469-f7646a378130 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b84be160>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:21.100196 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d403475-41e5-4406-8469-f7646a378130 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 200 len: 287 microversion: 2.1 time: 0.064291 Oct 28 13:16:21.108364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1703/3305] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:21 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:21.115386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f94f8e3c-ae44-4f4e-be7c-279ae9826b14 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b84d1d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:21.159877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:21.179820 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25c727e8-52c1-45c3-948b-f603ee87be02 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.541705 Oct 28 13:16:21.197903 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1603/3306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:20 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:21.374075 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f94f8e3c-ae44-4f4e-be7c-279ae9826b14 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 202 len: 0 microversion: 2.1 time: 0.264226 Oct 28 13:16:21.374969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1704/3307] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Oct 28 13:16:21 2022] DELETE /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:21.383013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de192b43-6c71-428d-ae99-30bfe4f03eaf tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b8aa3280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:21.467085 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de192b43-6c71-428d-ae99-30bfe4f03eaf tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 200 len: 286 microversion: 2.1 time: 0.088042 Oct 28 13:16:21.468674 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1604/3308] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:21 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:21.504912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:21.505821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:21.523425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:21.524213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:21.526227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:21.527187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:21.529218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:21.543891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:21.545395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:21.552582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:21.566077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:21.566585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:21.567056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:21.568339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:21.568339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:21.568641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:21.852686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:21.865521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63bf78f1-8be6-477f-91cf-c5e2a657928e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.364481 Oct 28 13:16:21.866111 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1705/3309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:21 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:22.063671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:22.065096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:22.074722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:22.079189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:22.079189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:22.079189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:22.079189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:22.079189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:22.271835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:22.285070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd377ecd-34ad-4821-9fb9-99d80a75ceee tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1275 microversion: 2.1 time: 0.224023 Oct 28 13:16:22.285070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1706/3310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:22 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:22.289651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:22.290271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:22.298056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:22.298561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:22.299118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:22.300021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:22.300666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:22.301260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:22.322361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:22.482164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:22.490959 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ded44e8f-6faf-4fdd-9723-349cff4895c3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.205386 Oct 28 13:16:22.506876 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1707/3311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:22 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:22.506876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9daf89f-13f0-4772-9c0a-2daea1c3f71d tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b8523af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:22.552407 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9daf89f-13f0-4772-9c0a-2daea1c3f71d tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 200 len: 286 microversion: 2.1 time: 0.051258 Oct 28 13:16:22.553763 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1708/3312] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:22 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:22.893571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:22.894484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:22.903595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:22.904390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:22.905606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:22.907049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:22.907747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:22.908404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:22.917953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:22.930892 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5dc0aaa7-f058-4d8e-8730-97794f91e7b0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 1.390902 Oct 28 13:16:22.947470 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1605/3313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:21 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:22.958490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-89c33ace-04fb-4117-9cab-6630d1c0505e req-794c3cb1-a5ed-49c8-ad34-8c714bed5ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c14e187-e2eb-4d72-b691-11b64a2772f3", "name": "network-vif-plugged", "status": "completed", "tag": "98cd6877-0115-4f83-9f8d-0ea86451adf4"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:22.972018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-89c33ace-04fb-4117-9cab-6630d1c0505e req-794c3cb1-a5ed-49c8-ad34-8c714bed5ca9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:22.972845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-89c33ace-04fb-4117-9cab-6630d1c0505e req-794c3cb1-a5ed-49c8-ad34-8c714bed5ca9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:22.974113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-89c33ace-04fb-4117-9cab-6630d1c0505e req-794c3cb1-a5ed-49c8-ad34-8c714bed5ca9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:22.997971 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-89c33ace-04fb-4117-9cab-6630d1c0505e req-794c3cb1-a5ed-49c8-ad34-8c714bed5ca9 service nova] Creating event network-vif-plugged:98cd6877-0115-4f83-9f8d-0ea86451adf4 for instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 on n-h2-862876-2 Oct 28 13:16:23.010720 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-89c33ace-04fb-4117-9cab-6630d1c0505e req-794c3cb1-a5ed-49c8-ad34-8c714bed5ca9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061893 Oct 28 13:16:23.011962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1606/3314] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:23.216391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:23.230816 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a59fe5a9-3e82-44e9-addd-1af289fe98c0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.341033 Oct 28 13:16:23.231425 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1709/3315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:22 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:23.314121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:23.314886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:23.324043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:23.324877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:23.325572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:23.326294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:23.326778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:23.327219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:23.469707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:23.483845 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3e97e37-5dc5-4a2a-8abd-f346dbb91d23 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1273 microversion: 2.1 time: 0.173767 Oct 28 13:16:23.485725 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1607/3316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:23 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:23.519056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:23.519685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:23.528420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:23.529165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:23.529789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:23.530726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:23.531359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:23.531959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:23.565510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9b85f29-f501-45f4-94d0-66a63ade51aa tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b93f4790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:23.635320 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9b85f29-f501-45f4-94d0-66a63ade51aa tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 200 len: 286 microversion: 2.1 time: 0.072270 Oct 28 13:16:23.642016 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1608/3317] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:23 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:16:23.770321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:23.786645 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0413e489-0798-453c-9dee-31ebfff44a1c tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1364 microversion: 2.1 time: 0.275361 Oct 28 13:16:23.788400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1710/3318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:23 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:23.957820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:23.959348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:23.966974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:23.967729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:23.968377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:23.969289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:23.969992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:23.970632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:24.257245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:24.258051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:24.264855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:24.265344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:24.266021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:24.266835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:24.267300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:24.267759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:24.282139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:24.296737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5faa355d-e34a-4fec-96ec-41329c67d8e1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.343243 Oct 28 13:16:24.297263 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1609/3319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:23 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:24.515232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:24.515868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:24.525144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:24.531892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:24.532484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:24.533263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:24.533747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:24.534181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:24.646090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:24.660565 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-df4448a3-f9db-494f-afec-03a0c7febcec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.408180 Oct 28 13:16:24.678825 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1711/3320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:24 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:24.678825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc584512-fe04-4a53-8a85-d948cb46871b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b85443a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:24.698787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-dc584512-fe04-4a53-8a85-d948cb46871b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] HTTP exception thrown: Snapshot 0b7a088b-37ec-44a6-8d6a-a4b90b2f709c could not be found. Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc584512-fe04-4a53-8a85-d948cb46871b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Request method failure captured: Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c HTTP/1.1 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Yca8rxjELdO0LLDBHxyzCGI8APcdYO3eRc-zf-KdfQ7mY7v8FrwHwLzSRCjWF84NUiRLiYsLZ00zCMSPk9XASMTDGr6Hc3dVppHyA699iwLzhfKTBt5RWC-Dl6u4eUzLYKPnnmk0XyAJwKHj3IkxzOSMbE76BVmuTF1ATLotggUuM Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_568ab1fca92e4740b8adc6a673198fb9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a4ee9e235de246f98a838c0f268ce600 Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: exception: Snapshot 0b7a088b-37ec-44a6-8d6a-a4b90b2f709c could not be found. Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '0b7a088b-37ec-44a6-8d6a-a4b90b2f709c'} Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0b7a088b-37ec-44a6-8d6a-a4b90b2f709c could not be found. (HTTP 404) (Request-ID: req-41906119-4e53-47fe-9258-da30e6722271) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:16:24.716742 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0b7a088b-37ec-44a6-8d6a-a4b90b2f709c could not be found. Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0b7a088b-37ec-44a6-8d6a-a4b90b2f709c could not be found. Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0b7a088b-37ec-44a6-8d6a-a4b90b2f709c could not be found. Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc584512-fe04-4a53-8a85-d948cb46871b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Returning 404 to user: Snapshot 0b7a088b-37ec-44a6-8d6a-a4b90b2f709c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc584512-fe04-4a53-8a85-d948cb46871b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c" status: 404 len: 111 microversion: 2.1 time: 0.054136 Oct 28 13:16:24.721997 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1712/3321] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Oct 28 13:16:24 2022] GET /compute/v2.1/os-snapshots/0b7a088b-37ec-44a6-8d6a-a4b90b2f709c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:24.728496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1deab0b6-e086-4727-ac07-de3e3273a1f3 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b8536f70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:24.964538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:24.974618 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48f16a76-3ac8-40ed-8631-54db10310737 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.464904 Oct 28 13:16:24.975476 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1610/3322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:24 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:24.994298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:24.994964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:25.002120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.002976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.003708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:25.004733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.005411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.005930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:25.037681 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1deab0b6-e086-4727-ac07-de3e3273a1f3 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 202 len: 0 microversion: 2.1 time: 0.313110 Oct 28 13:16:25.039030 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1713/3323] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:16:24 2022] DELETE /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:25.049407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d2db4f0-ed94-4d76-9d8e-39cc1d7c6ed5 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b9f9b670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:25.116340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d2db4f0-ed94-4d76-9d8e-39cc1d7c6ed5 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 200 len: 345 microversion: 2.1 time: 0.072904 Oct 28 13:16:25.117858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1714/3324] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:16:25 2022] GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:25.273718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:25.287148 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aa7a6125-3cd6-4b8d-9425-37a53aff0913 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1554 microversion: 2.1 time: 0.299329 Oct 28 13:16:25.289344 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1611/3325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:24 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1554 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:25.313192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:25.318195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:25.324493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.326781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.327502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:25.329006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.330317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:25.331011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.331651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:25.332446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:25.344870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.354006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.354733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:25.355663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.356284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.356910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:25.500175 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be44010d-774d-42e0-aff0-43b882af39f8 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190890 Oct 28 13:16:25.501431 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1715/3326] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:16:25 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:25.526677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:25.540136 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-476e4c38-1fd7-4cd2-a7fd-457fd9617b39 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.220955 Oct 28 13:16:25.541244 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1612/3327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:25 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:25.687482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:25.688494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:25.696112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.696756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.697870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:25.698682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:25.699269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:25.699792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:26.002644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:26.007766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:26.018503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:26.019677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:26.020689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:26.022008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:26.022719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:26.024161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:26.307935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:26.323456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:26.325018 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2738c465-92fb-40c1-a207-d1e3fa712b12 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.641295 Oct 28 13:16:26.326122 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1716/3328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:25 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:26.330639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6bf4b2d2-ce0d-491e-a66e-fd1ca75f5c55 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b84d18b0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:26.407261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d7d09f05-e2d0-48ee-912d-340d9c52825f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.405815 Oct 28 13:16:26.412010 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1613/3329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:25 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:26.425766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a891262d-5904-4308-8151-e57dc6294f94 req-330b4998-53fd-4b52-b9ee-93612941af4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03be984-eb23-4b20-8dca-6cef4bb29936", "tag": "e8e622b8-bde4-43dc-8343-b0a04e32e363"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:26.463368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a891262d-5904-4308-8151-e57dc6294f94 req-330b4998-53fd-4b52-b9ee-93612941af4b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:26.464148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a891262d-5904-4308-8151-e57dc6294f94 req-330b4998-53fd-4b52-b9ee-93612941af4b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:26.465579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a891262d-5904-4308-8151-e57dc6294f94 req-330b4998-53fd-4b52-b9ee-93612941af4b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:26.501427 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a891262d-5904-4308-8151-e57dc6294f94 req-330b4998-53fd-4b52-b9ee-93612941af4b service nova] Creating event network-changed:e8e622b8-bde4-43dc-8343-b0a04e32e363 for instance c03be984-eb23-4b20-8dca-6cef4bb29936 on n-h1-862876-2 Oct 28 13:16:26.502309 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6bf4b2d2-ce0d-491e-a66e-fd1ca75f5c55 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 200 len: 345 microversion: 2.1 time: 0.175128 Oct 28 13:16:26.510420 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1717/3330] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:16:26 2022] GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:26.515763 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a891262d-5904-4308-8151-e57dc6294f94 req-330b4998-53fd-4b52-b9ee-93612941af4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102392 Oct 28 13:16:26.517268 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1614/3331] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:26.566866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:26.567561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:26.577888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:26.577888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:26.577888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:26.581995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:26.582488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:26.582959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:27.110586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:27.127124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6f89033-d6e0-4f8c-ae35-6a877f0d8312 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1523 microversion: 2.1 time: 0.558500 Oct 28 13:16:27.127124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1718/3332] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:26 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:27.354064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:27.354815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:27.371478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:27.377796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:27.377796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:27.377796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:27.377796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:27.377796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:27.441617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:27.442242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:27.453953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:27.454446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:27.458653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:27.462643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:27.465044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:27.466503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:27.655916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:27.667113 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bae8e702-926e-4413-b4d8-c61a92d27f6e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.318161 Oct 28 13:16:27.669209 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1615/3333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:27 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:27.676196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bb63b843-5439-4803-89eb-f4c0330579be tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27bdb05a60>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:27.745163 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bb63b843-5439-4803-89eb-f4c0330579be tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 200 len: 345 microversion: 2.1 time: 0.074629 Oct 28 13:16:27.745745 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1616/3334] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:16:27 2022] GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:27.790960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:28.014590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:28.026113 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7003f09-59eb-4861-8c35-800fdb6741f1 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.588291 Oct 28 13:16:28.026783 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1719/3335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:27 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:28.144778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:28.145401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:28.151685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:28.152187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:28.152633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:28.156657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:28.156657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:28.156657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:28.425815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-90a16b54-e33f-4ae3-976e-8031ec47d6ef req-5983885f-26c0-4f08-83be-3503b4ce6284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c14e187-e2eb-4d72-b691-11b64a2772f3", "tag": "98cd6877-0115-4f83-9f8d-0ea86451adf4"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:28.443937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90a16b54-e33f-4ae3-976e-8031ec47d6ef req-5983885f-26c0-4f08-83be-3503b4ce6284 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:28.445232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90a16b54-e33f-4ae3-976e-8031ec47d6ef req-5983885f-26c0-4f08-83be-3503b4ce6284 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:28.447472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90a16b54-e33f-4ae3-976e-8031ec47d6ef req-5983885f-26c0-4f08-83be-3503b4ce6284 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:28.464208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-90a16b54-e33f-4ae3-976e-8031ec47d6ef req-5983885f-26c0-4f08-83be-3503b4ce6284 service nova] Creating event network-changed:98cd6877-0115-4f83-9f8d-0ea86451adf4 for instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 on n-h2-862876-2 Oct 28 13:16:28.471410 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-90a16b54-e33f-4ae3-976e-8031ec47d6ef req-5983885f-26c0-4f08-83be-3503b4ce6284 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049286 Oct 28 13:16:28.476259 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1720/3336] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:16:28.555475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:28.567462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f027cfe4-a766-424c-8731-a14353b41b12 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1503 microversion: 2.1 time: 0.426651 Oct 28 13:16:28.569014 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1617/3337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:28 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:28.596790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76f4c1b1-162b-4736-b1e8-42539bf8c8e3 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'create', calling method: .version_select at 0x7f27b852c3a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1616489838", "description": "tempest-description-9470994"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:28.692905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:28.693932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:28.701400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:28.702190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:28.702858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:28.704220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:28.704922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:28.705876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:29.082156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:29.103842 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de6db8d2-46d3-4a5d-97db-b8685fc7d2ca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.414566 Oct 28 13:16:29.121667 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76f4c1b1-162b-4736-b1e8-42539bf8c8e3 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.529082 Oct 28 13:16:29.122463 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1618/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:28 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:29.124082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1721/3339] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:29.127501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec3ad338-0063-4d3c-b717-6772914929df tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b960af70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:29.145336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:29.146155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:29.151148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:29.155799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:29.156306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:29.158146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:29.159268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:29.160303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:29.160926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:29.196353 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ec3ad338-0063-4d3c-b717-6772914929df tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] HTTP exception thrown: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec3ad338-0063-4d3c-b717-6772914929df tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Request method failure captured: Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 HTTP/1.1 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Yca8rxjELdO0LLDBHxyzCGI8APcdYO3eRc-zf-KdfQ7mY7v8FrwHwLzSRCjWF84NUiRLiYsLZ00zCMSPk9XASMTDGr6Hc3dVppHyA699iwLzhfKTBt5RWC-Dl6u4eUzLYKPnnmk0XyAJwKHj3IkxzOSMbE76BVmuTF1ATLotggUuM Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_568ab1fca92e4740b8adc6a673198fb9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a4ee9e235de246f98a838c0f268ce600 Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: exception: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4046cf65-f0e5-40f1-9746-d7c47f987825'} Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. (HTTP 404) (Request-ID: req-b83730f1-8b0a-4151-a052-6794cab71815) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:16:29.199071 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec3ad338-0063-4d3c-b717-6772914929df tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Returning 404 to user: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec3ad338-0063-4d3c-b717-6772914929df tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 404 len: 109 microversion: 2.1 time: 0.076956 Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1619/3340] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:16:29 2022] GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:29.214443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1616489838"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:29.217831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:29.230924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:29.231434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:29.233528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:29.235424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:29.235927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:29.236375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:29.867642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:30.038473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.security_group_api [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Adding security group bd6aac55-bb77-4a31-abec-d10f5be79cea to port 042506e5-8b9e-46ff-8274-a344e5960077 Oct 28 13:16:30.075574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:30.092316 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1ed6cfa-d782-480e-bb5b-b4bcadc9c181 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.964037 Oct 28 13:16:30.096966 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1722/3341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:29 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:30.104314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef0a8550-5699-4af3-ae8f-5d93c4a1e57b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b849cf70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:30.142009 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ef0a8550-5699-4af3-ae8f-5d93c4a1e57b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] HTTP exception thrown: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef0a8550-5699-4af3-ae8f-5d93c4a1e57b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Request method failure captured: Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 HTTP/1.1 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Yca8rxjELdO0LLDBHxyzCGI8APcdYO3eRc-zf-KdfQ7mY7v8FrwHwLzSRCjWF84NUiRLiYsLZ00zCMSPk9XASMTDGr6Hc3dVppHyA699iwLzhfKTBt5RWC-Dl6u4eUzLYKPnnmk0XyAJwKHj3IkxzOSMbE76BVmuTF1ATLotggUuM Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_568ab1fca92e4740b8adc6a673198fb9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a4ee9e235de246f98a838c0f268ce600 Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: exception: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4046cf65-f0e5-40f1-9746-d7c47f987825'} Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. (HTTP 404) (Request-ID: req-6ce206f5-c9e2-4226-8520-27918841e899) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:16:30.149339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef0a8550-5699-4af3-ae8f-5d93c4a1e57b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Returning 404 to user: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef0a8550-5699-4af3-ae8f-5d93c4a1e57b tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 404 len: 109 microversion: 2.1 time: 0.052449 Oct 28 13:16:30.154792 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1723/3342] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:16:30 2022] DELETE /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:30.160633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:30.161241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:30.168450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:30.168967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:30.169406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:30.170107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:30.170858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:30.171462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:30.528339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:30.539323 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f069685-f26d-49a7-8353-9893827e0684 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.386787 Oct 28 13:16:30.558544 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1724/3343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:30 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:30.565105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07a5318b-69ff-473c-9361-3b7acf627668 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Calling method '.version_select at 0x7f27b8498ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:30.600940 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-07a5318b-69ff-473c-9361-3b7acf627668 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] HTTP exception thrown: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07a5318b-69ff-473c-9361-3b7acf627668 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Request method failure captured: Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 HTTP/1.1 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Yca8rxjELdO0LLDBHxyzCGI8APcdYO3eRc-zf-KdfQ7mY7v8FrwHwLzSRCjWF84NUiRLiYsLZ00zCMSPk9XASMTDGr6Hc3dVppHyA699iwLzhfKTBt5RWC-Dl6u4eUzLYKPnnmk0XyAJwKHj3IkxzOSMbE76BVmuTF1ATLotggUuM Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_568ab1fca92e4740b8adc6a673198fb9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/568ab1fca92e4740b8adc6a673198fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 568ab1fca92e4740b8adc6a673198fb9 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1718428676 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a4ee9e235de246f98a838c0f268ce600 Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1718428676-project Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: exception: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4046cf65-f0e5-40f1-9746-d7c47f987825'} Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. (HTTP 404) (Request-ID: req-aef56ac7-8ed7-45f2-bfbe-03bb97751f8c) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:16:30.604602 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. Oct 28 13:16:30.608872 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:30.615916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07a5318b-69ff-473c-9361-3b7acf627668 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] Returning 404 to user: Volume 4046cf65-f0e5-40f1-9746-d7c47f987825 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:30.616939 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07a5318b-69ff-473c-9361-3b7acf627668 tempest-VolumesSnapshotsTestJSON-1718428676 tempest-VolumesSnapshotsTestJSON-1718428676-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825" status: 404 len: 109 microversion: 2.1 time: 0.057025 Oct 28 13:16:30.617751 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1725/3344] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:16:30 2022] GET /compute/v2.1/os-volumes/4046cf65-f0e5-40f1-9746-d7c47f987825 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:30.804876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-cb1e9561-7605-4114-a4f3-b57aff387bed req-ea211266-fdd3-401b-91d6-eb3b9c640333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a15c03-700a-4a6f-8ee3-7edae4920b25", "name": "network-vif-unplugged", "status": "completed", "tag": "caf3b258-7c32-47dc-9e6a-0430cbac695f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:30.817460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cb1e9561-7605-4114-a4f3-b57aff387bed req-ea211266-fdd3-401b-91d6-eb3b9c640333 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:30.818032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cb1e9561-7605-4114-a4f3-b57aff387bed req-ea211266-fdd3-401b-91d6-eb3b9c640333 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:30.818685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cb1e9561-7605-4114-a4f3-b57aff387bed req-ea211266-fdd3-401b-91d6-eb3b9c640333 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:30.833450 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-cb1e9561-7605-4114-a4f3-b57aff387bed req-ea211266-fdd3-401b-91d6-eb3b9c640333 service nova] Creating event network-vif-unplugged:caf3b258-7c32-47dc-9e6a-0430cbac695f for instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 on n-h1-862876-2 Oct 28 13:16:30.841706 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-cb1e9561-7605-4114-a4f3-b57aff387bed req-ea211266-fdd3-401b-91d6-eb3b9c640333 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042887 Oct 28 13:16:30.843049 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1726/3345] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:16:31.043599 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-958977b1-cac7-475b-8a42-019ccf4828f0 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action" status: 202 len: 0 microversion: 2.1 time: 1.839000 Oct 28 13:16:31.050149 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1620/3346] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:29 2022] POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action => generated 0 bytes in 1847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:31.055206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1616489838"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:31.055962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:31.067253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:31.068943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:31.071626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:31.073847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:31.075235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:31.077069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:31.128649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:31.130057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:31.141688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:31.142191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:31.142634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:31.143374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:31.143839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:31.146721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:31.173857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:31.264809 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.network.security_group_api [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Removing security group bd6aac55-bb77-4a31-abec-d10f5be79cea from port 042506e5-8b9e-46ff-8274-a344e5960077 Oct 28 13:16:31.468186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:31.479736 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3eccad50-307e-4a44-8287-84f709663e7f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.360233 Oct 28 13:16:31.480325 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1621/3347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:31 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:31.566194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:31.568734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:31.580538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:31.581070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:31.581519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:31.582250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:31.582709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:31.583161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:31.769815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:31.792463 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0ed94668-5916-40a1-ae1c-5a88c3870bb4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.230716 Oct 28 13:16:31.793564 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1622/3348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:31 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:31.899936 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9729bbd-824e-4767-8a05-a859b33db396 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action" status: 202 len: 0 microversion: 2.1 time: 0.843952 Oct 28 13:16:31.899936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1727/3349] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:31 2022] POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:31.905807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f1a1909-3eba-498a-b149-119442e23e59 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'create', calling method: .version_select at 0x7f27b9386b80>, body: {"pool": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:31.909482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-46e286fa-7b8a-4832-b147-080d7d21e0d2 req-6002c57e-485f-49fb-888f-56438391e0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b434829f-6f49-4804-af96-4061126f70a2", "tag": "042506e5-8b9e-46ff-8274-a344e5960077"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:31.920038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46e286fa-7b8a-4832-b147-080d7d21e0d2 req-6002c57e-485f-49fb-888f-56438391e0e2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:31.920762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46e286fa-7b8a-4832-b147-080d7d21e0d2 req-6002c57e-485f-49fb-888f-56438391e0e2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:31.921598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46e286fa-7b8a-4832-b147-080d7d21e0d2 req-6002c57e-485f-49fb-888f-56438391e0e2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:31.935262 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-46e286fa-7b8a-4832-b147-080d7d21e0d2 req-6002c57e-485f-49fb-888f-56438391e0e2 service nova] Creating event network-changed:042506e5-8b9e-46ff-8274-a344e5960077 for instance b434829f-6f49-4804-af96-4061126f70a2 on n-h1-862876-2 Oct 28 13:16:31.942701 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-46e286fa-7b8a-4832-b147-080d7d21e0d2 req-6002c57e-485f-49fb-888f-56438391e0e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036411 Oct 28 13:16:31.944191 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1728/3350] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:16:32.513049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:32.522174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:32.544236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:32.547852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:32.560540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:32.560540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:32.560540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:32.560540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:32.766243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:32.779153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-22ecd410-9991-4ff7-94a8-33061f66facb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.278334 Oct 28 13:16:32.781259 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1729/3351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:32 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:32.820519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:32.821243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:32.829168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:32.830026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:32.830647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:32.831650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:32.832311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:32.832929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:33.086982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:33.142014 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d1efb697-e7e6-41d9-9def-23c01fadfca3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.325050 Oct 28 13:16:33.143135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1730/3352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:32 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:33.150947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8b90d537-e8df-4561-8f56-59bf0925690c req-f0fc3fd7-fc65-4169-a3ae-297939358ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b434829f-6f49-4804-af96-4061126f70a2", "tag": "042506e5-8b9e-46ff-8274-a344e5960077"}, {"name": "network-changed", "server_uuid": "15a15c03-700a-4a6f-8ee3-7edae4920b25", "tag": "caf3b258-7c32-47dc-9e6a-0430cbac695f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:33.168764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8b90d537-e8df-4561-8f56-59bf0925690c req-f0fc3fd7-fc65-4169-a3ae-297939358ccd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:33.169516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8b90d537-e8df-4561-8f56-59bf0925690c req-f0fc3fd7-fc65-4169-a3ae-297939358ccd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:33.170100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8b90d537-e8df-4561-8f56-59bf0925690c req-f0fc3fd7-fc65-4169-a3ae-297939358ccd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:33.216408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8b90d537-e8df-4561-8f56-59bf0925690c req-f0fc3fd7-fc65-4169-a3ae-297939358ccd service nova] Creating event network-changed:042506e5-8b9e-46ff-8274-a344e5960077 for instance b434829f-6f49-4804-af96-4061126f70a2 on n-h1-862876-2 Oct 28 13:16:33.217054 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8b90d537-e8df-4561-8f56-59bf0925690c req-f0fc3fd7-fc65-4169-a3ae-297939358ccd service nova] Creating event network-changed:caf3b258-7c32-47dc-9e6a-0430cbac695f for instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 on n-h1-862876-2 Oct 28 13:16:33.228626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8b90d537-e8df-4561-8f56-59bf0925690c req-f0fc3fd7-fc65-4169-a3ae-297939358ccd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082663 Oct 28 13:16:33.229340 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1731/3353] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:33.828127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:33.828993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:33.851826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:33.853096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:33.854482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:33.856486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:33.857053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:33.858359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:34.065596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:34.077882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-118938a3-9871-4328-ab1b-91b0698c4c93 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.265388 Oct 28 13:16:34.078965 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1732/3354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:33 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:34.167748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:34.169149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:34.176489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:34.177170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:34.178163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:34.179240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:34.179914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:34.183257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:34.381934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:34.398326 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-852390ac-e7ce-476d-a3c7-12ee0b6aeef9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.236528 Oct 28 13:16:34.399480 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1733/3355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:34 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:34.420271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-350e9996-be1e-45a6-8391-e6d097a2916d req-24777e9a-2895-472d-855c-5922abb7a743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03be984-eb23-4b20-8dca-6cef4bb29936", "name": "network-vif-plugged", "status": "completed", "tag": "e8e622b8-bde4-43dc-8343-b0a04e32e363"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:34.435810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-350e9996-be1e-45a6-8391-e6d097a2916d req-24777e9a-2895-472d-855c-5922abb7a743 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:34.436711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-350e9996-be1e-45a6-8391-e6d097a2916d req-24777e9a-2895-472d-855c-5922abb7a743 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:34.437325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-350e9996-be1e-45a6-8391-e6d097a2916d req-24777e9a-2895-472d-855c-5922abb7a743 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:34.456946 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-350e9996-be1e-45a6-8391-e6d097a2916d req-24777e9a-2895-472d-855c-5922abb7a743 service nova] Creating event network-vif-plugged:e8e622b8-bde4-43dc-8343-b0a04e32e363 for instance c03be984-eb23-4b20-8dca-6cef4bb29936 on n-h1-862876-2 Oct 28 13:16:34.464186 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-350e9996-be1e-45a6-8391-e6d097a2916d req-24777e9a-2895-472d-855c-5922abb7a743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050961 Oct 28 13:16:34.465532 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1734/3356] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:35.101898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:35.102596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:35.111039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:35.115653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:35.116436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:35.117378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:35.117841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:35.118264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:35.329065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:35.348719 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-133dbf5c-df8f-4dc9-9e31-41fc3c66ca24 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.249505 Oct 28 13:16:35.354064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1735/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:35 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:35.425622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:35.426230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:35.434064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:35.437303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:35.442519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:35.443564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:35.444190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:35.444963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:35.452879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:35.660438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:35.674105 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ecf23b6e-a032-4778-8296-a28b7c055691 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.252743 Oct 28 13:16:35.676192 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1736/3358] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:35 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:36.377769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:36.377769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:36.385766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:36.386254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:36.390904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:36.391870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:36.402896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:36.402896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:36.562172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:36.570070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd43c444-5cde-45cc-a474-978da54861cb tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1315 microversion: 2.1 time: 0.197851 Oct 28 13:16:36.570665 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1737/3359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:36 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:36.699209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:36.700059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:36.706633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:36.707162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:36.707599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:36.708307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:36.708763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:36.709189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:36.969810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:36.977644 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0d58195-c57f-4fa9-a340-264b80244eaf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.282634 Oct 28 13:16:36.992658 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1738/3360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:36 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:37.291866 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f1a1909-3eba-498a-b149-119442e23e59 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.391070 Oct 28 13:16:37.292667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1623/3361] 10.222.0.25 () {60 vars in 1170 bytes} [Fri Oct 28 13:16:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:37.305661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.170"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:37.308377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:37.314457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:37.314977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:37.315416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:37.321187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:37.321187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:37.321187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:37.345206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "refresh_cache-b434829f-6f49-4804-af96-4061126f70a2" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:16:37.345695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquired lock "refresh_cache-b434829f-6f49-4804-af96-4061126f70a2" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:16:37.596177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:37.597033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:37.603773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=55 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:37.605816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:37.606547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:37.607126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:37.608062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:37.608594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:37.609113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:38.379005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:38.394590 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aad1e8d8-8825-44a5-b68b-61af5f538d9a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1503 microversion: 2.1 time: 0.803317 Oct 28 13:16:38.400253 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1624/3362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:37 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1503 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:38.412211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:38.418018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:38.439417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:38.442083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:38.442546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:38.445240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:38.445913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:38.449977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:38.670307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Building network info cache for instance {{(pid=127793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:16:38.873212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:38.881964 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-34ca4398-321d-4291-861d-8f4db8d8a248 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.480494 Oct 28 13:16:38.887060 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1625/3363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:38 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:38.892260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1357146543"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:38.892803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:38.910532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:38.916049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:38.916049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:38.916049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:38.916049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:38.916049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:39.152462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.security_group_api [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Adding security group 827cc53d-b2ca-4c42-b4db-f14f59d0e264 to port e8e622b8-bde4-43dc-8343-b0a04e32e363 Oct 28 13:16:40.084223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e8cb9bb7-6166-4a87-b1dc-79b84db7f4aa tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936/action" status: 202 len: 0 microversion: 2.1 time: 1.196018 Oct 28 13:16:40.087826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1626/3364] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:38 2022] POST /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936/action => generated 0 bytes in 1197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:40.091312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a984b652-4cbb-4ffa-b866-efafa520c2ad req-4a78ccbf-e1e6-4c5e-8d46-88dc1b0934b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b434829f-6f49-4804-af96-4061126f70a2", "tag": "042506e5-8b9e-46ff-8274-a344e5960077"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:40.131068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a984b652-4cbb-4ffa-b866-efafa520c2ad req-4a78ccbf-e1e6-4c5e-8d46-88dc1b0934b8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:40.133379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a984b652-4cbb-4ffa-b866-efafa520c2ad req-4a78ccbf-e1e6-4c5e-8d46-88dc1b0934b8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:40.133379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a984b652-4cbb-4ffa-b866-efafa520c2ad req-4a78ccbf-e1e6-4c5e-8d46-88dc1b0934b8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:40.173136 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a984b652-4cbb-4ffa-b866-efafa520c2ad req-4a78ccbf-e1e6-4c5e-8d46-88dc1b0934b8 service nova] Creating event network-changed:042506e5-8b9e-46ff-8274-a344e5960077 for instance b434829f-6f49-4804-af96-4061126f70a2 on n-h1-862876-2 Oct 28 13:16:40.191122 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a984b652-4cbb-4ffa-b866-efafa520c2ad req-4a78ccbf-e1e6-4c5e-8d46-88dc1b0934b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103166 Oct 28 13:16:40.192078 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1627/3365] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:40.221117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:40.221914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:40.243995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:40.251809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:40.253739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:40.255599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:40.259370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:40.260170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:40.677364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:40.689650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4662c9e7-9369-4adb-89d1-27c216881917 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.494659 Oct 28 13:16:40.700538 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1628/3366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:40 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:40.719162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2142068437"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:40.720169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:40.726435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:40.730958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:40.732054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:40.732978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:40.736591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:40.737254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:41.120745 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.security_group_api [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Adding security group 992fc407-375c-4763-ba3f-bbceb5f756d0 to port e8e622b8-bde4-43dc-8343-b0a04e32e363 Oct 28 13:16:41.131253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Updating instance_info_cache with network_info: [{"id": "042506e5-8b9e-46ff-8274-a344e5960077", "address": "fa:16:3e:30:62:e1", "network": {"id": "dd6566b8-2ff4-4880-84e7-4468a87bad78", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-796853857-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0f756dcc3ef24ca98d40410e48639a7b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap042506e5-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:16:41.217317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Releasing lock "refresh_cache-b434829f-6f49-4804-af96-4061126f70a2" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:16:41.219825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8c68d5d-9d29-4a74-92a1-405bcc7ac80f tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action" status: 202 len: 0 microversion: 2.1 time: 3.918308 Oct 28 13:16:41.220998 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1739/3367] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:37 2022] POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action => generated 0 bytes in 3920 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 28 13:16:41.227776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3df14df8-fc20-4333-98c7-269f1e2affae req-83e55b37-a97f-424f-91f5-a6f19615a6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03be984-eb23-4b20-8dca-6cef4bb29936", "tag": "e8e622b8-bde4-43dc-8343-b0a04e32e363"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:41.253631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3df14df8-fc20-4333-98c7-269f1e2affae req-83e55b37-a97f-424f-91f5-a6f19615a6e1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:41.254562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3df14df8-fc20-4333-98c7-269f1e2affae req-83e55b37-a97f-424f-91f5-a6f19615a6e1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:41.255216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3df14df8-fc20-4333-98c7-269f1e2affae req-83e55b37-a97f-424f-91f5-a6f19615a6e1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:41.282080 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3df14df8-fc20-4333-98c7-269f1e2affae req-83e55b37-a97f-424f-91f5-a6f19615a6e1 service nova] Creating event network-changed:e8e622b8-bde4-43dc-8343-b0a04e32e363 for instance c03be984-eb23-4b20-8dca-6cef4bb29936 on n-h1-862876-2 Oct 28 13:16:41.292997 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3df14df8-fc20-4333-98c7-269f1e2affae req-83e55b37-a97f-424f-91f5-a6f19615a6e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070591 Oct 28 13:16:41.295577 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1740/3368] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:41.305038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.170"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:41.644266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:41.655412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:41.656289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:41.656980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:41.657997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:41.658682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:41.659312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:42.201874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "refresh_cache-b434829f-6f49-4804-af96-4061126f70a2" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 13:16:42.204877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquired lock "refresh_cache-b434829f-6f49-4804-af96-4061126f70a2" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 13:16:42.572332 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8e3be61-7ae4-475c-985f-a6083dde7ef0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936/action" status: 202 len: 0 microversion: 2.1 time: 1.870075 Oct 28 13:16:42.575754 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1629/3369] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:40 2022] POST /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936/action => generated 0 bytes in 1874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:42.587444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:42.592506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:42.596852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:42.605654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:42.606795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:42.607756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:42.608424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:42.609232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:43.497458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:43.508384 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d80959f-919a-4247-8bf0-e234dfe00a38 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.930550 Oct 28 13:16:43.512380 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1630/3370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:42 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:43.534320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:43.539572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:43.551983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:43.552493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:43.553223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:43.554057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:43.554593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:43.555176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:43.992820 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3f57c109-b807-4731-b16b-5818243fe432 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.479096 Oct 28 13:16:43.995241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1631/3371] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Oct 28 13:16:43 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936/os-security-groups => generated 1159 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:44.001603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bf75e443-3a98-4345-abb8-fc079249fd69 req-c8177ec6-3911-4ae0-9404-a22cd71383a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03be984-eb23-4b20-8dca-6cef4bb29936", "tag": "e8e622b8-bde4-43dc-8343-b0a04e32e363"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:44.027757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bf75e443-3a98-4345-abb8-fc079249fd69 req-c8177ec6-3911-4ae0-9404-a22cd71383a2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:44.028549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bf75e443-3a98-4345-abb8-fc079249fd69 req-c8177ec6-3911-4ae0-9404-a22cd71383a2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:44.029234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bf75e443-3a98-4345-abb8-fc079249fd69 req-c8177ec6-3911-4ae0-9404-a22cd71383a2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:44.046725 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bf75e443-3a98-4345-abb8-fc079249fd69 req-c8177ec6-3911-4ae0-9404-a22cd71383a2 service nova] Creating event network-changed:e8e622b8-bde4-43dc-8343-b0a04e32e363 for instance c03be984-eb23-4b20-8dca-6cef4bb29936 on n-h1-862876-2 Oct 28 13:16:44.058811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bf75e443-3a98-4345-abb8-fc079249fd69 req-c8177ec6-3911-4ae0-9404-a22cd71383a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059783 Oct 28 13:16:44.061235 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1632/3372] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:44.095163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-68547088-67b1-4cb6-b561-347384460b5d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27bdb089d0>, body: {"security_group": {"name": " tempest-securitygroup -1826840727 ", "description": "tempest-description-140403648"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:45.205043 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-68547088-67b1-4cb6-b561-347384460b5d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.141936 Oct 28 13:16:45.209727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Building network info cache for instance {{(pid=127793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 13:16:45.210266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1633/3373] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:44 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:45.218377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:45.235012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:45.264840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:45.265535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:45.266501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:45.267556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:45.268213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:45.269316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:45.940919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:45.951123 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86d4f209-c93f-49fb-8cd1-85077123fcb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1719 microversion: 2.1 time: 0.739332 Oct 28 13:16:45.951945 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1634/3374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:45 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1719 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:45.957135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1bdfe636-2c31-48eb-9cd4-0220a71af5ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bd9fcee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:46.106027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1bdfe636-2c31-48eb-9cd4-0220a71af5ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f" status: 200 len: 223 microversion: 2.1 time: 0.152834 Oct 28 13:16:46.107166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1635/3375] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:16:45 2022] GET /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f => generated 223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:46.112357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e2207921-b3f5-46bb-bba6-a1ef075e02c4 req-e63680b8-c1bb-42c9-a5cf-7d7a67241138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b434829f-6f49-4804-af96-4061126f70a2", "tag": "042506e5-8b9e-46ff-8274-a344e5960077"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:46.137907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2207921-b3f5-46bb-bba6-a1ef075e02c4 req-e63680b8-c1bb-42c9-a5cf-7d7a67241138 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:46.140937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2207921-b3f5-46bb-bba6-a1ef075e02c4 req-e63680b8-c1bb-42c9-a5cf-7d7a67241138 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:46.145615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2207921-b3f5-46bb-bba6-a1ef075e02c4 req-e63680b8-c1bb-42c9-a5cf-7d7a67241138 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:46.171013 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e2207921-b3f5-46bb-bba6-a1ef075e02c4 req-e63680b8-c1bb-42c9-a5cf-7d7a67241138 service nova] Creating event network-changed:042506e5-8b9e-46ff-8274-a344e5960077 for instance b434829f-6f49-4804-af96-4061126f70a2 on n-h1-862876-2 Oct 28 13:16:46.176715 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e2207921-b3f5-46bb-bba6-a1ef075e02c4 req-e63680b8-c1bb-42c9-a5cf-7d7a67241138 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068108 Oct 28 13:16:46.177688 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1636/3376] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:46.185464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:46.187764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:46.198907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:46.198907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:46.198907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:46.199538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:46.201007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:46.201691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:46.816925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:46.849876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37c16088-e23f-4e29-ae0b-824ee6ecfa03 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.667647 Oct 28 13:16:46.862180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1637/3377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:46 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:46.869773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59ac70d6-151a-4a81-81ee-5a02bf0fa0f0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bdb05160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:46.908964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Updating instance_info_cache with network_info: [{"id": "042506e5-8b9e-46ff-8274-a344e5960077", "address": "fa:16:3e:30:62:e1", "network": {"id": "dd6566b8-2ff4-4880-84e7-4468a87bad78", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-796853857-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0f756dcc3ef24ca98d40410e48639a7b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap042506e5-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:16:47.042177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Releasing lock "refresh_cache-b434829f-6f49-4804-af96-4061126f70a2" {{(pid=127793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 13:16:47.043790 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6fd25a9f-8e44-4589-a8b6-3b74b0fce565 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action" status: 202 len: 0 microversion: 2.1 time: 5.746764 Oct 28 13:16:47.044615 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1741/3378] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:16:41 2022] POST /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2/action => generated 0 bytes in 5748 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 13:16:47.055940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:47.057234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:47.085661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:47.086176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:47.086618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:47.087987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:47.088522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:47.088954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:47.340242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:47.358070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9614d12e-fb8f-47ca-83ef-44ae77d58a2c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.311999 Oct 28 13:16:47.364364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1742/3379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:47 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:47.384226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:47.386234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:47.419215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:47.419965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:47.422650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:47.423613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:47.424324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:47.425922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:47.684436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:47.698511 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d697014-d0c9-4f9c-baab-6dcf8e28614a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1709 microversion: 2.1 time: 0.330569 Oct 28 13:16:47.707001 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1743/3380] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:47 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1709 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:47.727876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-653aee88-9f55-4dd5-8934-c70ea768ef51 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '.version_select at 0x7f27b8544ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:48.686206 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59ac70d6-151a-4a81-81ee-5a02bf0fa0f0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f" status: 202 len: 0 microversion: 2.1 time: 1.822412 Oct 28 13:16:48.686943 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1638/3381] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:46 2022] DELETE /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f => generated 0 bytes in 1824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:48.697744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:48.699615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:48.717047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:48.718467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:48.719577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:48.720692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:48.723774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:48.724505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:49.074266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:49.088477 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a32ce11-0c8f-45fc-b8d1-b27c18a11246 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.394716 Oct 28 13:16:49.090872 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1639/3382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:48 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:49.124763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83ea5961-119a-4872-af81-e2b431fd8a61 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '.version_select at 0x7f27bdb08dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:49.135664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ea5961-119a-4872-af81-e2b431fd8a61 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:49.136500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ea5961-119a-4872-af81-e2b431fd8a61 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:49.137179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ea5961-119a-4872-af81-e2b431fd8a61 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:49.157405 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83ea5961-119a-4872-af81-e2b431fd8a61 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.052216 Oct 28 13:16:49.160607 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1640/3383] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:16:49 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:49.173682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb1dcefd-8c27-47d3-875f-8a27b4114a53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b960a430>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:49.215335 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-653aee88-9f55-4dd5-8934-c70ea768ef51 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/43422aa9-2594-448c-81d9-a29d6b63e8d5" status: 202 len: 0 microversion: 2.1 time: 1.498152 Oct 28 13:16:49.220241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1744/3384] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:16:47 2022] DELETE /compute/v2.1/os-floating-ips/43422aa9-2594-448c-81d9-a29d6b63e8d5 => generated 0 bytes in 1514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:49.223369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:49.224254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:49.235703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-fb1dcefd-8c27-47d3-875f-8a27b4114a53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:16:49.240342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-fb1dcefd-8c27-47d3-875f-8a27b4114a53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 0177b883-5e52-4d7c-8a74-3789a41f373f not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:16:49.241925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:49.242055 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-fb1dcefd-8c27-47d3-875f-8a27b4114a53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:16:49.242055 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-dbda1518-8bd5-4757-98e1-b5028be46b18'] Oct 28 13:16:49.242301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:49.242690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:49.244027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:49.245505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:49.246796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb1dcefd-8c27-47d3-875f-8a27b4114a53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f HTTP/1.1 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-dbda1518-8bd5-4757-98e1-b5028be46b18'] Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '0177b883-5e52-4d7c-8a74-3789a41f373f'} Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:16:49.246946 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbda1518-8bd5-4757-98e1-b5028be46b18'] Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbda1518-8bd5-4757-98e1-b5028be46b18'] Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbda1518-8bd5-4757-98e1-b5028be46b18'] Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbda1518-8bd5-4757-98e1-b5028be46b18'] Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb1dcefd-8c27-47d3-875f-8a27b4114a53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:16:49.252213 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-dbda1518-8bd5-4757-98e1-b5028be46b18'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:49.257008 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb1dcefd-8c27-47d3-875f-8a27b4114a53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f" status: 404 len: 194 microversion: 2.1 time: 0.087592 Oct 28 13:16:49.258666 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1641/3385] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:16:49 2022] GET /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:49.265800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:49.266516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:49.275498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:49.276337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:49.276993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:49.278663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:49.279459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:49.280088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:49.628826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:49.638579 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1a72a30-fadb-423e-9b4f-d2a867a15fae tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.420922 Oct 28 13:16:49.642949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1745/3386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:49 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:49.655955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-deee9e90-f483-4dcf-8b95-26da4b5c2c75 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '.version_select at 0x7f27b9501af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:49.662086 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1cb6ebc8-1d68-445e-92e1-c486ac43e541 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1860 microversion: 2.1 time: 0.398929 Oct 28 13:16:49.682933 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1642/3387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:49 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1860 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:49.695926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0afb7db-f33b-4c05-91f8-2d855af93e78 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27bdadeee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1145019276", "description": "tempest-description-684391653"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:50.101137 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-deee9e90-f483-4dcf-8b95-26da4b5c2c75 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/bd6aac55-bb77-4a31-abec-d10f5be79cea" status: 202 len: 0 microversion: 2.1 time: 0.456032 Oct 28 13:16:50.102499 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1746/3388] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:49 2022] DELETE /compute/v2.1/os-security-groups/bd6aac55-bb77-4a31-abec-d10f5be79cea => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:50.130603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:50.131717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:50.146935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:50.149346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:50.150341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:50.152272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:50.152951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:50.154628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:50.388700 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c0afb7db-f33b-4c05-91f8-2d855af93e78 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.693901 Oct 28 13:16:50.391401 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1643/3389] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:50.405290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1488959685", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a6d79be4-5785-49f8-a61c-931d9498eb9a"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:50.413160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70d0472b-9e66-4e71-b365-58db835503f0 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1860 microversion: 2.1 time: 0.307965 Oct 28 13:16:50.417239 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1747/3390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:50 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1860 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:50.428593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:50.429442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:50.452744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:50.453239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:50.453672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:50.454447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:50.457251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:50.457942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:50.485671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] validate_networks() for [('a6d79be4-5785-49f8-a61c-931d9498eb9a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:16:50.528437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:16:50.933705 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf1d912a-c3da-4e0c-9ccb-98dcae9ec9f1 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 204 len: 0 microversion: 2.1 time: 0.509379 Oct 28 13:16:50.934444 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1748/3391] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:16:50 2022] DELETE /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:16:50.944125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4256d59-1fcc-4c49-9a14-801eec08f37b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27b84381f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-427073033", "description": "tempest-description-1108500387"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:51.076171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:16:51.076639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:16:51.083638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:16:51.083638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:16:51.083638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:16:51.087284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:51.087775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:51.088211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:51.089072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:51.089771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:51.090201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:51.109307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:16:51.117761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for user d70178138d974c20bb9598de42bd3294 and project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:16:51.130844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:16:51.134788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:16:51.313973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3e6038d4-9af6-4a49-b114-8aacf6bac80d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917512 Oct 28 13:16:51.316139 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1644/3392] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:16:51.325661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:51.328127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:51.341027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:51.341948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:51.342585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:51.343582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:51.344491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:51.345092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:51.471188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lazy-loading 'services' on Instance uuid 15a15c03-700a-4a6f-8ee3-7edae4920b25 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:16:51.716566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4256d59-1fcc-4c49-9a14-801eec08f37b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.780682 Oct 28 13:16:51.717849 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1749/3393] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:51.722820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:51.723813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:51.736242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:51.737074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:51.740171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:51.741203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:51.741905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:51.742550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:51.789704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-258ccdd8-6418-4cb3-9041-138afe832391 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "DELETE /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments/c10171bd-b471-4dde-895b-eb02963952c9" status: 202 len: 0 microversion: 2.1 time: 0.471948 Oct 28 13:16:51.791013 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1645/3394] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:16:51 2022] DELETE /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments/c10171bd-b471-4dde-895b-eb02963952c9 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:51.826564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbf884ce-4d59-4844-bb12-da3b853450d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:51.834182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cbf884ce-4d59-4844-bb12-da3b853450d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:52.088260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:52.098338 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-493dfb49-f94a-4b08-b0dc-b71af382ce2a tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1509 microversion: 2.1 time: 0.378959 Oct 28 13:16:52.100452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1750/3395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:51 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:52.109397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-916c034c-e247-43da-8443-ce831967942f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27b86ad550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1825831538", "description": "tempest-description-245814712"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:52.179329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cbf884ce-4d59-4844-bb12-da3b853450d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:52.204822 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cbf884ce-4d59-4844-bb12-da3b853450d8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1215 microversion: 2.1 time: 0.396396 Oct 28 13:16:52.204822 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1646/3396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:51 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:52.204822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:52.204822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:52.214618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:52.215153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:52.215596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:52.216316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:52.216777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:52.217209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:52.285538 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-930a44bb-c7cc-4df2-bd8d-d6b863eda3e3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094710 Oct 28 13:16:52.290986 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1647/3397] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:16:52 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:52.906000 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-916c034c-e247-43da-8443-ce831967942f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.803899 Oct 28 13:16:52.907703 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1751/3398] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:16:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:52.921459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7ce5419-3315-46d4-a9fe-4ad6c43a1f3f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b93c5310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:53.142585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:53.142585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:53.169460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:53.172896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:53.177148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:53.178289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:53.184981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:53.187529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:53.606040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:53.614168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2420f374-ecc7-4d8e-b0ae-aad4fef50f83 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1509 microversion: 2.1 time: 0.491269 Oct 28 13:16:53.630550 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1752/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:53 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:53.630550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:53.647754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:53.701699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:53.702123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:53.702562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:53.703293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:53.703747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:53.704169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:53.864086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:53.874280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ffd5503f-e364-4e24-ae17-2ce3b5b64b1f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1211 microversion: 2.1 time: 0.254133 Oct 28 13:16:53.875990 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1753/3400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:53 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:53.891961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:53.898854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:53.925558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:53.926247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:53.926594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:53.927594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:53.928200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:53.928638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:53.979908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:54.003163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25ecedf3-545e-4921-908c-fa6d548b7b97 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125836 Oct 28 13:16:54.014813 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1754/3401] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:16:53 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:54.181541 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7ce5419-3315-46d4-a9fe-4ad6c43a1f3f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 1.258915 Oct 28 13:16:54.181541 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1648/3402] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:16:52 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:54.193851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44e0db95-8e32-4f1e-889d-af2ab30a0dc3 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b84a8040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:54.639011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:54.639637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:54.666876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:54.668076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:54.669293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:54.671227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:54.671981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:54.675405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:55.553831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:55.562876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:55.567406 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c63f4aa6-50e9-4cf2-a082-7859e16db381 tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1509 microversion: 2.1 time: 0.933413 Oct 28 13:16:55.570172 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1649/3403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:54 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1509 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:55.581782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:55.583538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:55.632060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:55.632624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:55.633759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:55.635411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:55.638460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:55.640247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:56.379930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:56.397650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-741c5663-9a36-4aad-a984-a4a48cbbea82 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1273 microversion: 2.1 time: 0.823580 Oct 28 13:16:56.397650 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1650/3404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:55 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1273 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:56.412190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:56.418667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:56.436400 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44e0db95-8e32-4f1e-889d-af2ab30a0dc3 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd" status: 202 len: 0 microversion: 2.1 time: 2.247583 Oct 28 13:16:56.437935 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1755/3405] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:54 2022] DELETE /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd => generated 0 bytes in 2250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:56.440225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:56.440991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:56.441597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:56.442479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:56.443376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:56.445501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1e118796-338f-406e-b73e-14e2659d40b3 req-db690388-9f1e-4fd7-8f7b-aa8b8e44339e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b434829f-6f49-4804-af96-4061126f70a2", "name": "network-vif-deleted", "tag": "042506e5-8b9e-46ff-8274-a344e5960077"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:16:56.446300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:56.485157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ed1c3e5-969b-45f1-90e5-f7caf64f92ac tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083700 Oct 28 13:16:56.486979 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1651/3406] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:16:56 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:56.492249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-708df0ca-426b-4a05-b27e-3de4b2db5768 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bd9fc550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:56.496682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1e118796-338f-406e-b73e-14e2659d40b3 req-db690388-9f1e-4fd7-8f7b-aa8b8e44339e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:56.502173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1e118796-338f-406e-b73e-14e2659d40b3 req-db690388-9f1e-4fd7-8f7b-aa8b8e44339e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:56.508246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1e118796-338f-406e-b73e-14e2659d40b3 req-db690388-9f1e-4fd7-8f7b-aa8b8e44339e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:56.529711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1e118796-338f-406e-b73e-14e2659d40b3 req-db690388-9f1e-4fd7-8f7b-aa8b8e44339e service nova] Creating event network-vif-deleted:042506e5-8b9e-46ff-8274-a344e5960077 for instance b434829f-6f49-4804-af96-4061126f70a2 on n-h1-862876-2 Oct 28 13:16:56.557841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1e118796-338f-406e-b73e-14e2659d40b3 req-db690388-9f1e-4fd7-8f7b-aa8b8e44339e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118413 Oct 28 13:16:56.558834 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1756/3407] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:56.597892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:56.598602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:56.617049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:56.619878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:56.620576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:56.621544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:56.622699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:56.623739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:56.711093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:56.712858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:56.713481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:56.723742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lazy-loading 'fault' on Instance uuid b434829f-6f49-4804-af96-4061126f70a2 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:16:56.785924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-708df0ca-426b-4a05-b27e-3de4b2db5768 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:16:56.787205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-708df0ca-426b-4a05-b27e-3de4b2db5768 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 82927cc0-801f-4995-84cb-1b994bda17bd not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:16:56.787927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-708df0ca-426b-4a05-b27e-3de4b2db5768 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:16:56.787927 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-45e37f6d-2497-47f0-aad4-00e8dc112c83'] Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-708df0ca-426b-4a05-b27e-3de4b2db5768 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd HTTP/1.1 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-45e37f6d-2497-47f0-aad4-00e8dc112c83'] Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '82927cc0-801f-4995-84cb-1b994bda17bd'} Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:16:56.791724 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e37f6d-2497-47f0-aad4-00e8dc112c83'] Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e37f6d-2497-47f0-aad4-00e8dc112c83'] Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e37f6d-2497-47f0-aad4-00e8dc112c83'] Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45e37f6d-2497-47f0-aad4-00e8dc112c83'] Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-708df0ca-426b-4a05-b27e-3de4b2db5768 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:16:56.799010 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-45e37f6d-2497-47f0-aad4-00e8dc112c83'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:56.802693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-708df0ca-426b-4a05-b27e-3de4b2db5768 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd" status: 404 len: 194 microversion: 2.1 time: 0.314507 Oct 28 13:16:56.803813 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1652/3408] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:16:56 2022] GET /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd => generated 194 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:56.812831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0a5d470d-dfbc-4ecc-a8e1-1ad58503cd4e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b93d4c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:56.838386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0586c49d75e94228bb59d3e482ee4379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f756dcc3ef24ca98d40410e48639a7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:56.854664 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a04ce96-537d-470f-a165-b8349348865c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 200 len: 1313 microversion: 2.1 time: 0.261060 Oct 28 13:16:56.859154 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1757/3409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:56 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:57.429316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:57.431176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:57.446129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:57.449450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:57.450442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:57.451999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:57.455837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:57.456506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:57.996031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:58.010731 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c0fce36-e904-4d1f-8f35-6bd650561fb6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.589065 Oct 28 13:16:58.013295 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1758/3410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:57 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:16:58.028903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:58.036884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:58.051380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:58.052164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:58.055685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:58.056786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:58.057424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:58.059466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:58.147294 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17ce69cd-4609-45d4-b85e-36dcd6a2f5df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131781 Oct 28 13:16:58.153239 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1759/3411] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:16:58 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:58.169404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:58.170970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] [instance: b434829f-6f49-4804-af96-4061126f70a2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:58.182903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:58.186206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:58.187259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:58.190087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:58.190946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:58.192718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:58.228195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] HTTP exception thrown: Instance b434829f-6f49-4804-af96-4061126f70a2 could not be found. Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Request method failure captured: Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 HTTP/1.1 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9X8c79CeMHmtRA0KwEC6jabgz_XYkmFo5qExET6-FoGSkg7XmlLH92xcnj5hMI-UkPltBU8pljKvddPki56dDsz5iqsWz7LUT6pGVNGCkbDfrXvFRVGI9op1jwcXA61P_rAuw7BGCCb_-Puf9HxCpwM5t1dI1WPFIClV6vXqctEXM0 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 0f756dcc3ef24ca98d40410e48639a7b Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2093648112 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f756dcc3ef24ca98d40410e48639a7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f756dcc3ef24ca98d40410e48639a7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f756dcc3ef24ca98d40410e48639a7b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f756dcc3ef24ca98d40410e48639a7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2093648112 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 0f756dcc3ef24ca98d40410e48639a7b Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2093648112 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerRescueTestJSONUnderV235-2093648112-project Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0586c49d75e94228bb59d3e482ee4379 Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2093648112-project Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b434829f-6f49-4804-af96-4061126f70a2 could not be found. Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b434829f-6f49-4804-af96-4061126f70a2'} Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b434829f-6f49-4804-af96-4061126f70a2 could not be found. Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b434829f-6f49-4804-af96-4061126f70a2 could not be found. Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.232841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b434829f-6f49-4804-af96-4061126f70a2 could not be found. Oct 28 13:16:58.239137 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.245595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] Returning 404 to user: Instance b434829f-6f49-4804-af96-4061126f70a2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:58.246790 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b31a6d33-f33f-4e9d-bfb8-5f0740ee425c tempest-ServerRescueTestJSONUnderV235-2093648112 tempest-ServerRescueTestJSONUnderV235-2093648112-project] 10.222.0.25 "GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2" status: 404 len: 111 microversion: 2.1 time: 0.091018 Oct 28 13:16:58.248739 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1760/3412] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:58 2022] GET /compute/v2.1/servers/b434829f-6f49-4804-af96-4061126f70a2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:58.766794 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0a5d470d-dfbc-4ecc-a8e1-1ad58503cd4e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454" status: 202 len: 0 microversion: 2.1 time: 1.957551 Oct 28 13:16:58.768180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1653/3413] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:56 2022] DELETE /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454 => generated 0 bytes in 1959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:58.780809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-586ba333-22e5-43aa-a316-009eb5b54071 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b8503af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:58.907314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-586ba333-22e5-43aa-a316-009eb5b54071 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:16:58.907921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.security_group_api [None req-586ba333-22e5-43aa-a316-009eb5b54071 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group d8cf9275-6345-4d2d-a7e1-86179991b454 not found {{(pid=127793) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:16:58.908450 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-586ba333-22e5-43aa-a316-009eb5b54071 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:16:58.908450 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-95af5386-bb50-45fc-97d2-52b9518c0a05'] Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-586ba333-22e5-43aa-a316-009eb5b54071 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454 HTTP/1.1 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: exception: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-95af5386-bb50-45fc-97d2-52b9518c0a05'] Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'd8cf9275-6345-4d2d-a7e1-86179991b454'} Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:16:58.911475 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95af5386-bb50-45fc-97d2-52b9518c0a05'] Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95af5386-bb50-45fc-97d2-52b9518c0a05'] Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95af5386-bb50-45fc-97d2-52b9518c0a05'] Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95af5386-bb50-45fc-97d2-52b9518c0a05'] Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-586ba333-22e5-43aa-a316-009eb5b54071 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-95af5386-bb50-45fc-97d2-52b9518c0a05'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-586ba333-22e5-43aa-a316-009eb5b54071 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454" status: 404 len: 194 microversion: 2.1 time: 0.140639 Oct 28 13:16:58.918178 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1761/3414] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:16:58 2022] GET /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:16:58.923492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-210dc1ca-ed27-4806-8f1f-be0839368e91 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b8aa3550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:59.059889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:59.060645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:59.102528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:59.102528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:59.102528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:59.104373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:59.107235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:59.111052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:59.664325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:16:59.682371 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-addc0f08-bdb1-4a5f-af9e-2387ac754d6d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.639459 Oct 28 13:16:59.685289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1762/3415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:16:59 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:16:59.693226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:16:59.697827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:16:59.705607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:16:59.710944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:59.711685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:59.712679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:59.714214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:16:59.715379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:16:59.716434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:16:59.782719 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0659eb3d-60d2-45fb-b09c-135236e0d61e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096212 Oct 28 13:16:59.784479 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1763/3416] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:16:59 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:16:59.965387 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-210dc1ca-ed27-4806-8f1f-be0839368e91 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03" status: 202 len: 0 microversion: 2.1 time: 1.046290 Oct 28 13:16:59.966882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1654/3417] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:16:58 2022] DELETE /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:16:59.975476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-148dd5d3-d681-4e7c-ae4c-f1cd1a5c2337 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b84384c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:00.235109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-148dd5d3-d681-4e7c-ae4c-f1cd1a5c2337 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:17:00.235712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.security_group_api [None req-148dd5d3-d681-4e7c-ae4c-f1cd1a5c2337 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 not found {{(pid=127793) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:17:00.236234 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-148dd5d3-d681-4e7c-ae4c-f1cd1a5c2337 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:17:00.236234 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-a8376502-b465-460c-a2fb-ef37ba748586'] Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-148dd5d3-d681-4e7c-ae4c-f1cd1a5c2337 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03 HTTP/1.1 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: exception: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-a8376502-b465-460c-a2fb-ef37ba748586'] Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '95d84462-e7b2-4c8f-b0ae-ce7f97755a03'} Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:17:00.238298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8376502-b465-460c-a2fb-ef37ba748586'] Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8376502-b465-460c-a2fb-ef37ba748586'] Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8376502-b465-460c-a2fb-ef37ba748586'] Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8376502-b465-460c-a2fb-ef37ba748586'] Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-148dd5d3-d681-4e7c-ae4c-f1cd1a5c2337 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-a8376502-b465-460c-a2fb-ef37ba748586'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-148dd5d3-d681-4e7c-ae4c-f1cd1a5c2337 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03" status: 404 len: 194 microversion: 2.1 time: 0.270082 Oct 28 13:17:00.246971 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1764/3418] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:16:59 2022] GET /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03 => generated 194 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:17:00.261839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a440892f-c5de-47db-8bff-541d55e09d3e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bda43940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:00.707846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:00.708474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:00.732554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:00.734915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:00.737683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:00.738886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:00.751655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:00.754413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:01.082540 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a440892f-c5de-47db-8bff-541d55e09d3e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.828595 Oct 28 13:17:01.083238 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1655/3419] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:17:00 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:01.089741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:01.095014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:01.110775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:01.113033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:01.114385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:01.115520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:01.116742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:01.117224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:01.117665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:01.198937 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c1da1de-1514-445f-9550-849a290b208e tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113599 Oct 28 13:17:01.199597 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1656/3420] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:17:01 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:01.209968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:01.210554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d09b05f1-adcd-4fae-90a0-9363ada4b62f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27bd9fcf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1594538665", "description": "tempest-description-2057485385"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:01.219386 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9958f64-4b27-4918-b516-a2de82899178 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.517305 Oct 28 13:17:01.223775 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1765/3421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:00 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:01.917583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-777a1ff5-5e0a-4461-a926-feb8bd2df409 req-f3e45578-4f21-48a0-92a9-c989e9f1fd5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb84989-5cbd-4005-97c6-786f1a15b125", "tag": "901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:01.936226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-777a1ff5-5e0a-4461-a926-feb8bd2df409 req-f3e45578-4f21-48a0-92a9-c989e9f1fd5f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:01.936712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-777a1ff5-5e0a-4461-a926-feb8bd2df409 req-f3e45578-4f21-48a0-92a9-c989e9f1fd5f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:01.937137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-777a1ff5-5e0a-4461-a926-feb8bd2df409 req-f3e45578-4f21-48a0-92a9-c989e9f1fd5f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:01.959787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-777a1ff5-5e0a-4461-a926-feb8bd2df409 req-f3e45578-4f21-48a0-92a9-c989e9f1fd5f service nova] Creating event network-changed:901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0 for instance deb84989-5cbd-4005-97c6-786f1a15b125 on n-h1-862876-2 Oct 28 13:17:01.972712 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-777a1ff5-5e0a-4461-a926-feb8bd2df409 req-f3e45578-4f21-48a0-92a9-c989e9f1fd5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060700 Oct 28 13:17:01.973237 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1766/3422] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:17:02.186183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:02.213854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:02.220661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:02.239443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:02.239443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:02.244769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:02.253877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:02.254618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:02.255315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:02.337309 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09009996-c658-4e07-ae3b-17820d6fb0f6 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128698 Oct 28 13:17:02.342264 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1767/3423] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:17:02 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:17:02.351899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:02.361217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:02.384487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:02.385569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:02.388925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:02.390424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:02.391936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:02.394674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:02.936047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:02.956317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11874bcd-434b-426e-b7ba-38552309ac06 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.612479 Oct 28 13:17:02.957758 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1768/3424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:02 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:02.964659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:02.965369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:02.984930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:02.985473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:02.985907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:02.987499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:02.988523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:02.989135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:03.089915 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-decf3c9a-0c35-4472-9231-77da2c1bf0de tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.130843 Oct 28 13:17:03.099741 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1769/3425] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:17:02 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:03.136058 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d09b05f1-adcd-4fae-90a0-9363ada4b62f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.935064 Oct 28 13:17:03.144448 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1657/3426] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:17:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:03.151983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9950513c-3511-486c-bc01-6e70f58a985e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27b8544ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-271985101", "description": "tempest-description-92661228"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:03.355254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:03.358780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:03.378510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:03.379409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:03.380073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:03.381933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:03.382658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:03.384103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:03.501307 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4d68f38-354e-4ad5-a434-8c625998d085 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148759 Oct 28 13:17:03.508573 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1658/3427] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:17:03 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:17:03.988684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:03.989543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:04.001033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:04.001799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:04.002636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:04.007217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:04.007934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:04.010635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:04.115676 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9950513c-3511-486c-bc01-6e70f58a985e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.969050 Oct 28 13:17:04.116264 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1770/3428] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:17:03 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:04.426873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1736416075", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "858747b8-588f-4333-9d4c-f65e84504d5e"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:04.566316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] validate_networks() for [('858747b8-588f-4333-9d4c-f65e84504d5e', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:17:04.577236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:04.581901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ff7b934-38cb-45ce-baff-4dc1dcdade19 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.597159 Oct 28 13:17:04.583127 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1659/3429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:03 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:05.606487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:05.607265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:05.637318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:05.649186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:05.649846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:05.650788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:05.651425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:05.652051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:06.152587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:06.172480 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c47ae459-ef63-4bbd-9fa7-fdf11f07525d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.571204 Oct 28 13:17:06.207088 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1660/3430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:05 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:06.330670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:17:06.331906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:17:06.332538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:17:06.333336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:17:06.333908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:17:06.376887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:06.377750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:06.378353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:06.381002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:06.404819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:06.405651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:06.457605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Getting quotas for project 56d4361acebe4e51b86153651a68b957. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:17:06.472395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Getting quotas for user 47a3edc69b5e426b9e4434a60d95ab4c and project 56d4361acebe4e51b86153651a68b957. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:17:06.509006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:17:06.513070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:17:06.702372 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eef73bc5-e0ee-4f02-8b75-7ddd8f0e564a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.280331 Oct 28 13:17:06.703074 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1771/3431] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:17:06.722402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8a9cfebd-29fc-42fe-9b4d-328b5f62fb14 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:06.725940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8a9cfebd-29fc-42fe-9b4d-328b5f62fb14 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:06.886885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8a9cfebd-29fc-42fe-9b4d-328b5f62fb14 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:06.899611 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8a9cfebd-29fc-42fe-9b4d-328b5f62fb14 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1216 microversion: 2.1 time: 0.187176 Oct 28 13:17:06.900206 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1661/3432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:06 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1216 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:07.209344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:07.210458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:07.223523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:07.225990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:07.227794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:07.229385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:07.232455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:07.233239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:07.582528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:07.590469 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-981cd887-72de-4bbb-927d-10ef8ed94c42 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.385770 Oct 28 13:17:07.594193 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1772/3433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:07 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:07.723839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d16619f4-8a00-4375-8ae7-47810c5be897"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:07.729673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:07.750183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:07.754057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:07.755821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:07.756839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:07.761163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:07.767184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:07.926972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9663d1cc-516d-4b8f-8b5a-de85b508690d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:07.927845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9663d1cc-516d-4b8f-8b5a-de85b508690d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:08.092785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9663d1cc-516d-4b8f-8b5a-de85b508690d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:08.100360 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9663d1cc-516d-4b8f-8b5a-de85b508690d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1216 microversion: 2.1 time: 0.177320 Oct 28 13:17:08.102818 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1773/3434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:07 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:08.626649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:08.627627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:08.651712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:08.652494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:08.653665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:08.655030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:08.656489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:08.658019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:08.920710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:08.932940 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae7400f4-17a6-4200-be91-55804f5980cf tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.314150 Oct 28 13:17:08.934206 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1774/3435] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:08 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:08.949403 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8d7bb4c-bc6c-4f36-b8ae-b5c2f8316166 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "POST /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.230385 Oct 28 13:17:08.951166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1662/3436] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:17:07 2022] POST /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments => generated 194 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:09.129160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:09.129780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:09.139216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:09.139789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:09.140228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:09.140936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:09.141399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:09.141817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:09.961849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:09.963288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:09.975789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:09.981645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:09.982452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:09.983598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:09.988877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:09.988877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:09.988877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:10.803384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:10.819745 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5397c14e-6c93-4227-a525-de69ffd021d9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1212 microversion: 2.1 time: 1.694255 Oct 28 13:17:10.846942 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1775/3437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:09 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1212 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:10.861162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:10.891877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-176924ae-72d6-4339-858c-5b7cea6d3d4d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.932821 Oct 28 13:17:10.901698 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1663/3438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:09 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:11.856900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:11.857512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:11.881872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:11.882849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:11.884653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:11.886499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:11.888545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:11.889371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:11.921165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:11.922128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:11.939602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:11.940351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:11.940974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:11.941845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:11.942535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:11.943142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:12.165865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:12.184008 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-45fa8030-9e6b-4316-9b37-18c6fdd49f2a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1274 microversion: 2.1 time: 0.329013 Oct 28 13:17:12.194159 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1776/3439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:11 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1274 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:13.161012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:13.175448 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74c8638f-a1a8-403e-a062-73213e543c49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 1.261876 Oct 28 13:17:13.214616 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1664/3440] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:11 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:13.223250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:13.224446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:13.251575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:13.252359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:13.253969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:13.257901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:13.259906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:13.264639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:14.028553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a9fda6c6-3024-4cea-a6ad-b05701b10773 req-4af0c71e-7183-48cc-9ff9-b70bbe3ea9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb84989-5cbd-4005-97c6-786f1a15b125", "name": "network-vif-plugged", "status": "completed", "tag": "901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:14.077308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a9fda6c6-3024-4cea-a6ad-b05701b10773 req-4af0c71e-7183-48cc-9ff9-b70bbe3ea9c4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:14.078444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a9fda6c6-3024-4cea-a6ad-b05701b10773 req-4af0c71e-7183-48cc-9ff9-b70bbe3ea9c4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:14.078830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a9fda6c6-3024-4cea-a6ad-b05701b10773 req-4af0c71e-7183-48cc-9ff9-b70bbe3ea9c4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:14.111218 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a9fda6c6-3024-4cea-a6ad-b05701b10773 req-4af0c71e-7183-48cc-9ff9-b70bbe3ea9c4 service nova] Creating event network-vif-plugged:901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0 for instance deb84989-5cbd-4005-97c6-786f1a15b125 on n-h1-862876-2 Oct 28 13:17:14.128886 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a9fda6c6-3024-4cea-a6ad-b05701b10773 req-4af0c71e-7183-48cc-9ff9-b70bbe3ea9c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104483 Oct 28 13:17:14.130063 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1665/3441] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:14.207629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:14.209056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:14.226028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:14.241445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:14.248162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:14.249380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:14.253811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:14.254735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:14.549094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:14.574124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14b1ccd5-b509-43a9-9466-4b9ba150f48d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 1.354999 Oct 28 13:17:14.584797 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1777/3442] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:13 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:15.596590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:15.611980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:15.612595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:15.632029 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4efa8976-71d6-43d6-a9f7-02efecb9ade6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 1.430058 Oct 28 13:17:15.642899 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1666/3443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:14 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:15.649860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:15.651208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:15.652602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:15.655866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:15.656475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:15.659226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:15.713375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:16.341430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:16.361841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3f1bb741-7226-453f-9aa7-b7bda6bd38ed tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.754569 Oct 28 13:17:16.376234 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1778/3444] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:15 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:16.661488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:16.662342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:16.689841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:16.701770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:16.704706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:16.706560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:16.708004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:16.715948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:16.892675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:17.395924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:17.396534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:17.401383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:17.422577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:17.423339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:17.423957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:17.424902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:17.425600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:17.426254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:17.430712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:17.451906 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7eee5cf1-4bbf-44ec-8bc5-ca4290dc2161 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1315 microversion: 2.1 time: 0.794807 Oct 28 13:17:17.456855 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1667/3445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:16 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:17.860576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-27b4295f-cb3a-4255-86a3-25587491d9ed req-7c7ceaf9-67de-4fee-824d-510fc7af9cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207daa83-737b-4a44-ba70-f66efb07bcaa", "tag": "e4de7822-2264-47ae-82ad-a03aec6ec40c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:17.881557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-27b4295f-cb3a-4255-86a3-25587491d9ed req-7c7ceaf9-67de-4fee-824d-510fc7af9cf2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:17.882058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-27b4295f-cb3a-4255-86a3-25587491d9ed req-7c7ceaf9-67de-4fee-824d-510fc7af9cf2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:17.882494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-27b4295f-cb3a-4255-86a3-25587491d9ed req-7c7ceaf9-67de-4fee-824d-510fc7af9cf2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:17.909477 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-27b4295f-cb3a-4255-86a3-25587491d9ed req-7c7ceaf9-67de-4fee-824d-510fc7af9cf2 service nova] Creating event network-changed:e4de7822-2264-47ae-82ad-a03aec6ec40c for instance 207daa83-737b-4a44-ba70-f66efb07bcaa on n-h1-862876-2 Oct 28 13:17:17.923303 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-27b4295f-cb3a-4255-86a3-25587491d9ed req-7c7ceaf9-67de-4fee-824d-510fc7af9cf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065879 Oct 28 13:17:17.923933 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1668/3446] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:17:18.041728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:18.064290 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00afea87-3c8d-481e-93d4-2ebaf9cf6af5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.678009 Oct 28 13:17:18.066330 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1779/3447] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:17 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:18.481033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:18.482187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:18.495065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:18.495897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:18.496497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:18.497677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:18.500042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:18.500669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:18.905489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:18.918780 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e8b02b2-8f75-4e4a-a41e-fad95d3cfc8b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1501 microversion: 2.1 time: 0.443317 Oct 28 13:17:18.938402 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1669/3448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:18 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1501 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:18.947759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:18.948909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:18.954402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:18.979403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:18.982309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:18.984439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:18.986415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:18.989367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:18.990493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:19.090615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:19.091698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:19.109121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:19.111432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:19.113518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:19.131781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:19.133531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:19.137619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:19.801271 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.network.security_group_api [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Removing security group 727726fa-5854-433b-89d2-27935fc949dd from port 901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0 Oct 28 13:17:20.004668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:20.020475 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2572d3d0-7b07-428d-a595-b90df282464f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.934613 Oct 28 13:17:20.023426 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1670/3449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:19 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:21.052704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:21.053329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:21.068974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:21.070727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:21.076769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:21.080482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:21.083692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:21.088735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:21.356911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:21.368169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d31534c6-0570-4cfe-969c-fa152930644f tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.320423 Oct 28 13:17:21.373116 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1671/3450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:21 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:21.501361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9774ea7f-238c-48a3-93f0-c8a251a8f9d7 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125/action" status: 202 len: 0 microversion: 2.1 time: 2.558369 Oct 28 13:17:21.502240 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1780/3451] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:17:18 2022] POST /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125/action => generated 0 bytes in 2561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:17:21.514852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b3bb7aca-bae8-4e99-828b-f976a469f23d req-4a3f5687-f413-47dc-8c5e-ff4e82e157b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb84989-5cbd-4005-97c6-786f1a15b125", "tag": "901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:21.517572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:21.522717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:21.553155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:21.553665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:21.554106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:21.554849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:21.555347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:21.555779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:21.588467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:21.593289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b3bb7aca-bae8-4e99-828b-f976a469f23d req-4a3f5687-f413-47dc-8c5e-ff4e82e157b7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:21.603666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b3bb7aca-bae8-4e99-828b-f976a469f23d req-4a3f5687-f413-47dc-8c5e-ff4e82e157b7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:21.604965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b3bb7aca-bae8-4e99-828b-f976a469f23d req-4a3f5687-f413-47dc-8c5e-ff4e82e157b7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:21.654958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b3bb7aca-bae8-4e99-828b-f976a469f23d req-4a3f5687-f413-47dc-8c5e-ff4e82e157b7 service nova] Creating event network-changed:901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0 for instance deb84989-5cbd-4005-97c6-786f1a15b125 on n-h1-862876-2 Oct 28 13:17:21.672023 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b3bb7aca-bae8-4e99-828b-f976a469f23d req-4a3f5687-f413-47dc-8c5e-ff4e82e157b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158003 Oct 28 13:17:21.674648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1781/3452] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:22.058389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:22.072187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d02101b-1f2d-458a-a748-29e961657e23 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1459 microversion: 2.1 time: 0.561550 Oct 28 13:17:22.075238 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1672/3453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:21 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1459 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:22.104337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:22.105296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:22.120322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:22.123176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:22.142467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:22.142467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:22.142467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:22.142467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:22.397612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:22.398886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:22.406215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:22.406988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:22.407419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:22.408561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:22.409202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:22.409831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:22.643817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:22.652875 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5402423-126e-4218-aeb7-2014dd80ac0a tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.259568 Oct 28 13:17:22.671675 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1673/3454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:22 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:22.806980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:22.838834 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b8f3de7c-a709-467e-a1e9-46c1e89869b0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.741381 Oct 28 13:17:22.840023 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1782/3455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:22 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:22.870907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:22.871677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:22.884126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:22.885955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:22.886462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:22.890046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:22.891588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:22.895734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:23.679496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:23.680157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:23.692513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:23.693941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:23.693941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:23.694339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:23.695104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:23.696320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:23.971490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:23.982486 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-770fe973-c02e-46e4-bc4b-689c25c303da tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 1.117284 Oct 28 13:17:23.983725 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1674/3456] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:22 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:24.016868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:24.017520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:24.031838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:24.039150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:24.039150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:24.039150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:24.047303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:24.048712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:24.746967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:24.757376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-462f439f-af7c-47d8-8e59-f37183b74f7c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 1.083252 Oct 28 13:17:24.760829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:24.767291 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14fe7048-8d18-48fd-91fe-1d2eab206177 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.763177 Oct 28 13:17:24.768464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1675/3457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:24 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:24.775935 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1783/3458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:23 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:24.805718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:24.806337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:24.818619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:24.824120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:24.824120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:24.824120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:24.824120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:24.824120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:25.392781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:25.404420 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5201c993-0533-463a-b328-ec1c4a4ebf12 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.602088 Oct 28 13:17:25.405572 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1676/3459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:24 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:25.633932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1639842562", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a6d79be4-5785-49f8-a61c-931d9498eb9a"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:25.781221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:25.782049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:25.792340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:25.796072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:25.796712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:25.797644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:25.798270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:25.802547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:26.275426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:26.287459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ae17c95c-cfb0-4056-bd8d-2edb25223d0d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.509378 Oct 28 13:17:26.294875 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1677/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:25 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:27.322543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:27.326024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:27.338367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:27.342784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:27.345256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:27.345256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:27.345256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:27.347964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:28.208126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:28.208126 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5444473-8be4-4e7a-8355-3613e7c4325d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.886247 Oct 28 13:17:28.208126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1678/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:27 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:28.757340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:28.762590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:28.770780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:28.771284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:28.774162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:28.774950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:28.783488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:28.784043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:29.001725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lazy-loading 'services' on Instance uuid 2c14e187-e2eb-4d72-b691-11b64a2772f3 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:17:29.330366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5410e90-588a-45a0-b754-8ad3df720c51 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments/d16619f4-8a00-4375-8ae7-47810c5be897" status: 202 len: 0 microversion: 2.1 time: 0.576731 Oct 28 13:17:29.330997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1679/3462] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:17:28 2022] DELETE /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments/d16619f4-8a00-4375-8ae7-47810c5be897 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:17:29.363727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c8888b44-0229-408e-bddb-05e89b457158 req-70fcefb1-12af-41e0-a4d3-4577c5f47417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207daa83-737b-4a44-ba70-f66efb07bcaa", "name": "network-vif-plugged", "status": "completed", "tag": "e4de7822-2264-47ae-82ad-a03aec6ec40c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:29.409546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c8888b44-0229-408e-bddb-05e89b457158 req-70fcefb1-12af-41e0-a4d3-4577c5f47417 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:29.413196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c8888b44-0229-408e-bddb-05e89b457158 req-70fcefb1-12af-41e0-a4d3-4577c5f47417 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:29.414028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c8888b44-0229-408e-bddb-05e89b457158 req-70fcefb1-12af-41e0-a4d3-4577c5f47417 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:29.430059 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c8888b44-0229-408e-bddb-05e89b457158 req-70fcefb1-12af-41e0-a4d3-4577c5f47417 service nova] Creating event network-vif-plugged:e4de7822-2264-47ae-82ad-a03aec6ec40c for instance 207daa83-737b-4a44-ba70-f66efb07bcaa on n-h1-862876-2 Oct 28 13:17:29.445899 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c8888b44-0229-408e-bddb-05e89b457158 req-70fcefb1-12af-41e0-a4d3-4577c5f47417 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112726 Oct 28 13:17:29.447236 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1680/3463] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:29.465551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:29.478282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:29.497197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:29.497960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:29.500342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:29.501332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:29.503013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:29.505556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:30.070107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:30.081132 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cefe5009-8857-4db1-be0b-01d6c81f784d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1316 microversion: 2.1 time: 0.632294 Oct 28 13:17:30.085833 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1681/3464] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:29 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:30.104072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:30.106727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:30.119335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:30.120527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:30.120939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:30.123287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:30.126423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:30.128232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:30.225605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57d4ea1c-d690-4ab2-b300-acddbddf63f3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137612 Oct 28 13:17:30.227541 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1682/3465] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:17:30 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:31.002564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1678908673", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "35b0cf8f-78ca-4b1e-81d5-1a1186c30f61"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:34.753528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=27 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:35.658470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:40.201820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:40.658376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] validate_networks() for [('a6d79be4-5785-49f8-a61c-931d9498eb9a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:17:40.681646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:17:41.076201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=41 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:41.227910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:17:41.229481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:17:41.230233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:17:41.230958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:17:41.231822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:17:41.244346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.244933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.245464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.246269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.246847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.247337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.269556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:17:41.276931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:17:41.295079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:17:41.297623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:17:41.521822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:17:41.522253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:17:41.522730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:17:41.523196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:17:41.523594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:17:41.538469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.539970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.540621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.541682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.542349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.543066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.563923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:17:41.574178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Getting quotas for user d70178138d974c20bb9598de42bd3294 and project 524832a11bb148639788f80ef22b2865. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:17:41.590653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:17:41.592977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:17:41.623316 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4eaa99df-09f9-4135-b8a6-9b9f8e9e62f9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.861740 Oct 28 13:17:41.630795 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1683/3466] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 10870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:17:41.636794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:41.637672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:41.645305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.646035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.647035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.648854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.649531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.650166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.783211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ab392ff-c5ee-4e47-a66e-3b71f98ba7f5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.154138 Oct 28 13:17:41.784313 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1784/3467] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 16156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:17:41.800374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:41.805713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:41.825459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.829505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.830234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.831970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:41.832779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:41.833816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:41.932332 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed3c6f9b-3f0c-4bdc-bf87-6e23d8b2094f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145196 Oct 28 13:17:41.934458 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1785/3468] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:17:41 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:17:41.948656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8630893f-6441-422c-a9b6-d6f28428ee36 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:41.950553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8630893f-6441-422c-a9b6-d6f28428ee36 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:42.064307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8630893f-6441-422c-a9b6-d6f28428ee36 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:42.072866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8630893f-6441-422c-a9b6-d6f28428ee36 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1193 microversion: 2.1 time: 0.136688 Oct 28 13:17:42.074630 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1786/3469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:41 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:42.109691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8840af1-98aa-45bb-beb0-a9753f90c13f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:42.110313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8840af1-98aa-45bb-beb0-a9753f90c13f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:42.180556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f8840af1-98aa-45bb-beb0-a9753f90c13f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:42.194809 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8840af1-98aa-45bb-beb0-a9753f90c13f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1215 microversion: 2.1 time: 0.118243 Oct 28 13:17:42.195699 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1787/3470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:42 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:42.201271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:42.202437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:42.210806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:42.211838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:42.212688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:42.213614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:42.214044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:42.214566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:42.235355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:42.244039 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14889800-c8f0-4929-b547-d7eaa28dfcd7 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1503 microversion: 2.1 time: 0.611794 Oct 28 13:17:42.245982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:17:42.258866 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1684/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:41 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1503 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:42.269199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1594538665"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:42.270070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:42.277258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:42.277955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:42.278595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:42.279531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:42.280167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:42.280763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:42.655841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b286209-0c6b-4af8-a9a5-060f47379856 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 204 len: 0 microversion: 2.1 time: 0.458588 Oct 28 13:17:42.657935 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1788/3472] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:17:42 2022] DELETE /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:17:42.665222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:42.666002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:42.679204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:42.681028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:42.681028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:42.681391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:42.681856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:42.682287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:42.688642 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.security_group_api [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Adding security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 to port e4de7822-2264-47ae-82ad-a03aec6ec40c Oct 28 13:17:42.952088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:42.980626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7715f0cb-6aa9-44bc-9041-51f4072e6b6f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1679 microversion: 2.1 time: 0.319622 Oct 28 13:17:42.992556 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1789/3473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:42 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:43.100228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-619defff-8b24-4940-82ff-51c29315b6a2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:43.105294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-619defff-8b24-4940-82ff-51c29315b6a2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:43.400179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-619defff-8b24-4940-82ff-51c29315b6a2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:43.410799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-619defff-8b24-4940-82ff-51c29315b6a2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1193 microversion: 2.1 time: 0.316988 Oct 28 13:17:43.421312 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1790/3474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:43 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1193 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:43.421312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:43.435026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:43.446095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:43.455211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:43.462520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:43.463529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:43.464301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:43.465012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:43.594889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:43.596939 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e5a1550-403a-49f5-99d8-19c9949fc233 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1219 microversion: 2.1 time: 0.174568 Oct 28 13:17:43.602914 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1791/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:43 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:43.984295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d4f4bd8-dce4-4e4f-baa9-4bfdc8346c11 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa/action" status: 202 len: 0 microversion: 2.1 time: 1.719860 Oct 28 13:17:43.987856 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1685/3476] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:17:42 2022] POST /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa/action => generated 0 bytes in 1722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:17:43.995857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c1179be-a68d-4a2f-9362-3892e8701aa0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b85a2b80>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:44.006837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:44.008304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:44.017129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:44.031149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:44.038460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:44.038460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:44.038460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:44.038460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:44.472558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:44.495371 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5bfaefb-9030-46e6-8a99-f4a04a8381fa tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1679 microversion: 2.1 time: 0.492748 Oct 28 13:17:44.511222 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1686/3477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:44 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1679 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:44.517024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c4043c06-2ded-435c-9bc0-d483729bcfac req-07f06a11-3b0d-4c61-98f9-fb05a1e81521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207daa83-737b-4a44-ba70-f66efb07bcaa", "tag": "e4de7822-2264-47ae-82ad-a03aec6ec40c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:44.521747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-9c1179be-a68d-4a2f-9362-3892e8701aa0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use.", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:17:44.522458 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-9c1179be-a68d-4a2f-9362-3892e8701aa0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use. Oct 28 13:17:44.522458 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-c5d8f69c-1be3-4169-8fcf-dd692df78fbe'] Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c1179be-a68d-4a2f-9362-3892e8701aa0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549 HTTP/1.1 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: exception: Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use. Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-c5d8f69c-1be3-4169-8fcf-dd692df78fbe'] Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6eaf2ffa-6a44-47fc-861d-05d66c47d549'} Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:17:44.526449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use. Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8f69c-1be3-4169-8fcf-dd692df78fbe'] Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use. Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8f69c-1be3-4169-8fcf-dd692df78fbe'] Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use. Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8f69c-1be3-4169-8fcf-dd692df78fbe'] Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use. Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5d8f69c-1be3-4169-8fcf-dd692df78fbe'] Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c1179be-a68d-4a2f-9362-3892e8701aa0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 400 to user: Security Group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 in use. Oct 28 13:17:44.541368 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-c5d8f69c-1be3-4169-8fcf-dd692df78fbe'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:17:44.545479 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c1179be-a68d-4a2f-9362-3892e8701aa0 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549" status: 400 len: 185 microversion: 2.1 time: 0.551607 Oct 28 13:17:44.547829 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1792/3478] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:17:43 2022] DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549 => generated 185 bytes in 557 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:17:44.564357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c4043c06-2ded-435c-9bc0-d483729bcfac req-07f06a11-3b0d-4c61-98f9-fb05a1e81521 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:44.564765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c4043c06-2ded-435c-9bc0-d483729bcfac req-07f06a11-3b0d-4c61-98f9-fb05a1e81521 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:44.565218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c4043c06-2ded-435c-9bc0-d483729bcfac req-07f06a11-3b0d-4c61-98f9-fb05a1e81521 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:44.611315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:44.611958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:44.616416 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c4043c06-2ded-435c-9bc0-d483729bcfac req-07f06a11-3b0d-4c61-98f9-fb05a1e81521 service nova] Creating event network-changed:e4de7822-2264-47ae-82ad-a03aec6ec40c for instance 207daa83-737b-4a44-ba70-f66efb07bcaa on n-h1-862876-2 Oct 28 13:17:44.632637 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c4043c06-2ded-435c-9bc0-d483729bcfac req-07f06a11-3b0d-4c61-98f9-fb05a1e81521 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119743 Oct 28 13:17:44.651499 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1687/3479] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:44.652780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:44.653278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:44.656938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:44.668598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:44.678706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:44.686055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:44.690386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:44.696219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:44.734879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:44.741678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:44.743721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:44.747103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:44.748238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:44.754475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:45.075506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:45.093489 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09215387-e74f-446b-b616-f35c8676298d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1189 microversion: 2.1 time: 0.545738 Oct 28 13:17:45.094105 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1793/3480] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:44 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1189 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:45.108726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:45.109619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:45.123803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:45.124398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:45.124903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:45.126356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:45.129093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:45.129806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:45.232464 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3967c69-7394-4582-bcb4-b852e6c120ab tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa/action" status: 202 len: 0 microversion: 2.1 time: 0.579450 Oct 28 13:17:45.238221 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1688/3481] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:17:44 2022] POST /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:17:45.256147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:45.261170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:45.281676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:45.284311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:45.284865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:45.285650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:45.287000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:45.287941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:45.291998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:45.302111 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86cc592d-b66c-4393-b7fe-cfd5aba1fe49 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1267 microversion: 2.1 time: 0.206894 Oct 28 13:17:45.305458 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1794/3482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:45 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:45.527318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:45.528095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:45.547965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:45.552623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:45.555424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:45.558221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:45.563278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:45.581421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:46.542580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:46.562810 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de672549-b36b-4f56-824f-ffa0828560a3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1679 microversion: 2.1 time: 1.041007 Oct 28 13:17:46.565596 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1795/3483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:45 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1679 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:46.579423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:46.580468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:46.597045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:46.622051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:46.622051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:46.622051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:46.622051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:46.622051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:46.769356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:46.780935 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6fe071da-9aec-4914-9f22-a6c6178bf098 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1574 microversion: 2.1 time: 1.538991 Oct 28 13:17:46.794782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1689/3484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:45 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1574 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:46.802418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:46.806714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:46.830553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:46.855787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:46.857340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:46.857758 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e9e436c-febf-49d9-9fc2-fbfc2a24e9ed tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1245 microversion: 2.1 time: 0.290811 Oct 28 13:17:46.862096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:46.862096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:46.862096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:46.862096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:46.862516 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1796/3485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:46 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1245 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:47.165020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:47.165020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9bc41981-e5cd-45cb-af83-941bb4874169 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1273 microversion: 2.1 time: 0.364413 Oct 28 13:17:47.165020 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1690/3486] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:46 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:47.592622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:47.593242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:47.602054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:47.603442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:47.604198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:47.605089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:47.606138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:47.606768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:47.811164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:47.812175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:47.812943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:47.828684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:47.831554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:47.832547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:47.833536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:47.835038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:47.837646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:47.846762 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-62e9bacf-1a67-4ad8-8cdf-7b9434c422af tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1612 microversion: 2.1 time: 0.252083 Oct 28 13:17:47.847457 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1797/3487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:47 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1612 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:47.891175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8acdb4f4-02f3-49e9-a8c7-5e36aee0f85c req-6351b065-af09-4fdf-bbdd-24c89651d023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c14e187-e2eb-4d72-b691-11b64a2772f3", "name": "network-vif-deleted", "tag": "98cd6877-0115-4f83-9f8d-0ea86451adf4"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:47.925105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8acdb4f4-02f3-49e9-a8c7-5e36aee0f85c req-6351b065-af09-4fdf-bbdd-24c89651d023 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:47.932045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8acdb4f4-02f3-49e9-a8c7-5e36aee0f85c req-6351b065-af09-4fdf-bbdd-24c89651d023 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:47.932579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8acdb4f4-02f3-49e9-a8c7-5e36aee0f85c req-6351b065-af09-4fdf-bbdd-24c89651d023 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:47.969301 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8acdb4f4-02f3-49e9-a8c7-5e36aee0f85c req-6351b065-af09-4fdf-bbdd-24c89651d023 service nova] Creating event network-vif-deleted:98cd6877-0115-4f83-9f8d-0ea86451adf4 for instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 on n-h2-862876-2 Oct 28 13:17:47.996772 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8acdb4f4-02f3-49e9-a8c7-5e36aee0f85c req-6351b065-af09-4fdf-bbdd-24c89651d023 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119842 Oct 28 13:17:48.001379 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1798/3488] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:48.023156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:48.024154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:48.085944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:48.086374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:48.095927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:48.099835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:48.107622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:48.108834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:48.372691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:48.394421 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6b182089-1ce1-4dd0-a911-732ad9014c1b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1574 microversion: 2.1 time: 0.588634 Oct 28 13:17:48.395448 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1691/3489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:47 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1574 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:48.408809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:48.411489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:48.428916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:48.429661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:48.431931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:48.434201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:48.437089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:48.437731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:48.500718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:48.533233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e2a54dcc-904e-4e3b-ab8f-5357e63e021f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1251 microversion: 2.1 time: 0.530081 Oct 28 13:17:48.534401 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1799/3490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:48 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1251 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:48.604870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:48.616556 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee044637-0909-4fbc-86bd-aba9dc6fbe31 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1273 microversion: 2.1 time: 0.219263 Oct 28 13:17:48.620318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1692/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:48 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:48.880805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:48.882231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:48.901087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:48.905008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:48.908911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:48.910874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:48.911752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:48.912458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:49.022288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:49.023645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:49.024914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:49.025556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lazy-loading 'fault' on Instance uuid 2c14e187-e2eb-4d72-b691-11b64a2772f3 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:17:49.420918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:49.422111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:49.437058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:49.439129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:49.439129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:49.441017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:49.441888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:49.444797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:49.746503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:49.768064 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4dd1544f-d1c3-4559-ab64-005f318a455b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1574 microversion: 2.1 time: 0.351878 Oct 28 13:17:49.768919 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1693/3492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:49 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1574 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:49.776074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:49.781003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:49.792853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:49.801278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:49.801739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:49.808056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e078236549214dddb42cabe996363a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f68daf1ebe84ac6844d1658e33b5c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:49.808288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:49.808629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:49.809243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:49.817830 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e54ec9a-077a-4d63-a637-0f783fef56a9 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 200 len: 1329 microversion: 2.1 time: 0.944763 Oct 28 13:17:49.842318 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1800/3493] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:48 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 1329 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:49.858200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:49.859259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:49.867912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:49.869168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:49.869874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:49.870770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:49.871733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:49.872317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:50.166271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:50.174727 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6200545-6c94-42e1-8317-e15bda27cbc3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.404551 Oct 28 13:17:50.187511 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1694/3494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:49 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:50.605231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:50.617526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eefff90f-3549-4cc9-a870-f314fdd4879c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.769245 Oct 28 13:17:50.617526 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1801/3495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:49 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:50.797102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:50.813819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:50.813819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:50.813819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:50.813819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:50.813819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:50.813819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:50.813819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:50.846677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:50.847322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:50.853327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:50.853818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:50.854253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:50.855002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:50.855463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:50.855895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 HTTP/1.1 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '2c14e187-e2eb-4d72-b691-11b64a2772f3'} Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:17:50.883538 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7cc9daff-7161-4412-9dc7-a5b2f9b85057 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 404 len: 111 microversion: 2.1 time: 0.034751 Oct 28 13:17:50.888257 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1802/3496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:50 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:17:50.895521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d26132d0-7671-45d0-be59-1c36b313043f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '.version_select at 0x7f27b853ee50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:50.966132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:50.975060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2833d69d-da22-4cd8-af12-74cca6ee9f2c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1572 microversion: 2.1 time: 0.181452 Oct 28 13:17:50.987056 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1695/3497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:50 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1572 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:51.015900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-271985101"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:51.016549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:51.022519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:51.023214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:51.023673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:51.024498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:51.024981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:51.025398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:51.115721 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d26132d0-7671-45d0-be59-1c36b313043f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29297614" status: 202 len: 0 microversion: 2.1 time: 0.232023 Oct 28 13:17:51.116316 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1803/3498] 10.222.0.25 () {58 vars in 1215 bytes} [Fri Oct 28 13:17:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29297614 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:17:51.158867 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.security_group_api [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Adding security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 to port e4de7822-2264-47ae-82ad-a03aec6ec40c Oct 28 13:17:51.201845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:51.202591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:51.210001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:51.210486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:51.210978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:51.211735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:51.212276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:51.212745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:51.258061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:51.286619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:51.381411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:51.392446 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-41b3a0b5-bb2d-4352-9821-15bf9e3de268 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.195633 Oct 28 13:17:51.394816 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1804/3499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:51 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:51.638337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:51.639094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:51.651495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:51.659389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:51.659891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:51.660354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:51.661058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:51.661535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:51.661957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:51.683241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:52.047483 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c5bf3eed-6a8d-4ce2-a793-d3f2ae65ab9b tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa/action" status: 202 len: 0 microversion: 2.1 time: 1.035525 Oct 28 13:17:52.055067 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1696/3500] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:17:51 2022] POST /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa/action => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:17:52.095715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:52.110383 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3230fb39-a487-4de7-8c56-62374c4434a2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.476189 Oct 28 13:17:52.112607 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1805/3501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:51 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:52.123934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-684ef00f-343f-4934-852f-3fb80dd83c0c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b853edc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:52.287959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ecfe4e93-ad38-46ef-a9d9-ee29e23965dc req-3553ce63-2f9f-4b97-a8ae-a3afb277b3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207daa83-737b-4a44-ba70-f66efb07bcaa", "tag": "e4de7822-2264-47ae-82ad-a03aec6ec40c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:52.300683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ecfe4e93-ad38-46ef-a9d9-ee29e23965dc req-3553ce63-2f9f-4b97-a8ae-a3afb277b3f3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:52.301202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ecfe4e93-ad38-46ef-a9d9-ee29e23965dc req-3553ce63-2f9f-4b97-a8ae-a3afb277b3f3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:52.301818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ecfe4e93-ad38-46ef-a9d9-ee29e23965dc req-3553ce63-2f9f-4b97-a8ae-a3afb277b3f3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:52.317161 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ecfe4e93-ad38-46ef-a9d9-ee29e23965dc req-3553ce63-2f9f-4b97-a8ae-a3afb277b3f3 service nova] Creating event network-changed:e4de7822-2264-47ae-82ad-a03aec6ec40c for instance 207daa83-737b-4a44-ba70-f66efb07bcaa on n-h1-862876-2 Oct 28 13:17:52.324549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ecfe4e93-ad38-46ef-a9d9-ee29e23965dc req-3553ce63-2f9f-4b97-a8ae-a3afb277b3f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267617 Oct 28 13:17:52.325204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1697/3502] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:52.420571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:52.422064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:52.434220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:52.436278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:52.436937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:52.438016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:52.439179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:52.440259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:52.760229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-684ef00f-343f-4934-852f-3fb80dd83c0c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use.", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:17:52.762153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-684ef00f-343f-4934-852f-3fb80dd83c0c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use. Oct 28 13:17:52.762153 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-1c5fe9f4-72cb-4bdc-b32e-b3865d2d7537'] Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-684ef00f-343f-4934-852f-3fb80dd83c0c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3 HTTP/1.1 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: exception: Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use. Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-1c5fe9f4-72cb-4bdc-b32e-b3865d2d7537'] Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '339b3130-bc26-4e3e-9430-f317f3b8f7a3'} Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:17:52.764919 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use. Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c5fe9f4-72cb-4bdc-b32e-b3865d2d7537'] Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use. Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c5fe9f4-72cb-4bdc-b32e-b3865d2d7537'] Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use. Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c5fe9f4-72cb-4bdc-b32e-b3865d2d7537'] Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use. Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c5fe9f4-72cb-4bdc-b32e-b3865d2d7537'] Oct 28 13:17:52.769844 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:17:52.774422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-684ef00f-343f-4934-852f-3fb80dd83c0c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 400 to user: Security Group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 in use. Oct 28 13:17:52.774422 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-1c5fe9f4-72cb-4bdc-b32e-b3865d2d7537'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:17:52.781024 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-684ef00f-343f-4934-852f-3fb80dd83c0c tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3" status: 400 len: 185 microversion: 2.1 time: 0.660891 Oct 28 13:17:52.781024 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1806/3503] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:17:52 2022] DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3 => generated 185 bytes in 664 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:17:52.789051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:52.789583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:52.798933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:52.799438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:52.800885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:52.801725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:52.802251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:52.802913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:52.817073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:52.829741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bb1d1140-e88e-452c-a4da-6bc63941518e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.415125 Oct 28 13:17:52.830339 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1698/3504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:52 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:52.856054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:17:53.141288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:53.142569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:53.149677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:53.150324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:53.150892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:53.151923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:53.152459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:53.153087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:53.334988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:53.345962 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8fa1a75a-8fcb-4a67-8d9c-92f86e922b8e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.207022 Oct 28 13:17:53.361534 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1699/3505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:53 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:53.408507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:53.467437 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8a98f55-8ca8-4cb2-b71c-a88f3d6741b9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 204 len: 0 microversion: 2.1 time: 0.683615 Oct 28 13:17:53.469288 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1807/3506] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:17:52 2022] DELETE /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:17:53.493476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:53.497482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:53.526977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:53.527502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:53.530421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:53.533377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:53.534083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:53.541489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:53.810238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:53.818050 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69c9f5d8-e2ea-4e3c-8ced-f9dac934a5ad tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1646 microversion: 2.1 time: 0.336803 Oct 28 13:17:53.818631 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1700/3507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:53 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1646 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:53.855057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:53.855698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:53.862156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:53.862773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:53.863367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:53.864078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:53.864584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:53.865223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:53.986410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2ade6477-6ff4-4ac2-86a0-e8c6b7f906f8 req-05e49346-839a-43d1-add6-1b464b449c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4923609-8fac-4a9b-ab1a-8e35fd1d95f7", "tag": "28446564-effa-405e-b48e-11317d88b817"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:53.998054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2ade6477-6ff4-4ac2-86a0-e8c6b7f906f8 req-05e49346-839a-43d1-add6-1b464b449c27 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:53.998978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2ade6477-6ff4-4ac2-86a0-e8c6b7f906f8 req-05e49346-839a-43d1-add6-1b464b449c27 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:53.999412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2ade6477-6ff4-4ac2-86a0-e8c6b7f906f8 req-05e49346-839a-43d1-add6-1b464b449c27 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:54.013777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:17:54.016452 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2ade6477-6ff4-4ac2-86a0-e8c6b7f906f8 req-05e49346-839a-43d1-add6-1b464b449c27 service nova] Creating event network-changed:28446564-effa-405e-b48e-11317d88b817 for instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 on n-h2-862876-2 Oct 28 13:17:54.021504 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2ade6477-6ff4-4ac2-86a0-e8c6b7f906f8 req-05e49346-839a-43d1-add6-1b464b449c27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039906 Oct 28 13:17:54.022967 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1701/3508] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:54.306398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:54.315105 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52f3b07b-67cc-458c-bd19-2f35df29a632 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.465279 Oct 28 13:17:54.316503 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1808/3509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:53 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:54.370356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:54.371006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:54.379318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:54.380031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:54.380636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:54.381748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:54.382387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:54.383603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:54.635355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:54.650819 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-825791e0-3f19-4955-a92c-a3f2a36d3aab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.284044 Oct 28 13:17:54.654262 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1702/3510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:54 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:54.842881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:54.844781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:54.854783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:54.857596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:54.858734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:54.860129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:54.860808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:54.861692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:55.340872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:55.342005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:55.362254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:55.363781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:55.364259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:55.365025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:55.365535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:55.366470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:55.616312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:55.666268 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b09faaa-29b4-4e8d-99e3-042eee941a9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1646 microversion: 2.1 time: 0.815554 Oct 28 13:17:55.681376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1809/3511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:54 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1646 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:55.698365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:55.699167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:55.712389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:55.713159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:55.715245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:55.716379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:55.717093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:55.718738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:55.751058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:55.780501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e526e328-700a-4dfd-a9b4-75b35c324d4a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.445284 Oct 28 13:17:55.784833 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1703/3512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:55 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:55.803644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7f087156-8d82-4f76-8aa0-e493f918546e req-79339b67-ed04-4a7b-ae65-4a0d31834671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207daa83-737b-4a44-ba70-f66efb07bcaa", "name": "network-vif-deleted", "tag": "e4de7822-2264-47ae-82ad-a03aec6ec40c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:55.869523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7f087156-8d82-4f76-8aa0-e493f918546e req-79339b67-ed04-4a7b-ae65-4a0d31834671 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:55.871601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7f087156-8d82-4f76-8aa0-e493f918546e req-79339b67-ed04-4a7b-ae65-4a0d31834671 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:55.874926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7f087156-8d82-4f76-8aa0-e493f918546e req-79339b67-ed04-4a7b-ae65-4a0d31834671 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:55.913184 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7f087156-8d82-4f76-8aa0-e493f918546e req-79339b67-ed04-4a7b-ae65-4a0d31834671 service nova] Creating event network-vif-deleted:e4de7822-2264-47ae-82ad-a03aec6ec40c for instance 207daa83-737b-4a44-ba70-f66efb07bcaa on n-h1-862876-2 Oct 28 13:17:55.920249 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7f087156-8d82-4f76-8aa0-e493f918546e req-79339b67-ed04-4a7b-ae65-4a0d31834671 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128746 Oct 28 13:17:55.922559 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1704/3513] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:17:56.092358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bb938081-7e28-498d-9e6a-651b55c09b83 req-994c0fdb-951d-4882-a2d8-8c76d2e4a97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d793914c-41a1-415c-93d3-9a2484acfe24", "tag": "484df944-ae61-44a8-afba-183838a958a1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:56.122924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bb938081-7e28-498d-9e6a-651b55c09b83 req-994c0fdb-951d-4882-a2d8-8c76d2e4a97b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:56.123700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bb938081-7e28-498d-9e6a-651b55c09b83 req-994c0fdb-951d-4882-a2d8-8c76d2e4a97b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:56.126981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bb938081-7e28-498d-9e6a-651b55c09b83 req-994c0fdb-951d-4882-a2d8-8c76d2e4a97b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:56.135375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:56.146318 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e626f7e4-d0c9-4419-a276-9f848fd3f011 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.463133 Oct 28 13:17:56.147781 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1810/3514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:55 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:56.156726 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bb938081-7e28-498d-9e6a-651b55c09b83 req-994c0fdb-951d-4882-a2d8-8c76d2e4a97b service nova] Creating event network-changed:484df944-ae61-44a8-afba-183838a958a1 for instance d793914c-41a1-415c-93d3-9a2484acfe24 on n-h2-862876-2 Oct 28 13:17:56.173289 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bb938081-7e28-498d-9e6a-651b55c09b83 req-994c0fdb-951d-4882-a2d8-8c76d2e4a97b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084391 Oct 28 13:17:56.174323 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1705/3515] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:17:56.681416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:56.682033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:56.691913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:56.692682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:56.693946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:56.694215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:56.694983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:56.695587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:56.741105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:56.745639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:56.745639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:56.745639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lazy-loading 'fault' on Instance uuid 207daa83-737b-4a44-ba70-f66efb07bcaa {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:17:56.802982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:56.815030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:56.816329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:56.822251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b4d8d86-0564-48a4-b8c0-610a20b45c13 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 200 len: 1306 microversion: 2.1 time: 0.144681 Oct 28 13:17:56.823328 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1811/3516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:56 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 1306 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:56.839268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:56.850669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:56.852213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:56.858448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:56.859212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:56.859933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:57.174389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:57.175024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:57.182871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:57.183361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:57.190313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:57.191303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:57.192284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:57.192870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:57.221217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:57.238619 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-308bf991-b3eb-4154-9d13-62fdb237a85c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.430621 Oct 28 13:17:57.246988 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1706/3517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:56 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:57.557891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:57.566690 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-811dad76-273a-44cb-bc04-37367aaa0d65 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.396048 Oct 28 13:17:57.567967 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1812/3518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:57 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:17:57.848732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:57.850371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:57.879654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:57.882630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:57.883648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:57.885260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:57.886019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:57.886496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:57.922989 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa HTTP/1.1 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '207daa83-737b-4a44-ba70-f66efb07bcaa'} Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:57.925125 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:57.930994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:57.930994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:57.930994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:57.930994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:17:57.930994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:17:57.930994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:17:57.930994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:57.938611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:17:57.940735 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-890edf3f-c32a-44e6-be4a-09ef2afe1f67 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 404 len: 111 microversion: 2.1 time: 0.095911 Oct 28 13:17:57.941924 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1707/3519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:57 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:17:57.950072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d021066a-5df0-48bc-a0b0-e9235366febf tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b85a23a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:58.270762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:58.272065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:58.279306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:58.280107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:58.280753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:58.281977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:58.282599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:58.283243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:58.449951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:58.458135 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5339ab4b-902f-4e12-85f4-e4f34018234d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.191187 Oct 28 13:17:58.458727 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1708/3520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:58 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:58.591739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:58.592279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:58.598438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:58.599420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:58.599898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:58.600613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:58.601072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:58.601495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:58.695887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d021066a-5df0-48bc-a0b0-e9235366febf tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549" status: 202 len: 0 microversion: 2.1 time: 0.749137 Oct 28 13:17:58.697232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1813/3521] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:17:57 2022] DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549 => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:17:58.707481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5905b56-2b08-491a-873f-8c5e60df3e53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b858cd30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:58.769106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:58.790869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-15b32401-4c32-4916-85ca-3cf4fd8a576d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.202497 Oct 28 13:17:58.792026 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1709/3522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:58 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:17:59.050691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:59.051292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:59.064020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:59.067124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:59.067124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:59.067124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:59.067124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:59.067124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:59.085205 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 HTTP/1.1 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2c14e187-e2eb-4d72-b691-11b64a2772f3'} Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:17:59.086982 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e4fc6a9-a0ac-4a7d-8f7c-d8ef99b17627 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 404 len: 111 microversion: 2.1 time: 0.042132 Oct 28 13:17:59.091654 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1710/3523] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:17:59 2022] DELETE /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:17:59.098699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:59.099552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2c14e187-e2eb-4d72-b691-11b64a2772f3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:59.107720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:59.108229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:59.108673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:59.109395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:59.109869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:59.110303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:59.166395 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 HTTP/1.1 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2c14e187-e2eb-4d72-b691-11b64a2772f3'} Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:17:59.167994 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 2c14e187-e2eb-4d72-b691-11b64a2772f3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-44abdbc9-7853-41a4-a011-ee0fa15008f2 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3" status: 404 len: 111 microversion: 2.1 time: 0.076520 Oct 28 13:17:59.173297 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1711/3524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:59 2022] GET /compute/v2.1/servers/2c14e187-e2eb-4d72-b691-11b64a2772f3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:17:59.196034 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f5905b56-2b08-491a-873f-8c5e60df3e53 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3" status: 202 len: 0 microversion: 2.1 time: 0.494299 Oct 28 13:17:59.198022 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1814/3525] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:17:58 2022] DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:17:59.215237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b01abacc-d0b3-47d7-9420-3043d499a255 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'create', calling method: .version_select at 0x7f27bdb050d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-440849523", "description": "tempest-description-1079353016"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:17:59.483760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:17:59.484527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:17:59.498923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:59.499794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:59.502515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:59.505350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:17:59.506736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:17:59.508089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:17:59.722111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:17:59.729106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b461682f-7603-43da-a4b8-a825f7a9f6a6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.250229 Oct 28 13:17:59.730004 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1815/3526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:17:59 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:00.119096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ad3bdfc4-fe75-4ae4-9cc6-a0014c65d9a7 req-67f55f0f-f481-4490-87c0-65c1e0b8ed2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d793914c-41a1-415c-93d3-9a2484acfe24", "name": "network-vif-plugged", "status": "completed", "tag": "484df944-ae61-44a8-afba-183838a958a1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:00.129786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ad3bdfc4-fe75-4ae4-9cc6-a0014c65d9a7 req-67f55f0f-f481-4490-87c0-65c1e0b8ed2c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:00.130608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ad3bdfc4-fe75-4ae4-9cc6-a0014c65d9a7 req-67f55f0f-f481-4490-87c0-65c1e0b8ed2c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:00.131322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ad3bdfc4-fe75-4ae4-9cc6-a0014c65d9a7 req-67f55f0f-f481-4490-87c0-65c1e0b8ed2c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:00.144814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ad3bdfc4-fe75-4ae4-9cc6-a0014c65d9a7 req-67f55f0f-f481-4490-87c0-65c1e0b8ed2c service nova] Creating event network-vif-plugged:484df944-ae61-44a8-afba-183838a958a1 for instance d793914c-41a1-415c-93d3-9a2484acfe24 on n-h2-862876-2 Oct 28 13:18:00.151887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ad3bdfc4-fe75-4ae4-9cc6-a0014c65d9a7 req-67f55f0f-f481-4490-87c0-65c1e0b8ed2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.420472 Oct 28 13:18:00.152844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1816/3527] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:00.158574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:00.158863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:00.177257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:00.178231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:00.179375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:00.180399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:00.181668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:00.183004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:00.192088 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b01abacc-d0b3-47d7-9420-3043d499a255 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.980242 Oct 28 13:18:00.194066 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1712/3528] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:17:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:00.241012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11ba59ac-e4e7-4df1-b45e-3d244f67b0b5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Action: 'update', calling method: .version_select at 0x7f27bd904280>, body: {"security_group": {"name": "tempest-sg-hth-1136425768", "description": "tempest-description-hth-262830807"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:00.469175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:00.478252 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eed9fded-5cd0-4777-ac8d-14faf664cc6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.324199 Oct 28 13:18:00.478867 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1817/3529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:00 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:00.759544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:00.760227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:00.769168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:00.769945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:00.772290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:00.774796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:00.776513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:00.777146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:00.794886 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11ba59ac-e4e7-4df1-b45e-3d244f67b0b5 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/140667bb-8864-4469-8d07-ae99ec977f84" status: 200 len: 217 microversion: 2.1 time: 0.590295 Oct 28 13:18:00.800074 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1713/3530] 10.222.0.25 () {60 vars in 1290 bytes} [Fri Oct 28 13:18:00 2022] PUT /compute/v2.1/os-security-groups/140667bb-8864-4469-8d07-ae99ec977f84 => generated 217 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:00.812305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42a8c64d-9a9b-4552-baef-137377634053 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b95540d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:00.971446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42a8c64d-9a9b-4552-baef-137377634053 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/140667bb-8864-4469-8d07-ae99ec977f84" status: 200 len: 217 microversion: 2.1 time: 0.162975 Oct 28 13:18:00.972065 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1714/3531] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:18:00 2022] GET /compute/v2.1/os-security-groups/140667bb-8864-4469-8d07-ae99ec977f84 => generated 217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:18:00.988396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-294fcf63-ba6a-475e-b79d-788d15cb3771 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b8baf790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.055909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:01.071722 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f926900-78d2-4af2-969c-41cb919d4f76 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1293 microversion: 2.1 time: 0.316674 Oct 28 13:18:01.074248 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1818/3532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:00 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1293 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:01.511013 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-294fcf63-ba6a-475e-b79d-788d15cb3771 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/140667bb-8864-4469-8d07-ae99ec977f84" status: 202 len: 0 microversion: 2.1 time: 0.516947 Oct 28 13:18:01.511013 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1715/3533] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:00 2022] DELETE /compute/v2.1/os-security-groups/140667bb-8864-4469-8d07-ae99ec977f84 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:18:01.511797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.511797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:01.518071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.518570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:01.521425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:01.532945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:01.538517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:01.539048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:01.539499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:01.539694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:01.540221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:01.540509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:01.540683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:01.541117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:01.541880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:01.542508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:01.543561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:01.566665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa HTTP/1.1 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '207daa83-737b-4a44-ba70-f66efb07bcaa'} Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:01.580396 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.586299 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.592636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:01.593399 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b2a8c1d3-65d4-484b-be75-ae658d76b3c9 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 404 len: 111 microversion: 2.1 time: 0.079267 Oct 28 13:18:01.595087 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1716/3534] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:18:01 2022] DELETE /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:01.608387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.614890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: 207daa83-737b-4a44-ba70-f66efb07bcaa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:01.628949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:01.635390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:01.636395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:01.638797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:01.656487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:01.656487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:01.664544 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa HTTP/1.1 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '207daa83-737b-4a44-ba70-f66efb07bcaa'} Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.666197 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Instance 207daa83-737b-4a44-ba70-f66efb07bcaa could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:01.671762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-10b30669-3a3a-4650-83cf-4366965ad0bd tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa" status: 404 len: 111 microversion: 2.1 time: 0.067657 Oct 28 13:18:01.672514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1717/3535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:01 2022] GET /compute/v2.1/servers/207daa83-737b-4a44-ba70-f66efb07bcaa => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:01.685849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05e58115-c7db-480d-8dae-1393e233c6ca tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bdb294c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.731218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-05e58115-c7db-480d-8dae-1393e233c6ca tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:18:01.732054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-05e58115-c7db-480d-8dae-1393e233c6ca tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:18:01.733090 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-05e58115-c7db-480d-8dae-1393e233c6ca tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist Oct 28 13:18:01.733090 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-201a97dc-a1fc-416e-904c-ed3415a9e24f'] Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05e58115-c7db-480d-8dae-1393e233c6ca tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3 HTTP/1.1 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-201a97dc-a1fc-416e-904c-ed3415a9e24f'] Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '339b3130-bc26-4e3e-9430-f317f3b8f7a3'} Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:18:01.744305 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-201a97dc-a1fc-416e-904c-ed3415a9e24f'] Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-201a97dc-a1fc-416e-904c-ed3415a9e24f'] Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-201a97dc-a1fc-416e-904c-ed3415a9e24f'] Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-201a97dc-a1fc-416e-904c-ed3415a9e24f'] Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05e58115-c7db-480d-8dae-1393e233c6ca tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 339b3130-bc26-4e3e-9430-f317f3b8f7a3 does not exist Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-201a97dc-a1fc-416e-904c-ed3415a9e24f'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-05e58115-c7db-480d-8dae-1393e233c6ca tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3" status: 404 len: 194 microversion: 2.1 time: 0.064122 Oct 28 13:18:01.749555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1718/3536] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:01 2022] DELETE /compute/v2.1/os-security-groups/339b3130-bc26-4e3e-9430-f317f3b8f7a3 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:01.757643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ed0c3c5-69d4-46bc-8468-40277d13f008 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bd904940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.797416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-5ed0c3c5-69d4-46bc-8468-40277d13f008 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:18:01.798022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-5ed0c3c5-69d4-46bc-8468-40277d13f008 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:18:01.798572 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5ed0c3c5-69d4-46bc-8468-40277d13f008 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist Oct 28 13:18:01.798572 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-a1e86e10-d1fd-4040-9f5d-b6956fbfea2e'] Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ed0c3c5-69d4-46bc-8468-40277d13f008 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549 HTTP/1.1 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-a1e86e10-d1fd-4040-9f5d-b6956fbfea2e'] Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6eaf2ffa-6a44-47fc-861d-05d66c47d549'} Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:18:01.800510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e86e10-d1fd-4040-9f5d-b6956fbfea2e'] Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e86e10-d1fd-4040-9f5d-b6956fbfea2e'] Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e86e10-d1fd-4040-9f5d-b6956fbfea2e'] Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e86e10-d1fd-4040-9f5d-b6956fbfea2e'] Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ed0c3c5-69d4-46bc-8468-40277d13f008 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 6eaf2ffa-6a44-47fc-861d-05d66c47d549 does not exist Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-a1e86e10-d1fd-4040-9f5d-b6956fbfea2e'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ed0c3c5-69d4-46bc-8468-40277d13f008 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549" status: 404 len: 194 microversion: 2.1 time: 0.054303 Oct 28 13:18:01.810622 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1719/3537] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:01 2022] DELETE /compute/v2.1/os-security-groups/6eaf2ffa-6a44-47fc-861d-05d66c47d549 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:01.817190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0dca0f3-706a-4ea6-8972-9285c62aaa6e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bd9e0b80>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.843265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-c0dca0f3-706a-4ea6-8972-9285c62aaa6e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:18:01.843945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-c0dca0f3-706a-4ea6-8972-9285c62aaa6e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:18:01.844851 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c0dca0f3-706a-4ea6-8972-9285c62aaa6e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:18:01.844851 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-3204be25-fe6e-473d-bf61-2b9845570c65'] Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0dca0f3-706a-4ea6-8972-9285c62aaa6e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03 HTTP/1.1 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-3204be25-fe6e-473d-bf61-2b9845570c65'] Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '95d84462-e7b2-4c8f-b0ae-ce7f97755a03'} Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:18:01.848004 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3204be25-fe6e-473d-bf61-2b9845570c65'] Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3204be25-fe6e-473d-bf61-2b9845570c65'] Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3204be25-fe6e-473d-bf61-2b9845570c65'] Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3204be25-fe6e-473d-bf61-2b9845570c65'] Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0dca0f3-706a-4ea6-8972-9285c62aaa6e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 95d84462-e7b2-4c8f-b0ae-ce7f97755a03 does not exist Oct 28 13:18:01.853591 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-3204be25-fe6e-473d-bf61-2b9845570c65'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:01.856794 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c0dca0f3-706a-4ea6-8972-9285c62aaa6e tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03" status: 404 len: 194 microversion: 2.1 time: 0.041043 Oct 28 13:18:01.861144 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1720/3538] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:01 2022] DELETE /compute/v2.1/os-security-groups/95d84462-e7b2-4c8f-b0ae-ce7f97755a03 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:01.867847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac167c4a-9010-4955-9e40-ba00fa11cb9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b9c7c700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.895880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-ac167c4a-9010-4955-9e40-ba00fa11cb9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:18:01.896701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-ac167c4a-9010-4955-9e40-ba00fa11cb9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group d8cf9275-6345-4d2d-a7e1-86179991b454 not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:18:01.897298 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ac167c4a-9010-4955-9e40-ba00fa11cb9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:18:01.897298 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-9ddbe653-15a0-4e17-a544-26c178a6cf67'] Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac167c4a-9010-4955-9e40-ba00fa11cb9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454 HTTP/1.1 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-9ddbe653-15a0-4e17-a544-26c178a6cf67'] Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'd8cf9275-6345-4d2d-a7e1-86179991b454'} Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:18:01.901214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddbe653-15a0-4e17-a544-26c178a6cf67'] Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddbe653-15a0-4e17-a544-26c178a6cf67'] Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddbe653-15a0-4e17-a544-26c178a6cf67'] Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddbe653-15a0-4e17-a544-26c178a6cf67'] Oct 28 13:18:01.905829 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.915272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac167c4a-9010-4955-9e40-ba00fa11cb9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group d8cf9275-6345-4d2d-a7e1-86179991b454 does not exist Oct 28 13:18:01.915272 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-9ddbe653-15a0-4e17-a544-26c178a6cf67'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:01.917597 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ac167c4a-9010-4955-9e40-ba00fa11cb9d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454" status: 404 len: 194 microversion: 2.1 time: 0.055322 Oct 28 13:18:01.923239 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1721/3539] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:01 2022] DELETE /compute/v2.1/os-security-groups/d8cf9275-6345-4d2d-a7e1-86179991b454 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:01.928878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57de4d27-02c9-4345-89b4-0ec3a02131dc tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bdb29c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:01.980444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-57de4d27-02c9-4345-89b4-0ec3a02131dc tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:18:01.981052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-57de4d27-02c9-4345-89b4-0ec3a02131dc tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 82927cc0-801f-4995-84cb-1b994bda17bd not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:18:01.981570 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-57de4d27-02c9-4345-89b4-0ec3a02131dc tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:18:01.981570 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-d495692f-b54f-4fcc-ba7c-c20cf427da5b'] Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57de4d27-02c9-4345-89b4-0ec3a02131dc tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd HTTP/1.1 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-d495692f-b54f-4fcc-ba7c-c20cf427da5b'] Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '82927cc0-801f-4995-84cb-1b994bda17bd'} Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:18:01.984095 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d495692f-b54f-4fcc-ba7c-c20cf427da5b'] Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d495692f-b54f-4fcc-ba7c-c20cf427da5b'] Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d495692f-b54f-4fcc-ba7c-c20cf427da5b'] Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d495692f-b54f-4fcc-ba7c-c20cf427da5b'] Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57de4d27-02c9-4345-89b4-0ec3a02131dc tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 82927cc0-801f-4995-84cb-1b994bda17bd does not exist Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-d495692f-b54f-4fcc-ba7c-c20cf427da5b'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57de4d27-02c9-4345-89b4-0ec3a02131dc tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd" status: 404 len: 194 microversion: 2.1 time: 0.061123 Oct 28 13:18:01.991691 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1722/3540] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:01 2022] DELETE /compute/v2.1/os-security-groups/82927cc0-801f-4995-84cb-1b994bda17bd => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:02.003799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30a50c83-20df-4463-9b4e-d05050c13413 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27bd904ee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:02.042361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG neutronclient.v2_0.client [None req-30a50c83-20df-4463-9b4e-d05050c13413 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist", "detail": ""}} {{(pid=127794) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:18:02.044524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.security_group_api [None req-30a50c83-20df-4463-9b4e-d05050c13413 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Neutron security group 0177b883-5e52-4d7c-8a74-3789a41f373f not found {{(pid=127794) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:18:02.045370 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-30a50c83-20df-4463-9b4e-d05050c13413 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:18:02.045370 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-6f1957b0-ccc1-4fde-9d2f-a603e545348f'] Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30a50c83-20df-4463-9b4e-d05050c13413 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f HTTP/1.1 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: exception: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-6f1957b0-ccc1-4fde-9d2f-a603e545348f'] Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '0177b883-5e52-4d7c-8a74-3789a41f373f'} Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:18:02.051112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1957b0-ccc1-4fde-9d2f-a603e545348f'] Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1957b0-ccc1-4fde-9d2f-a603e545348f'] Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1957b0-ccc1-4fde-9d2f-a603e545348f'] Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f1957b0-ccc1-4fde-9d2f-a603e545348f'] Oct 28 13:18:02.057118 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:02.063805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30a50c83-20df-4463-9b4e-d05050c13413 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Security group 0177b883-5e52-4d7c-8a74-3789a41f373f does not exist Oct 28 13:18:02.063805 n-d-862876-2 devstack@n-api.service[127794]: Neutron server returns request_ids: ['req-6f1957b0-ccc1-4fde-9d2f-a603e545348f'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:02.064562 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30a50c83-20df-4463-9b4e-d05050c13413 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f" status: 404 len: 194 microversion: 2.1 time: 0.073647 Oct 28 13:18:02.067636 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1723/3541] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:01 2022] DELETE /compute/v2.1/os-security-groups/0177b883-5e52-4d7c-8a74-3789a41f373f => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:02.082289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:02.083139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:02.095029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:02.095594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:02.096040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:02.097233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:02.097752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:02.098233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:02.132171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:18:02.136495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:02.146566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e228c18a-00c0-49e2-8cc0-2cb3a6e661e3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.648774 Oct 28 13:18:02.150830 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1819/3542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:01 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:02.158053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:02.161232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:02.174639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:02.177607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:02.178060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:02.178864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:02.179538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:02.180172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:02.587076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:02.595449 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c4f2c59-0659-4062-a7dd-716e13f23528 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1474 microversion: 2.1 time: 0.443498 Oct 28 13:18:02.596042 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1820/3543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:02 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:02.782705 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b85ebdc-1d8f-4401-b62f-a5ec001037d8 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 204 len: 0 microversion: 2.1 time: 0.708816 Oct 28 13:18:02.785557 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1724/3544] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:18:02 2022] DELETE /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:18:02.787772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1060359579", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:02.796438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:02.797456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:02.805699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:02.809699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:02.809699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:02.811764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:02.812691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:02.813328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:02.917264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:18:03.055527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:03.066035 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e641790e-2748-464e-b646-c5d638773f25 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1647 microversion: 2.1 time: 0.275023 Oct 28 13:18:03.066965 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1725/3545] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:02 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1647 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:03.193781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:03.194418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:03.203283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:03.204029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:03.210847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:03.210847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:03.210847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:03.210847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:03.524510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:03.527582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6b7be97-4b39-44e0-952a-40c9bcf056f4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.356184 Oct 28 13:18:03.547012 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1726/3546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:03 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:03.594932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-73080fd2-51fa-4950-8b28-76d856233270 req-33036c22-5ca8-4799-90ea-6aebb82a31c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4923609-8fac-4a9b-ab1a-8e35fd1d95f7", "name": "network-vif-plugged", "status": "completed", "tag": "28446564-effa-405e-b48e-11317d88b817"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:03.634237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73080fd2-51fa-4950-8b28-76d856233270 req-33036c22-5ca8-4799-90ea-6aebb82a31c5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:03.634237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73080fd2-51fa-4950-8b28-76d856233270 req-33036c22-5ca8-4799-90ea-6aebb82a31c5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:03.634237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73080fd2-51fa-4950-8b28-76d856233270 req-33036c22-5ca8-4799-90ea-6aebb82a31c5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:03.671914 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-73080fd2-51fa-4950-8b28-76d856233270 req-33036c22-5ca8-4799-90ea-6aebb82a31c5 service nova] Creating event network-vif-plugged:28446564-effa-405e-b48e-11317d88b817 for instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 on n-h2-862876-2 Oct 28 13:18:03.694023 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-73080fd2-51fa-4950-8b28-76d856233270 req-33036c22-5ca8-4799-90ea-6aebb82a31c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142069 Oct 28 13:18:03.695061 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1727/3547] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:04.098328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:04.099030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:04.114870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:04.115664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:04.118689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:04.121069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:04.125173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:04.127925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:04.175213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:18:04.175767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:18:04.177697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:18:04.178219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:18:04.178729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:18:04.216050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:04.216704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:04.247557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:04.250070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:04.256550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:04.258885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:04.337698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:04.350668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:04.378611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:18:04.381511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 605a0992-422f-40a8-8c8a-8c3c3f00c598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:18:04.729241 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50db8955-5839-4727-891a-11a62f56ca17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.951769 Oct 28 13:18:04.740461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1821/3548] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:18:04.753977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:04.754619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:04.784444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:04.788169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:04.788713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:04.790872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:04.799908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:04.799908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.057760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:05.067100 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-39355213-09b5-4c5d-a7ce-2958c3c7fa6e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.325438 Oct 28 13:18:05.070319 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1822/3549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:04 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:05.076499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-041e2da5-83cf-4aa8-8a56-393139acd950 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:05.083183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-041e2da5-83cf-4aa8-8a56-393139acd950 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 605a0992-422f-40a8-8c8a-8c3c3f00c598] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:05.113281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-041e2da5-83cf-4aa8-8a56-393139acd950 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 605a0992-422f-40a8-8c8a-8c3c3f00c598] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:18:05.178244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:05.193535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d14530e-cfca-4610-83d8-cfd6ddec5113 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1647 microversion: 2.1 time: 1.101765 Oct 28 13:18:05.195309 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1728/3550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:04 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1647 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:05.426927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:05.427496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:05.468691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.472029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.473498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.477549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.487373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.487373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.513883 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 HTTP/1.1 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2947206d-44a2-41bb-af6a-75fed884b370'} Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:05.516680 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cde7ec17-3805-4466-bafb-ba30e24619b3 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 404 len: 111 microversion: 2.1 time: 0.115089 Oct 28 13:18:05.531948 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1729/3551] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:18:05 2022] DELETE /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:05.534736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-27055c7a-ce01-4a98-8e8c-e700486d41cf req-9dcff4b8-230a-40c6-848a-c07d9d7ad6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03be984-eb23-4b20-8dca-6cef4bb29936", "name": "network-vif-deleted", "tag": "e8e622b8-bde4-43dc-8343-b0a04e32e363"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:05.546145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-27055c7a-ce01-4a98-8e8c-e700486d41cf req-9dcff4b8-230a-40c6-848a-c07d9d7ad6a4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.547520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-27055c7a-ce01-4a98-8e8c-e700486d41cf req-9dcff4b8-230a-40c6-848a-c07d9d7ad6a4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.547967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-27055c7a-ce01-4a98-8e8c-e700486d41cf req-9dcff4b8-230a-40c6-848a-c07d9d7ad6a4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.576505 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-27055c7a-ce01-4a98-8e8c-e700486d41cf req-9dcff4b8-230a-40c6-848a-c07d9d7ad6a4 service nova] Creating event network-vif-deleted:e8e622b8-bde4-43dc-8343-b0a04e32e363 for instance c03be984-eb23-4b20-8dca-6cef4bb29936 on n-h1-862876-2 Oct 28 13:18:05.603776 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-27055c7a-ce01-4a98-8e8c-e700486d41cf req-9dcff4b8-230a-40c6-848a-c07d9d7ad6a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072261 Oct 28 13:18:05.605552 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1730/3552] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 2947206d-44a2-41bb-af6a-75fed884b370] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.624881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.657593 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 HTTP/1.1 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2947206d-44a2-41bb-af6a-75fed884b370'} Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.659386 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 2947206d-44a2-41bb-af6a-75fed884b370 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:05.665036 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f95acb4b-55f7-4846-bdfb-21edf36a84b4 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370" status: 404 len: 111 microversion: 2.1 time: 0.056372 Oct 28 13:18:05.670277 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1731/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:05 2022] GET /compute/v2.1/servers/2947206d-44a2-41bb-af6a-75fed884b370 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:05.675327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:05.675840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:05.691376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.691888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.696258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.697138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.697630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.698078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.750349 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 HTTP/1.1 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'be0a200a-8337-4ce1-9404-6e719e6c00c3'} Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:05.754997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bf2a84f2-0f47-4e82-bad0-743d404c5577 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 404 len: 111 microversion: 2.1 time: 0.090649 Oct 28 13:18:05.770598 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1732/3554] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:18:05 2022] DELETE /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:05.799540 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-041e2da5-83cf-4aa8-8a56-393139acd950 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598" status: 204 len: 0 microversion: 2.1 time: 0.726267 Oct 28 13:18:05.801568 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1823/3555] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:18:05 2022] DELETE /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:18:05.807652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:05.816349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: be0a200a-8337-4ce1-9404-6e719e6c00c3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:05.823606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3274883a-d48a-483b-8841-af36461519cc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:05.824657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3274883a-d48a-483b-8841-af36461519cc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 605a0992-422f-40a8-8c8a-8c3c3f00c598] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:05.829124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:05.840647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.841261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.841820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.843123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:05.852307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:05.867988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:05.904713 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-3274883a-d48a-483b-8841-af36461519cc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3274883a-d48a-483b-8841-af36461519cc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598 HTTP/1.1 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '605a0992-422f-40a8-8c8a-8c3c3f00c598'} Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.918217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3274883a-d48a-483b-8841-af36461519cc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:05.924385 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3274883a-d48a-483b-8841-af36461519cc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598" status: 404 len: 111 microversion: 2.1 time: 0.102969 Oct 28 13:18:05.927289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1824/3556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:05 2022] GET /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:05.937505 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 HTTP/1.1 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'be0a200a-8337-4ce1-9404-6e719e6c00c3'} Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:05.943171 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.948765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:05.948765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:05.948765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:05.948765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:05.948765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:05.948765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. Oct 28 13:18:05.948765 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:05.951813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance be0a200a-8337-4ce1-9404-6e719e6c00c3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:05.965589 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-10764341-4c0d-448b-b14f-79b4472f7b22 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3" status: 404 len: 111 microversion: 2.1 time: 0.178663 Oct 28 13:18:05.965589 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1733/3557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:05 2022] GET /compute/v2.1/servers/be0a200a-8337-4ce1-9404-6e719e6c00c3 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:06.092915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:06.093631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:06.120144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:06.120651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:06.121083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:06.121815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:06.122265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:06.122693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:06.137888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-738819702", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "35b0cf8f-78ca-4b1e-81d5-1a1186c30f61"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:06.233659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:18:06.575758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:06.585113 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c66f558-c846-4855-a0cd-f881d488954b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1315 microversion: 2.1 time: 0.495987 Oct 28 13:18:06.608216 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1825/3558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:06 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:06.621892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:06.622524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:06.629983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:06.630485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:06.638995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:06.640063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:06.652286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:06.652286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:06.732164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:06.769865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:06.770405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:06.787822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:06.789684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lazy-loading 'fault' on Instance uuid c03be984-eb23-4b20-8dca-6cef4bb29936 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:18:06.899182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a3edc69b5e426b9e4434a60d95ab4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d4361acebe4e51b86153651a68b957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:06.920056 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2ea9a9cb-4cd9-441b-a05e-fadcf3623f00 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 200 len: 1305 microversion: 2.1 time: 0.314308 Oct 28 13:18:06.920659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1826/3559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:06 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 1305 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:06.930490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:18:06.931183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:18:06.931859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:18:06.932432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:18:06.933022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:18:06.943646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:06.944176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:06.944696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:06.945586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:06.946077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:06.946505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:06.989632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:06.993303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:07.007235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:18:07.009884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:18:07.279859 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d75134ba-44fa-4384-ab82-bd7a53efbec8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146191 Oct 28 13:18:07.294554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1734/3560] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:18:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:18:07.295140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-30382616-9c16-4d5a-8003-c4e1db197458 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:07.307580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-30382616-9c16-4d5a-8003-c4e1db197458 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:07.396493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-30382616-9c16-4d5a-8003-c4e1db197458 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:07.408099 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-30382616-9c16-4d5a-8003-c4e1db197458 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1220 microversion: 2.1 time: 0.119467 Oct 28 13:18:07.409522 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1827/3561] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:07 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:07.616529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:07.617155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:07.641605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:07.642123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:07.643042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:07.643648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:07.651528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:07.652277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:07.916252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:07.942812 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e82435bc-f3fd-489d-97b3-da43a0a99e6b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1501 microversion: 2.1 time: 0.331358 Oct 28 13:18:07.943882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1735/3562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:07 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1501 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:07.946431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:07.947965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] [instance: c03be984-eb23-4b20-8dca-6cef4bb29936] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:07.961137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:07.961628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:07.962072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:07.970593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:07.971406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:07.977496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:07.977995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:07.978441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:07.987313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:07.988132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:07.988773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:07.991438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:08.002512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:08.002512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:08.005651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:08.024508 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] HTTP exception thrown: Instance c03be984-eb23-4b20-8dca-6cef4bb29936 could not be found. Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Request method failure captured: Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 HTTP/1.1 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9YeCTB6flIXZXT_YRO-2khTNRPKLbgWstdnfdpZmn1IcsolJu_1KoQm2mLQy7lFk3SgnpPaa5WKhnG8ZuZk70Md0CIAa9Z4JUXG3_DQ3EaW1AllosFcmiIXnHoulsiZh1obM1_Vhwk3xq5KVFahLuAr6x-REn89alVDDcYfwH3FK6M Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/56d4361acebe4e51b86153651a68b957"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_56d4361acebe4e51b86153651a68b957", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/56d4361acebe4e51b86153651a68b957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 56d4361acebe4e51b86153651a68b957 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-580781179 Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 47a3edc69b5e426b9e4434a60d95ab4c Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupsTestJSON-580781179-project Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance c03be984-eb23-4b20-8dca-6cef4bb29936 could not be found. Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'c03be984-eb23-4b20-8dca-6cef4bb29936'} Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03be984-eb23-4b20-8dca-6cef4bb29936 could not be found. Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03be984-eb23-4b20-8dca-6cef4bb29936 could not be found. Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:08.026199 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03be984-eb23-4b20-8dca-6cef4bb29936 could not be found. Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:08.031636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Returning 404 to user: Instance c03be984-eb23-4b20-8dca-6cef4bb29936 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:08.036034 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00b1fb84-78fe-4263-923f-de034cd00d26 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936" status: 404 len: 111 microversion: 2.1 time: 0.093167 Oct 28 13:18:08.037564 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1828/3563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:07 2022] GET /compute/v2.1/servers/c03be984-eb23-4b20-8dca-6cef4bb29936 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:18:08.058676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a116419d-f094-4993-a019-7a23db47174d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b84543a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:08.449010 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-907e80b5-5995-4b57-943a-b35048697fb4 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7/action" status: 202 len: 0 microversion: 2.1 time: 0.482647 Oct 28 13:18:08.450689 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1736/3564] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:18:07 2022] POST /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:18:08.462510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b008cfa-b44c-4e76-9e20-fb491d716e69 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:08.463533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3b008cfa-b44c-4e76-9e20-fb491d716e69 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:08.563535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3b008cfa-b44c-4e76-9e20-fb491d716e69 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:08.571803 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b008cfa-b44c-4e76-9e20-fb491d716e69 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1220 microversion: 2.1 time: 0.119543 Oct 28 13:18:08.586920 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1737/3565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:08 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:08.594582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:08.595411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:08.602229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:08.602965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:08.603590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:08.604456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:08.605089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:08.605677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:08.716046 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a116419d-f094-4993-a019-7a23db47174d tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/992fc407-375c-4763-ba3f-bbceb5f756d0" status: 202 len: 0 microversion: 2.1 time: 0.672671 Oct 28 13:18:08.716856 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1829/3566] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:08 2022] DELETE /compute/v2.1/os-security-groups/992fc407-375c-4763-ba3f-bbceb5f756d0 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:18:08.725169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d1480809-0d73-4212-be66-e87c186008b2 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] Calling method '.version_select at 0x7f27b8800d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:08.817930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:08.829402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-82666427-78f0-4451-94e3-1e144a6456fe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1506 microversion: 2.1 time: 0.240423 Oct 28 13:18:08.830479 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1738/3567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:08 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:09.250958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d1480809-0d73-4212-be66-e87c186008b2 tempest-SecurityGroupsTestJSON-580781179 tempest-SecurityGroupsTestJSON-580781179-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/827cc53d-b2ca-4c42-b4db-f14f59d0e264" status: 202 len: 0 microversion: 2.1 time: 0.529423 Oct 28 13:18:09.251742 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1830/3568] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:18:08 2022] DELETE /compute/v2.1/os-security-groups/827cc53d-b2ca-4c42-b4db-f14f59d0e264 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:18:09.599805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:09.600572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:09.618626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:09.619167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:09.619613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:09.620334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:09.620797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:09.621229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:09.858902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:09.859730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:09.872267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:09.873042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:09.874138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:09.877005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:09.877693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:09.878147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:10.375227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:10.384032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-02a1dd00-585e-4f39-a56d-09b33e46a501 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1216 microversion: 2.1 time: 0.788031 Oct 28 13:18:10.408203 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1739/3569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:09 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1216 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:10.477278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:10.491208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-554e11ac-67b9-4175-a812-23ade41d38b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1486 microversion: 2.1 time: 0.637444 Oct 28 13:18:10.505005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1831/3570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:09 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1486 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:10.523192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:10.524280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:10.536915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:10.543779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:10.547858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:10.548856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:10.549577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:10.550267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:10.594193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lazy-loading 'flavor' on Instance uuid f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:18:11.417663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:11.418305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:11.426166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:11.426658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:11.427317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:11.428016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:11.428474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:11.429549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:11.501075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:11.509878 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f00f24b-7f0f-4142-8dab-72fc92185e17 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1280 microversion: 2.1 time: 0.097582 Oct 28 13:18:11.510449 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1832/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:11 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:11.524727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2106691353", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "8a5ca9f0-82b0-4d71-8677-088d1cfb750f"}], "block_device_mapping_v2": [{"uuid": "c22fad2f-00d3-4979-845e-3d13414b615c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:11.595907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] validate_networks() for [('8a5ca9f0-82b0-4d71-8677-088d1cfb750f', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:18:11.999248 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77996fc2-27b7-45ba-ba8f-b55dd2646bf0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7/action" status: 202 len: 0 microversion: 2.1 time: 1.480441 Oct 28 13:18:12.003193 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1740/3572] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:18:10 2022] POST /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7/action => generated 0 bytes in 1485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:18:12.017292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:12.018004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:12.028028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:12.028520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:12.028976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:12.029884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:12.030347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:12.030784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:12.084514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:18:12.084986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:18:12.086078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:18:12.086495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:18:12.086956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:18:12.103932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:12.104427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:12.104872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:12.105608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:12.106074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:12.106512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:12.136170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:12.142366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Getting quotas for user 2042816d9181427cb51f1c710281aa53 and project 5acad27b2ef04ec59e1aaf75997cc653. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:12.237047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:18:12.239510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c22fad2f-00d3-4979-845e-3d13414b615c',volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:18:12.486529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:12.503091 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d1123134-4346-4f97-8389-e85dd1e8b425 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1492 microversion: 2.1 time: 0.498450 Oct 28 13:18:12.504058 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1741/3573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:12 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1492 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:12.551275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:12.551930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:12.560281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:12.560774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:12.568411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:12.568411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:12.568411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:12.568411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:12.679009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:12.687530 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a87689d5-c34d-4124-a3f3-9bc9b5c4a3af tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1278 microversion: 2.1 time: 0.157704 Oct 28 13:18:12.692710 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1742/3574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:12 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:12.886711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9268356b-c5ee-4498-aaaa-1554a2564ef2 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.365130 Oct 28 13:18:12.887428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1833/3575] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:18:12.900339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88d6b749-1ff4-47a1-9f27-924e521f3a57 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:12.901290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88d6b749-1ff4-47a1-9f27-924e521f3a57 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:13.260454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88d6b749-1ff4-47a1-9f27-924e521f3a57 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:13.271269 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88d6b749-1ff4-47a1-9f27-924e521f3a57 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1053 microversion: 2.1 time: 0.375766 Oct 28 13:18:13.274145 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1743/3576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:12 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1053 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:13.319193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:13.320260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:13.378857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.380535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.383306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:13.384565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.386673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.391776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:13.460088 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 HTTP/1.1 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '18c24964-fb49-4247-a5fe-c8af53330f59'} Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:13.462426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.468112 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.471899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:13.473655 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-62aa1825-0e1a-4247-acc6-b1b310601c7f tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 404 len: 111 microversion: 2.1 time: 0.159782 Oct 28 13:18:13.474820 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1834/3577] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:18:13 2022] DELETE /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:13.484999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:13.492770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] [instance: 18c24964-fb49-4247-a5fe-c8af53330f59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:13.497337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.498132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.499420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:13.500878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.501527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.502768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:13.526619 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] HTTP exception thrown: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.529000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Request method failure captured: Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 HTTP/1.1 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9TXwHPUhijaQMgDy0AXKGCD284qK_WSAeDQjRubUW_x6pW6BISuIZ99t2i7h537ZUG4pKpnpb6Xggr8eiXMJfffH2amOM_qbP_3Urzh-hFziBGqtVdJmc3Yhi6Ie_d4atmmZEW15b7__hWXd08SdJ38FMMSdH4Q3LaZiShekOTjA6o Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f68daf1ebe84ac6844d1658e33b5c3a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f68daf1ebe84ac6844d1658e33b5c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7f68daf1ebe84ac6844d1658e33b5c3a Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805044355 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e078236549214dddb42cabe996363a24 Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeNegativeTest-805044355-project Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '18c24964-fb49-4247-a5fe-c8af53330f59'} Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:13.530186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.535795 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:13.535795 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:13.535795 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:13.535795 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:13.535795 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:13.535795 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. Oct 28 13:18:13.535795 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:13.540895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] Returning 404 to user: Instance 18c24964-fb49-4247-a5fe-c8af53330f59 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:13.544740 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d3949d4-b291-4d94-922f-b5606074eef1 tempest-AttachVolumeNegativeTest-805044355 tempest-AttachVolumeNegativeTest-805044355-project] 10.222.0.25 "GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59" status: 404 len: 111 microversion: 2.1 time: 0.064760 Oct 28 13:18:13.551537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1744/3578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:13 2022] GET /compute/v2.1/servers/18c24964-fb49-4247-a5fe-c8af53330f59 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:18:13.551684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:13.578281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.584884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.584884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:13.584884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.591186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.591743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:13.721166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:13.722148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:13.742972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.746078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.748521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:13.755364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:13.755505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:13.759662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:14.065592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:14.075124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-08d6b0f3-1ec8-433b-a32a-92417acec475 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1513 microversion: 2.1 time: 0.550801 Oct 28 13:18:14.077857 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1835/3579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:13 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1513 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:14.325181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47cb29fb-4125-4c6a-b97b-9cec82c2c911 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:14.328861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47cb29fb-4125-4c6a-b97b-9cec82c2c911 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:14.558049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:14.579415 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-39d1e322-579d-4fbf-ae0f-cd852ff2ef94 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 0.862856 Oct 28 13:18:14.580568 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1745/3580] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:13 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:14.607486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47cb29fb-4125-4c6a-b97b-9cec82c2c911 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:14.615149 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47cb29fb-4125-4c6a-b97b-9cec82c2c911 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1053 microversion: 2.1 time: 0.319121 Oct 28 13:18:14.632676 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1836/3581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:14 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1053 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:15.105234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:15.106172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:15.117827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:15.126714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:15.132191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:15.140966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:15.140966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:15.140966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:15.609788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:15.610417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:15.645488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:15.646638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:15.648707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:15.655473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:15.655473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:15.655473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:15.880497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:15.891071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f338e1ca-8cf6-4a77-b368-535149a566d2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.791215 Oct 28 13:18:15.893112 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1746/3582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:15 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:15.918171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:15.919063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:15.926845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:15.928709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:15.930013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:15.930947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:15.932524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:15.934177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:16.069642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:16.103654 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab37cf1c-6a2e-4600-a3f8-57f9ea467d2b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 0.501563 Oct 28 13:18:16.105695 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1837/3583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:15 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:16.142119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:16.155150 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a0aa18d-5986-4e9f-ac70-6fef60174d5b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1151 microversion: 2.1 time: 0.244254 Oct 28 13:18:16.155876 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1747/3584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:15 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1151 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:16.921872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:16.922394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:16.951325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:16.952024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:16.952491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:16.953248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:16.953716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:16.954145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:17.128108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:17.129420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:17.145509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:17.153063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:17.153793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:17.155365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:17.157505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:17.158804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:17.159429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:18.504970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:18.519389 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3eadda6f-5c34-4b6c-b166-ee22d4dd2d0e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 1.601429 Oct 28 13:18:18.522056 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1838/3585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:16 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:18.558448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:18.561880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:18.567170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:18.567670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:18.568110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:18.569059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:18.569557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:18.569982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:19.033342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:19.046537 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3e8cab3-5296-4975-95b4-87c321d28492 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 1.922518 Oct 28 13:18:19.059235 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1748/3586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:17 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:19.308456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5144f45f-2422-4a02-83cf-52095dc5d0db req-83c812dc-0721-47c8-8301-755682387f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4923609-8fac-4a9b-ab1a-8e35fd1d95f7", "name": "network-vif-plugged", "status": "completed", "tag": "28446564-effa-405e-b48e-11317d88b817"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:19.336351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5144f45f-2422-4a02-83cf-52095dc5d0db req-83c812dc-0721-47c8-8301-755682387f33 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:19.338539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:19.353614 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6cbe6975-a2ac-4a5a-abd6-3d97bb74d9b4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1169 microversion: 2.1 time: 0.827417 Oct 28 13:18:19.367618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5144f45f-2422-4a02-83cf-52095dc5d0db req-83c812dc-0721-47c8-8301-755682387f33 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:19.367618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5144f45f-2422-4a02-83cf-52095dc5d0db req-83c812dc-0721-47c8-8301-755682387f33 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:19.368235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1839/3587] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:18 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1169 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:19.422693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5144f45f-2422-4a02-83cf-52095dc5d0db req-83c812dc-0721-47c8-8301-755682387f33 service nova] Creating event network-vif-plugged:28446564-effa-405e-b48e-11317d88b817 for instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 on n-h2-862876-2 Oct 28 13:18:19.480194 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5144f45f-2422-4a02-83cf-52095dc5d0db req-83c812dc-0721-47c8-8301-755682387f33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175924 Oct 28 13:18:19.492946 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1749/3588] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:19.550884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:19.552376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:19.565598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:19.566421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:19.568778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:19.570386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:19.572361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:19.572994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:20.073946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:20.075372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:20.092216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:20.094816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:20.095478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:20.097584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:20.102182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:20.103044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:21.098445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:21.107278 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e8651bab-419a-4885-9c3b-d3abbc599748 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 1.561521 Oct 28 13:18:21.116037 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1840/3589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:19 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:21.153080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f617eba5-16ad-42b1-926d-1792c3514235 req-59010cde-40ec-4b2b-bdd4-5b62c1baafa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ce0318-21cc-4df6-a6e8-985e68b6563d", "tag": "d8ec5407-e2ac-432c-9898-d864ef504f19"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:21.175930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:21.185641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c987a01-1e05-41a9-b1af-4c9e6ec207f2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 1.118287 Oct 28 13:18:21.186243 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1750/3590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:20 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:21.192953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f617eba5-16ad-42b1-926d-1792c3514235 req-59010cde-40ec-4b2b-bdd4-5b62c1baafa8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:21.192953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f617eba5-16ad-42b1-926d-1792c3514235 req-59010cde-40ec-4b2b-bdd4-5b62c1baafa8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:21.192953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f617eba5-16ad-42b1-926d-1792c3514235 req-59010cde-40ec-4b2b-bdd4-5b62c1baafa8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:21.205395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:21.206448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:21.213560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:21.214244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:21.214891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:21.217044 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f617eba5-16ad-42b1-926d-1792c3514235 req-59010cde-40ec-4b2b-bdd4-5b62c1baafa8 service nova] Creating event network-changed:d8ec5407-e2ac-432c-9898-d864ef504f19 for instance e0ce0318-21cc-4df6-a6e8-985e68b6563d on n-h1-862876-2 Oct 28 13:18:21.220555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:21.221337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:21.225082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:21.228431 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f617eba5-16ad-42b1-926d-1792c3514235 req-59010cde-40ec-4b2b-bdd4-5b62c1baafa8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110857 Oct 28 13:18:21.229724 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1841/3591] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:21.413548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:21.427923 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0d63bdf-ec9e-4989-982e-454ac1c6e856 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1169 microversion: 2.1 time: 0.240587 Oct 28 13:18:21.428746 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1751/3592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:21 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1169 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:22.138447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:22.139175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:22.156767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:22.165127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:22.168407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:22.169174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:22.175927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:22.176871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:22.182446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:22.211848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:22.212562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:22.227639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:22.228154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:22.231986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:22.232736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:22.239091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:22.242128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:23.265542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:23.848188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:23.863762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f5e73ab-b050-48c9-b24d-23e77797f215 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 1.653453 Oct 28 13:18:23.864721 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1752/3593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:22 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:23.886525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:23.887474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:23.895282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:23.899022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:23.899022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:23.900720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:23.901910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:23.904704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:23.913955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:24.130219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:24.140830 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5df74f2-be48-4247-b7ff-b44da40f557f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 2.008193 Oct 28 13:18:24.141689 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1842/3594] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:22 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:24.715246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:24.724577 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fae6a71c-1206-487a-a704-f9079abca17c tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1211 microversion: 2.1 time: 0.857773 Oct 28 13:18:24.738134 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1753/3595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:23 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1211 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:24.890310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:24.891282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:24.895302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=18 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:24.911908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:24.912748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:24.918120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:24.918120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:24.920207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:24.921193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:25.168397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:25.169185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:25.179978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:25.185299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:25.185899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:25.187129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:25.187831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:25.189607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:25.927404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:25.937909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-005af1f7-924a-4061-83d2-54dc28643c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 1.052477 Oct 28 13:18:25.955094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1843/3596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:24 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:25.959160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:25.960646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:25.983970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:25.984832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:25.985778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:25.986734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:25.987446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:25.993337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:26.924026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:26.937188 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5734c010-beb5-4895-b9fc-ff1952a3bbcc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 1.772889 Oct 28 13:18:26.943805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1754/3597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:25 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:26.989900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:26.991274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:27.012975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:27.015354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:27.016455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:27.018416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:27.022889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:27.023613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:27.313324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:27.322621 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d0a324a-1bce-4c49-8603-2fad29bd0ae1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1211 microversion: 2.1 time: 1.379707 Oct 28 13:18:27.327345 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1844/3598] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:25 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1211 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:27.655294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:27.666343 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1df422de-8cb1-4dbe-91db-b9e9e0acc05e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 0.687649 Oct 28 13:18:27.668157 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1755/3599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:26 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:27.977317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:27.977936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:28.004929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:28.005341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:28.005782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:28.013245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:28.018270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:28.022022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:28.355695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:28.357165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:28.370338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:28.374499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:28.377435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:28.378567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:28.381347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:28.386814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:29.021539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:29.032530 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9f0464e-a9de-4568-ada0-48909a09ecd8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1211 microversion: 2.1 time: 0.682502 Oct 28 13:18:29.036958 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1756/3600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:28 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1211 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:29.047823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:29.048431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:29.067632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:29.068877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a249cc1-24fd-4b3a-82e0-8f500e5c1b70 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 1.096115 Oct 28 13:18:29.082375 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1845/3601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:27 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:29.082566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:29.082566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:29.082566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:29.082566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:29.082566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:29.082566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:29.520958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:29.549430 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88d02ea1-58d3-45a9-bf0e-6c45fd5389ef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 0.499085 Oct 28 13:18:29.550367 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1757/3602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:29 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:30.059934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:30.060462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:30.070009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.078026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.078026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.078026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.078026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.078026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.085096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-736a41e1-6bc4-4c1d-9f96-24d2ea43906b req-3de70211-c3fc-4f34-b1ac-e86374317b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796fd28c-d3fc-4143-8fc8-6a4680a8975f", "tag": "cf1e7a15-c820-4706-867a-d001cf5f55f8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:30.091535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:30.123272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-736a41e1-6bc4-4c1d-9f96-24d2ea43906b req-3de70211-c3fc-4f34-b1ac-e86374317b22 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.123861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-736a41e1-6bc4-4c1d-9f96-24d2ea43906b req-3de70211-c3fc-4f34-b1ac-e86374317b22 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.125232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-736a41e1-6bc4-4c1d-9f96-24d2ea43906b req-3de70211-c3fc-4f34-b1ac-e86374317b22 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.166972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-736a41e1-6bc4-4c1d-9f96-24d2ea43906b req-3de70211-c3fc-4f34-b1ac-e86374317b22 service nova] Creating event network-changed:cf1e7a15-c820-4706-867a-d001cf5f55f8 for instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f on n-h1-862876-2 Oct 28 13:18:30.184164 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-736a41e1-6bc4-4c1d-9f96-24d2ea43906b req-3de70211-c3fc-4f34-b1ac-e86374317b22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.519505 Oct 28 13:18:30.185489 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1846/3603] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:30.193466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:30.195730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:30.204354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.205508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.216197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.216197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.216197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.217366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.418611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:30.445312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c4bbfbe1-2694-4578-b114-8d03835a8a20 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.390043 Oct 28 13:18:30.446626 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1758/3604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:30 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:30.519061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a550406f-b058-4926-a9e0-9bd9175a10dc req-3b352d17-3199-4a9f-836a-14893c3c0666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ce0318-21cc-4df6-a6e8-985e68b6563d", "name": "network-vif-plugged", "status": "completed", "tag": "d8ec5407-e2ac-432c-9898-d864ef504f19"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:30.549540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a550406f-b058-4926-a9e0-9bd9175a10dc req-3b352d17-3199-4a9f-836a-14893c3c0666 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.550125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a550406f-b058-4926-a9e0-9bd9175a10dc req-3b352d17-3199-4a9f-836a-14893c3c0666 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.550528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a550406f-b058-4926-a9e0-9bd9175a10dc req-3b352d17-3199-4a9f-836a-14893c3c0666 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.595271 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a550406f-b058-4926-a9e0-9bd9175a10dc req-3b352d17-3199-4a9f-836a-14893c3c0666 service nova] Creating event network-vif-plugged:d8ec5407-e2ac-432c-9898-d864ef504f19 for instance e0ce0318-21cc-4df6-a6e8-985e68b6563d on n-h1-862876-2 Oct 28 13:18:30.609545 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a550406f-b058-4926-a9e0-9bd9175a10dc req-3b352d17-3199-4a9f-836a-14893c3c0666 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096617 Oct 28 13:18:30.616206 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1759/3605] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:30.628530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:30.629551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:30.654447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.654447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.654447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.654447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:30.654447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:30.654447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:30.972286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:30.987171 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f450876a-9985-4771-95af-b9158ac1c5f2 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.799837 Oct 28 13:18:31.008560 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1847/3606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:30 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:31.308681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:31.321400 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b09342e6-038c-48d7-92cf-efc3b5be4f12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 0.703029 Oct 28 13:18:31.325153 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1760/3607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:30 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:31.472862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:31.473499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:31.496401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:31.500852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:31.504849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:31.506117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:31.506833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:31.510520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:32.022280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:32.023004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:32.031232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:32.031727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:32.032165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:32.032876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:32.033339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:32.033768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:32.162328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:32.177420 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-69712e3a-0427-47ac-a61f-33b51dab6ac3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.711172 Oct 28 13:18:32.188109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1848/3608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:31 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:32.348155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:32.349135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:32.360621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:32.365048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:32.371726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:32.372679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:32.375700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:32.376422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:32.625503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:32.642738 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-163701e8-de21-4e24-87c1-ec0848c2b07f tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.623790 Oct 28 13:18:32.645327 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1761/3609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:32 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:33.212499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:33.213095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:33.224987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:33.225512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:33.225949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:33.226663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:33.244397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:33.247616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:33.755384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:33.767235 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e1b7748-6fa2-49cf-83e1-120b5137d435 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.559923 Oct 28 13:18:33.770012 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1762/3610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:33 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:33.797626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:33.799284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:33.818086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:33.821455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:33.822244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:33.823727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:33.825905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:33.826651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:33.847810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:33.869030 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94eb7240-f096-40fc-97fb-06b9cd3fae2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1320 microversion: 2.1 time: 1.518330 Oct 28 13:18:33.890383 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1849/3611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:32 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1320 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:34.553371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:34.567352 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd1a090a-1aa9-4e95-a5f9-40a1538dfb41 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.794577 Oct 28 13:18:34.572768 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1763/3612] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:33 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:34.795658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:34.797811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:34.807870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:34.809274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:34.809274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:34.810186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:34.810971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:34.811681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:34.856755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:34.906918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:34.914064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:34.962842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:34.963329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:34.963761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:34.971685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:34.972170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:34.972864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:35.383387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:35.396087 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8125489f-496e-4206-81a7-13a3de09a4b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.605725 Oct 28 13:18:35.406354 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1850/3613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:34 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:35.601357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:35.601981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:35.632372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:35.635017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:35.636659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:35.637779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:35.643757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:35.646503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:36.001818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:36.020562 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bb661aab-dcc4-40f7-ad99-0c41486a5fb8 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.419641 Oct 28 13:18:36.024992 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1851/3614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:35 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:36.096893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:36.112744 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2e8a5f8e-8c8f-4200-b690-caba04d70c5b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1502 microversion: 2.1 time: 1.215373 Oct 28 13:18:36.117180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1764/3615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:34 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1502 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:36.146392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:36.147557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:36.166409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:36.168382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:36.171042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:36.174401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:36.175336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:36.184884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:36.426602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:36.427273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:36.439804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:36.440655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:36.441396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:36.442405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:36.443201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:36.443983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:37.202644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:37.221337 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a6bd2258-cbdd-416c-bec8-f3dde98c071a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1502 microversion: 2.1 time: 1.078940 Oct 28 13:18:37.223780 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1852/3616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:36 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1502 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:37.231913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:37.234990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:37.246579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:37.247278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:37.247858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:37.248732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:37.249399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:37.249940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:37.376724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:37.388509 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a510eae1-86ed-48a5-bd48-19a26ee5d2b8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.968361 Oct 28 13:18:37.389118 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1765/3617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:36 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:37.430135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:37.430649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:37.461086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:37.461599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:37.462047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:37.462788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:37.463251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:37.474184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:37.558502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:18:37.973039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:37.989642 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f013d3fc-3762-433c-9d78-6187f6afba75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 204 len: 0 microversion: 2.1 time: 0.578371 Oct 28 13:18:37.990326 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1766/3618] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:18:37 2022] DELETE /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:18:38.011533 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1d41c30-7516-4833-b73b-86b7eb1be521 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.766894 Oct 28 13:18:38.011533 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1853/3619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:37 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:38.019173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:38.019890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:38.039536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:38.039951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:38.040467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:38.041280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:38.041878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:38.049620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:38.416762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:38.417824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:38.432714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:38.433279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:38.433792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:38.434503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:38.434990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:38.435603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:38.617000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:38.631196 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4d828657-13c8-415c-8742-e07704f03bc0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1508 microversion: 2.1 time: 0.628715 Oct 28 13:18:38.635911 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1767/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:37 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1508 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:38.673641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8de0673-56c6-4bd8-bbe5-f3653f6d7651 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Action: 'create', calling method: .version_select at 0x7f27b8b67e50>, body: {"keypair": {"name": "tempest-keypair-1706623388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIvf34Fd3c9FzHuXBeDlhJnFGJa4fjBdvgVpDeWmLgvQJ2ICHOCp5V13FKuppm9VZ7eBrc80XxbbDgSWVFrElF7oACAAfc+uK2R9vRKM7cZzapRZ0NogMtfffhaDZ4lWQ=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:38.782062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c8de0673-56c6-4bd8-bbe5-f3653f6d7651 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Getting quotas for project 7c7fd700fc2044c19c2fcc6e6ccc48ae. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:38.806909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c8de0673-56c6-4bd8-bbe5-f3653f6d7651 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Getting quotas for user 9bd4a046d9214c8d819c65dd78ba6bf1 and project 7c7fd700fc2044c19c2fcc6e6ccc48ae. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:38.825080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:38.839888 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8de0673-56c6-4bd8-bbe5-f3653f6d7651 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [8e9a6bd9-dc6c-4f2b-8c2d-cf48bf23457e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 13:18:39.046310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:39.058668 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-833f1998-5313-45b2-8433-b176da1a861b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.646003 Oct 28 13:18:39.080727 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1854/3621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:38 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:39.096079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:39.097114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:39.116862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:39.118476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:39.119307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:39.120215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:39.120859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:39.121465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:39.853032 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8de0673-56c6-4bd8-bbe5-f3653f6d7651 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [8e9a6bd9-dc6c-4f2b-8c2d-cf48bf23457e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35596. Oct 28 13:18:39.861929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:39.881328 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-29be0ae7-c976-4947-a087-f317c3af2f2b tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.794880 Oct 28 13:18:39.882417 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1855/3622] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:39 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:39.901293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:39.903395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:39.918779 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8de0673-56c6-4bd8-bbe5-f3653f6d7651 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 1.252945 Oct 28 13:18:39.919968 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1768/3623] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:18:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1255 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 13:18:39.943657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:39.945671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:39.946452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:39.948799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:39.951721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:39.952832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:40.094485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:40.097078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:40.114026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:40.119698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:40.121641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:40.124921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:40.126767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:40.127286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:40.395405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:40.399064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:40.407408 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32d16b16-a893-4b71-b903-48d24d358aec tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.324205 Oct 28 13:18:40.412185 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1769/3624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:40 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:40.915437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:40.923669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:40.962735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:40.979944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:40.987192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:40.990371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:40.991515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:40.992214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:41.385742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:41.405304 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3410e71c-6067-4835-a50b-0e0b002eb931 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.499274 Oct 28 13:18:41.407202 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1770/3625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:40 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:41.438105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:41.445862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:41.457086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:41.457680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:41.458228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:41.467730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:41.469312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:41.469981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:41.571990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:41.586136 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7fbfc366-c1b9-414b-a4ac-765ef9b7e70b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1508 microversion: 2.1 time: 1.695590 Oct 28 13:18:41.588402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1856/3626] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:39 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1508 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:41.983701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:41.997843 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4733e307-22fd-4b9e-9439-c4764eb53b2d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.565741 Oct 28 13:18:42.005267 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1771/3627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:41 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:42.430424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:42.432332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:42.443501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:42.444050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:42.450701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:42.450701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:42.450701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:42.450701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:42.610441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:42.611167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:42.625139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:42.625639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:42.626066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:42.626987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:42.630060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:42.630752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f91f01d-93a2-40b7-9109-81810c319c1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1508 microversion: 2.1 time: 0.726861 Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1772/3628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:42 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1508 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:43.367824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:43.442885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:43.453128 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9bcb696-29e2-430d-9288-a12ff464eb39 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 1.027307 Oct 28 13:18:43.456160 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1857/3629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:42 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:43.461010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ace46f8e-9f06-4174-893b-f6573a2763b7 req-64db3a57-202e-4548-b344-0164eb47aecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796fd28c-d3fc-4143-8fc8-6a4680a8975f", "name": "network-vif-plugged", "status": "completed", "tag": "cf1e7a15-c820-4706-867a-d001cf5f55f8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:43.471842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ace46f8e-9f06-4174-893b-f6573a2763b7 req-64db3a57-202e-4548-b344-0164eb47aecd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:43.472580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ace46f8e-9f06-4174-893b-f6573a2763b7 req-64db3a57-202e-4548-b344-0164eb47aecd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:43.473186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ace46f8e-9f06-4174-893b-f6573a2763b7 req-64db3a57-202e-4548-b344-0164eb47aecd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:43.490028 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ace46f8e-9f06-4174-893b-f6573a2763b7 req-64db3a57-202e-4548-b344-0164eb47aecd service nova] Creating event network-vif-plugged:cf1e7a15-c820-4706-867a-d001cf5f55f8 for instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f on n-h1-862876-2 Oct 28 13:18:43.495710 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ace46f8e-9f06-4174-893b-f6573a2763b7 req-64db3a57-202e-4548-b344-0164eb47aecd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040293 Oct 28 13:18:43.497235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1858/3630] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:43.748500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4f33142b-ad67-41fe-a707-612157678d8a req-41f3566e-49e3-473b-a34e-b23c6959d690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ce0318-21cc-4df6-a6e8-985e68b6563d", "name": "network-vif-deleted", "tag": "d8ec5407-e2ac-432c-9898-d864ef504f19"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:43.785973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4f33142b-ad67-41fe-a707-612157678d8a req-41f3566e-49e3-473b-a34e-b23c6959d690 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:43.786767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4f33142b-ad67-41fe-a707-612157678d8a req-41f3566e-49e3-473b-a34e-b23c6959d690 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:43.787479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4f33142b-ad67-41fe-a707-612157678d8a req-41f3566e-49e3-473b-a34e-b23c6959d690 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:43.821478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:43.843631 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4f33142b-ad67-41fe-a707-612157678d8a req-41f3566e-49e3-473b-a34e-b23c6959d690 service nova] Creating event network-vif-deleted:d8ec5407-e2ac-432c-9898-d864ef504f19 for instance e0ce0318-21cc-4df6-a6e8-985e68b6563d on n-h1-862876-2 Oct 28 13:18:43.855676 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4965e94-664a-440e-a003-56cb4fcd40e1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.507735 Oct 28 13:18:43.855676 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1773/3631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:43 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:43.866258 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4f33142b-ad67-41fe-a707-612157678d8a req-41f3566e-49e3-473b-a34e-b23c6959d690 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121989 Oct 28 13:18:43.869139 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1859/3632] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:18:44.396740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:44.399292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:44.421497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:44.422264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:44.423587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:44.424462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:44.425415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:44.426008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:44.468689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:44.469567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:44.471255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:44.471954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid e0ce0318-21cc-4df6-a6e8-985e68b6563d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:18:44.485549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:44.486528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:44.501450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:44.504534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:44.507362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:44.508314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:44.509206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:44.511542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:44.697314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:44.718122 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-22fc5128-de70-49d6-9be6-b31793ca628d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1310 microversion: 2.1 time: 0.327881 Oct 28 13:18:44.719702 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1774/3633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:44 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1310 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:44.884327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:44.885366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:44.898033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:44.898792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:44.899416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:44.903147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:44.903147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:44.903964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:45.018111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:45.029179 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5a9e270d-1aa1-4957-8439-9ef249f0a7ec tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.550308 Oct 28 13:18:45.030442 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1860/3634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:44 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:45.281340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:45.291451 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54dfa493-fba0-435e-a782-2fd9bfd24eb1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1199 microversion: 2.1 time: 0.414552 Oct 28 13:18:45.292018 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1775/3635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:44 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1199 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:45.752555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:45.754920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:45.767074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:45.768170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:45.770431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:45.782251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:45.782251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:45.782251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:45.827505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:45.828383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:45.828985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:45.829694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid e0ce0318-21cc-4df6-a6e8-985e68b6563d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:18:45.892366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:45.904317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-417fe67d-d015-4afa-80e2-3638a51be2e9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 200 len: 1310 microversion: 2.1 time: 0.161957 Oct 28 13:18:45.905169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1861/3636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:45 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 1310 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:46.054058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:46.055517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:46.062588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:46.063548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:46.064253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:46.065374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:46.066084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:46.066727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:46.316270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:46.316957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:46.332532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:46.334362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:46.334785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:46.337185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:46.337669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:46.338104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:46.574684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:46.588896 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-251b56c6-c7c3-474e-b388-f11d5f6e448a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1505 microversion: 2.1 time: 0.533335 Oct 28 13:18:46.598983 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1776/3637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:46 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:46.931923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:46.932672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:46.942659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:46.945833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:46.945833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:46.945833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:46.945833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:46.946278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:46.974898 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d HTTP/1.1 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'e0ce0318-21cc-4df6-a6e8-985e68b6563d'} Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:18:46.977024 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e36e1ebf-a046-4f92-922b-4393fe26058c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 404 len: 111 microversion: 2.1 time: 0.050951 Oct 28 13:18:46.988582 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1777/3638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:46 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:18:47.000814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6059b019-21df-4aec-b897-3133d3bd5935 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: .version_select at 0x7f27bd92e700>, body: {"keypair": {"name": "tempest-key-492686361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfKvziwSIMcQqmqQFUdie5ybXsH3Q4smuq45RUIZsC/2w4fT32ERnD2hbakqogB0TFkgew0eN6voB0RB4Gnntr6x5LYaRs3yGhMr6ypUxz3Fzs/ZnNk8rFuYCrEJrM7WQ=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:47.004322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:47.016280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8649aef-43b5-4d89-bc13-33259d49a5c9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1383 microversion: 2.1 time: 0.704510 Oct 28 13:18:47.020370 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1862/3639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:46 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1383 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:47.031231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6059b019-21df-4aec-b897-3133d3bd5935 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:47.037168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6059b019-21df-4aec-b897-3133d3bd5935 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:47.171493 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6059b019-21df-4aec-b897-3133d3bd5935 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.177666 Oct 28 13:18:47.174836 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1778/3640] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:18:46 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:47.184468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92c8a9ce-82b3-4058-bf78-efcca692627f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '.version_select at 0x7f27b8ad8ee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:47.191585 n-d-862876-2 devstack@n-api.service[127794]: WARNING oslo_db.sqlalchemy.utils [None req-92c8a9ce-82b3-4058-bf78-efcca692627f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 13:18:47.206928 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92c8a9ce-82b3-4058-bf78-efcca692627f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.027427 Oct 28 13:18:47.208366 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1779/3641] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:18:47 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:47.250161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1460637893", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dac5605d-2f74-41ba-b0f7-965f038174dd"}, {"port": "ac53c53a-9f3f-4bb6-8e75-30afad7abfcc", "tag": "port-1"}, {"port": "446efb77-9678-4e81-8d74-330b08b10c0e", "tag": "port-2"}, {"uuid": "06885aa9-6cf8-422d-b793-e0f30aeda2dc", "tag": "net-1"}, {"uuid": "06885aa9-6cf8-422d-b793-e0f30aeda2dc"}, {"uuid": "4f6170de-81ee-4815-b1d3-6c38fd68ef43", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4f6170de-81ee-4815-b1d3-6c38fd68ef43", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d73f7dd0-952b-497f-91ad-19cc10e03757", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1fcaede6-651a-4071-9e33-38f1c4c97c7f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ec9032fb-b2e3-4caf-b143-3dd13bf872cc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1870918362"}], "key_name": "tempest-keypair-1706623388", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:47.456499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] validate_networks() for [('dac5605d-2f74-41ba-b0f7-965f038174dd', None, None, None, None, None), (None, None, 'ac53c53a-9f3f-4bb6-8e75-30afad7abfcc', None, None, None), (None, None, '446efb77-9678-4e81-8d74-330b08b10c0e', None, None, None), ('06885aa9-6cf8-422d-b793-e0f30aeda2dc', None, None, None, None, None), ('06885aa9-6cf8-422d-b793-e0f30aeda2dc', None, None, None, None, None), ('4f6170de-81ee-4815-b1d3-6c38fd68ef43', '10.2.2.100', None, None, None, None), ('4f6170de-81ee-4815-b1d3-6c38fd68ef43', '10.2.2.200', None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:18:47.550359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:47.550359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:47.553728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:47.554533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:47.555228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:47.556310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:47.556988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:47.557633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:47.804705 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a85278f-8068-4f92-b1ec-0ac65b6d01c2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1534 microversion: 2.1 time: 0.764581 Oct 28 13:18:47.805959 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1863/3642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:47 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1534 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:47.812179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:47.813098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:47.828522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:47.829324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:47.830041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:47.831417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:47.832093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:47.832733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:48.133497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:48.161984 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a86563f9-d34e-4977-9f91-89cee031ccfe tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1505 microversion: 2.1 time: 0.353988 Oct 28 13:18:48.163054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1864/3643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:47 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:48.181062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:48.181786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:48.188479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:48.189307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:48.189927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:48.197582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:48.197582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:48.197582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:48.390687 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f651e24b-5eed-4e67-8bbf-9cc041edc8a3 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1534 microversion: 2.1 time: 0.226407 Oct 28 13:18:48.391323 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1865/3644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:48 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1534 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:48.396899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-347419240", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-key-492686361", "networks": [{"uuid": "35b0cf8f-78ca-4b1e-81d5-1a1186c30f61"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:48.472950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:18:48.999879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:18:49.000311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:18:49.000796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:18:49.001210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:18:49.001621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:18:49.017834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:49.018155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:49.019554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:49.019554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:49.019800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:49.030982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:49.069842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:49.076613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:49.104607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:18:49.109304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:18:49.398322 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68da8017-ca17-40ae-9512-ddb228f6badb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003251 Oct 28 13:18:49.408144 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1866/3645] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:18:49.427394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:49.434856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:49.435377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:49.435800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:49.436539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:49.436999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:49.437426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:49.527691 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c3bc04a-6cdb-445d-83b0-023e068857f2 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.113911 Oct 28 13:18:49.531611 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1867/3646] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:18:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:49.986050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68a924b5-dd52-4b0b-b3b4-4b25a0358baa tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Action: 'create', calling method: .version_select at 0x7f27b86ad0d0>, body: {"keypair": {"name": "tempest-keypair-1451927692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRIkJTfkb2O0PVLCtknlkGChopqHPhQaW5JtiyHAfQugjY32I+TwECa0mekAQArxJZIcaNhz+M3UFpfqdfqVjk5/C8ruRJUSfWX7i67fR5eBqZRmiVx7KVaBZksNyPJZg=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:50.020169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-68a924b5-dd52-4b0b-b3b4-4b25a0358baa tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Getting quotas for project 653d6f1ee82e4ad79c52e6b10416b7cd. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:50.027832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-68a924b5-dd52-4b0b-b3b4-4b25a0358baa tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Getting quotas for user 6653382d9a254ea2a40a635083080f12 and project 653d6f1ee82e4ad79c52e6b10416b7cd. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:50.125859 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68a924b5-dd52-4b0b-b3b4-4b25a0358baa tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.589773 Oct 28 13:18:50.126733 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1868/3647] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:18:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:50.132868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:50.146014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:50.169243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:50.169983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:50.170932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:50.171853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:50.172872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:50.173685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:50.671097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:18:50.672133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:18:50.672855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:18:50.673477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:18:50.674103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:18:50.687537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:50.689127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:50.689893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:50.691200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:50.698329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:50.698329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:50.715485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Getting quotas for project 7c7fd700fc2044c19c2fcc6e6ccc48ae. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:18:50.722414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Getting quotas for user 9bd4a046d9214c8d819c65dd78ba6bf1 and project 7c7fd700fc2044c19c2fcc6e6ccc48ae. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:18:50.873733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:50.883365 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-758cebf6-1a49-4c02-8e80-96c51e1420f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 200 len: 1508 microversion: 2.1 time: 0.755014 Oct 28 13:18:50.887261 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1869/3648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:50 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 1508 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:50.904507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:50.904507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:50.918456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:50.920921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:50.920921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:50.920921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:50.920921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:50.921485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:50.926242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:51.026800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:51.039124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fef933e2-17b0-4047-946c-3eccbcfdd71d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1231 microversion: 2.1 time: 0.146772 Oct 28 13:18:51.039124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1870/3649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:50 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1231 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:51.040226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:18:51.043269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d73f7dd0-952b-497f-91ad-19cc10e03757',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1fcaede6-651a-4071-9e33-38f1c4c97c7f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec9032fb-b2e3-4caf-b143-3dd13bf872cc',volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:18:51.060534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862876-2", "block_migration": false, "disk_over_commit": false}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:51.068272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:51.072783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:51.073253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:51.074702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:51.075685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:51.076327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:51.076930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:51.134392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lazy-loading 'flavor' on Instance uuid 796fd28c-d3fc-4143-8fc8-6a4680a8975f {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:18:51.169793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Going to try to live migrate instance to n-h2-862876-2 {{(pid=127793) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:18:53.169581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bbd0d8c-7684-4f93-a986-55b232a13d2c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.919676 Oct 28 13:18:53.169581 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1780/3650] 10.222.0.25 () {62 vars in 1189 bytes} [Fri Oct 28 13:18:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 5925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:18:53.216777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:53.217403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:53.238626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:53.238626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:53.238626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:53.239055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:53.239313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:53.239746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:53.542315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:53.552056 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3bebe517-b8fa-4a7b-ac88-87c5bc326d88 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.381429 Oct 28 13:18:53.552725 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1781/3651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:53 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:53.559264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1e2c5a1d-2d37-46db-bf94-39be5d8d3095 req-cfb23664-118c-409e-ba93-3c61ed257000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4923609-8fac-4a9b-ab1a-8e35fd1d95f7", "name": "network-vif-unplugged", "status": "completed", "tag": "28446564-effa-405e-b48e-11317d88b817"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:53.567129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1e2c5a1d-2d37-46db-bf94-39be5d8d3095 req-cfb23664-118c-409e-ba93-3c61ed257000 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:53.567903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1e2c5a1d-2d37-46db-bf94-39be5d8d3095 req-cfb23664-118c-409e-ba93-3c61ed257000 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:53.569319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1e2c5a1d-2d37-46db-bf94-39be5d8d3095 req-cfb23664-118c-409e-ba93-3c61ed257000 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:53.585882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.server_external_events [req-1e2c5a1d-2d37-46db-bf94-39be5d8d3095 req-cfb23664-118c-409e-ba93-3c61ed257000 service nova] Unable to find a host for instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7. Dropping event network-vif-unplugged {{(pid=127794) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 13:18:53.585882 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1e2c5a1d-2d37-46db-bf94-39be5d8d3095 req-cfb23664-118c-409e-ba93-3c61ed257000 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029535 Oct 28 13:18:53.585882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1782/3652] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 13:18:53.589099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:53.589731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:53.595739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:53.596230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:53.596668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:53.597365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:53.597818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:53.598240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:53.669867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:53.681522 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c4650c75-17f7-4732-9e5b-7a7d79b6ecf4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1285 microversion: 2.1 time: 0.096051 Oct 28 13:18:53.682582 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1783/3653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:53 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:53.687998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f336fac9-5a12-4890-8244-ff07e22d8a1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:53.688623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f336fac9-5a12-4890-8244-ff07e22d8a1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:53.775786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f336fac9-5a12-4890-8244-ff07e22d8a1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:53.786841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f336fac9-5a12-4890-8244-ff07e22d8a1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:53.789286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f336fac9-5a12-4890-8244-ff07e22d8a1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:53.790710 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f336fac9-5a12-4890-8244-ff07e22d8a1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1286 microversion: 2.32 time: 0.106698 Oct 28 13:18:53.792960 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1784/3654] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:18:53 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:18:53.814059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:53.816446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:53.837858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:53.838651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:53.839414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:53.840579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:53.841377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:53.842024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:54.110365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:54.120875 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce6299df-8f58-4854-afe2-fea15c6f72db tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.326606 Oct 28 13:18:54.140318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1785/3655] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:53 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:54.152246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:54.152876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:54.171351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:54.172055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:54.172291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:54.173928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:54.178286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:54.180593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:54.500571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:54.507048 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bf4a523f-da99-4528-8fbc-f391b9f91dd9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.363000 Oct 28 13:18:54.508388 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1786/3656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:54 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:54.550535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:54.551220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:54.565877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:54.566387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:54.570509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:54.571285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:54.571763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:54.572196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:54.826381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:54.836043 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5be9a17b-41a0-4a2c-a68b-4ebde6fe8ec6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.304242 Oct 28 13:18:54.838180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1787/3657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:54 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:54.853995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:54.862158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:54.872161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:54.872535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:54.876428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:54.876428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:54.876428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:54.876428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:55.487979 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d6ac8ed-bc6f-4569-8096-11ba7a1c4c7c tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f/action" status: 202 len: 0 microversion: 2.1 time: 4.431616 Oct 28 13:18:55.498642 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1871/3658] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:18:51 2022] POST /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f/action => generated 0 bytes in 4434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:18:55.498642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d31b70d4-76b3-4bcf-9807-d6e24802c331 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:55.498642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d31b70d4-76b3-4bcf-9807-d6e24802c331 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:55.539096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:55.557433 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e464b71f-8568-43be-af8e-c7159aa409c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.718029 Oct 28 13:18:55.558910 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1788/3659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:54 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:55.564153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f60f39b1-637d-40a0-9de5-67b5db3808ab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:55.573999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60f39b1-637d-40a0-9de5-67b5db3808ab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:55.574846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60f39b1-637d-40a0-9de5-67b5db3808ab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:55.575469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60f39b1-637d-40a0-9de5-67b5db3808ab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:55.607222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f60f39b1-637d-40a0-9de5-67b5db3808ab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Going to try to stop instance {{(pid=127794) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:18:55.637460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d31b70d4-76b3-4bcf-9807-d6e24802c331 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:55.651123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d31b70d4-76b3-4bcf-9807-d6e24802c331 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:55.652926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d31b70d4-76b3-4bcf-9807-d6e24802c331 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:55.654274 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d31b70d4-76b3-4bcf-9807-d6e24802c331 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1286 microversion: 2.32 time: 0.163869 Oct 28 13:18:55.655360 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1872/3660] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:18:55 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:18:55.661335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:55.662300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:55.671063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:55.671847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:55.672545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:55.673292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:55.674004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:55.674624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:55.870944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f60f39b1-637d-40a0-9de5-67b5db3808ab tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.310127 Oct 28 13:18:55.875098 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1789/3661] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:18:55 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:18:55.901478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:55.903670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:55.933104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:55.933731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:55.936955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:55.937709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:55.946598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:55.956589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:55.964756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:55.989764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:56.007651 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76f63017-1abd-42fc-8402-77efe4310581 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.350795 Oct 28 13:18:56.008386 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1873/3662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:55 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:56.324523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-373b4a51-4ecb-4576-8c8a-60cf9bd388de req-cc0e2495-29e0-47a9-86eb-e58823cf1dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4151c0d7-a98c-41a5-9826-a66b34d833c4", "tag": "b3713279-f04f-47aa-8ed2-02318de4d36e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:18:56.352525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-373b4a51-4ecb-4576-8c8a-60cf9bd388de req-cc0e2495-29e0-47a9-86eb-e58823cf1dff service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:56.353327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-373b4a51-4ecb-4576-8c8a-60cf9bd388de req-cc0e2495-29e0-47a9-86eb-e58823cf1dff service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:56.353959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-373b4a51-4ecb-4576-8c8a-60cf9bd388de req-cc0e2495-29e0-47a9-86eb-e58823cf1dff service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:56.384810 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-373b4a51-4ecb-4576-8c8a-60cf9bd388de req-cc0e2495-29e0-47a9-86eb-e58823cf1dff service nova] Creating event network-changed:b3713279-f04f-47aa-8ed2-02318de4d36e for instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 on n-h2-862876-2 Oct 28 13:18:56.411945 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-373b4a51-4ecb-4576-8c8a-60cf9bd388de req-cc0e2495-29e0-47a9-86eb-e58823cf1dff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097653 Oct 28 13:18:56.417217 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1874/3663] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:18:56.464784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:56.487550 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3ce6765a-23b6-4913-862b-c01ae8c7f8d6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.607748 Oct 28 13:18:56.489742 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1790/3664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:55 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:18:56.592019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:56.597601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:56.634889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:56.635305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:56.637214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:56.642396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:56.643098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:56.644929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:56.683136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:56.684890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:56.702508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:56.704713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:56.707360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:56.708366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:56.713549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:56.713549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:56.877468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:56.903003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:56.907717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:56.911088 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-124abd8c-3d74-418a-9e92-9a41a4c2f354 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1528 microversion: 2.32 time: 0.233749 Oct 28 13:18:56.915002 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1791/3665] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:18:56 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1528 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:18:57.034605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:57.035553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:57.050916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:57.051657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:57.054215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:57.055218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:57.056733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:57.057314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:57.212196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:57.246222 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cc3237bb-e725-4a56-b5d7-65b97a1056ab tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.658605 Oct 28 13:18:57.251462 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1875/3666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:56 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:57.392704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:57.410253 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48404c4b-1ad9-4de8-aaeb-5de59faee818 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.379029 Oct 28 13:18:57.412639 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1792/3667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:57 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:57.517195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:57.518402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:57.563344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:57.565440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:57.568191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:57.572011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:57.572675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:57.574545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:57.945376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:57.947168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:57.963156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:57.964285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:57.965773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:57.966994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:57.968563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:57.971902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:58.073201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:58.083174 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c04f00be-7f33-40fd-8635-8df297e84274 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.573681 Oct 28 13:18:58.088310 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1876/3668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:57 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:58.123858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:58.143281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:58.144794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:58.156625 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1690f062-b3c3-4433-a3b6-89bb66e4a8cd tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1576 microversion: 2.32 time: 0.208986 Oct 28 13:18:58.172346 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1793/3669] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:18:57 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:18:58.273599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:58.274221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:58.282898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:58.283405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:58.283844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:58.284558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:58.285015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:58.285441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:58.435021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:58.435936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:58.447856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:58.450482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:58.458058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:58.458058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:58.458058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:58.458058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:58.569980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:58.586729 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4d480cb-b092-47c8-a8ea-4a4e0e43d2a8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.318850 Oct 28 13:18:58.590120 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1877/3670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:58 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:58.723416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:58.734727 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3524ff1-bbc6-4146-b175-cc2c45ba32bc tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.303378 Oct 28 13:18:58.740333 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1794/3671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:58 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:59.113365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:59.113985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:59.134116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.134628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.135101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:59.135821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.136534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.136965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:59.189018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:59.190369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:59.216945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.218270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.220699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:59.226655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.229258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.233158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:59.463408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:59.475488 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51a71e42-043d-4960-97c6-b336bda495cb tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.365092 Oct 28 13:18:59.486831 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1878/3672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:59 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:18:59.487181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:59.499274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:59.503743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:18:59.505277 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-39965d2e-1f57-4911-a37e-b7e0b55a1b43 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1594 microversion: 2.32 time: 0.321366 Oct 28 13:18:59.522120 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1795/3673] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:18:59 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1594 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:18:59.611418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:59.613897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:59.619682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:59.622265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:18:59.643872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.645941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.655613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:59.655613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.655613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.655613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:59.774135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:18:59.775519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:18:59.797934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.807839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.807839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:18:59.811802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:18:59.816425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:18:59.817153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:00.108013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:00.124434 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef14a0f8-372f-4007-ae48-098ca2e9eb47 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.517506 Oct 28 13:19:00.126428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1879/3674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:59 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:00.186732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:00.196934 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-303e1ab9-a0b6-469b-aa9f-1c847cd3e41d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.435844 Oct 28 13:19:00.199279 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1796/3675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:18:59 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:00.503585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:00.505095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:00.517518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:00.518383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:00.519004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:00.520948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:00.522991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:00.526058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:00.541920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:00.543579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:00.566919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:00.569378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:00.571549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:00.576354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:00.577389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:00.594074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:00.716619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:00.900974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:00.913221 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-acd80afe-4a42-441f-8670-477e166b92f6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.417195 Oct 28 13:19:00.944937 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1880/3676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:00 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:01.009197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:01.020504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:01.022697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:01.024212 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e56b8cc-3d76-4a33-87df-59ec1384778a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1662 microversion: 2.32 time: 0.490103 Oct 28 13:19:01.025744 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1797/3677] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:00 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1662 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:01.151795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:01.153661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:01.166382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:01.169371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:01.170012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:01.174212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:01.175193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:01.175825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:01.225943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:01.226811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:01.239232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:01.242677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:01.243379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:01.244616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:01.245877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:01.251268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:01.523703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:01.538201 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-166f6bda-5844-4508-9dce-f84018f1a733 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.391662 Oct 28 13:19:01.540735 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1881/3678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:01 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:01.777307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:01.786851 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b12e8a46-43c8-4d4c-8e09-f95a60550f93 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.564993 Oct 28 13:19:01.789124 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1798/3679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:01 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:01.940362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:01.941519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:01.951284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:01.952239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:01.952858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:01.960759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:01.962471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:01.965304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:02.059781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:02.060585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:02.080748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:02.084735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:02.085191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:02.088738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:02.092326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:02.096709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:02.284406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:02.296350 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-62c76d1b-381f-434b-ab6f-aa4bcfe40b9c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.362095 Oct 28 13:19:02.299723 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1882/3680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:01 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:02.442787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:02.464802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:02.474279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:02.477277 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4fe014f-5224-4ac9-859f-f935a98a91f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1709 microversion: 2.32 time: 0.420896 Oct 28 13:19:02.477828 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1799/3681] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:02 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1709 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:02.562703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:02.565678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:02.586416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:02.587295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:02.588370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:02.589602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:02.590326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:02.592734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:02.820182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:02.823600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:02.830420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:02.835410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:02.836167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:02.836331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:02.838705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:02.841657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:02.842284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:02.844689 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a4344b20-8c04-4906-bedc-47f307639644 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.286956 Oct 28 13:19:02.846184 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1883/3682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:02 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:03.230168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:03.245037 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6f5a85c-21fb-4cad-9ca5-a7bbd8f416f9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.429372 Oct 28 13:19:03.258853 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1800/3683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:02 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:03.328797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:03.329514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:03.347961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:03.355824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:03.356358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:03.359880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:03.360401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:03.360893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:03.508312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:03.510151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:03.521904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:03.524621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:03.526079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:03.526937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:03.527943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:03.528643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:03.529317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:03.760672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:03.778168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ba2fe9c6-ed5a-45e1-a73b-d2bde9b54c80 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.457211 Oct 28 13:19:03.784880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=16 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:03.789095 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1884/3684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:03 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:03.795221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-be5d2227-e496-420a-a104-b218bb4da8ab req-e379b023-a0d5-4e67-bfc8-6827c2af204a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4151c0d7-a98c-41a5-9826-a66b34d833c4", "name": "network-vif-plugged", "status": "completed", "tag": "b3713279-f04f-47aa-8ed2-02318de4d36e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:03.817957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:03.826724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-be5d2227-e496-420a-a104-b218bb4da8ab req-e379b023-a0d5-4e67-bfc8-6827c2af204a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:03.827930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-be5d2227-e496-420a-a104-b218bb4da8ab req-e379b023-a0d5-4e67-bfc8-6827c2af204a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:03.828708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-be5d2227-e496-420a-a104-b218bb4da8ab req-e379b023-a0d5-4e67-bfc8-6827c2af204a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:03.837528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:03.846306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:03.847190 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-67a04588-bdb8-49d1-8bd0-770902b84d7f tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1709 microversion: 2.32 time: 0.344469 Oct 28 13:19:03.848185 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1801/3685] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:03 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1709 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:03.851581 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-be5d2227-e496-420a-a104-b218bb4da8ab req-e379b023-a0d5-4e67-bfc8-6827c2af204a service nova] Creating event network-vif-plugged:b3713279-f04f-47aa-8ed2-02318de4d36e for instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 on n-h2-862876-2 Oct 28 13:19:03.861168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-be5d2227-e496-420a-a104-b218bb4da8ab req-e379b023-a0d5-4e67-bfc8-6827c2af204a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070294 Oct 28 13:19:03.863037 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1885/3686] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:03.874119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:03.875432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:03.913757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:03.916289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:03.916935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:03.921426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:03.922103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:03.924527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:04.249989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:04.273823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:04.274543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:04.278495 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32965bd9-60be-4002-9def-24ba63e2b280 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.395141 Oct 28 13:19:04.290810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:04.295850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:04.295850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:04.296280 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1802/3687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:03 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:04.296393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:04.296393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:04.296393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:04.605779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:04.614381 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d02fb35f-41d7-4a7a-b97e-014a34f99a0d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.346557 Oct 28 13:19:04.631580 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1886/3688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:04 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:04.818628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:04.820705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:04.837339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:04.839607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:04.845449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:04.845449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:04.846430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:04.847254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:04.878364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:04.879112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:04.895060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:04.896574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:04.898259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:04.899487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:04.900918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:04.902422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:04.913380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:05.122659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:05.135003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:05.137874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:05.139399 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fbbd0d85-533e-4fca-82ce-ab75f89a36de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1756 microversion: 2.32 time: 0.266637 Oct 28 13:19:05.140494 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1887/3689] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:04 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:05.204708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:05.219907 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4babb0aa-3cc1-4890-8af1-de0fc4b00db5 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.416631 Oct 28 13:19:05.221803 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1803/3690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:04 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:05.300868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:05.301515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:05.308604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:05.309096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:05.322996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:05.324244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:05.325985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:05.326660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:05.623156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:05.633361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c501ee89-435d-4932-91a2-29c33552a7c7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1327 microversion: 2.1 time: 0.336559 Oct 28 13:19:05.634961 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1888/3691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:05 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1327 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:05.641089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:05.641848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:05.657791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:05.659493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:05.660958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:05.663463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:05.664878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:05.665516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.042352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:06.058356 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a564500b-6b3b-45a0-a57c-ef320b6eb066 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.419550 Oct 28 13:19:06.059036 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1804/3692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:05 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:06.166033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:06.166767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:06.169261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:06.178765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:06.182080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:06.182080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.182080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:06.182080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:06.182080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.248765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:06.252791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:06.272158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:06.277989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:06.278234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.279232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:06.279899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:06.282607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.469056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:06.483070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:06.487243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:06.489558 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b9ff9c4-a703-45ad-b446-bbda1188bf17 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1803 microversion: 2.32 time: 0.327767 Oct 28 13:19:06.490950 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1889/3693] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:06 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1803 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:06.632478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:06.655784 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aa78b126-8dd4-4b3b-8022-bb3c6e335667 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1677 microversion: 2.1 time: 0.408750 Oct 28 13:19:06.656757 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1805/3694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:06 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1677 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:06.676235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:06.676857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:06.684408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:06.685153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:06.685586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.686468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:06.687115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:06.687729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.930972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:06.950731 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44d97e62-5233-44e4-a8de-213626e448fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1508 microversion: 2.1 time: 0.293559 Oct 28 13:19:06.957255 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1890/3695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:06 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:06.981201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:06.982161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:06.996630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:06.997751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:06.998716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:06.999740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.000197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.000729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.086793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:07.087556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:07.100467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.100467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.100920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.111131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.111640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.112090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.181003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:07.184897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:07.194490 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a8655cf4-d667-4570-aa6d-e5130c73fb80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1508 microversion: 2.1 time: 0.219775 Oct 28 13:19:07.196834 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1806/3696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:06 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:07.224787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:07.225354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:07.232422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.232918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.233353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.234058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.234512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.235221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.302051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:07.450974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:07.462676 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0e1b4bb9-61f3-4243-9730-c9db1e479df1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.380870 Oct 28 13:19:07.463315 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1891/3697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:07 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:07.519722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:07.520341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:07.529495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.545199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.546116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.548280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.548956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.549391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.801501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:07.819807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:07.821621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:07.823348 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dce76e49-e041-4522-86ba-66a9b463c1ee tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1850 microversion: 2.32 time: 0.307872 Oct 28 13:19:07.824443 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1892/3698] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:07 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1850 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:07.829302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:07.839584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:07.839584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.839584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.839584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.840497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.841319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.841950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.862986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-836d93c4-013e-4e13-80c0-2cc4dc985576 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 204 len: 0 microversion: 2.1 time: 0.643020 Oct 28 13:19:07.862986 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1807/3699] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:07 2022] DELETE /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:19:07.873274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:07.873986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:07.888851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.889700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.895966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:07.897560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:07.898169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:07.898682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:08.205383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:08.214035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:08.214948 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a92fc781-a621-43e1-b237-b9f01ec8b879 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1654 microversion: 2.1 time: 0.389221 Oct 28 13:19:08.215554 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1893/3700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:07 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1654 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:08.234010 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-51f89db5-85c9-46a2-97d9-179c316e8015 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1514 microversion: 2.1 time: 0.366282 Oct 28 13:19:08.236611 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1808/3701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:07 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:08.245648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d9f0c701-6d58-4c56-851c-7627f92f87af tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:08.261239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9f0c701-6d58-4c56-851c-7627f92f87af tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:08.266371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9f0c701-6d58-4c56-851c-7627f92f87af tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:08.266867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9f0c701-6d58-4c56-851c-7627f92f87af tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:08.315949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d9f0c701-6d58-4c56-851c-7627f92f87af tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Going to try to start instance {{(pid=127793) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 13:19:08.489940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:08.491125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:08.502944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:08.504004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:08.505002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:08.507622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:08.508194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:08.508975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:08.585700 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d9f0c701-6d58-4c56-851c-7627f92f87af tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.346310 Oct 28 13:19:08.586565 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1894/3702] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:19:08 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:19:08.595671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:08.596803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:08.604697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:08.605568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:08.606404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:08.607671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:08.608716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:08.609376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:08.859434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:08.873266 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef8b953f-40c2-45aa-bfa4-5576c9d2f50c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1663 microversion: 2.1 time: 0.281803 Oct 28 13:19:08.874010 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1895/3703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:08 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1663 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:08.879996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:08.881624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:08.895605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:08.908825 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-70a762f7-b65f-49af-b63a-c0d7240a9c9d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.423769 Oct 28 13:19:08.910280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:08.930832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:08.933226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:08.939072 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1809/3704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:08 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:08.939783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:08.940960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:08.941851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:09.267960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:09.269302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:09.283328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:09.285440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:09.288535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:09.292006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:09.292705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:09.293363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:10.028905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:10.050299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:10.052265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:10.054418 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0169ba5-ec1d-49af-ba61-e20b32e976aa tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1850 microversion: 2.32 time: 1.179045 Oct 28 13:19:10.057335 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1896/3705] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:08 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1850 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:10.066562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3ce21150-376e-4c48-9de9-7a7bf313cb80 req-12f43e89-514d-4379-9397-1147d6d7e9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "c906a364-1c73-4835-a3cb-a92097af050c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:10.123648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ce21150-376e-4c48-9de9-7a7bf313cb80 req-12f43e89-514d-4379-9397-1147d6d7e9e0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:10.125981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ce21150-376e-4c48-9de9-7a7bf313cb80 req-12f43e89-514d-4379-9397-1147d6d7e9e0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:10.131284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ce21150-376e-4c48-9de9-7a7bf313cb80 req-12f43e89-514d-4379-9397-1147d6d7e9e0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:10.171478 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3ce21150-376e-4c48-9de9-7a7bf313cb80 req-12f43e89-514d-4379-9397-1147d6d7e9e0 service nova] Creating event network-changed:c906a364-1c73-4835-a3cb-a92097af050c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:19:10.196747 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3ce21150-376e-4c48-9de9-7a7bf313cb80 req-12f43e89-514d-4379-9397-1147d6d7e9e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134024 Oct 28 13:19:10.197596 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1897/3706] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:10.209690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:10.213267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:10.245181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:10.245946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:10.246579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:10.247469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:10.250488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:10.251158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:10.307657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:10.335001 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-64598e5c-4fe9-45a9-839c-20297ce1e2da tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1514 microversion: 2.1 time: 1.061911 Oct 28 13:19:10.340908 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1810/3707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:09 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1514 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:10.368678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:10.369330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:10.376639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:10.377482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:10.378815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:10.379628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:10.380138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:10.381398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:10.720186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:10.742736 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-03a4065a-fe60-4e91-bc51-fd48088c1e5a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.391329 Oct 28 13:19:10.742736 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1811/3708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:10 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:10.775384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:10.785372 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb65e41d-813e-420f-8d82-d42acb67c31e tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1663 microversion: 2.1 time: 0.583659 Oct 28 13:19:10.789292 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1898/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:10 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1663 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:11.091061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:11.094670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:11.121385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:11.124211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:11.125287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:11.129937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:11.131994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:11.134370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:11.364536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:11.365207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:11.376153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:11.381756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:11.385300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:11.402926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:11.402926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:11.402926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:11.624052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:11.631864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:11.633590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:11.634983 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d34792c-348c-4151-938f-23c9da14c30b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1871 microversion: 2.32 time: 0.549744 Oct 28 13:19:11.635751 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1812/3710] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:11 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1871 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:11.760622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:11.761855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:11.776609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:11.780646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:11.781562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:11.784791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:11.789801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:11.789801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:11.984076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:11.995731 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5372e3c5-4785-4778-b075-672efc2cbd71 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1514 microversion: 2.1 time: 0.635556 Oct 28 13:19:12.012990 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1899/3711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:11 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1514 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:12.019973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:12.023153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:12.030056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:12.030860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:12.033114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:12.034029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:12.050142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:12.050999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:12.539456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:12.555534 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bb087de4-8d3e-4277-8508-f3b5463027a0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.798598 Oct 28 13:19:12.570770 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1813/3712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:11 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:12.570770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3dbb3fdd-a757-40d8-ac47-f610a5686a32 req-a7dc40ab-7933-4c2e-8716-c084c909f481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "ac53c53a-9f3f-4bb6-8e75-30afad7abfcc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:12.590272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3dbb3fdd-a757-40d8-ac47-f610a5686a32 req-a7dc40ab-7933-4c2e-8716-c084c909f481 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:12.596683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3dbb3fdd-a757-40d8-ac47-f610a5686a32 req-a7dc40ab-7933-4c2e-8716-c084c909f481 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:12.597264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3dbb3fdd-a757-40d8-ac47-f610a5686a32 req-a7dc40ab-7933-4c2e-8716-c084c909f481 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:12.654411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:12.655076 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3dbb3fdd-a757-40d8-ac47-f610a5686a32 req-a7dc40ab-7933-4c2e-8716-c084c909f481 service nova] Creating event network-changed:ac53c53a-9f3f-4bb6-8e75-30afad7abfcc for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:19:12.666638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-45aab088-3a62-4029-ba5f-06f2809bf8b6 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1663 microversion: 2.1 time: 0.651693 Oct 28 13:19:12.667907 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1900/3713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:12 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1663 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:12.673511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-16581822-e009-468a-b2b2-ed5dc6a78858 req-d19fdce7-15f0-43be-9578-ecfe3d0fb665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4151c0d7-a98c-41a5-9826-a66b34d833c4", "name": "network-vif-deleted", "tag": "b3713279-f04f-47aa-8ed2-02318de4d36e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:12.684521 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3dbb3fdd-a757-40d8-ac47-f610a5686a32 req-a7dc40ab-7933-4c2e-8716-c084c909f481 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103800 Oct 28 13:19:12.685221 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1814/3714] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:12.687571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-16581822-e009-468a-b2b2-ed5dc6a78858 req-d19fdce7-15f0-43be-9578-ecfe3d0fb665 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:12.688278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-16581822-e009-468a-b2b2-ed5dc6a78858 req-d19fdce7-15f0-43be-9578-ecfe3d0fb665 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:12.688964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-16581822-e009-468a-b2b2-ed5dc6a78858 req-d19fdce7-15f0-43be-9578-ecfe3d0fb665 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:12.698422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:12.699195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:12.705455 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-16581822-e009-468a-b2b2-ed5dc6a78858 req-d19fdce7-15f0-43be-9578-ecfe3d0fb665 service nova] Creating event network-vif-deleted:b3713279-f04f-47aa-8ed2-02318de4d36e for instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 on n-h2-862876-2 Oct 28 13:19:12.713038 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-16581822-e009-468a-b2b2-ed5dc6a78858 req-d19fdce7-15f0-43be-9578-ecfe3d0fb665 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043631 Oct 28 13:19:12.714271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1901/3715] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:12.742839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:12.745963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:12.746460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:12.747250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:12.747723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:12.748148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.031296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:13.032088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:13.043472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:13.043967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:13.049593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.050660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:13.051177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:13.051614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.134709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:13.136894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:13.139944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.164635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid 4151c0d7-a98c-41a5-9826-a66b34d833c4 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:19:13.308866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:13.329593 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6903d53-ad93-43b0-ab6b-df1ebbf6bf7f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 200 len: 1317 microversion: 2.1 time: 0.305507 Oct 28 13:19:13.336788 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1902/3716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:13 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:13.511705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:13.525402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:13.527360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:13.528907 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d7eb8757-bfb5-4927-a151-db5bab009f46 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1871 microversion: 2.32 time: 0.842534 Oct 28 13:19:13.543545 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1815/3717] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:12 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1871 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:13.584983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:13.585641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:13.598935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:13.601241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:13.602013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.603212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:13.604410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:13.605016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.696871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:13.697499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:13.708295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:13.710722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:13.712938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.717409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:13.719645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:13.737232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:13.850165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:13.854203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:13.861921 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc2b6684-27af-4b46-90b4-4e69af23d82a tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.280711 Oct 28 13:19:13.862911 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1903/3718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:13 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:14.345603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:14.358385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:14.358385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:14.359596 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2322ff48-6e16-4885-bcfb-76ad6d20c7b9 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.667421 Oct 28 13:19:14.367601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.368093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.374200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:14.375215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.383978 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1816/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:13 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:14.384299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.385641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:14.394118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:14.395648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:14.420454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.420895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.421736 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:19:14.423382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:14.425221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.425710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.426151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 HTTP/1.1 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4151c0d7-a98c-41a5-9826-a66b34d833c4'} Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:14.427186 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27d026cf-5ab8-421c-b2a1-fc0f721967d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 404 len: 111 microversion: 2.1 time: 0.076005 Oct 28 13:19:14.436878 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1904/3720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:14 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:19:14.447647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2bbacf9f-9b72-4ba5-8d4d-680965fa180b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '.version_select at 0x7f27bdaa5790>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:14.611698 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2bbacf9f-9b72-4ba5-8d4d-680965fa180b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-492686361" status: 202 len: 0 microversion: 2.1 time: 0.173476 Oct 28 13:19:14.612279 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1905/3721] 10.222.0.25 () {58 vars in 1206 bytes} [Fri Oct 28 13:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-492686361 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:19:14.627072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:14.627698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:14.643090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.643585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.644224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:14.644939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.645400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.645826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:14.837254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:14.869393 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f0179810-488f-4fe8-8361-959576406201 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.460166 Oct 28 13:19:14.869393 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1817/3722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:14 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:14.888705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:14.889481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:14.895766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.896422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.897390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:14.898335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:14.899104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:14.900003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:15.000000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:15.012967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:15.015224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:15.017056 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4ac2ac68-a737-4c12-9845-adb63a59359b tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.403719 Oct 28 13:19:15.018114 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1906/3723] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:14 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:15.026642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:15.028293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:15.035832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:15.036714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:15.037428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:15.038416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:15.042656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:15.043538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:15.191201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:15.228514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-efc2fe58-9a5d-4fe2-bf98-55d0500dc665 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.344353 Oct 28 13:19:15.228993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:15.232124 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1818/3724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:14 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:15.241770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-119449137", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "35b0cf8f-78ca-4b1e-81d5-1a1186c30f61"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:15.262738 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3f621f27-30ea-49ec-b531-83b1a7961dcd tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.242124 Oct 28 13:19:15.263855 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1907/3725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:15 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:15.312522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:15.314443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:15.355970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:15.361625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:15.362121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:15.362937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:15.373674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:15.374232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:15.441234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:19:15.684141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:15.697325 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f179dd2-049f-4a5a-b98e-978d66592063 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.399679 Oct 28 13:19:15.697920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1908/3726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:15 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:15.705798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-396600f0-9281-406a-95f7-17be47bb2039 req-020c036c-33d9-42ac-a553-8e3380d51b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "446efb77-9678-4e81-8d74-330b08b10c0e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:15.771401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-396600f0-9281-406a-95f7-17be47bb2039 req-020c036c-33d9-42ac-a553-8e3380d51b4f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:15.779968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-396600f0-9281-406a-95f7-17be47bb2039 req-020c036c-33d9-42ac-a553-8e3380d51b4f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:15.783098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-396600f0-9281-406a-95f7-17be47bb2039 req-020c036c-33d9-42ac-a553-8e3380d51b4f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:15.810062 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-396600f0-9281-406a-95f7-17be47bb2039 req-020c036c-33d9-42ac-a553-8e3380d51b4f service nova] Creating event network-changed:446efb77-9678-4e81-8d74-330b08b10c0e for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:19:15.832094 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-396600f0-9281-406a-95f7-17be47bb2039 req-020c036c-33d9-42ac-a553-8e3380d51b4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130384 Oct 28 13:19:15.835168 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1909/3727] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:15.847143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:15.853495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:15.872855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:15.873443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:15.874667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:15.876472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:15.877015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:15.877554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:16.288079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:16.298233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2f5d2b5-a5b1-44f9-a0d6-670d2a1ab892 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.462924 Oct 28 13:19:16.302827 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1910/3728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:15 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:16.313259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:16.314182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:16.327650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:16.329237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:16.330577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:16.333025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:16.334577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:16.335235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:16.898653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:16.910598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:16.918862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:16.920095 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad1887a0-c260-4509-a050-027f25c8ec6c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.615970 Oct 28 13:19:16.925028 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1911/3729] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:16 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:16.930483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:16.935758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:16.950158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:16.952091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:16.955701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:16.956698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:16.957340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:16.957956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:17.215053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:19:17.218154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:19:17.218154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:19:17.218154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:19:17.218154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:19:17.233406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:17.233901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:17.234337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:17.235144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:17.235616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:17.243576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:17.318898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:19:17.339626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:19:17.397188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:19:17.408532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:17.421093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:19:17.425046 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5c3eba7-3f38-42c0-ac95-6a432bdc3c59 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.493359 Oct 28 13:19:17.434055 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1912/3730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:16 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:17.451642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:17.452450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:17.469003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:17.471105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:17.471560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:17.479126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:17.483501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:17.486304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:17.602285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lazy-loading 'flavor' on Instance uuid 4ce0226a-6507-4449-92ec-3050830d72a1 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:19:17.687826 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7272bf21-d12f-40b5-b522-4e4c4d405114 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.454326 Oct 28 13:19:17.690332 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1819/3731] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:19:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:19:17.710219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c44d0a87-1713-40a5-abef-5f2ac82e4983 req-44409a24-00ff-4fe2-aeea-52b7341e595f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796fd28c-d3fc-4143-8fc8-6a4680a8975f", "name": "network-vif-unplugged", "status": "completed", "tag": "cf1e7a15-c820-4706-867a-d001cf5f55f8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:17.752181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c44d0a87-1713-40a5-abef-5f2ac82e4983 req-44409a24-00ff-4fe2-aeea-52b7341e595f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:17.752850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c44d0a87-1713-40a5-abef-5f2ac82e4983 req-44409a24-00ff-4fe2-aeea-52b7341e595f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:17.754548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c44d0a87-1713-40a5-abef-5f2ac82e4983 req-44409a24-00ff-4fe2-aeea-52b7341e595f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:17.779228 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c44d0a87-1713-40a5-abef-5f2ac82e4983 req-44409a24-00ff-4fe2-aeea-52b7341e595f service nova] Creating event network-vif-unplugged:cf1e7a15-c820-4706-867a-d001cf5f55f8 for instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f on n-h1-862876-2 Oct 28 13:19:17.793649 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c44d0a87-1713-40a5-abef-5f2ac82e4983 req-44409a24-00ff-4fe2-aeea-52b7341e595f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101451 Oct 28 13:19:17.795806 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1820/3732] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:17.822293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0da593a-6b0c-43e3-9df7-dc80eb0dc246 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:17.827891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0da593a-6b0c-43e3-9df7-dc80eb0dc246 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:18.089466 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f001a5b3-6772-4769-9ce1-661cf99df3d3 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 0.646343 Oct 28 13:19:18.089466 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1913/3733] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:19:17 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:19:18.095133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:18.096093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:18.109998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:18.113163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:18.116269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:18.118350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:18.119161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:18.123532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:18.813300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a0da593a-6b0c-43e3-9df7-dc80eb0dc246 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:18.823583 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a0da593a-6b0c-43e3-9df7-dc80eb0dc246 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1208 microversion: 2.1 time: 1.024481 Oct 28 13:19:18.858961 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1821/3734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:17 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1208 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:18.864570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:18.865173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:18.896980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:18.900034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:18.903665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:18.904656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:18.907167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:18.911072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:19.147291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:19.179654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:19.189741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:19.192392 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e37aeafb-6fca-4ac4-b862-1650b4164600 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 1.107690 Oct 28 13:19:19.204236 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1914/3735] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:18 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:19.232619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:19.240584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:19.274553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:19.282492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:19.284265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:19.286105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:19.299793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:19.306124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:19.784277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:19.795680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f243eb55-81eb-49f1-8d71-54b9500560e1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1658 microversion: 2.1 time: 0.935551 Oct 28 13:19:19.796266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1822/3736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:18 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1658 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:19.820717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d0a8a15a-8e35-4a61-8a29-b45c8265e292 req-23bcfb1d-301f-484b-b933-14617f23d7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "216191b8-6f5e-47bd-9d63-06490921d508"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:19.857532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0a8a15a-8e35-4a61-8a29-b45c8265e292 req-23bcfb1d-301f-484b-b933-14617f23d7b0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:19.859774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0a8a15a-8e35-4a61-8a29-b45c8265e292 req-23bcfb1d-301f-484b-b933-14617f23d7b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:19.863859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d0a8a15a-8e35-4a61-8a29-b45c8265e292 req-23bcfb1d-301f-484b-b933-14617f23d7b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:19.904104 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d0a8a15a-8e35-4a61-8a29-b45c8265e292 req-23bcfb1d-301f-484b-b933-14617f23d7b0 service nova] Creating event network-changed:216191b8-6f5e-47bd-9d63-06490921d508 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:19:19.930052 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d0a8a15a-8e35-4a61-8a29-b45c8265e292 req-23bcfb1d-301f-484b-b933-14617f23d7b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128476 Oct 28 13:19:19.933624 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1823/3737] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:19.951750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:19.952759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:19.979841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:19.982619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:19.985261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:19.990383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:19.990383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:19.991707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:20.107273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:20.120788 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ec26f23-e7c9-472b-b651-19bd34512940 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.910481 Oct 28 13:19:20.130159 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1915/3738] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:19 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:20.140788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:20.148680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:20.173627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:20.175147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:20.178249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:20.179276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:20.179751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:20.180177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:20.184171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:20.353634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:20.377129 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d32474e-cede-4118-a5fe-8d7fc110b81b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1212 microversion: 2.1 time: 0.244638 Oct 28 13:19:20.378043 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1916/3739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:20 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1212 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:20.399166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7547b814-e455-46e1-935e-7f45ec75c0ef req-58882eb6-ec9e-4030-bc5d-3a35fa445310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796fd28c-d3fc-4143-8fc8-6a4680a8975f", "tag": "cf1e7a15-c820-4706-867a-d001cf5f55f8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:20.435536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7547b814-e455-46e1-935e-7f45ec75c0ef req-58882eb6-ec9e-4030-bc5d-3a35fa445310 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:20.439397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7547b814-e455-46e1-935e-7f45ec75c0ef req-58882eb6-ec9e-4030-bc5d-3a35fa445310 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:20.440026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7547b814-e455-46e1-935e-7f45ec75c0ef req-58882eb6-ec9e-4030-bc5d-3a35fa445310 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:20.455495 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7547b814-e455-46e1-935e-7f45ec75c0ef req-58882eb6-ec9e-4030-bc5d-3a35fa445310 service nova] Creating event network-changed:cf1e7a15-c820-4706-867a-d001cf5f55f8 for instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f on n-h1-862876-2 Oct 28 13:19:20.460981 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7547b814-e455-46e1-935e-7f45ec75c0ef req-58882eb6-ec9e-4030-bc5d-3a35fa445310 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065890 Oct 28 13:19:20.478511 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1917/3740] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:20.478511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:20.478511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:20.521265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:20.524138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:20.524703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:20.525531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:20.527923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:20.546851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:21.143187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:21.181400 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9535ce7c-691a-455b-9d2f-ebdc6e28eb35 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action" status: 202 len: 0 microversion: 2.1 time: 1.242445 Oct 28 13:19:21.187441 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1824/3741] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:19:19 2022] POST /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1/action => generated 0 bytes in 1249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:19:21.188163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:21.196287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:21.201852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:21.204778 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20348781-de20-467d-b8a4-f278cb3bf784 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.736449 Oct 28 13:19:21.204968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:21.205395 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1918/3742] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:20 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:21.221288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:21.222212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:21.229167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:21.229167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:21.229167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:21.229167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:21.240844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:21.246931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:21.274321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:21.276060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:21.276570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:21.277292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:21.281455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:21.282028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:21.520208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:21.550171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eb4b2255-9364-4776-acc2-769076f6c095 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.359985 Oct 28 13:19:21.579700 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1825/3743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:21 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:21.590081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:21.591144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:21.599195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:21.599737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:21.600260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:21.601141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:21.601776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:21.602213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:21.691801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:21.711259 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88d6910c-7e1b-44d0-8653-0c123fabd75e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1204 microversion: 2.1 time: 0.129087 Oct 28 13:19:21.726412 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1826/3744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:21 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1204 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:21.727042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:21.737438 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed90a270-634b-484b-b3f0-c447fe2a5e38 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1664 microversion: 2.1 time: 0.524858 Oct 28 13:19:21.742978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1919/3745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:21 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1664 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:22.064360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9943c8ab-6377-42f6-a2b4-3bcbc87c9f51 req-c3db9b9b-235f-4bb4-9d28-e508b1e452fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "aa4b0395-5a41-4684-922b-b72b520b96b8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:22.133606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9943c8ab-6377-42f6-a2b4-3bcbc87c9f51 req-c3db9b9b-235f-4bb4-9d28-e508b1e452fb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:22.139646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9943c8ab-6377-42f6-a2b4-3bcbc87c9f51 req-c3db9b9b-235f-4bb4-9d28-e508b1e452fb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:22.140178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9943c8ab-6377-42f6-a2b4-3bcbc87c9f51 req-c3db9b9b-235f-4bb4-9d28-e508b1e452fb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:22.201974 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9943c8ab-6377-42f6-a2b4-3bcbc87c9f51 req-c3db9b9b-235f-4bb4-9d28-e508b1e452fb service nova] Creating event network-changed:aa4b0395-5a41-4684-922b-b72b520b96b8 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:19:22.235047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:22.235635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:22.245808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:22.249115 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9943c8ab-6377-42f6-a2b4-3bcbc87c9f51 req-c3db9b9b-235f-4bb4-9d28-e508b1e452fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156580 Oct 28 13:19:22.249737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:22.250303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:22.251569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:22.251715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1827/3746] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:22.258297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:22.258297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:22.588132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:22.588132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:22.591176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:22.603538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:22.604284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:22.605194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:22.605836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:22.606426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:22.947734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:22.962481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:22.964087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:22.966441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2329cdc2-6efb-4359-9a40-909b4a4a9dc7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.736296 Oct 28 13:19:22.976299 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1920/3747] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:22 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:22.989689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:22.994271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:23.009547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:23.010421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:23.014838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:23.015735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:23.017032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:23.017776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:23.165801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:23.181884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:23.183879 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2886c7cf-f859-424d-a51d-ed8328e8a3d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.608708 Oct 28 13:19:23.185002 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1828/3748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:22 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:23.197301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:23.198231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:23.204592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:23.211623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a2e78ae-1ef7-464e-a540-f90783516896 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1204 microversion: 2.1 time: 0.233417 Oct 28 13:19:23.213903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:23.215922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:23.216435 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1921/3749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:22 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1204 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:23.217113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:23.219184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:23.219866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:23.220494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:23.729410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:23.745046 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9dadb99f-193a-441f-ad93-4545d99cd653 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1664 microversion: 2.1 time: 0.555174 Oct 28 13:19:23.745672 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1829/3750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:23 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1664 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:23.993199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:23.993901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:24.006234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.008074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.008604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.009397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.012885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.013422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.224489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:24.225376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:24.236108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.236989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.240650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.241807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.244434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.245079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.419889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:24.436602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:24.441025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:24.444603 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b1daaae-517e-4dec-91c4-0d44381cbd1a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.455383 Oct 28 13:19:24.446830 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1922/3751] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:23 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:24.459848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:24.470274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:24.482512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.483236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.484443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.486933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.487747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.490778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.667384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:24.686695 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad32a012-43a4-42f8-82a8-585aadb61b1d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1260 microversion: 2.1 time: 0.237562 Oct 28 13:19:24.710216 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1923/3752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:24 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:24.732184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b352e289-2928-4788-900d-19463be505db req-baa07f5b-7507-4611-b7d4-3505bd523b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "bffbf9ff-87ff-46cb-a6a2-b5138ecb6120"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:24.775981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b352e289-2928-4788-900d-19463be505db req-baa07f5b-7507-4611-b7d4-3505bd523b9f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.777080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b352e289-2928-4788-900d-19463be505db req-baa07f5b-7507-4611-b7d4-3505bd523b9f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.778806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b352e289-2928-4788-900d-19463be505db req-baa07f5b-7507-4611-b7d4-3505bd523b9f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.815325 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b352e289-2928-4788-900d-19463be505db req-baa07f5b-7507-4611-b7d4-3505bd523b9f service nova] Creating event network-changed:bffbf9ff-87ff-46cb-a6a2-b5138ecb6120 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:19:24.842571 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b352e289-2928-4788-900d-19463be505db req-baa07f5b-7507-4611-b7d4-3505bd523b9f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125388 Oct 28 13:19:24.848665 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1924/3753] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:24.893826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:24.900528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:24.942610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:24.943956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.944536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.944994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.945746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:24.948265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:24.948930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:24.964147 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3dd354fc-b9f9-45f6-8b90-caaf584e71d1 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.756125 Oct 28 13:19:24.979150 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1830/3754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:24 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:25.470535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:25.471220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:25.481884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:25.482414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:25.482826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:25.483546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:25.483997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:25.487820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:25.632418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:25.640596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e2704320-5188-443e-98a0-03dfc8290f8d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.789984 Oct 28 13:19:25.641194 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1925/3755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:24 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:25.671110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:25.671425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:25.697749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:25.697749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:25.711345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:25.711345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:25.711345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:25.711345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:26.124652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:26.133626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e525d79-0303-45c2-897a-a8d83fd65098 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1667 microversion: 2.1 time: 0.468747 Oct 28 13:19:26.134220 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1926/3756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:25 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1667 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:26.169996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:26.171248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:26.193268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:26.200284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:26.200949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:26.203375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:26.208740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:26.210868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:26.213257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:26.221966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:26.231440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:26.248383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:26.250968 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60349a6d-e152-42e2-89a7-18a1684edc32 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.784582 Oct 28 13:19:26.256215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1831/3757] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:25 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:26.270115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:26.274204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:26.292325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:26.293134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:26.293745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:26.301092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:26.302040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:26.302717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:26.374078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:26.395315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0de7adbb-fa43-40e1-aca1-e0a81fb1ba92 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1266 microversion: 2.1 time: 0.254076 Oct 28 13:19:26.434024 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1927/3758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:26 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:26.441266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:26.449867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:26.486890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:26.493020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:26.493495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:26.494258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:26.494736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:26.511716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:26.659087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:26.683166 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.api [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Working on deleting snapshot 0164070b-a101-4173-af25-eed733521e9e from shelved instance... Oct 28 13:19:26.931038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:26.951045 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-39eaca24-e0ea-4883-b1c4-7fc6dfbe58c8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.684638 Oct 28 13:19:26.968404 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1832/3759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:26 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:27.143253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e7f4c7c9-a5a9-406f-ad2f-e22435087b8d req-f7b5df8a-d619-487d-9f86-aca4b7c18341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "a2a1ba3d-63f3-4bcb-b866-ef09c515046c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:27.171268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e7f4c7c9-a5a9-406f-ad2f-e22435087b8d req-f7b5df8a-d619-487d-9f86-aca4b7c18341 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:27.175346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e7f4c7c9-a5a9-406f-ad2f-e22435087b8d req-f7b5df8a-d619-487d-9f86-aca4b7c18341 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:27.175346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e7f4c7c9-a5a9-406f-ad2f-e22435087b8d req-f7b5df8a-d619-487d-9f86-aca4b7c18341 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:27.228129 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e7f4c7c9-a5a9-406f-ad2f-e22435087b8d req-f7b5df8a-d619-487d-9f86-aca4b7c18341 service nova] Creating event network-changed:a2a1ba3d-63f3-4bcb-b866-ef09c515046c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:19:27.248543 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e7f4c7c9-a5a9-406f-ad2f-e22435087b8d req-f7b5df8a-d619-487d-9f86-aca4b7c18341 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107651 Oct 28 13:19:27.257859 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1833/3760] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:27.281537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:27.286867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:27.287605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:27.308834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:27.309402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:27.309856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:27.316540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:27.321461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:27.321938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:28.342162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:28.357972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:28.363139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:28.369016 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6d5e9c3-0a93-49d8-ae8f-52a732c47772 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 1.088616 Oct 28 13:19:28.371253 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1834/3761] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:27 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:28.385067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:28.388458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:28.413023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:28.428466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:28.428466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:28.428466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:28.428466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:28.428466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:28.823363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:29.202396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Doing local delete in cell 449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=127793) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 13:19:29.206209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:29.209029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:29.211798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:29.214457 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.api [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 13:19:29.247363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] deallocate_for_instance() {{(pid=127793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 13:19:29.603012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:29.656964 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ca5b049-c359-47a6-be28-0d87f0a61bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1308 microversion: 2.1 time: 1.282660 Oct 28 13:19:29.674928 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1835/3762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:28 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1308 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:29.686064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:29.686906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:29.726660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:29.727794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:29.727794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:29.736130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:29.738953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:29.740005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:30.381020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:30.399281 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1f98650-07f3-464d-8827-e1e4cd2073f0 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.731879 Oct 28 13:19:30.402172 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1836/3763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:29 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:30.423034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8d7494b4-d6e5-42f9-b9cb-f79851c17aa0 req-9bede9ae-2f46-417e-9f46-488967f58d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd61b5d2-16aa-4b8e-aff2-24ff59dfc068", "tag": "730dbf15-f5fe-4c61-9e9d-348ad2711c10"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:30.447716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8d7494b4-d6e5-42f9-b9cb-f79851c17aa0 req-9bede9ae-2f46-417e-9f46-488967f58d96 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:30.448506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8d7494b4-d6e5-42f9-b9cb-f79851c17aa0 req-9bede9ae-2f46-417e-9f46-488967f58d96 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:30.449120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8d7494b4-d6e5-42f9-b9cb-f79851c17aa0 req-9bede9ae-2f46-417e-9f46-488967f58d96 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:30.485309 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8d7494b4-d6e5-42f9-b9cb-f79851c17aa0 req-9bede9ae-2f46-417e-9f46-488967f58d96 service nova] Creating event network-changed:730dbf15-f5fe-4c61-9e9d-348ad2711c10 for instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 on n-h2-862876-2 Oct 28 13:19:30.493331 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8d7494b4-d6e5-42f9-b9cb-f79851c17aa0 req-9bede9ae-2f46-417e-9f46-488967f58d96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088239 Oct 28 13:19:30.494203 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1837/3764] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:30.501657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:30.502529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:30.507842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Updating instance_info_cache with network_info: [] {{(pid=127793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:19:30.510074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:30.511008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:30.511873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:30.512738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:30.513359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:30.513949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.224287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:31.238655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:31.241246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:31.243329 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-557ad649-8f21-47aa-8e3f-993e785c8f99 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.747598 Oct 28 13:19:31.245413 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1838/3765] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:30 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:31.250392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:31.251622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:31.258838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.263065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.263549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.264620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.265259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.265870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.641723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:31.653868 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c73a6a8-b3a3-40b9-a703-b946c673843f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1308 microversion: 2.1 time: 0.406136 Oct 28 13:19:31.655701 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1839/3766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:31 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:31.677698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:31.681288 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fdc2e38-8daf-49fc-95fd-a2634ff75862 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 204 len: 0 microversion: 2.1 time: 5.245607 Oct 28 13:19:31.681790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:31.683083 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1928/3767] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:26 2022] DELETE /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 0 bytes in 5248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:19:31.691858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:31.693345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f4923609-8fac-4a9b-ab1a-8e35fd1d95f7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:31.697470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:31.704765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.705270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.705710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.708277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.708768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.709206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.709906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.711296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.711786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.712232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.715727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.716182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.747202 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] HTTP exception thrown: Instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 could not be found. Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Request method failure captured: Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 HTTP/1.1 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SWT6BgvCZTXsOfv9Vyc6ioCnbTHbmj9JxEA_DdFhqusPsRbKCZrawNmdRxzkK22HS8opsxRx98Xdr1ZZc1ozXkmYWvMKboN94t84b0I0pk83XF1AdoTAzNYMExiAb3E3UnZGiSFcwiBCQm_wKk-bLTIJULP8dF0jtfx7J2TG8yxFE Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_524832a11bb148639788f80ef22b2865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/524832a11bb148639788f80ef22b2865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d70178138d974c20bb9598de42bd3294 Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 could not be found. Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f4923609-8fac-4a9b-ab1a-8e35fd1d95f7'} Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 could not be found. Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 could not be found. Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:31.748888 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 could not be found. Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Returning 404 to user: Instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-895c3d58-43aa-45c4-a5a3-19d904ddd211 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7" status: 404 len: 111 microversion: 2.1 time: 0.063354 Oct 28 13:19:31.755829 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1929/3768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:31 2022] GET /compute/v2.1/servers/f4923609-8fac-4a9b-ab1a-8e35fd1d95f7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:19:31.763127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:31.763881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:31.771610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.772102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.772529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.773515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:31.774139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:31.775053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:31.818348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:32.155822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:32.169186 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd195420-87e4-4bf1-bcf6-92b3a438ba90 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.510047 Oct 28 13:19:32.187621 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1840/3769] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:31 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:32.274429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:32.275186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:32.282194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:32.283065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:32.283653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:32.284441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:32.286995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:32.286995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:32.325375 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36f6a193-1b63-4399-93f7-7b2938f9ee0d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "DELETE /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 204 len: 0 microversion: 2.1 time: 0.564255 Oct 28 13:19:32.330840 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1930/3770] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:31 2022] DELETE /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:19:32.337888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:32.338583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:32.370280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:32.370818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:32.371482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:32.373915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:32.374405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:32.376063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:32.527816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:32.530469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:32.540086 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8a18d9f-b175-441a-883a-bcd2356c687c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1465 microversion: 2.1 time: 0.207668 Oct 28 13:19:32.552843 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1931/3771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:32 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1465 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:32.565220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-24725f54-f26f-4af9-87ec-2fdf99467b6a req-e5540ec1-748e-4ca7-8b5b-0cf2193e37af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4923609-8fac-4a9b-ab1a-8e35fd1d95f7", "name": "network-vif-deleted", "tag": "28446564-effa-405e-b48e-11317d88b817"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:32.588804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-24725f54-f26f-4af9-87ec-2fdf99467b6a req-e5540ec1-748e-4ca7-8b5b-0cf2193e37af service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:32.593698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-24725f54-f26f-4af9-87ec-2fdf99467b6a req-e5540ec1-748e-4ca7-8b5b-0cf2193e37af service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:32.594413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-24725f54-f26f-4af9-87ec-2fdf99467b6a req-e5540ec1-748e-4ca7-8b5b-0cf2193e37af service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:32.611959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.server_external_events [req-24725f54-f26f-4af9-87ec-2fdf99467b6a req-e5540ec1-748e-4ca7-8b5b-0cf2193e37af service nova] Unable to find a host for instance f4923609-8fac-4a9b-ab1a-8e35fd1d95f7. Dropping event network-vif-deleted {{(pid=127793) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 13:19:32.613683 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-24725f54-f26f-4af9-87ec-2fdf99467b6a req-e5540ec1-748e-4ca7-8b5b-0cf2193e37af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.059382 Oct 28 13:19:32.615042 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1932/3772] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 13:19:32.643977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:32.657352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:32.661520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:32.661520 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27fc9e4e-9c88-45fa-b827-51982230e207 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.391381 Oct 28 13:19:32.661520 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1841/3773] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:32 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:32.692069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:32.692755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:32.719709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:32.719709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:32.720119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:32.721486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:32.722049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:32.726188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:32.978094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:32.987150 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-12e267f5-9428-42fa-a179-51ac20976c5d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1308 microversion: 2.1 time: 0.306865 Oct 28 13:19:32.999891 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1933/3774] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:32 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:33.196456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:33.197446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:33.213235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:33.213973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:33.214606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:33.216853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:33.223516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:33.223881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:33.563929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:33.565259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:33.588249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:33.592075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:33.593895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:33.594831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:33.596840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:33.599166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:33.611678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:33.621632 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f801fb86-5d9a-449a-95f0-eaf924c4d877 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1393 microversion: 2.1 time: 0.430735 Oct 28 13:19:33.642790 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1842/3775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:33 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1393 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:33.705410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:33.706256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:33.744357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:33.754201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:33.757565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:33.760904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:33.761824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:33.764329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:33.764822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:33.781656 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0b458d7-9e0f-47cf-99c5-7cdec01f5013 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1465 microversion: 2.1 time: 0.221339 Oct 28 13:19:33.782629 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1934/3776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:33 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:33.857181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:34.015480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:34.016163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:34.027708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:34.039373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:34.039373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:34.039373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:34.039373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:34.039373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:34.200979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:34.209486 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d7de934-5aab-43a4-a206-eccad11459b7 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1308 microversion: 2.1 time: 0.199601 Oct 28 13:19:34.215202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1935/3777] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:34 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:34.490774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:34.503106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:34.505513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:34.507297 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14ff1621-d08e-46fc-8081-ed8b937f0734 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.811990 Oct 28 13:19:34.507915 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1843/3778] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:33 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:34.651859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:34.652484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:34.684165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:34.685158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:34.685774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:34.686892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:34.687533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:34.688882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:34.805500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:34.806095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:34.826958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:34.828023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:34.835492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:34.837619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:34.841556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:34.846799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:34.982357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:35.007248 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36094fb6-1806-4dec-a75e-cb9a3c3e1214 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1465 microversion: 2.1 time: 0.189543 Oct 28 13:19:35.012897 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1844/3779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:34 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1465 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:35.033240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ebc83861-918d-4f67-b107-2f67ceb3c7cf req-ccdb49ae-a7e5-460f-aa4f-db6e3e67799b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb84989-5cbd-4005-97c6-786f1a15b125", "name": "network-vif-deleted", "tag": "901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:35.069142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ebc83861-918d-4f67-b107-2f67ceb3c7cf req-ccdb49ae-a7e5-460f-aa4f-db6e3e67799b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.069638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ebc83861-918d-4f67-b107-2f67ceb3c7cf req-ccdb49ae-a7e5-460f-aa4f-db6e3e67799b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.070083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ebc83861-918d-4f67-b107-2f67ceb3c7cf req-ccdb49ae-a7e5-460f-aa4f-db6e3e67799b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.074278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:35.082464 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-968e9605-e5fd-4e80-9a3b-5977611ee3c5 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1383 microversion: 2.1 time: 0.434430 Oct 28 13:19:35.088819 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1936/3780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:34 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1383 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:35.110617 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ebc83861-918d-4f67-b107-2f67ceb3c7cf req-ccdb49ae-a7e5-460f-aa4f-db6e3e67799b service nova] Creating event network-vif-deleted:901b9fa5-b5ce-4dfe-9f5b-0694b0ec57d0 for instance deb84989-5cbd-4005-97c6-786f1a15b125 on n-h1-862876-2 Oct 28 13:19:35.112646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a99e637-29c7-4ed6-92fd-26e71faebb6d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '.version_select at 0x7f27b9a53a60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:35.116599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a99e637-29c7-4ed6-92fd-26e71faebb6d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.117423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a99e637-29c7-4ed6-92fd-26e71faebb6d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.118109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a99e637-29c7-4ed6-92fd-26e71faebb6d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.127457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ebc83861-918d-4f67-b107-2f67ceb3c7cf req-ccdb49ae-a7e5-460f-aa4f-db6e3e67799b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114044 Oct 28 13:19:35.128248 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1845/3781] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:35.129720 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a99e637-29c7-4ed6-92fd-26e71faebb6d tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.021023 Oct 28 13:19:35.130901 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1937/3782] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:19:35 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:35.167788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:35.168839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:35.185561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.191336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.191336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.191336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.191336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.191336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.242936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:35.244137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:35.251689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.252605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.253319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.256098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.256098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.256098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.576939 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e997a6ba-90da-4ac0-8424-0fc9c8bda641 tempest-LiveMigrationTest-390172180 tempest-LiveMigrationTest-390172180-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1534 microversion: 2.1 time: 0.422315 Oct 28 13:19:35.584460 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1846/3783] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:35 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1534 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:35.599068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:35.599764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:35.608157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.609764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.616775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.616775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.616775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.616775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.666308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:35.675442 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-74bb3f67-8de4-4795-bd24-cd4fced8dfc1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1308 microversion: 2.1 time: 0.443268 Oct 28 13:19:35.682066 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1938/3784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:35 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:35.691781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:35.693179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:35.705086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.705879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.706644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.708624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:35.709427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:35.710143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:35.769228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:36.346482 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae5fc0a6-ec19-456e-8ad1-5f2e66bbca3f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "DELETE /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 204 len: 0 microversion: 2.1 time: 0.663407 Oct 28 13:19:36.347052 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1939/3785] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:35 2022] DELETE /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:19:36.356437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-181a7032-9b0e-4204-87c9-38d2a3a677e1 req-0e3630ec-dc60-4621-b1f5-74451f33599f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd61b5d2-16aa-4b8e-aff2-24ff59dfc068", "name": "network-vif-plugged", "status": "completed", "tag": "730dbf15-f5fe-4c61-9e9d-348ad2711c10"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:36.381412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:36.391555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-181a7032-9b0e-4204-87c9-38d2a3a677e1 req-0e3630ec-dc60-4621-b1f5-74451f33599f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.393043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-181a7032-9b0e-4204-87c9-38d2a3a677e1 req-0e3630ec-dc60-4621-b1f5-74451f33599f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.393043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-181a7032-9b0e-4204-87c9-38d2a3a677e1 req-0e3630ec-dc60-4621-b1f5-74451f33599f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.399956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:36.401466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:36.415415 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4c6a4e9-089b-4ded-bafa-ee3734942980 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.816888 Oct 28 13:19:36.416643 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1847/3786] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:35 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:36.434431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:36.437631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:36.439267 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-181a7032-9b0e-4204-87c9-38d2a3a677e1 req-0e3630ec-dc60-4621-b1f5-74451f33599f service nova] Creating event network-vif-plugged:730dbf15-f5fe-4c61-9e9d-348ad2711c10 for instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 on n-h2-862876-2 Oct 28 13:19:36.446849 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-181a7032-9b0e-4204-87c9-38d2a3a677e1 req-0e3630ec-dc60-4621-b1f5-74451f33599f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094533 Oct 28 13:19:36.451673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.452876 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1940/3787] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:36.464684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.465298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.466090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.466573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.467623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.478456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:36.479271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:36.496833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.515345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.516118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.516939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.517571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lazy-loading 'fault' on Instance uuid deb84989-5cbd-4005-97c6-786f1a15b125 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:19:36.531219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.531682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.532432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.532895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.533326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.648545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:36.675316 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e17a812a-d323-41b5-b25c-783822acff05 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 200 len: 1305 microversion: 2.1 time: 0.246600 Oct 28 13:19:36.684361 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1848/3788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:36 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 1305 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:36.712399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:36.712399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:36.719196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.719829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.720342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.721137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:36.721651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:36.722147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:36.942944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:36.951801 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95530280-0d10-4962-8a54-c1c1341ac67e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1308 microversion: 2.1 time: 0.246853 Oct 28 13:19:36.952716 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1849/3789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:36 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:37.024327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:37.037653 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8595f18b-0664-4ebc-b15f-0808fe8edfca tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1389 microversion: 2.1 time: 0.579624 Oct 28 13:19:37.040122 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1941/3790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:36 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1389 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:37.445850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:37.447276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:37.458673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.459498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.459936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:37.460864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.461540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.462164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:37.707474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:37.709350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: deb84989-5cbd-4005-97c6-786f1a15b125] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:37.725389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.727192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.728597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:37.729692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.730329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.731413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:37.758677 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] HTTP exception thrown: Instance deb84989-5cbd-4005-97c6-786f1a15b125 could not be found. Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Request method failure captured: Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 HTTP/1.1 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9SWT6BgvCZTXsOfv9Vyc6ioCnbTHbmj9JxEA_DdFhqusPsRbKCZrawNmdRxzkK22HS8opsxRx98Xdr1ZZc1ozXkmYWvMKboN94t84b0I0pk83XF1AdoTAzNYMExiAb3E3UnZGiSFcwiBCQm_wKk-bLTIJULP8dF0jtfx7J2TG8yxFE Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_524832a11bb148639788f80ef22b2865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/524832a11bb148639788f80ef22b2865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d70178138d974c20bb9598de42bd3294 Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance deb84989-5cbd-4005-97c6-786f1a15b125 could not be found. Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'deb84989-5cbd-4005-97c6-786f1a15b125'} Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb84989-5cbd-4005-97c6-786f1a15b125 could not be found. Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb84989-5cbd-4005-97c6-786f1a15b125 could not be found. Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:37.761516 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb84989-5cbd-4005-97c6-786f1a15b125 could not be found. Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Returning 404 to user: Instance deb84989-5cbd-4005-97c6-786f1a15b125 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:19:37.774460 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e1ca23c-dcae-47b6-bfce-05451858912a tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125" status: 404 len: 111 microversion: 2.1 time: 0.062214 Oct 28 13:19:37.776933 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1942/3791] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:37 2022] GET /compute/v2.1/servers/deb84989-5cbd-4005-97c6-786f1a15b125 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:19:37.789177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:37.790017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:37.798655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.799645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.800955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:37.802230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.802894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.803556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:37.812648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:37.823261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:37.825015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:37.826388 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f74a92c0-d981-4aa5-8b8c-8a76920cc4f8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1892 microversion: 2.32 time: 0.385234 Oct 28 13:19:37.839528 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1850/3792] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:37 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1892 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:37.847784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:37.980314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:37.980933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:37.989942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.992880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.993595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:37.996964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:37.997647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:37.998278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:38.240539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:38.249667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-461eaed9-b7d9-452f-9fa1-7a99d9b77d0b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1308 microversion: 2.1 time: 0.273117 Oct 28 13:19:38.250267 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1851/3793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:37 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:38.259722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:38.260803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:38.269106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:38.269987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:38.270937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:38.271878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:38.272573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:38.273171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:38.343305 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6350d19a-636e-4550-908d-e0d8d72af42c tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 204 len: 0 microversion: 2.1 time: 0.552451 Oct 28 13:19:38.344016 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1943/3794] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:37 2022] DELETE /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:19:38.365868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-66394026-a181-4912-bfb3-742c34b30fff req-467860d4-4226-4370-8fef-94314e5600b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796fd28c-d3fc-4143-8fc8-6a4680a8975f", "name": "network-vif-deleted", "tag": "cf1e7a15-c820-4706-867a-d001cf5f55f8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:38.392898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-66394026-a181-4912-bfb3-742c34b30fff req-467860d4-4226-4370-8fef-94314e5600b8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:38.393381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-66394026-a181-4912-bfb3-742c34b30fff req-467860d4-4226-4370-8fef-94314e5600b8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:38.406107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:38.408667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-66394026-a181-4912-bfb3-742c34b30fff req-467860d4-4226-4370-8fef-94314e5600b8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:38.424241 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5fda15ab-7a16-4698-85c5-2292d3832145 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1347 microversion: 2.1 time: 0.170169 Oct 28 13:19:38.425729 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1852/3795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:38 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1347 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:38.450398 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-66394026-a181-4912-bfb3-742c34b30fff req-467860d4-4226-4370-8fef-94314e5600b8 service nova] Creating event network-vif-deleted:cf1e7a15-c820-4706-867a-d001cf5f55f8 for instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f on n-h2-862876-2 Oct 28 13:19:38.450612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:38.456917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:38.466543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-66394026-a181-4912-bfb3-742c34b30fff req-467860d4-4226-4370-8fef-94314e5600b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119701 Oct 28 13:19:38.469378 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1944/3796] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:38.490979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:38.496118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:38.501640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:38.501640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:38.501640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:38.501640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:38.743734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:38.757856 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-44143180-6764-4e9e-921c-8a60474d0992 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1506 microversion: 2.1 time: 0.327108 Oct 28 13:19:38.757856 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1853/3797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:38 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:38.854526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:38.855418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:38.872522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:38.872522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:38.872522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:38.872522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:38.873134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:38.873779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:39.285842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:39.287860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:39.299940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:39.302908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:39.303718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:39.308384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:39.309506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:39.310171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:39.419038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:39.433108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:39.434690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:39.444510 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70e00a51-1e7f-4e3a-9a47-d49744f3d3e2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.595034 Oct 28 13:19:39.445111 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1945/3798] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:38 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:39.466771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:39.468926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:39.488913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:39.497711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:39.499735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:39.500741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:39.502219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:39.505710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:39.639326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:39.649501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8b026b30-e7cb-4414-b47a-e6d1567883e0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1490 microversion: 2.1 time: 0.379207 Oct 28 13:19:39.662010 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1854/3799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:39 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1490 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:39.780808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:39.782427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:39.807264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:39.807776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:39.808217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:39.808938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:39.809395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:39.809817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:39.819986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:39.834024 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78aa870b-ccb3-4469-b009-91c4d3b8e8b9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1184 microversion: 2.1 time: 0.372410 Oct 28 13:19:39.839034 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1946/3800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:39 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1184 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:39.884472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-119449137", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "35b0cf8f-78ca-4b1e-81d5-1a1186c30f61"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:39.958448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:19:40.130350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:40.140648 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abf7faf5-c9a1-4d03-b895-340ea622bebc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1506 microversion: 2.1 time: 0.365783 Oct 28 13:19:40.147833 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1855/3801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:39 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:40.475603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:40.476259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:40.488864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:40.489012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:40.489413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:40.490511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:40.491353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:40.491974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:40.827389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:19:40.828192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:19:40.829177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:19:40.829762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:19:40.830389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:19:40.843314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:40.844184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:40.845087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:40.847110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:40.847814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:40.848603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:40.897134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:19:40.920340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:19:40.959518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:19:40.966884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:19:41.111699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:41.126971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:41.132357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:41.136096 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ba85427-aec9-413d-9696-e87e958e2516 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.664180 Oct 28 13:19:41.138204 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1856/3802] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:40 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:41.150779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1590ac71-2e92-439c-b969-3f526cb262b7 req-9965a38f-0f4b-4233-9df6-2dd04076e93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d63c99-cc82-4458-bfbc-27b3f944f3ea", "name": "network-vif-deleted", "tag": "f1cc1003-7a92-4dc8-baa1-095391669b36"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:41.176571 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf2341f7-5594-4a1a-9385-cd74996bf295 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.296774 Oct 28 13:19:41.177576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1590ac71-2e92-439c-b969-3f526cb262b7 req-9965a38f-0f4b-4233-9df6-2dd04076e93d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:41.178072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1590ac71-2e92-439c-b969-3f526cb262b7 req-9965a38f-0f4b-4233-9df6-2dd04076e93d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:41.178509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1590ac71-2e92-439c-b969-3f526cb262b7 req-9965a38f-0f4b-4233-9df6-2dd04076e93d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:41.181401 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1947/3803] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:19:41.201937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:41.208160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:41.230007 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1590ac71-2e92-439c-b969-3f526cb262b7 req-9965a38f-0f4b-4233-9df6-2dd04076e93d service nova] Creating event network-vif-deleted:f1cc1003-7a92-4dc8-baa1-095391669b36 for instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea on n-h2-862876-2 Oct 28 13:19:41.252961 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1590ac71-2e92-439c-b969-3f526cb262b7 req-9965a38f-0f4b-4233-9df6-2dd04076e93d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112974 Oct 28 13:19:41.253852 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1857/3804] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:41.278674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:41.278674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:41.278946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:41.279248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:41.279687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:41.280420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:41.280884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:41.302341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:41.307217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:41.315704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:41.316485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:41.324364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:41.325230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:41.325996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:41.493335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:41.514704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-77690529-fbd2-48f0-8a29-fdd5d509ca40 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1184 microversion: 2.1 time: 0.324667 Oct 28 13:19:41.515581 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1948/3805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:41 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1184 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:41.568002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9632c99-5a35-4c7a-8dd1-56a71457b1e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:41.568002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9632c99-5a35-4c7a-8dd1-56a71457b1e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:41.699616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:41.711910 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17e452c2-77d6-4f64-9174-e4da8360fe79 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 200 len: 1299 microversion: 2.1 time: 0.453952 Oct 28 13:19:41.736999 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1858/3806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:41 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 1299 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:41.748225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9632c99-5a35-4c7a-8dd1-56a71457b1e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:41.766869 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9632c99-5a35-4c7a-8dd1-56a71457b1e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1208 microversion: 2.1 time: 0.223897 Oct 28 13:19:41.789240 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1949/3807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:41 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1208 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:42.164010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:42.164638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:42.171740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:42.175796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:42.178136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:42.183114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:42.184087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:42.184805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:42.539191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:42.539863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:42.556950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:42.557460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:42.557896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:42.558595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:42.559435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:42.560032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:42.608938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:42.632730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:42.635558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:42.637443 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3861a695-6f22-4af0-8dd5-8e76f76d8350 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.478334 Oct 28 13:19:42.638710 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1859/3808] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:42 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:42.688076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:42.732930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:42.745851 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-580c539f-cb93-4e71-a76b-b0ddc45a56cf tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1184 microversion: 2.1 time: 0.211772 Oct 28 13:19:42.760346 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1950/3809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:42 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1184 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:42.793996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87587141-10de-4ea8-bf18-866d9af0c0d8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:42.794612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87587141-10de-4ea8-bf18-866d9af0c0d8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:42.950146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-87587141-10de-4ea8-bf18-866d9af0c0d8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:42.962230 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87587141-10de-4ea8-bf18-866d9af0c0d8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1208 microversion: 2.1 time: 0.172658 Oct 28 13:19:42.984564 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1951/3810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:42 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1208 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:43.286506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:43.287673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: f7d63c99-cc82-4458-bfbc-27b3f944f3ea] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:43.339177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:43.367267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:43.368106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:43.369093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:43.369755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:43.370562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:43.385849 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] HTTP exception thrown: Instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea could not be found. Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Request method failure captured: Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea HTTP/1.1 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SWT6BgvCZTXsOfv9Vyc6ioCnbTHbmj9JxEA_DdFhqusPsRbKCZrawNmdRxzkK22HS8opsxRx98Xdr1ZZc1ozXkmYWvMKboN94t84b0I0pk83XF1AdoTAzNYMExiAb3E3UnZGiSFcwiBCQm_wKk-bLTIJULP8dF0jtfx7J2TG8yxFE Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_524832a11bb148639788f80ef22b2865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/524832a11bb148639788f80ef22b2865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d70178138d974c20bb9598de42bd3294 Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea could not be found. Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'f7d63c99-cc82-4458-bfbc-27b3f944f3ea'} Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea could not be found. Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea could not be found. Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:43.388791 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:43.394225 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:43.394225 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:43.394225 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:43.394225 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:19:43.394225 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:19:43.394225 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea could not be found. Oct 28 13:19:43.394225 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:43.401827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Returning 404 to user: Instance f7d63c99-cc82-4458-bfbc-27b3f944f3ea could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:19:43.401827 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da664746-0c98-4c71-99ff-46cc495808aa tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea" status: 404 len: 111 microversion: 2.1 time: 0.662460 Oct 28 13:19:43.401827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1860/3811] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:42 2022] GET /compute/v2.1/servers/f7d63c99-cc82-4458-bfbc-27b3f944f3ea => generated 111 bytes in 664 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:19:43.406488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:43.407157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:43.416754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:43.417252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:43.417685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:43.429067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:43.429640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:43.430070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:43.472036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:43.669194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:43.679215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:43.684012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:43.684507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:43.684943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:43.686357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:43.686874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:43.687669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:43.725471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:44.146411 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6324e26a-dea8-481e-8f76-697a2dec0003 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 204 len: 0 microversion: 2.1 time: 0.742968 Oct 28 13:19:44.148145 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1952/3812] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:43 2022] DELETE /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:19:44.155186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:44.170920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:44.174439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:44.176804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:44.178151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:44.178968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:44.179663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:44.180601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:44.181310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:44.181961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:44.224958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:44.230173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:44.236741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8832a3bc-abf9-45e8-bc97-c55d8ec71cef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.572440 Oct 28 13:19:44.237993 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1861/3813] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:43 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:44.249436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:44.250273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:44.273349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:44.273673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:44.273673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:44.273673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:44.273673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:44.273673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:44.273673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:44.281241 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-42683bf8-d729-4a9b-a11a-d549e4b1a517 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1184 microversion: 2.1 time: 0.129624 Oct 28 13:19:44.282698 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1953/3814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:44 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1184 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:44.288000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:44.288911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:44.932930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:44.932930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:44.932930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:44.932930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:44.932930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:44.932930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:44.935247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:44.935247 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5e6340a-2809-48c6-b24d-d803f7808589 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1204 microversion: 2.1 time: 0.246393 Oct 28 13:19:44.935247 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1862/3815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:44 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1204 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:44.936882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:44.936882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28152bf5-4e63-495c-96cf-a5e026f133f0 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1493 microversion: 2.1 time: 0.258941 Oct 28 13:19:44.936882 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1954/3816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:44 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1493 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:45.279827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:45.280743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:45.289151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.289656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.290131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:45.290843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.291297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.291726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:45.310431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:45.311315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:45.342593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.343116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.345453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:45.346367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.362774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.362774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:45.450799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:45.459340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d56696d2-0b1e-49f2-8791-42faed51b652 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1184 microversion: 2.1 time: 0.153875 Oct 28 13:19:45.459936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1955/3817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:45 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1184 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:45.515389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:45.516830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:45.530699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.533804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.557573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:45.558603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.569520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.570335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:45.769919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:45.782583 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3d76b00-38fc-461f-869a-b6c1f6d10197 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1260 microversion: 2.1 time: 0.271644 Oct 28 13:19:45.783598 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1956/3818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:45 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:45.796799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:45.797673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:45.806069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.811745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.812392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:45.817732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:45.817732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:45.817732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:46.024733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:46.055452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:46.057564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:46.064444 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-94608133-535c-4e5d-a44e-26d2959fb283 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.788531 Oct 28 13:19:46.065430 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1863/3819] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:45 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:46.093674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6ecc8226-e0e1-497b-a30c-ce83f6c69ebd req-31632587-f05a-4d60-8b2e-08871e8d227c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d991d48-c735-4695-976c-650b4b1bc7d8", "name": "network-vif-deleted", "tag": "0d58dc1c-13e4-4b35-b312-3b8e237f18a9"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:46.117955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:46.119994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ecc8226-e0e1-497b-a30c-ce83f6c69ebd req-31632587-f05a-4d60-8b2e-08871e8d227c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:46.120681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ecc8226-e0e1-497b-a30c-ce83f6c69ebd req-31632587-f05a-4d60-8b2e-08871e8d227c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:46.121321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ecc8226-e0e1-497b-a30c-ce83f6c69ebd req-31632587-f05a-4d60-8b2e-08871e8d227c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:46.125765 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed502ff8-e2ef-4984-87db-47d6d3061146 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1451 microversion: 2.1 time: 0.338653 Oct 28 13:19:46.139759 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1957/3820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:45 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1451 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:46.146952 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6ecc8226-e0e1-497b-a30c-ce83f6c69ebd req-31632587-f05a-4d60-8b2e-08871e8d227c service nova] Creating event network-vif-deleted:0d58dc1c-13e4-4b35-b312-3b8e237f18a9 for instance 4d991d48-c735-4695-976c-650b4b1bc7d8 on n-h1-862876-2 Oct 28 13:19:46.154379 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6ecc8226-e0e1-497b-a30c-ce83f6c69ebd req-31632587-f05a-4d60-8b2e-08871e8d227c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084431 Oct 28 13:19:46.159500 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1864/3821] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:46.488229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:46.489787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:46.502037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:46.502548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:46.503024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:46.503739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:46.504194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:46.504661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:46.660105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:46.669455 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32f0eb26-d65f-499c-8311-4c2b17ca66b3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1184 microversion: 2.1 time: 0.185586 Oct 28 13:19:46.670478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1958/3822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:46 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1184 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:46.814662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:46.815646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:46.824173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:46.829717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:46.831293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:46.833495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:46.834526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:46.835179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:46.961232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:46.987900 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-404392ca-838d-4ad3-b86d-2a1b4a3856d9 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1266 microversion: 2.1 time: 0.177962 Oct 28 13:19:46.991390 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1865/3823] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:46 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:47.097226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:47.098064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:47.108622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.109122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.109561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.110329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.112147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.112590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.153770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:47.154934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:47.164747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.165238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.165676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.166386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.166861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.167439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.201482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.202193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.202804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.203861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lazy-loading 'fault' on Instance uuid 4d991d48-c735-4695-976c-650b4b1bc7d8 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:19:47.290073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:47.305255 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b13bfa33-408f-4629-a22a-ff227c3a6ecc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 200 len: 1304 microversion: 2.1 time: 0.155554 Oct 28 13:19:47.310146 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1866/3824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:47 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:47.596962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:47.606606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:47.612609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:47.620345 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99acb80d-c3e5-40da-928c-6539a03edb70 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.527303 Oct 28 13:19:47.626166 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1959/3825] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:47 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:47.694884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:47.695544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:47.711844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.712629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.713230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.714119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.717854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.718514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.767898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:47.768610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:47.769195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:47.769794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lazy-loading 'fault' on Instance uuid 796fd28c-d3fc-4143-8fc8-6a4680a8975f {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:19:47.864790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:47.890933 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e73327b6-ab90-4fcc-9718-24a87f3a48c4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 200 len: 1143 microversion: 2.1 time: 0.198285 Oct 28 13:19:47.891780 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1867/3826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:47 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 1143 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:48.014246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:48.015030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:48.021894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.022699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.023302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.024234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.025042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.025671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.276854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:48.285408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-289222ba-bb66-4a66-9fa0-8f64337f24d3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1308 microversion: 2.1 time: 0.275374 Oct 28 13:19:48.286038 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1960/3827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:48 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:48.333949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:48.334707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4d991d48-c735-4695-976c-650b4b1bc7d8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:48.340871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.341441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.342072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.342826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.343287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.343871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.358496 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] HTTP exception thrown: Instance 4d991d48-c735-4695-976c-650b4b1bc7d8 could not be found. Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Request method failure captured: Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 HTTP/1.1 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SWT6BgvCZTXsOfv9Vyc6ioCnbTHbmj9JxEA_DdFhqusPsRbKCZrawNmdRxzkK22HS8opsxRx98Xdr1ZZc1ozXkmYWvMKboN94t84b0I0pk83XF1AdoTAzNYMExiAb3E3UnZGiSFcwiBCQm_wKk-bLTIJULP8dF0jtfx7J2TG8yxFE Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_524832a11bb148639788f80ef22b2865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/524832a11bb148639788f80ef22b2865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d70178138d974c20bb9598de42bd3294 Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 4d991d48-c735-4695-976c-650b4b1bc7d8 could not be found. Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4d991d48-c735-4695-976c-650b4b1bc7d8'} Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d991d48-c735-4695-976c-650b4b1bc7d8 could not be found. Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d991d48-c735-4695-976c-650b4b1bc7d8 could not be found. Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:48.360323 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d991d48-c735-4695-976c-650b4b1bc7d8 could not be found. Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Returning 404 to user: Instance 4d991d48-c735-4695-976c-650b4b1bc7d8 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-af25feae-63ee-420c-9072-789a200152a1 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8" status: 404 len: 111 microversion: 2.1 time: 0.032355 Oct 28 13:19:48.363405 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1868/3828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:48 2022] GET /compute/v2.1/servers/4d991d48-c735-4695-976c-650b4b1bc7d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:19:48.378943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:48.383045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:48.393866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.395412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.398525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.399638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.400371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.402606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.474030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:48.655784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:48.656553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:48.670202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.670710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.671906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.674125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:48.674599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:48.675057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:48.857059 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0183c9d-b766-48c0-8c4f-e91c0ebcc329 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 204 len: 0 microversion: 2.1 time: 0.488919 Oct 28 13:19:48.858886 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1961/3829] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:48 2022] DELETE /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:19:48.868853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-32529361", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f3ae6caf-d5b3-4967-a0fb-acfd65c842ad"}], "security_groups": [{"name": "tempest-securitygroup--1798180185"}], "key_name": "tempest-keypair-1451927692", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "20d6998a-f9bf-4c35-8469-3a0c61e5bdf0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:49.116894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] validate_networks() for [('f3ae6caf-d5b3-4967-a0fb-acfd65c842ad', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:19:49.221300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:49.238084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:49.240360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:49.241589 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-707e82f5-c181-42e5-a10e-f9f8f49902dc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.590479 Oct 28 13:19:49.242148 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1869/3830] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:48 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:19:49.252754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:49.255956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:49.270305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.271060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.271644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.272539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.273007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.273429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.590457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:49.590457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9cde43f-e144-4fdc-b0fd-164cc372de43 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1673 microversion: 2.1 time: 0.341442 Oct 28 13:19:49.603658 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1870/3831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:49 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1673 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:49.615105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:49.615962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 796fd28c-d3fc-4143-8fc8-6a4680a8975f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:49.622537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.623071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.624467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.625431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.626056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.626691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.645862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] HTTP exception thrown: Instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f could not be found. Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Request method failure captured: Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f HTTP/1.1 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UnVFIhzRVXW2My96cUUpSpqN8pmeOlcs89qhhlGQPz5Xf5EqA-X1VMaE_BQQkuRAdiOU9nxf4-3ptPbtY_7QtJfrBWrtQTTc2UTjfySCJfIpaa6hpjtbs8TRYPGgivh37iKaho7ot7XIwfIV-oh1wfw1C5UY-Yf1HSD6rPqRMG1pY Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5acad27b2ef04ec59e1aaf75997cc653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveMigrationTest-1861441409 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveMigrationTest-1861441409-project Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2042816d9181427cb51f1c710281aa53 Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveMigrationTest-1861441409-project Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f could not be found. Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '796fd28c-d3fc-4143-8fc8-6a4680a8975f'} Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f could not be found. Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f could not be found. Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:49.648740 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:49.652608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:49.652608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:49.652608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:49.652608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:19:49.652608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:19:49.652608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f could not be found. Oct 28 13:19:49.652608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:49.654949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Returning 404 to user: Instance 796fd28c-d3fc-4143-8fc8-6a4680a8975f could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:19:49.656035 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d81f3be1-aff3-4e50-aae3-b52564ae70df tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f" status: 404 len: 111 microversion: 2.1 time: 0.051316 Oct 28 13:19:49.656767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1871/3832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:49 2022] GET /compute/v2.1/servers/796fd28c-d3fc-4143-8fc8-6a4680a8975f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:19:49.663481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:49.665084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:49.672730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.673595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.675352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.677892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.678541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.680475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.858378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Getting quotas for project 653d6f1ee82e4ad79c52e6b10416b7cd. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:19:49.876200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Getting quotas for user 6653382d9a254ea2a40a635083080f12 and project 653d6f1ee82e4ad79c52e6b10416b7cd. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:19:49.907502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:19:49.908112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:19:49.908814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:19:49.909234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:19:49.910887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:19:49.929283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.929986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.931225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.932805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:49.934009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:49.935565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:49.979600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Getting quotas for project 653d6f1ee82e4ad79c52e6b10416b7cd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:19:49.987473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Getting quotas for user 6653382d9a254ea2a40a635083080f12 and project 653d6f1ee82e4ad79c52e6b10416b7cd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:19:50.087823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:19:50.090738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20d6998a-f9bf-4c35-8469-3a0c61e5bdf0',volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:19:50.631233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:50.640724 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e4948356-7b9e-4df8-9640-a73f02ecb60d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1308 microversion: 2.1 time: 0.982692 Oct 28 13:19:50.641315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1872/3833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:49 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1308 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:50.662670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:50.663486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:50.672195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:50.672898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:50.677896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:50.678836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:50.679643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:50.680208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:50.781142 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-348b3b26-bcae-4e4d-a89b-a7d9facac29f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.919960 Oct 28 13:19:50.787253 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1962/3834] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:19:48 2022] POST /compute/v2.1/servers => generated 407 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:19:50.792012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-500452d1-f889-4982-bc45-95885db60999 req-c6d0c9a6-8393-4d4a-9230-dd4444b99c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505ff1b7-1cf5-4ae5-8494-f1e9df121241", "tag": "0421fbc0-5f6c-4913-970a-36cc80fa7162"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:50.836243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-500452d1-f889-4982-bc45-95885db60999 req-c6d0c9a6-8393-4d4a-9230-dd4444b99c4f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:50.844985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-500452d1-f889-4982-bc45-95885db60999 req-c6d0c9a6-8393-4d4a-9230-dd4444b99c4f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:50.845443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-500452d1-f889-4982-bc45-95885db60999 req-c6d0c9a6-8393-4d4a-9230-dd4444b99c4f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:50.870892 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-500452d1-f889-4982-bc45-95885db60999 req-c6d0c9a6-8393-4d4a-9230-dd4444b99c4f service nova] Creating event network-changed:0421fbc0-5f6c-4913-970a-36cc80fa7162 for instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 on n-h1-862876-2 Oct 28 13:19:50.884825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-500452d1-f889-4982-bc45-95885db60999 req-c6d0c9a6-8393-4d4a-9230-dd4444b99c4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096212 Oct 28 13:19:50.885454 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1963/3835] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:50.891926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:50.892639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:50.914974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:50.915455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:50.915909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:50.916641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:50.917106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:50.917539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:51.438950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:51.465832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:51.470234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:51.475626 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07551666-b453-421b-89a2-496bcbf127fc tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.814571 Oct 28 13:19:51.477719 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1873/3836] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:50 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:51.495728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac445b23-003e-45b9-9ebd-510b58c4c27a tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:51.496952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ac445b23-003e-45b9-9ebd-510b58c4c27a tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:51.554707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:51.564875 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13dfe0cf-0eda-4cf3-9944-9b146348c087 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1673 microversion: 2.1 time: 0.677519 Oct 28 13:19:51.565699 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1964/3837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:50 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1673 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:51.666577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:51.667859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:51.705653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:51.709877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:51.711341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:51.713087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:51.716217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:51.716801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:51.827312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ac445b23-003e-45b9-9ebd-510b58c4c27a tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:51.836729 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ac445b23-003e-45b9-9ebd-510b58c4c27a tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1120 microversion: 2.1 time: 0.356816 Oct 28 13:19:51.838121 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1874/3838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:51 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1120 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:52.116847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:52.135365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:52.205414 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-93c9587c-b02a-49cc-9e95-6ee8a5f2fae0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1308 microversion: 2.1 time: 0.527405 Oct 28 13:19:52.207343 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1965/3839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:51 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:52.508678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:52.512606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:52.523970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:52.527417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:52.528027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:52.528901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:52.551855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:52.556807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:52.590296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:52.593691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:52.607618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:52.608128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:52.608573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:52.611067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:52.616683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:52.617425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:52.876969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:52.886242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1aa8985f-4b84-43e6-a51b-3e0f6c10964d tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1606 microversion: 2.1 time: 0.300746 Oct 28 13:19:52.899478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1966/3840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:52 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1606 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:52.899478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:52.924457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:52.968058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:52.968563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:52.972966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:52.972966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:52.972966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:52.972966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:53.088291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:53.100011 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cef59779-b7bc-4b51-a3cc-378bee2b085b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1170 microversion: 2.1 time: 0.206453 Oct 28 13:19:53.103639 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1967/3841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:52 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1170 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:53.120471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-36f5bf67-4470-4776-aded-170411cd024d req-4851eb2f-9257-407a-bd64-8916ea341a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0226a-6507-4449-92ec-3050830d72a1", "name": "network-vif-deleted", "tag": "1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:53.161932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-36f5bf67-4470-4776-aded-170411cd024d req-4851eb2f-9257-407a-bd64-8916ea341a4a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:53.165737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-36f5bf67-4470-4776-aded-170411cd024d req-4851eb2f-9257-407a-bd64-8916ea341a4a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:53.166236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-36f5bf67-4470-4776-aded-170411cd024d req-4851eb2f-9257-407a-bd64-8916ea341a4a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:53.187527 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-36f5bf67-4470-4776-aded-170411cd024d req-4851eb2f-9257-407a-bd64-8916ea341a4a service nova] Creating event network-vif-deleted:1350130b-bfc3-4dcf-8ae1-7019b3d2bfdc for instance 4ce0226a-6507-4449-92ec-3050830d72a1 on n-h2-862876-2 Oct 28 13:19:53.199923 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-36f5bf67-4470-4776-aded-170411cd024d req-4851eb2f-9257-407a-bd64-8916ea341a4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093114 Oct 28 13:19:53.200785 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1968/3842] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:53.233139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:53.233916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:53.244605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:53.271665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:53.273348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:53.274236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:53.275156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:53.283229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:53.410249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:53.426981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:53.429779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:53.432765 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-364de805-77ee-4c5a-a010-bebc8e26a5b2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.928218 Oct 28 13:19:53.433881 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1875/3843] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:52 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:53.913504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:53.915105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:53.938356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:53.938945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:53.944208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:53.945161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:53.945781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:53.946857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:54.018297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:54.019110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:54.019751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:54.020473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lazy-loading 'fault' on Instance uuid 4ce0226a-6507-4449-92ec-3050830d72a1 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:19:54.154388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70178138d974c20bb9598de42bd3294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524832a11bb148639788f80ef22b2865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:54.165650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f184f84-603a-43ab-b600-72a977b21698 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 200 len: 1328 microversion: 2.1 time: 0.256016 Oct 28 13:19:54.166245 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1876/3844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:53 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 1328 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:54.183902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:54.184534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:54.212636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:54.213145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:54.214626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:54.215385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:54.219059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:54.219921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:54.569144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:54.579323 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a20663a2-fb62-4ddf-9145-331d4dd12966 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1308 microversion: 2.1 time: 1.353755 Oct 28 13:19:54.580241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1969/3845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:53 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1308 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:54.586012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:54.586637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:54.594286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:54.601522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:54.602385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:54.602809 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6393375d-ef95-4c75-8d65-1dba9d8bb461 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1218 microversion: 2.1 time: 0.429354 Oct 28 13:19:54.603171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:54.603412 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1877/3846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:54 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1218 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:54.603956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:54.623554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:54.623728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:55.036690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:55.050295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:55.051839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:55.053020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f43fad90-dd9f-4e55-957b-aedbdb67a817 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.471735 Oct 28 13:19:55.053589 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1970/3847] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:54 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:55.193585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:55.199553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] [instance: 4ce0226a-6507-4449-92ec-3050830d72a1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:55.208429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:55.218058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:55.218058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:55.218058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:55.218058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:55.218058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:55.256720 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] HTTP exception thrown: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 could not be found. Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Request method failure captured: Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 HTTP/1.1 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9SWT6BgvCZTXsOfv9Vyc6ioCnbTHbmj9JxEA_DdFhqusPsRbKCZrawNmdRxzkK22HS8opsxRx98Xdr1ZZc1ozXkmYWvMKboN94t84b0I0pk83XF1AdoTAzNYMExiAb3E3UnZGiSFcwiBCQm_wKk-bLTIJULP8dF0jtfx7J2TG8yxFE Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/524832a11bb148639788f80ef22b2865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_524832a11bb148639788f80ef22b2865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/524832a11bb148639788f80ef22b2865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 524832a11bb148639788f80ef22b2865 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-115993337 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d70178138d974c20bb9598de42bd3294 Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-115993337-project Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 could not be found. Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4ce0226a-6507-4449-92ec-3050830d72a1'} Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 could not be found. Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 could not be found. Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:19:55.259703 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:55.263475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:19:55.263475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:19:55.263475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:19:55.263475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:19:55.263475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:19:55.263475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 could not be found. Oct 28 13:19:55.263475 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:19:55.264759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Returning 404 to user: Instance 4ce0226a-6507-4449-92ec-3050830d72a1 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:19:55.266891 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4f7aa72-359e-435c-872c-420eb8507fdc tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1" status: 404 len: 111 microversion: 2.1 time: 0.077740 Oct 28 13:19:55.267496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1878/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:55 2022] GET /compute/v2.1/servers/4ce0226a-6507-4449-92ec-3050830d72a1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:19:55.281818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61cd859b-af8e-4716-b0e4-9b9e1e02e996 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] Calling method '.version_select at 0x7f27b96f5310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:55.417721 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61cd859b-af8e-4716-b0e4-9b9e1e02e996 tempest-ServerActionsTestJSON-115993337 tempest-ServerActionsTestJSON-115993337-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767193991" status: 202 len: 0 microversion: 2.1 time: 0.143103 Oct 28 13:19:55.427752 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1971/3849] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767193991 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:19:55.534978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:55.539106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:55.553389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:55.554515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:55.557192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:55.559050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:55.560204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:55.561854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:55.593771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:19:55.608430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:55.609057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:55.622125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:55.622633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:55.624631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:55.625385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:55.625861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:55.626301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:55.654328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:55.998336 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30795a2d-35df-48c3-98a0-f4385cc5a2e9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "DELETE /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 204 len: 0 microversion: 2.1 time: 0.467561 Oct 28 13:19:55.998972 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1879/3850] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:19:55 2022] DELETE /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:19:56.013737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:56.022148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:56.050636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:56.052701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:56.053773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:56.056728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:56.058019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:56.060664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:56.145697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:56.155610 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be00bd7f-a952-47d2-95e5-d78fac8f3175 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1308 microversion: 2.1 time: 0.551780 Oct 28 13:19:56.165731 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1972/3851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:55 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:56.191807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:56.193907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:56.210083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:56.212005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:56.214141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:56.214865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:56.216877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:56.219404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:56.368539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:56.392671 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-039a55fd-5e14-416d-aa1c-6a21e7ed3e8d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1226 microversion: 2.1 time: 0.381163 Oct 28 13:19:56.393585 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1880/3852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:55 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1226 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:56.408973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:56.416628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:56.442777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:56.444037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:56.449098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:56.450048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:56.450678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:56.472864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:56.473040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:56.485712 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09a24a68-5e5d-43cf-ae24-629bd4e8b36f tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1669 microversion: 2.1 time: 0.311457 Oct 28 13:19:56.486668 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1973/3853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:56 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:57.194912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:57.195670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:57.207232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:57.208469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:57.211989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:57.212871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:57.216218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:57.216916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:58.156542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:58.177088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:58.185434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:58.187839 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c22baa9-c903-4af6-a8fe-35c342734801 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 1.792942 Oct 28 13:19:58.188793 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1881/3854] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:56 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:58.214338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:58.225273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:58.229615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:19:58.243631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:58.244426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:58.245036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:58.245929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:58.246553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:58.247325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:58.327472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:58.344952 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-baef185c-7b74-450f-bae3-d7d514be23dd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1308 microversion: 2.1 time: 1.157534 Oct 28 13:19:58.346232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1974/3855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:57 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1308 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:19:58.351505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:58.352348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:58.375899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:58.376607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:58.377569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:58.378223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:58.378713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:58.379399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:58.381167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:58.390880 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec9a10a6-88e3-4d2f-8e2f-91539da3370c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1236 microversion: 2.1 time: 0.181770 Oct 28 13:19:58.393153 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1882/3856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:58 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1236 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:58.405825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-403642b8-6642-4bcf-8227-1204d5b68ab9 req-7a8995e2-317f-41e8-a81d-5c3c96820012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505ff1b7-1cf5-4ae5-8494-f1e9df121241", "name": "network-vif-plugged", "status": "completed", "tag": "0421fbc0-5f6c-4913-970a-36cc80fa7162"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:58.428849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-403642b8-6642-4bcf-8227-1204d5b68ab9 req-7a8995e2-317f-41e8-a81d-5c3c96820012 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:58.431173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-403642b8-6642-4bcf-8227-1204d5b68ab9 req-7a8995e2-317f-41e8-a81d-5c3c96820012 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:58.431173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-403642b8-6642-4bcf-8227-1204d5b68ab9 req-7a8995e2-317f-41e8-a81d-5c3c96820012 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:58.455269 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-403642b8-6642-4bcf-8227-1204d5b68ab9 req-7a8995e2-317f-41e8-a81d-5c3c96820012 service nova] Creating event network-vif-plugged:0421fbc0-5f6c-4913-970a-36cc80fa7162 for instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 on n-h1-862876-2 Oct 28 13:19:58.463893 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-403642b8-6642-4bcf-8227-1204d5b68ab9 req-7a8995e2-317f-41e8-a81d-5c3c96820012 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068915 Oct 28 13:19:58.474997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1883/3857] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:19:58.559254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:58.571153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f258f2d-a275-49ee-9a9c-ecdf3de0c634 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1601 microversion: 2.1 time: 0.221224 Oct 28 13:19:58.574532 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1975/3858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:58 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:19:58.945597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3b55b4b3-3eb2-4b32-9f32-aefe5426d4c5 req-13b222b7-3c48-437c-acdb-034505cbe47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a15c03-700a-4a6f-8ee3-7edae4920b25", "name": "network-vif-deleted", "tag": "caf3b258-7c32-47dc-9e6a-0430cbac695f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:19:58.956141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3b55b4b3-3eb2-4b32-9f32-aefe5426d4c5 req-13b222b7-3c48-437c-acdb-034505cbe47a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:58.956633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3b55b4b3-3eb2-4b32-9f32-aefe5426d4c5 req-13b222b7-3c48-437c-acdb-034505cbe47a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:58.957062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3b55b4b3-3eb2-4b32-9f32-aefe5426d4c5 req-13b222b7-3c48-437c-acdb-034505cbe47a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:58.990438 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3b55b4b3-3eb2-4b32-9f32-aefe5426d4c5 req-13b222b7-3c48-437c-acdb-034505cbe47a service nova] Creating event network-vif-deleted:caf3b258-7c32-47dc-9e6a-0430cbac695f for instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 on n-h2-862876-2 Oct 28 13:19:59.015384 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3b55b4b3-3eb2-4b32-9f32-aefe5426d4c5 req-13b222b7-3c48-437c-acdb-034505cbe47a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084581 Oct 28 13:19:59.016682 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1884/3859] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:19:59.220016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:59.221085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:59.237077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:59.237750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:59.239447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:59.242304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:59.243076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:59.243662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:59.373097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:59.373817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:59.385389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:59.394545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:59.394545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:59.394728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:59.395324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:59.395771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:59.796614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:59.819994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:59.826414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:19:59.829688 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-695c2da0-88a0-4805-8ae5-98f037a359fb tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.613376 Oct 28 13:19:59.832389 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1976/3860] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:19:59 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:19:59.851495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:19:59.852393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:19:59.867084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:59.869045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:59.871290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:59.872380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:19:59.874713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:19:59.875515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:19:59.970957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:00.003666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=20 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:00.221307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:00.231940 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69eb26be-cb9a-4257-9a77-14ac8311cfec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1308 microversion: 2.1 time: 0.864510 Oct 28 13:20:00.234659 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1885/3861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:59 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1308 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:00.249455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:00.255145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:00.269068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:00.269068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:00.269068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:00.269068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:00.274528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:00.275080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:00.343244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:00.343736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:00.344178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:00.344634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lazy-loading 'fault' on Instance uuid 15a15c03-700a-4a6f-8ee3-7edae4920b25 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:20:00.487454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:00.500109 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01ac23f5-2bc8-4e69-b69c-f99348fab451 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1304 microversion: 2.1 time: 0.665568 Oct 28 13:20:00.503817 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1977/3862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:19:59 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1304 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:00.526058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b90b5a3f-94bd-4a19-9e71-e60b773276a5 req-9e54d512-9472-45aa-8aa4-c1b1cf1762f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-plugged", "status": "completed", "tag": "c906a364-1c73-4835-a3cb-a92097af050c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:00.558398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b90b5a3f-94bd-4a19-9e71-e60b773276a5 req-9e54d512-9472-45aa-8aa4-c1b1cf1762f8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:00.559243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b90b5a3f-94bd-4a19-9e71-e60b773276a5 req-9e54d512-9472-45aa-8aa4-c1b1cf1762f8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:00.561747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b90b5a3f-94bd-4a19-9e71-e60b773276a5 req-9e54d512-9472-45aa-8aa4-c1b1cf1762f8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:00.575889 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b90b5a3f-94bd-4a19-9e71-e60b773276a5 req-9e54d512-9472-45aa-8aa4-c1b1cf1762f8 service nova] Creating event network-vif-plugged:c906a364-1c73-4835-a3cb-a92097af050c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:00.583776 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b90b5a3f-94bd-4a19-9e71-e60b773276a5 req-9e54d512-9472-45aa-8aa4-c1b1cf1762f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061512 Oct 28 13:20:00.585413 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1978/3863] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:00.594841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:00.603937 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f80caf42-9af5-45d4-8f8a-190868fef4f3 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 200 len: 1324 microversion: 2.1 time: 0.366291 Oct 28 13:20:00.604530 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1886/3864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:00 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:00.872498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:00.873207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:00.882700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:00.883847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:00.884612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:00.885654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:00.886331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:00.887270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.263944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:01.267205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:01.280237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.282567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.283099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.285665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.286420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.287056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.421248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:01.436490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:01.440006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:01.463575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf858972-483d-4121-a626-1b158453ab23 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.582256 Oct 28 13:20:01.463575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1979/3865] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:00 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:01.536402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:01.539483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:01.553592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.556448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.557128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.559503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.563048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.563748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.705578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:01.717718 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0dd1e9b9-564b-4281-8ef9-c179782bc682 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1489 microversion: 2.1 time: 0.458508 Oct 28 13:20:01.720026 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1887/3866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:01 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1489 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:01.741531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:01.745306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 15a15c03-700a-4a6f-8ee3-7edae4920b25] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:01.756491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.757220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.757808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.760184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.761125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.764359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.810272 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] HTTP exception thrown: Instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 could not be found. Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Request method failure captured: Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 HTTP/1.1 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9UnVFIhzRVXW2My96cUUpSpqN8pmeOlcs89qhhlGQPz5Xf5EqA-X1VMaE_BQQkuRAdiOU9nxf4-3ptPbtY_7QtJfrBWrtQTTc2UTjfySCJfIpaa6hpjtbs8TRYPGgivh37iKaho7ot7XIwfIV-oh1wfw1C5UY-Yf1HSD6rPqRMG1pY Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5acad27b2ef04ec59e1aaf75997cc653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-LiveMigrationTest-1861441409-project Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 2042816d9181427cb51f1c710281aa53 Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-LiveMigrationTest-1861441409-project Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 could not be found. Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '15a15c03-700a-4a6f-8ee3-7edae4920b25'} Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 could not be found. Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 could not be found. Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:01.814417 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:01.817854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:01.817854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:01.817854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:01.817854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:20:01.817854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:20:01.817854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 could not be found. Oct 28 13:20:01.817854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:01.820095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Returning 404 to user: Instance 15a15c03-700a-4a6f-8ee3-7edae4920b25 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:20:01.822592 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-45c45646-ac73-4140-91e6-958534b794de tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25" status: 404 len: 111 microversion: 2.1 time: 0.098319 Oct 28 13:20:01.827571 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1888/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:01 2022] GET /compute/v2.1/servers/15a15c03-700a-4a6f-8ee3-7edae4920b25 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:20:01.840849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:01.842026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:01.858150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:01.867645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.871161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.871803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:01.873297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:01.875353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:01.876007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:02.513316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:02.523082 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b993b4c4-6ed3-44f3-89d8-37da8d18901d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1490 microversion: 2.1 time: 0.696077 Oct 28 13:20:02.523774 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1889/3868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:01 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1490 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:02.542024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f5e60e9-77a7-4198-907b-b329f29034bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '.version_select at 0x7f27b889d0d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:02.591682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:02.625657 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bc5d004-a1ec-45df-917e-1d30c2ca445b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1304 microversion: 2.1 time: 1.100453 Oct 28 13:20:02.627710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1980/3869] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:01 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1304 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:02.632853 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f5e60e9-77a7-4198-907b-b329f29034bb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892498360" status: 202 len: 0 microversion: 2.1 time: 0.108082 Oct 28 13:20:02.633928 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1890/3870] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892498360 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:20:02.647359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:02.649925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:02.676528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:02.676905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:02.677622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:02.678817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:02.680894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:02.681571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:02.683605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:02.684768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:02.704574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:02.705341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:02.705953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:02.708864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:02.709864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:02.712396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:03.334916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:03.347325 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-905eec56-81e4-4d22-9ef2-3acb1eba263c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1489 microversion: 2.1 time: 0.711723 Oct 28 13:20:03.349206 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1891/3871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:02 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1489 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:03.370675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-910f38cb-d39f-49b3-8e78-b6583b23f702 req-f6cd8fa5-0b82-4d2e-8067-a0c03d525421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f245ed-032b-4be2-b55f-4cdd987d4e22", "tag": "669987fb-3926-40d0-91ad-0a12b50186d3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:03.392379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-910f38cb-d39f-49b3-8e78-b6583b23f702 req-f6cd8fa5-0b82-4d2e-8067-a0c03d525421 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:03.393239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-910f38cb-d39f-49b3-8e78-b6583b23f702 req-f6cd8fa5-0b82-4d2e-8067-a0c03d525421 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:03.393877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-910f38cb-d39f-49b3-8e78-b6583b23f702 req-f6cd8fa5-0b82-4d2e-8067-a0c03d525421 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:03.424338 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-910f38cb-d39f-49b3-8e78-b6583b23f702 req-f6cd8fa5-0b82-4d2e-8067-a0c03d525421 service nova] Creating event network-changed:669987fb-3926-40d0-91ad-0a12b50186d3 for instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 on n-h1-862876-2 Oct 28 13:20:03.447561 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-910f38cb-d39f-49b3-8e78-b6583b23f702 req-f6cd8fa5-0b82-4d2e-8067-a0c03d525421 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091884 Oct 28 13:20:03.451349 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1892/3872] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:03.465596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:03.466529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:03.482318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:03.484100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:03.486049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:03.489064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:03.489675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:03.492061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:03.564731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:20:03.642323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:03.654467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:03.656069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:03.657518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c21b6f3-857f-4cd4-b7b6-98f731e40972 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.996684 Oct 28 13:20:03.670781 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1981/3873] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:02 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:03.676739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:03.677275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:03.685737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:03.686322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:03.687056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:03.687867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:03.688540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:03.689051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:04.032756 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11e6345d-8f78-4b06-bdf7-d97761562c97 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 204 len: 0 microversion: 2.1 time: 0.579645 Oct 28 13:20:04.033679 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1893/3874] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:20:03 2022] DELETE /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:20:04.043378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:04.044860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:04.055325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:04.058098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:04.058826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:04.059775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:04.063856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:04.064775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:04.065588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:04.076201 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-41d922fb-80be-47be-b9a1-d287ed3cae06 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1304 microversion: 2.1 time: 0.416586 Oct 28 13:20:04.083337 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1982/3875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:03 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1304 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:04.694476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:04.696578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:04.730155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:04.730993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:04.733495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:04.740243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:04.743512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:04.745560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:05.088891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:05.102113 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd61f336-7a8d-4d11-aa22-7d8fd8214b4d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1495 microversion: 2.1 time: 1.063473 Oct 28 13:20:05.108202 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1894/3876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:04 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1495 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:05.127315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:05.128291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:05.138038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:05.139547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:05.141520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:05.148914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:05.152005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:05.152903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:05.817917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:05.834600 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-84ecfc10-0faf-4138-9a63-c95d12d29c59 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1304 microversion: 2.1 time: 0.718469 Oct 28 13:20:05.836793 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1895/3877] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:05 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1304 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:05.855817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:05.857854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:05.886690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:05.888716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:05.890333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:05.895309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:05.897782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:05.904881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:06.000268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:20:06.033358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:06.059569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:06.063691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:06.066606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:06.075545 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0bd94a28-0543-4c9e-921d-aae70990ac1d tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 1.390993 Oct 28 13:20:06.083075 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1983/3878] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:04 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:06.141138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:06.142599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:06.166058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:06.166585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:06.167060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:06.174386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:06.178177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:06.179497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:06.450171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a76b1763-78e4-4d76-a7bd-23af7de70ca4 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "DELETE /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 204 len: 0 microversion: 2.1 time: 0.609813 Oct 28 13:20:06.454085 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1896/3879] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:20:05 2022] DELETE /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:20:06.474093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:06.477018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:06.482338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:06.483532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:06.492990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:06.493723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:06.494333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:06.494613 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d70cac95-0117-4930-a770-7d86ecdd1f24 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1495 microversion: 2.1 time: 0.359277 Oct 28 13:20:06.495456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:06.496063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:06.498178 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1984/3880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:06 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1495 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:06.511545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:06.859034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:06.859675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:06.883756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:06.884376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:06.891064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:06.891064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:06.891064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:06.891064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:07.421487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:07.435769 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-795d5c78-0bb1-439c-bd42-e052453d6540 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1485 microversion: 2.1 time: 0.975174 Oct 28 13:20:07.450038 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1897/3881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:06 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1485 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:07.461852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:07.462493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:07.468971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:07.472773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:07.472773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:07.472773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:07.472773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:07.472773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:07.484964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:07.495992 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad56775d-b8fd-4ee6-b6b8-7110603ed707 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1304 microversion: 2.1 time: 0.641156 Oct 28 13:20:07.497129 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1985/3882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:06 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1304 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:07.523869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:07.524526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:07.530512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:07.531240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:07.531677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:07.532371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:07.533024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:07.533440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:07.730963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:07.744362 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bf2a16c-3e3b-41c6-93de-7524a01a618d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1495 microversion: 2.1 time: 0.224932 Oct 28 13:20:07.745741 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1986/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:07 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1495 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:08.039230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ae3d1243-6cf0-4073-9513-a4bb26503f88 req-fa5b90cc-37e1-4add-b1f8-7095de5b530e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55347b5e-23a4-471d-b5a0-bbb0e8134ba9", "name": "network-vif-deleted", "tag": "03324192-3f49-463e-9862-16252a818baa"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:08.045943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:08.077010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ae3d1243-6cf0-4073-9513-a4bb26503f88 req-fa5b90cc-37e1-4add-b1f8-7095de5b530e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:08.078798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ae3d1243-6cf0-4073-9513-a4bb26503f88 req-fa5b90cc-37e1-4add-b1f8-7095de5b530e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:08.078798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ae3d1243-6cf0-4073-9513-a4bb26503f88 req-fa5b90cc-37e1-4add-b1f8-7095de5b530e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:08.108086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:08.111240 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ae3d1243-6cf0-4073-9513-a4bb26503f88 req-fa5b90cc-37e1-4add-b1f8-7095de5b530e service nova] Creating event network-vif-deleted:03324192-3f49-463e-9862-16252a818baa for instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 on n-h2-862876-2 Oct 28 13:20:08.122799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ae3d1243-6cf0-4073-9513-a4bb26503f88 req-fa5b90cc-37e1-4add-b1f8-7095de5b530e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086918 Oct 28 13:20:08.123460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:08.125282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:08.126037 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1987/3884] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:08.129811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-68473c7c-175f-40aa-b003-97fe30928088 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.677045 Oct 28 13:20:08.131408 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1898/3885] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:07 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:08.460501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:08.461540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:08.479509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:08.483813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:08.484455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:08.485806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:08.487512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:08.489759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:08.522803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:08.524249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:08.552115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:08.553430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:08.554020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:08.558224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:08.558966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:08.559736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:08.604347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:08.604851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:08.605291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:08.605746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lazy-loading 'fault' on Instance uuid 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:20:08.928817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:08.943921 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-800a17da-1454-40c5-8d26-703e124b6e2b tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 200 len: 1301 microversion: 2.1 time: 0.488487 Oct 28 13:20:08.976562 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1988/3886] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:08 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 1301 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:08.989373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d4bb16f5-581d-44ef-b6f5-01817b77e1f8 req-02a336dd-b98b-4a22-b674-f3aad8dd4d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505ff1b7-1cf5-4ae5-8494-f1e9df121241", "name": "network-vif-deleted", "tag": "0421fbc0-5f6c-4913-970a-36cc80fa7162"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:08.998698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:09.010584 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2a6a3b87-148a-4134-9c08-eaed325749c0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.494516 Oct 28 13:20:09.012539 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1899/3887] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:08 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:09.021836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4bb16f5-581d-44ef-b6f5-01817b77e1f8 req-02a336dd-b98b-4a22-b674-f3aad8dd4d6d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.022028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:09.022660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:09.023038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4bb16f5-581d-44ef-b6f5-01817b77e1f8 req-02a336dd-b98b-4a22-b674-f3aad8dd4d6d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.027521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4bb16f5-581d-44ef-b6f5-01817b77e1f8 req-02a336dd-b98b-4a22-b674-f3aad8dd4d6d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.035956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.036687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.037307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.038160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.038894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.039468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.070014 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d4bb16f5-581d-44ef-b6f5-01817b77e1f8 req-02a336dd-b98b-4a22-b674-f3aad8dd4d6d service nova] Creating event network-vif-deleted:0421fbc0-5f6c-4913-970a-36cc80fa7162 for instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 on n-h1-862876-2 Oct 28 13:20:09.077134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d4bb16f5-581d-44ef-b6f5-01817b77e1f8 req-02a336dd-b98b-4a22-b674-f3aad8dd4d6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097085 Oct 28 13:20:09.078814 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1989/3888] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:09.162789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:09.163524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:09.172771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.173530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.174174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.175128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.175783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.176971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.220446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:09.234384 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8b3a0019-a2e3-40ea-abc5-4c1b83d17031 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1453 microversion: 2.1 time: 0.220742 Oct 28 13:20:09.237521 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1900/3889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:09 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:09.658859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:09.699377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:09.699377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:09.699377 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a14cae73-2760-4913-9502-1949728ef7c6 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.542859 Oct 28 13:20:09.703872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1990/3890] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:09 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:09.741425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-735a43ca-ee7a-4539-95dd-09505aedea76 req-5f6008ee-c0c2-4e1b-86ee-c3a71da20e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-plugged", "status": "completed", "tag": "aa4b0395-5a41-4684-922b-b72b520b96b8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:09.755135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-735a43ca-ee7a-4539-95dd-09505aedea76 req-5f6008ee-c0c2-4e1b-86ee-c3a71da20e77 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.755970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-735a43ca-ee7a-4539-95dd-09505aedea76 req-5f6008ee-c0c2-4e1b-86ee-c3a71da20e77 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.756405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-735a43ca-ee7a-4539-95dd-09505aedea76 req-5f6008ee-c0c2-4e1b-86ee-c3a71da20e77 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.771159 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-735a43ca-ee7a-4539-95dd-09505aedea76 req-5f6008ee-c0c2-4e1b-86ee-c3a71da20e77 service nova] Creating event network-vif-plugged:aa4b0395-5a41-4684-922b-b72b520b96b8 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:09.808741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-735a43ca-ee7a-4539-95dd-09505aedea76 req-5f6008ee-c0c2-4e1b-86ee-c3a71da20e77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068265 Oct 28 13:20:09.809552 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1901/3891] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:09.973127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:09.974061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 55347b5e-23a4-471d-b5a0-bbb0e8134ba9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:09.981318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.981898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.983050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.983763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:09.984221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:09.984649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:09.998599 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] HTTP exception thrown: Instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 could not be found. Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Request method failure captured: Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 HTTP/1.1 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9UnVFIhzRVXW2My96cUUpSpqN8pmeOlcs89qhhlGQPz5Xf5EqA-X1VMaE_BQQkuRAdiOU9nxf4-3ptPbtY_7QtJfrBWrtQTTc2UTjfySCJfIpaa6hpjtbs8TRYPGgivh37iKaho7ot7XIwfIV-oh1wfw1C5UY-Yf1HSD6rPqRMG1pY Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5acad27b2ef04ec59e1aaf75997cc653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-LiveMigrationTest-1861441409-project Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2042816d9181427cb51f1c710281aa53 Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-LiveMigrationTest-1861441409-project Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 could not be found. Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '55347b5e-23a4-471d-b5a0-bbb0e8134ba9'} Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 could not be found. Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 could not be found. Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:10.000643 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 could not be found. Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Returning 404 to user: Instance 55347b5e-23a4-471d-b5a0-bbb0e8134ba9 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-375ea79a-5c74-4a8a-aa27-8db12de02cd9 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9" status: 404 len: 111 microversion: 2.1 time: 0.034377 Oct 28 13:20:10.005379 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1991/3892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:09 2022] GET /compute/v2.1/servers/55347b5e-23a4-471d-b5a0-bbb0e8134ba9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:20:10.012406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:10.013002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:10.021348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.021835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.022269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.023388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.023846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.024295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.049687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:10.061048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:10.072829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:20:10.085770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.089209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.092049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.093541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.098487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.101163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09159b3a-0e79-4547-ae80-873e6e17892e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.389063 Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1992/3893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:10 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.691871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.695013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.695013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid 505ff1b7-1cf5-4ae5-8494-f1e9df121241 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:20:10.695013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:10.695013 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25ea44ff-291f-4cfb-a54e-5d5c373640b5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 200 len: 1298 microversion: 2.1 time: 0.133323 Oct 28 13:20:10.695013 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1993/3894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:10 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 1298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:10.729976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:10.730627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:10.741300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.742297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.742962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.743777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.744756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.746084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.797318 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c3de8f2-389b-4838-b9bf-5b800347925d tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 204 len: 0 microversion: 2.1 time: 0.789358 Oct 28 13:20:10.799526 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1902/3895] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:20:10 2022] DELETE /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:20:10.808380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:10.809566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:10.816286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.817261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.818042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:10.822369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:10.822369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:10.822369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.090342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:11.105089 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7ad3704-275d-4682-aecf-a25ff7be6db8 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1500 microversion: 2.1 time: 0.300858 Oct 28 13:20:11.118930 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1903/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:10 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1500 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:11.204398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:11.223880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:11.229563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:11.229563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a7e3db49-5d11-4b1d-93d7-a52329cbc778 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.502955 Oct 28 13:20:11.229563 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1994/3897] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:10 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:11.501950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:11.509553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:11.525010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:11.525745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:11.526350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.527401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:11.538069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:11.538069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.580539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:11.587212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:11.591495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:11.592367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:11.593062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.593978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:11.594587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:11.595279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.614407 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 HTTP/1.1 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '505ff1b7-1cf5-4ae5-8494-f1e9df121241'} Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:11.624716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:11.629763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:11.629763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:11.629763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:11.629763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:20:11.629763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:20:11.629763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:20:11.629763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:11.656255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:20:11.659097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-291dafb6-3212-437e-99ce-6c4cd52d8075 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 404 len: 111 microversion: 2.1 time: 0.083109 Oct 28 13:20:11.666587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1995/3898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:11 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:20:11.680747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:11.684822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:11.696550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:11.697184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:11.697632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.698353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:11.698888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:11.703834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.731286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:11.749815 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-df58750f-6b2a-40d3-9bed-53248e3f8d81 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.270545 Oct 28 13:20:11.749815 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1904/3899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:11 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:11.771237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:20:11.833139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2a143a84-39a3-48e0-b53c-7af7b31b824b req-aef3260e-0e33-4166-bfbc-4d84a156ab45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-plugged", "status": "completed", "tag": "ac53c53a-9f3f-4bb6-8e75-30afad7abfcc"}, {"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-plugged", "status": "completed", "tag": "446efb77-9678-4e81-8d74-330b08b10c0e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:11.850015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2a143a84-39a3-48e0-b53c-7af7b31b824b req-aef3260e-0e33-4166-bfbc-4d84a156ab45 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:11.850015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2a143a84-39a3-48e0-b53c-7af7b31b824b req-aef3260e-0e33-4166-bfbc-4d84a156ab45 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:11.850425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2a143a84-39a3-48e0-b53c-7af7b31b824b req-aef3260e-0e33-4166-bfbc-4d84a156ab45 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:11.866066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2a143a84-39a3-48e0-b53c-7af7b31b824b req-aef3260e-0e33-4166-bfbc-4d84a156ab45 service nova] Creating event network-vif-plugged:ac53c53a-9f3f-4bb6-8e75-30afad7abfcc for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:11.866785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2a143a84-39a3-48e0-b53c-7af7b31b824b req-aef3260e-0e33-4166-bfbc-4d84a156ab45 service nova] Creating event network-vif-plugged:446efb77-9678-4e81-8d74-330b08b10c0e for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:11.873782 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2a143a84-39a3-48e0-b53c-7af7b31b824b req-aef3260e-0e33-4166-bfbc-4d84a156ab45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046135 Oct 28 13:20:11.875029 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1905/3900] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:12.137576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:12.138927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:12.153511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.153688 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-656e1e03-c6e0-41c4-9678-53ea31cd9350 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 204 len: 0 microversion: 2.1 time: 0.482916 Oct 28 13:20:12.154152 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1996/3901] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:20:11 2022] DELETE /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:20:12.155363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.156643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.168744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:12.171124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.172095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.172230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:12.173830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.187412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.196622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.197895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.199356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.202379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.208822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.492203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:12.502326 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-af4e29eb-cd7e-474b-8cea-4792398d1c30 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1500 microversion: 2.1 time: 0.376331 Oct 28 13:20:12.506872 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1906/3902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:12 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1500 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:12.521427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:12.522685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:12.528938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.529645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.530325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.531288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.532096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.532726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.578167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:12.590155 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de4699fc-93ef-4fc3-ab49-9cb9aacec945 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1496 microversion: 2.1 time: 0.429734 Oct 28 13:20:12.591730 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1997/3903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:12 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1496 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:12.774415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:12.774415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:12.783723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.784235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.784677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.785424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:12.785888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:12.786323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:12.978617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:12.994230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:12.997372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:13.001810 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3dd46002-de66-4436-b787-8acb2f8340d2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.493429 Oct 28 13:20:13.005141 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1907/3904] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:12 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:13.030567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-36705b09-7077-43e9-87c5-ce77b69db80b req-d0889349-b23f-443f-a5ff-94cd5f2a9955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1ffca7-434e-4a17-b653-1de7ad966c6c", "name": "network-vif-deleted", "tag": "c9686326-87a8-4332-8fdd-fc24a3f1076c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:13.041015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-36705b09-7077-43e9-87c5-ce77b69db80b req-d0889349-b23f-443f-a5ff-94cd5f2a9955 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:13.041485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-36705b09-7077-43e9-87c5-ce77b69db80b req-d0889349-b23f-443f-a5ff-94cd5f2a9955 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:13.042374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-36705b09-7077-43e9-87c5-ce77b69db80b req-d0889349-b23f-443f-a5ff-94cd5f2a9955 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:13.055274 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-36705b09-7077-43e9-87c5-ce77b69db80b req-d0889349-b23f-443f-a5ff-94cd5f2a9955 service nova] Creating event network-vif-deleted:c9686326-87a8-4332-8fdd-fc24a3f1076c for instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c on n-h2-862876-2 Oct 28 13:20:13.061767 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-36705b09-7077-43e9-87c5-ce77b69db80b req-d0889349-b23f-443f-a5ff-94cd5f2a9955 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055042 Oct 28 13:20:13.063234 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1908/3905] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:13.092781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:13.101482 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2aa61f4-d3fb-4dc0-bc58-aeb7de8bb58f tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.333782 Oct 28 13:20:13.110909 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1998/3906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:12 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:13.530826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:13.531429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:13.539444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:13.540164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:13.540941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:13.541983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:13.542597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:13.543384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:13.617933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:13.619208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:13.635957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:13.638113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:13.638852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:13.640971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:13.642910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:13.643495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:13.749134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2042816d9181427cb51f1c710281aa53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acad27b2ef04ec59e1aaf75997cc653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:13.761350 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-132c0dab-838e-4359-b258-d6986d9e5e36 tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 200 len: 1295 microversion: 2.1 time: 0.238021 Oct 28 13:20:13.763819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1909/3907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:13 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 1295 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:13.903865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-plugged", "status": "completed", "tag": "bffbf9ff-87ff-46cb-a6a2-b5138ecb6120"}, {"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-plugged", "status": "completed", "tag": "216191b8-6f5e-47bd-9d63-06490921d508"}, {"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-plugged", "status": "completed", "tag": "a2a1ba3d-63f3-4bcb-b866-ef09c515046c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:13.940135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:13.940666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:13.941119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:13.996703 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] Creating event network-vif-plugged:bffbf9ff-87ff-46cb-a6a2-b5138ecb6120 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:13.997403 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] Creating event network-vif-plugged:216191b8-6f5e-47bd-9d63-06490921d508 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:13.997732 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] Creating event network-vif-plugged:a2a1ba3d-63f3-4bcb-b866-ef09c515046c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:14.024614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c0683048-ca34-4279-bd9e-42fb7c0d914f req-21a475ed-f7f5-40e9-bb0c-e9b52220e3b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.125697 Oct 28 13:20:14.031615 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1910/3908] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:20:14.037908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:14.038628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:14.055116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:14.056157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:14.056942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:14.058965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:14.060069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:14.060973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:14.069949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:14.082722 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ceb4f26d-21c7-4b67-9f0f-0a3136826c65 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1496 microversion: 2.1 time: 0.468441 Oct 28 13:20:14.099489 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 1999/3909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:13 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1496 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:14.128882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:14.130944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:14.140243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:14.152174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:14.152642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:14.153392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:14.153852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:14.154312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:14.403923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:14.412591 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce594675-3dfc-4b94-83e7-9d87f96dd5b0 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.289983 Oct 28 13:20:14.418844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2000/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:14 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:14.516894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:14.548057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:14.550101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:14.551977 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0d3019f-a39c-493d-b175-9552760cdfc2 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.519124 Oct 28 13:20:14.584164 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1911/3911] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:14 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:14.793008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:14.793630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] [instance: 8b1ffca7-434e-4a17-b653-1de7ad966c6c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:14.802113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:14.803370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:14.804150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:14.805078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:14.805735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:14.806384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:14.824382 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] HTTP exception thrown: Instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c could not be found. Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Request method failure captured: Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c HTTP/1.1 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9UnVFIhzRVXW2My96cUUpSpqN8pmeOlcs89qhhlGQPz5Xf5EqA-X1VMaE_BQQkuRAdiOU9nxf4-3ptPbtY_7QtJfrBWrtQTTc2UTjfySCJfIpaa6hpjtbs8TRYPGgivh37iKaho7ot7XIwfIV-oh1wfw1C5UY-Yf1HSD6rPqRMG1pY Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5acad27b2ef04ec59e1aaf75997cc653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5acad27b2ef04ec59e1aaf75997cc653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 5acad27b2ef04ec59e1aaf75997cc653 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-LiveMigrationTest-1861441409 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-LiveMigrationTest-1861441409-project Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 2042816d9181427cb51f1c710281aa53 Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-LiveMigrationTest-1861441409-project Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c could not be found. Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '8b1ffca7-434e-4a17-b653-1de7ad966c6c'} Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c could not be found. Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c could not be found. Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:14.826360 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:14.829820 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:14.829820 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:14.829820 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:14.829820 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:20:14.829820 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:20:14.829820 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c could not be found. Oct 28 13:20:14.829820 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:20:14.837231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] Returning 404 to user: Instance 8b1ffca7-434e-4a17-b653-1de7ad966c6c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:20:14.837231 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5dd5cba0-7869-46e2-93dd-0270d6b319cb tempest-LiveMigrationTest-1861441409 tempest-LiveMigrationTest-1861441409-project] 10.222.0.25 "GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c" status: 404 len: 111 microversion: 2.1 time: 0.043955 Oct 28 13:20:14.838022 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2001/3912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:14 2022] GET /compute/v2.1/servers/8b1ffca7-434e-4a17-b653-1de7ad966c6c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:20:15.103330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-494f9d45-ca8f-43de-b1ee-6348594c3b6a req-972d9920-b150-40c4-b197-06161c88a26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd61b5d2-16aa-4b8e-aff2-24ff59dfc068", "name": "network-vif-deleted", "tag": "730dbf15-f5fe-4c61-9e9d-348ad2711c10"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:15.108667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:15.110880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:15.124723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:15.130231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-494f9d45-ca8f-43de-b1ee-6348594c3b6a req-972d9920-b150-40c4-b197-06161c88a26d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:15.130687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-494f9d45-ca8f-43de-b1ee-6348594c3b6a req-972d9920-b150-40c4-b197-06161c88a26d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:15.131176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-494f9d45-ca8f-43de-b1ee-6348594c3b6a req-972d9920-b150-40c4-b197-06161c88a26d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:15.131406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:15.131942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:15.132912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:15.133574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:15.134192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:15.179133 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-494f9d45-ca8f-43de-b1ee-6348594c3b6a req-972d9920-b150-40c4-b197-06161c88a26d service nova] Creating event network-vif-deleted:730dbf15-f5fe-4c61-9e9d-348ad2711c10 for instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 on n-h2-862876-2 Oct 28 13:20:15.188494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-494f9d45-ca8f-43de-b1ee-6348594c3b6a req-972d9920-b150-40c4-b197-06161c88a26d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090734 Oct 28 13:20:15.189222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:15.194296 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1912/3913] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:15.417804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:15.433444 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09acd0a8-f916-4cb3-be1e-6169fa11612b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1454 microversion: 2.1 time: 0.325751 Oct 28 13:20:15.438090 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2002/3914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:15 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1454 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:15.458900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:15.459833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:15.484318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:15.484848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:15.485286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:15.495166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:15.500208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:15.500867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:15.588134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:15.589069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:15.617498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:15.618283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:15.620728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:15.621639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:15.622511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:15.627491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:15.809453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:15.820673 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c89bc06-39fb-4bd2-97d6-9a602722a4e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.387269 Oct 28 13:20:15.822053 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1913/3915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:15 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:16.095522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:16.118200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:16.120654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:16.121865 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49d482d5-81cb-4c8e-9345-6b254a02d274 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1880 microversion: 2.32 time: 0.543973 Oct 28 13:20:16.122433 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2003/3916] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:15 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1880 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:16.461386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:16.461933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:16.471313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:16.472029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:16.473333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:16.474200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:16.475026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:16.475688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:16.488179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:16.523574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:16.524885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:16.525484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:16.526087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:20:16.646377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:16.651796 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-38b17cb2-0132-4186-bcaf-bf5259c17e1c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 200 len: 1298 microversion: 2.1 time: 0.194358 Oct 28 13:20:16.655766 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1914/3917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:16 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 1298 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:16.849040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:16.850129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:16.866546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:16.867129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:16.867572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:16.868293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:16.868753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:16.869179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:17.150277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:17.150989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:17.178119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:17.180403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:17.180891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:17.183120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:17.183618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:17.184093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:17.237687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:17.246152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cba4c16c-2f16-4547-abbc-3dbc72b7b241 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.402017 Oct 28 13:20:17.252680 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2004/3918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:16 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:17.626430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:17.642465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:17.647125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:17.653083 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2acb5dcb-a3aa-4e36-bfe2-01fdc6c3aab9 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2833 microversion: 2.32 time: 0.506854 Oct 28 13:20:17.654781 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1915/3919] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:20:17 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2833 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:20:17.680527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:17.688090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:17.688250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:17.688250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:17.690876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:17.691374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:17.692550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:17.693267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:17.693729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:17.694158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:17.694329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:17.695028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:17.695643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:17.696338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:17.696951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:17.697376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:17.709650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 HTTP/1.1 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'bd61b5d2-16aa-4b8e-aff2-24ff59dfc068'} Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:17.711699 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:17.715948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:17.715948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:17.715948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:17.715948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:20:17.715948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:20:17.715948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:20:17.715948 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:17.717367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:20:17.718440 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5380a8d1-5f0c-45b4-bb9b-a935e7926a68 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 404 len: 111 microversion: 2.1 time: 0.038731 Oct 28 13:20:17.719261 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1916/3920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:17 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:20:17.847247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1588566218", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "35b0cf8f-78ca-4b1e-81d5-1a1186c30f61"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:17.923793 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6050f66d-8fe8-4646-9017-d310de0b3ae7 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.247687 Oct 28 13:20:17.925651 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2005/3921] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Oct 28 13:20:17 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf/os-interface => generated 1830 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:20:17.935752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:20:18.293347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:18.294024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:18.311038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:18.315601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:18.316237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:18.317698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:18.319332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:18.320095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:18.869987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:20:18.871324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:20:18.871951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:20:18.872869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:20:18.873858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:20:18.886853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:18.887843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:18.888549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:18.889456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:18.890073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:18.892542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:18.918191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:20:18.947139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:18.950523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:20:19.003582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:20:19.008013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:20:19.220239 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6ba5fea-07d2-49c1-bc5e-0a80a57a89c5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367681 Oct 28 13:20:19.221249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1917/3922] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:20:19.232871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-418746bd-951e-453f-acef-2abdedcfad67 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:19.233798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-418746bd-951e-453f-acef-2abdedcfad67 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:19.427527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-418746bd-951e-453f-acef-2abdedcfad67 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:19.446464 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-418746bd-951e-453f-acef-2abdedcfad67 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1209 microversion: 2.1 time: 0.208905 Oct 28 13:20:19.458191 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1918/3923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:19 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:19.993017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:20.006563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-898606a5-c1ac-429a-877a-bfbf36fc7589 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 1.726473 Oct 28 13:20:20.024084 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2006/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:18 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:20.465697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-02f3bc89-eb8b-418e-b042-e7aa47d39e30 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:20.466312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-02f3bc89-eb8b-418e-b042-e7aa47d39e30 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:20.617740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7b980635-15f3-4ab5-b708-0681ea20879f req-16351148-ef7d-4121-855a-c22b3353fe4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f245ed-032b-4be2-b55f-4cdd987d4e22", "name": "network-vif-plugged", "status": "completed", "tag": "669987fb-3926-40d0-91ad-0a12b50186d3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:20.629675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-02f3bc89-eb8b-418e-b042-e7aa47d39e30 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:20.642694 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-02f3bc89-eb8b-418e-b042-e7aa47d39e30 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1209 microversion: 2.1 time: 0.180895 Oct 28 13:20:20.648015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7b980635-15f3-4ab5-b708-0681ea20879f req-16351148-ef7d-4121-855a-c22b3353fe4c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:20.651452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7b980635-15f3-4ab5-b708-0681ea20879f req-16351148-ef7d-4121-855a-c22b3353fe4c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:20.652305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7b980635-15f3-4ab5-b708-0681ea20879f req-16351148-ef7d-4121-855a-c22b3353fe4c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:20.661216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1919/3925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:20 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1209 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:20.681002 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7b980635-15f3-4ab5-b708-0681ea20879f req-16351148-ef7d-4121-855a-c22b3353fe4c service nova] Creating event network-vif-plugged:669987fb-3926-40d0-91ad-0a12b50186d3 for instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 on n-h1-862876-2 Oct 28 13:20:20.690967 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7b980635-15f3-4ab5-b708-0681ea20879f req-16351148-ef7d-4121-855a-c22b3353fe4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077289 Oct 28 13:20:20.712714 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2007/3926] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:20:21.048622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:21.052043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:21.088508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:21.101857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:21.102792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:21.105514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:21.106734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:21.109027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:21.421844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:21.433830 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d37f2a8b-29e2-46cf-bc3a-8591523ee4ff tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1292 microversion: 2.1 time: 0.404888 Oct 28 13:20:21.435301 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1920/3927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:21 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1292 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:21.672124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:21.673776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:21.682787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:21.686730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:21.686730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:21.686730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:21.686730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:21.686730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:21.958134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:21.975004 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e255a797-5990-4fac-a01a-c17a5f53649b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1261 microversion: 2.1 time: 0.305223 Oct 28 13:20:21.991485 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2008/3928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:21 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1261 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:22.474908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:22.475523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:22.488681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:22.489485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:22.490671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:22.497279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:22.497279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:22.497279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:22.889124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:22.901108 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25a350d6-6fa7-4f0d-8e7c-36b11ee6822c tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1483 microversion: 2.1 time: 0.431667 Oct 28 13:20:22.919824 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1921/3929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:22 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1483 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:22.952672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:22.955903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:23.003714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:23.005541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:23.008590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:23.009082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:23.012792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:23.013879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:23.016192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:23.020480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:23.020984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:23.021427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:23.022145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:23.022604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:23.023450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:23.026356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:23.210274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:23.218054 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1359161-3cb3-4101-bbc5-a7513c4efcaf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1267 microversion: 2.1 time: 0.221096 Oct 28 13:20:23.242502 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1922/3930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:22 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:23.781724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d6d8239b-2959-4a8b-b8ce-f639b7bd159d req-9540007b-1a0d-418e-bf92-f7a644905932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "tag": "c906a364-1c73-4835-a3cb-a92097af050c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:23.794568 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b8dcbf49-6e0c-4914-a614-f0d9876a8c64 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.853328 Oct 28 13:20:23.795381 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2009/3931] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:20:22 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22/os-interface => generated 284 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:23.818647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d6d8239b-2959-4a8b-b8ce-f639b7bd159d req-9540007b-1a0d-418e-bf92-f7a644905932 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:23.819171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d6d8239b-2959-4a8b-b8ce-f639b7bd159d req-9540007b-1a0d-418e-bf92-f7a644905932 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:23.819785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d6d8239b-2959-4a8b-b8ce-f639b7bd159d req-9540007b-1a0d-418e-bf92-f7a644905932 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:23.849315 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d6d8239b-2959-4a8b-b8ce-f639b7bd159d req-9540007b-1a0d-418e-bf92-f7a644905932 service nova] Creating event network-changed:c906a364-1c73-4835-a3cb-a92097af050c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:20:23.866808 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d6d8239b-2959-4a8b-b8ce-f639b7bd159d req-9540007b-1a0d-418e-bf92-f7a644905932 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085188 Oct 28 13:20:23.867397 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1923/3932] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:20:24.252972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:24.253612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:24.268982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:24.269624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:24.270129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:24.271199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:24.272403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:24.274398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:24.542101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:24.555601 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f3b52c7-8bad-4499-b99c-bea7e204bd82 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1267 microversion: 2.1 time: 0.309572 Oct 28 13:20:24.564422 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2010/3933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:24 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:25.593101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:25.600408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:25.611254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:25.625176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:25.625795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:25.626980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:25.627751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:25.633014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:25.974050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:25.989065 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d9db592-13ae-409c-bdd2-678459ca3634 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1267 microversion: 2.1 time: 0.400475 Oct 28 13:20:26.007524 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1924/3934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:25 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1267 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:27.015176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:27.015810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:27.029920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:27.030424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:27.030903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:27.031638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:27.032089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:27.063166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:27.612017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:27.628006 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a55191c-762a-48a6-9df8-e745fd519c5f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1267 microversion: 2.1 time: 0.617971 Oct 28 13:20:27.632030 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2011/3935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:27 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1267 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:28.656364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:28.657283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:28.671523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:28.673582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:28.684968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:28.685803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:28.686351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:28.689461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:28.747171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:28.747923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:28.760798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:28.764541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:28.768418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:28.769732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:28.781035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:28.781677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:28.907199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:29.144944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:29.171621 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-076008c2-379d-4ecf-b67f-ce0713d96846 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1309 microversion: 2.1 time: 0.516529 Oct 28 13:20:29.188989 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1925/3936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:28 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1309 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:29.206331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2ba425c8-6884-4e8f-b77a-6d9b01ffdaf3 req-cf25f9ed-b244-4cbf-a04f-78565a1afd88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f245ed-032b-4be2-b55f-4cdd987d4e22", "tag": "669987fb-3926-40d0-91ad-0a12b50186d3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:29.218163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2ba425c8-6884-4e8f-b77a-6d9b01ffdaf3 req-cf25f9ed-b244-4cbf-a04f-78565a1afd88 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:29.219250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2ba425c8-6884-4e8f-b77a-6d9b01ffdaf3 req-cf25f9ed-b244-4cbf-a04f-78565a1afd88 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:29.219863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2ba425c8-6884-4e8f-b77a-6d9b01ffdaf3 req-cf25f9ed-b244-4cbf-a04f-78565a1afd88 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:29.237899 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2ba425c8-6884-4e8f-b77a-6d9b01ffdaf3 req-cf25f9ed-b244-4cbf-a04f-78565a1afd88 service nova] Creating event network-changed:669987fb-3926-40d0-91ad-0a12b50186d3 for instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 on n-h1-862876-2 Oct 28 13:20:29.248605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2ba425c8-6884-4e8f-b77a-6d9b01ffdaf3 req-cf25f9ed-b244-4cbf-a04f-78565a1afd88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057022 Oct 28 13:20:29.249801 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1926/3937] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:29.300278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:29.317484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81bfe39e-912e-4af5-b9f8-6962dc0c321b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1483 microversion: 2.1 time: 0.572608 Oct 28 13:20:29.318874 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2012/3938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:28 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1483 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:29.629573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1862147429", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "e2266792-210d-4f4e-83a1-4011395bcaa5"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:29.744071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] validate_networks() for [('e2266792-210d-4f4e-83a1-4011395bcaa5', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:20:30.201739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:30.202953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:30.215472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:30.223232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:30.224000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:30.224612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:30.225074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:30.225501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:30.635798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:31.483411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:31.492169 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e1f3aa12-2ec5-4f9c-ab6b-12054c5a11fe tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1309 microversion: 2.1 time: 1.294433 Oct 28 13:20:31.511166 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2013/3939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:30 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1309 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:31.936998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:20:31.938182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:20:31.938928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:20:31.939461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:20:31.939976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:20:31.959483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:31.964646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:31.964646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:31.976975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:31.978475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:31.982053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:32.035618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Getting quotas for project 7bbbd50ac3ad49e780304b623d969655. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:20:32.052828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Getting quotas for user ae1ee4c7b6a445c4843d2765686d39f8 and project 7bbbd50ac3ad49e780304b623d969655. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:20:32.099055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:20:32.121427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:20:32.311920 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c5efc85-7098-461c-a4d8-a41955734938 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.056762 Oct 28 13:20:32.318830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1927/3940] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:20:32.324854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-260bb49d-b349-476e-a49b-bf1f29495b16 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:32.326314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-260bb49d-b349-476e-a49b-bf1f29495b16 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:32.446167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-83d04c48-df7f-44b8-870e-a54881c18d98 req-452d807e-e28e-476a-b2ea-0a102f42d49c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184ff744-c5cd-4eca-8667-bcf3dd7e27dd", "tag": "671c327a-22d2-43d1-9bf2-a90153286b92"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:32.472848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-83d04c48-df7f-44b8-870e-a54881c18d98 req-452d807e-e28e-476a-b2ea-0a102f42d49c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:32.473348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-83d04c48-df7f-44b8-870e-a54881c18d98 req-452d807e-e28e-476a-b2ea-0a102f42d49c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:32.473777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-83d04c48-df7f-44b8-870e-a54881c18d98 req-452d807e-e28e-476a-b2ea-0a102f42d49c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:32.517164 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-83d04c48-df7f-44b8-870e-a54881c18d98 req-452d807e-e28e-476a-b2ea-0a102f42d49c service nova] Creating event network-changed:671c327a-22d2-43d1-9bf2-a90153286b92 for instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd on n-h2-862876-2 Oct 28 13:20:32.524650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-83d04c48-df7f-44b8-870e-a54881c18d98 req-452d807e-e28e-476a-b2ea-0a102f42d49c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091800 Oct 28 13:20:32.525417 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1928/3941] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:20:32.553628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:32.556361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:32.588370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:32.589252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:32.589842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:32.590703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:32.591334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:32.591906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:32.641161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-260bb49d-b349-476e-a49b-bf1f29495b16 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:32.659915 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-260bb49d-b349-476e-a49b-bf1f29495b16 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1217 microversion: 2.1 time: 0.338674 Oct 28 13:20:32.676001 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2014/3942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:32 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1217 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:33.033560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:33.046887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4360248-4a58-498c-8f74-ef74df177c1f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1309 microversion: 2.1 time: 0.514012 Oct 28 13:20:33.047491 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1929/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:32 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1309 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:33.686204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56e5f334-8480-4816-8a89-7153eefb71f9 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:33.687137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-56e5f334-8480-4816-8a89-7153eefb71f9 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:33.757058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-56e5f334-8480-4816-8a89-7153eefb71f9 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:33.772406 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-56e5f334-8480-4816-8a89-7153eefb71f9 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1217 microversion: 2.1 time: 0.091851 Oct 28 13:20:33.774263 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2015/3944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:33 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:34.076297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:34.077033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:34.087842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:34.088495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:34.089040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:34.090272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:34.091282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:34.091962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:34.492831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:34.503776 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6cf5038-8256-45fd-9f7c-0240b951b4c6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1309 microversion: 2.1 time: 0.431897 Oct 28 13:20:34.504584 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1930/3945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:34 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:34.797748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:34.798640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:34.808118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:34.848104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:34.855658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:34.856433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:34.856914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:34.861739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:34.959461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:34.974453 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c4a1ed9-f520-47bc-925b-2497fd669e76 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1269 microversion: 2.1 time: 0.180665 Oct 28 13:20:34.976312 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2016/3946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:34 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:35.532592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:35.533889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:35.575941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:35.581376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:35.590837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:35.592887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:35.593392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:35.601435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:35.999936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:36.000712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:36.019960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:36.020616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:36.021168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:36.028635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:36.032131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:36.032873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:36.408056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:36.423446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eba981c6-57b8-458a-8c95-8a28390e6d12 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1309 microversion: 2.1 time: 0.895030 Oct 28 13:20:36.429112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:36.440093 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3cf963f0-ad0b-4031-a199-6dd1f9b36134 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1287 microversion: 2.1 time: 0.441923 Oct 28 13:20:36.442287 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1931/3947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:35 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1309 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:36.449345 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2017/3948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:35 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1287 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:37.451626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:37.455302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:37.470354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:37.484536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:37.485197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:37.496635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:37.499400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:37.500603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:37.504544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:37.505407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:37.506160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:37.509666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:37.515040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:37.517232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:37.517716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:37.523075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:37.693591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:37.719612 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00c9eece-654e-4ab7-9fb0-36d364e043e4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1275 microversion: 2.1 time: 0.241643 Oct 28 13:20:37.722068 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2018/3949] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:37 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:37.781472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:37.792670 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-866675a5-dce1-4f94-a139-747d1a1b1050 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1309 microversion: 2.1 time: 0.345368 Oct 28 13:20:37.793299 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1932/3950] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:37 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:38.023415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f075162b-688a-4331-bb9a-b357fdd5b975 req-04bd6851-6392-414f-abd1-21607809b388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184ff744-c5cd-4eca-8667-bcf3dd7e27dd", "name": "network-vif-plugged", "status": "completed", "tag": "671c327a-22d2-43d1-9bf2-a90153286b92"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:38.054671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f075162b-688a-4331-bb9a-b357fdd5b975 req-04bd6851-6392-414f-abd1-21607809b388 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:38.055326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f075162b-688a-4331-bb9a-b357fdd5b975 req-04bd6851-6392-414f-abd1-21607809b388 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:38.061377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f075162b-688a-4331-bb9a-b357fdd5b975 req-04bd6851-6392-414f-abd1-21607809b388 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:38.087208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f075162b-688a-4331-bb9a-b357fdd5b975 req-04bd6851-6392-414f-abd1-21607809b388 service nova] Creating event network-vif-plugged:671c327a-22d2-43d1-9bf2-a90153286b92 for instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd on n-h2-862876-2 Oct 28 13:20:38.095409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f075162b-688a-4331-bb9a-b357fdd5b975 req-04bd6851-6392-414f-abd1-21607809b388 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076162 Oct 28 13:20:38.096738 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2019/3951] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:38.750510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:38.751161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:38.776986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:38.777805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:38.778268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:38.779050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:38.779513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:38.779938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:38.816011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:38.817083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:38.833091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:38.837683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:38.838159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:38.838941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:38.839407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:38.845064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:39.125551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:39.134870 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dbcdf59e-d550-43c8-a31e-4230d7356170 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.393660 Oct 28 13:20:39.151256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1933/3952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:38 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:39.234313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:39.246224 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a206856-f7ad-4470-87e0-ae1dcc6fdc2c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1309 microversion: 2.1 time: 0.434672 Oct 28 13:20:39.250474 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2020/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:38 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:40.162245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:40.164008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:40.186057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.187025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.189382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.192107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.193087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.195248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.277850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:40.280842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:40.295147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.295644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.297644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.298372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.298878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.302274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.556769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:40.565106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-370e4602-8030-41b6-8a5f-1e5738b06b50 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1490 microversion: 2.1 time: 0.292867 Oct 28 13:20:40.566055 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2021/3954] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:40 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1490 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:40.573069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:40.581339 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d2e15475-51fc-4a9f-8e66-f464a9363632 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.424917 Oct 28 13:20:40.581949 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1934/3955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:40 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:40.588470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:40.591112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:40.598240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.598577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.599307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.600209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.600669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.601211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.664540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:40.805958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6f29e7b4-618a-49ac-bb20-4b2d20357b13 req-4f6e6150-b6f9-4853-8c55-8f090598fda3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4f4827-87f9-44af-89b6-c7ff390e7e93", "tag": "25c000b9-3e66-436e-84da-8ee838ec8745"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:40.822447 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17051b99-1a5c-466a-8cbd-ac1088973b00 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "PUT /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1085 microversion: 2.1 time: 0.238056 Oct 28 13:20:40.825404 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2022/3956] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:20:40 2022] PUT /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1085 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:40.845541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:40.846668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:40.853718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.854469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.854469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.855185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.855719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.856119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.864889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6f29e7b4-618a-49ac-bb20-4b2d20357b13 req-4f6e6150-b6f9-4853-8c55-8f090598fda3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:40.865600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6f29e7b4-618a-49ac-bb20-4b2d20357b13 req-4f6e6150-b6f9-4853-8c55-8f090598fda3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:40.866051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6f29e7b4-618a-49ac-bb20-4b2d20357b13 req-4f6e6150-b6f9-4853-8c55-8f090598fda3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:40.888943 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6f29e7b4-618a-49ac-bb20-4b2d20357b13 req-4f6e6150-b6f9-4853-8c55-8f090598fda3 service nova] Creating event network-changed:25c000b9-3e66-436e-84da-8ee838ec8745 for instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 on n-h2-862876-2 Oct 28 13:20:40.905045 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6f29e7b4-618a-49ac-bb20-4b2d20357b13 req-4f6e6150-b6f9-4853-8c55-8f090598fda3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107869 Oct 28 13:20:40.905669 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1935/3957] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:41.254670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:41.266119 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c92154f-63bd-4435-b00b-5047f0efa1d1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1511 microversion: 2.1 time: 0.424973 Oct 28 13:20:41.278985 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2023/3958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:40 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:41.305866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:41.307214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:41.315508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:41.316031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:41.316574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:41.317284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:41.317733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:41.318153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:41.609832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:41.611580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:41.613684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:41.620245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:41.621436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:41.621976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:41.623275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:41.624387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:41.625077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:41.627511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b053992c-d71c-4a86-9a36-6d42b7385cb4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1511 microversion: 2.1 time: 0.330104 Oct 28 13:20:41.628694 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1936/3959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:41 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:41.653033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:41.653886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:41.665926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:41.666792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:41.667665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:41.668687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:41.669219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:41.669663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:41.675953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:41.710553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:20:41.969241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:41.999898 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db65d205-a254-47e6-bea5-caf5cbd0f0a2 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.397861 Oct 28 13:20:42.001176 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2024/3960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:41 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:42.016460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:42.077716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:42.263822 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25b4392b-e29e-4e17-85ee-e6d25a615ca8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 204 len: 0 microversion: 2.1 time: 0.616059 Oct 28 13:20:42.265069 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1937/3961] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:20:41 2022] DELETE /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:20:42.275578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:42.276351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:42.295152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:42.295152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:42.295152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:42.295152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:42.295880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:42.295949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:42.500367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:42.508909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd99c6c8-0763-4d92-bfe4-0546c9a733cb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1517 microversion: 2.1 time: 0.237182 Oct 28 13:20:42.519445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2025/3962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:42 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:43.028818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:43.029927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:43.049208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:43.049717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:43.051454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:43.051454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:43.052062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:43.052436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:43.542629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:43.543841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:43.545942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:43.556758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:43.557270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:43.557715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:43.569402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:43.569402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:43.569402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:43.707942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:43.729713 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14770d44-cd64-4532-93b0-e16830e0e1f6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.706370 Oct 28 13:20:43.732685 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1938/3963] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:43 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:43.770455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:44.353256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:44.363764 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10f0e77d-c243-468e-ba57-b0030d34696b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1517 microversion: 2.1 time: 0.825996 Oct 28 13:20:44.364995 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2026/3964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:43 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1517 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:44.756580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:44.757811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:44.781949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:44.782733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:44.783381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:44.784263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:44.785695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:44.787314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:45.134837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:45.153598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-201e32ae-be6e-41d1-8678-770cbd8df308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.399849 Oct 28 13:20:45.157259 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1939/3965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:44 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:45.184594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-330dd1eb-592e-4fba-b150-607c7aecf733 req-84a916e2-2415-419c-83c6-e0a3e23386eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184ff744-c5cd-4eca-8667-bcf3dd7e27dd", "name": "network-vif-deleted", "tag": "671c327a-22d2-43d1-9bf2-a90153286b92"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:45.205225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-330dd1eb-592e-4fba-b150-607c7aecf733 req-84a916e2-2415-419c-83c6-e0a3e23386eb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:45.205715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-330dd1eb-592e-4fba-b150-607c7aecf733 req-84a916e2-2415-419c-83c6-e0a3e23386eb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:45.206148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-330dd1eb-592e-4fba-b150-607c7aecf733 req-84a916e2-2415-419c-83c6-e0a3e23386eb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:45.227503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-330dd1eb-592e-4fba-b150-607c7aecf733 req-84a916e2-2415-419c-83c6-e0a3e23386eb service nova] Creating event network-vif-deleted:671c327a-22d2-43d1-9bf2-a90153286b92 for instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd on n-h2-862876-2 Oct 28 13:20:45.245748 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-330dd1eb-592e-4fba-b150-607c7aecf733 req-84a916e2-2415-419c-83c6-e0a3e23386eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065793 Oct 28 13:20:45.248299 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2027/3966] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:45.390554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:45.390787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:45.411620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:45.411620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:45.411620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:45.411620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:45.411620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:45.411620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:45.514036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:45.527725 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8b0137f-66e9-4d0a-99d0-ba26b617f12e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1315 microversion: 2.1 time: 0.141788 Oct 28 13:20:45.528319 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1940/3967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:45 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:46.178953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:46.179662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:46.186111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:46.186805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:46.187104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:46.187814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:46.188294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:46.188726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:46.555777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:46.557498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:46.567612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:46.568538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:46.569353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:46.570272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:46.571032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:46.571464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:46.574662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:46.583388 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58c14107-91ee-4290-84d2-c7f0ba557d61 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.409371 Oct 28 13:20:46.600865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2028/3968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:46 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:46.689343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:46.702727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:46.702727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:46.702727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid 184ff744-c5cd-4eca-8667-bcf3dd7e27dd {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:20:46.787686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:46.795721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-afad16d6-872c-42e9-be92-7e73c0b6e5e8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 200 len: 1320 microversion: 2.1 time: 0.247573 Oct 28 13:20:46.801710 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1941/3969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:46 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 1320 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:47.013947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1786662736", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:47.091854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:20:47.399356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:20:47.400212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:20:47.400815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:20:47.401368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:20:47.401981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:20:47.413469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:47.414021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:47.414532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:47.415302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:47.415762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:47.416182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:47.435552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:20:47.441753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for user c3852e30767345639ee5d92350d2950a and project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:20:47.456101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:20:47.461422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:20:47.615019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:47.621271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:47.628880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:47.629388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:47.630006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:47.630726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:47.631210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:47.631648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:47.787992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:47.796216 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0889bab6-aa3f-49cc-8ded-8f0dce8a8848 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.190281 Oct 28 13:20:47.796933 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1942/3970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:47 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:47.827742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:47.828690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:47.835637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:47.836242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:47.836802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:47.837589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:47.838259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:47.838937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd HTTP/1.1 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '184ff744-c5cd-4eca-8667-bcf3dd7e27dd'} Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:20:47.872538 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd91d59b-7238-4bcb-b452-6503e56e48a5 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 404 len: 111 microversion: 2.1 time: 0.033824 Oct 28 13:20:47.886989 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1943/3971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:47 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:20:47.928677 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06d6694e-4a16-4eb4-a2a1-d1e6c8cfbb1d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065536 Oct 28 13:20:47.936739 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2029/3972] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:20:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:20:47.942339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-43f61f1f-93a4-40f8-8d68-32d7ea8b368a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:47.943489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-43f61f1f-93a4-40f8-8d68-32d7ea8b368a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:48.040011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-230910653", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "35b0cf8f-78ca-4b1e-81d5-1a1186c30f61"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:48.097813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-43f61f1f-93a4-40f8-8d68-32d7ea8b368a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:48.108457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-43f61f1f-93a4-40f8-8d68-32d7ea8b368a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1213 microversion: 2.1 time: 0.170733 Oct 28 13:20:48.109220 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1944/3973] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:47 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:48.109510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] validate_networks() for [('35b0cf8f-78ca-4b1e-81d5-1a1186c30f61', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:20:48.177382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-523ba1d1-cd6d-47fe-b36f-854181c989cc req-0ef618b7-4d60-4162-8a65-d79e5511fd06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4f4827-87f9-44af-89b6-c7ff390e7e93", "name": "network-vif-plugged", "status": "completed", "tag": "25c000b9-3e66-436e-84da-8ee838ec8745"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:48.203333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-523ba1d1-cd6d-47fe-b36f-854181c989cc req-0ef618b7-4d60-4162-8a65-d79e5511fd06 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:48.209458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-523ba1d1-cd6d-47fe-b36f-854181c989cc req-0ef618b7-4d60-4162-8a65-d79e5511fd06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:48.209458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-523ba1d1-cd6d-47fe-b36f-854181c989cc req-0ef618b7-4d60-4162-8a65-d79e5511fd06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:48.218035 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-523ba1d1-cd6d-47fe-b36f-854181c989cc req-0ef618b7-4d60-4162-8a65-d79e5511fd06 service nova] Creating event network-vif-plugged:25c000b9-3e66-436e-84da-8ee838ec8745 for instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 on n-h2-862876-2 Oct 28 13:20:48.225736 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-523ba1d1-cd6d-47fe-b36f-854181c989cc req-0ef618b7-4d60-4162-8a65-d79e5511fd06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053894 Oct 28 13:20:48.226363 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1945/3974] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:20:48.821116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:48.822514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:48.829313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:48.829833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:48.830340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:48.831089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:48.832113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:48.832542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:48.992411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:20:48.995441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:20:48.995441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:20:48.995656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:48.995778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:20:48.995778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:20:49.002483 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff757060-1fe8-40eb-9f9b-059830f48aed tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1317 microversion: 2.1 time: 0.186898 Oct 28 13:20:49.003133 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1946/3975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:48 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:49.003787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:49.004186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:49.004918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:49.005825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:49.006427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:49.007037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:49.029357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:20:49.033339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Getting quotas for user 28081081267d49ababe7e2bdb8a821c9 and project 208e49fa113b498d8679c37937014b8e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:20:49.046974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:20:49.049071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:20:49.136690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49ff24fe-8df0-4a5e-9bc0-8308ddc595a1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:49.137919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49ff24fe-8df0-4a5e-9bc0-8308ddc595a1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:49.239643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49ff24fe-8df0-4a5e-9bc0-8308ddc595a1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:49.250396 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49ff24fe-8df0-4a5e-9bc0-8308ddc595a1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1213 microversion: 2.1 time: 0.121331 Oct 28 13:20:49.252070 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1947/3976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:49 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:49.291173 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ada663f-e2d5-4ef7-a779-009456808526 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255340 Oct 28 13:20:49.293296 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2030/3977] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:20:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:20:49.306587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-294a0a33-85ad-47f2-ba68-5a8c8df6f602 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:49.307413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-294a0a33-85ad-47f2-ba68-5a8c8df6f602 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:49.310656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:49.374341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-294a0a33-85ad-47f2-ba68-5a8c8df6f602 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:49.381866 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-294a0a33-85ad-47f2-ba68-5a8c8df6f602 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1208 microversion: 2.1 time: 0.081860 Oct 28 13:20:49.382442 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1948/3978] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:49 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:50.028284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:50.036719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:50.036719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.036719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.036719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.037293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.037963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.038455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.212238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:50.222711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f9f19740-22be-496c-a6df-1b3b728d1fcd tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1507 microversion: 2.1 time: 0.198452 Oct 28 13:20:50.223842 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2031/3979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:50 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:50.248953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:50.250439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:50.261371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.262916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.263551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.264489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.265118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.266057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.277592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:50.278573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:50.289328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.289823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.290266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.290997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.293503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.293958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.316402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-709b77bc-b71b-417e-9378-274d7c962fba tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93/ips" status: 200 len: 110 microversion: 2.1 time: 0.072120 Oct 28 13:20:50.317962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1949/3980] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:20:50 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93/ips => generated 110 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:50.333207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:50.334319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:50.341614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.342614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.343374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.344440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.345260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.345901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.388491 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d76a28d3-1040-4f43-8e1b-bde75cec48ef tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93/ips" status: 200 len: 110 microversion: 2.1 time: 0.059320 Oct 28 13:20:50.389054 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1950/3981] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:20:50 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93/ips => generated 110 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:50.400429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:50.401253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:50.409337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.411334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.412087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.413209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.413882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.414574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.415807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:50.425783 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-776bdc1e-9fbb-46e1-8c36-697477e55af6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1209 microversion: 2.1 time: 0.152344 Oct 28 13:20:50.431511 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2032/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:50 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1209 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:50.452882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-71c249f5-cffb-422e-a296-7e96ccafb152 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:50.453740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-71c249f5-cffb-422e-a296-7e96ccafb152 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:50.467251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59b41396-da10-41f8-859b-07b7b8a6e308 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93/ips/tempest-ServerAddressesTestJSON-2094034913-network" status: 200 len: 95 microversion: 2.1 time: 0.071510 Oct 28 13:20:50.467936 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1951/3983] 10.222.0.25 () {58 vars in 1401 bytes} [Fri Oct 28 13:20:50 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93/ips/tempest-ServerAddressesTestJSON-2094034913-network => generated 95 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:20:50.481571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:50.489421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:50.490873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.492622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.493319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.494434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:50.495138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:50.495778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:50.529912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-71c249f5-cffb-422e-a296-7e96ccafb152 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:50.541913 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-71c249f5-cffb-422e-a296-7e96ccafb152 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1208 microversion: 2.1 time: 0.109086 Oct 28 13:20:50.542817 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2033/3984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:50 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1208 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:50.561907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:20:51.286777 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9d7b6d85-088b-4179-b260-d2d38e5e24e0 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 204 len: 0 microversion: 2.1 time: 0.808665 Oct 28 13:20:51.292961 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1952/3985] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:20:50 2022] DELETE /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:20:51.300927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:51.300927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:51.307268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:51.307920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:51.309010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:51.309756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:51.310224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:51.310651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:51.458211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:51.459020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:51.468306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:51.468620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:51.469072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:51.469790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:51.470505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:51.471017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:51.552463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:51.556681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:51.561471 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25b0c97e-394b-4efd-80c3-e0cf14a1a47d tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1513 microversion: 2.1 time: 0.267144 Oct 28 13:20:51.562577 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2034/3986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:51 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:51.569398 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f2c0e1c1-5a50-49e2-84b1-507a254ec323 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1273 microversion: 2.1 time: 0.116843 Oct 28 13:20:51.570002 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1953/3987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:51 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:51.578454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:51.585025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:51.586291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:51.587062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:51.588029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:51.589928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:51.590733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:51.591650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:51.655525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:51.663253 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-662ae6bf-7d0b-4785-8208-39dc927fc47a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1204 microversion: 2.1 time: 0.096344 Oct 28 13:20:51.663838 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2035/3988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:51 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:52.587451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:52.588067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:52.595996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:52.596468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:52.596886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:52.596993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:52.597358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:52.598059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:52.598517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:52.598970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:52.605182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:52.605182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:52.605182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:52.606275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:52.606832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:52.607333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:52.707139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:52.733017 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b49715a-7dc6-4b39-b63f-d02063fd7a4f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1273 microversion: 2.1 time: 0.136198 Oct 28 13:20:52.733017 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2036/3989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:52 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:52.736821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:52.737689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:52.761980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:52.766722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:52.767209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:52.768254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:52.769093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:52.769533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:52.826087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:52.843969 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41599d58-b95a-4ce7-8dcd-f58bee7297b6 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1513 microversion: 2.1 time: 0.260365 Oct 28 13:20:52.844681 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1954/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:52 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:52.929868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:52.941722 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-acb4346d-9c22-45a1-9d01-a955a1bddafa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1260 microversion: 2.1 time: 0.208396 Oct 28 13:20:52.942837 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2037/3991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:52 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:53.493148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8c803f77-4efe-46b8-82d5-d673a68b7f42 req-bfc00083-b103-44fb-8838-0ef5851ead58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4f4827-87f9-44af-89b6-c7ff390e7e93", "name": "network-vif-deleted", "tag": "25c000b9-3e66-436e-84da-8ee838ec8745"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:53.503912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c803f77-4efe-46b8-82d5-d673a68b7f42 req-bfc00083-b103-44fb-8838-0ef5851ead58 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:53.504396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c803f77-4efe-46b8-82d5-d673a68b7f42 req-bfc00083-b103-44fb-8838-0ef5851ead58 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:53.504828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c803f77-4efe-46b8-82d5-d673a68b7f42 req-bfc00083-b103-44fb-8838-0ef5851ead58 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:53.531612 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8c803f77-4efe-46b8-82d5-d673a68b7f42 req-bfc00083-b103-44fb-8838-0ef5851ead58 service nova] Creating event network-vif-deleted:25c000b9-3e66-436e-84da-8ee838ec8745 for instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 on n-h2-862876-2 Oct 28 13:20:53.537209 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8c803f77-4efe-46b8-82d5-d673a68b7f42 req-bfc00083-b103-44fb-8838-0ef5851ead58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047356 Oct 28 13:20:53.542653 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1955/3992] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:53.759614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:53.760497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:53.769173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:53.769896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:53.770476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:53.771370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:53.772114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:53.772685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:53.870302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:53.871737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:53.879939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:53.880535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:53.881125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:53.881841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:53.882449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:53.883018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:53.888296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:53.960219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1ee4c7b6a445c4843d2765686d39f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbbd50ac3ad49e780304b623d969655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:53.986792 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e9b32cd-3553-44de-af23-bda5b87c8da4 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 200 len: 1302 microversion: 2.1 time: 0.119415 Oct 28 13:20:53.989882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1956/3993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:53 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:54.002272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:54.002527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:54.011240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:54.012146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:54.013080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:54.014605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:54.015752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:54.016418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:54.099778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:54.108324 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-566fe465-9124-4a84-8129-cd151a5c93ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1268 microversion: 2.1 time: 0.117132 Oct 28 13:20:54.114542 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1957/3994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:53 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1268 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:54.227596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:54.235534 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9f018cbf-6016-4d12-b6b3-452ca83bbd4c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1271 microversion: 2.1 time: 0.480020 Oct 28 13:20:54.236433 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2038/3995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:53 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1271 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:55.015262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:55.015874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] [instance: 4c4f4827-87f9-44af-89b6-c7ff390e7e93] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:55.023109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:55.023607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:55.024042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:55.024783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:55.025430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:55.025981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:55.041768 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] HTTP exception thrown: Instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 could not be found. Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Request method failure captured: Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 HTTP/1.1 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9cc4fg-dAF5P2hIMGkzoHvFz_WNLUh0k9_Hr6Xs8sokBGfNJEDXRu-wRHtPZGpmhaByb_tafT5ZesZwcTdgBMBPtbhUf_vsXYqtCpU_Fu3TNF8aqEtaG00rPTpGbT7eGmLE3Wn_1e3GLLQfoUBv5w-ZIPOsVDQm842kiH4RbWvrREM Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7bbbd50ac3ad49e780304b623d969655 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerAddressesTestJSON-255750844 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7bbbd50ac3ad49e780304b623d969655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7bbbd50ac3ad49e780304b623d969655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7bbbd50ac3ad49e780304b623d969655", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7bbbd50ac3ad49e780304b623d969655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerAddressesTestJSON-255750844 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7bbbd50ac3ad49e780304b623d969655 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerAddressesTestJSON-255750844 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerAddressesTestJSON-255750844-project Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ae1ee4c7b6a445c4843d2765686d39f8 Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerAddressesTestJSON-255750844-project Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 could not be found. Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4c4f4827-87f9-44af-89b6-c7ff390e7e93'} Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 could not be found. Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 could not be found. Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:20:55.043916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 could not be found. Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] Returning 404 to user: Instance 4c4f4827-87f9-44af-89b6-c7ff390e7e93 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9279ee4-6db7-45d4-9eea-0bd80dc54652 tempest-ServerAddressesTestJSON-255750844 tempest-ServerAddressesTestJSON-255750844-project] 10.222.0.25 "GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93" status: 404 len: 111 microversion: 2.1 time: 0.034688 Oct 28 13:20:55.049180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1958/3996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:55 2022] GET /compute/v2.1/servers/4c4f4827-87f9-44af-89b6-c7ff390e7e93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:20:55.133153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:55.134348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:55.151098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:55.151098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:55.151098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:55.151098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:55.151098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:55.151098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:55.250857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:55.259982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:55.260641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:55.262718 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e4271f4-8c0d-412c-8ca8-2f495c83982c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1266 microversion: 2.1 time: 0.133509 Oct 28 13:20:55.263494 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2039/3997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:55 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:55.274390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:55.276712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:55.287688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:55.290397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:55.291789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:55.292599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:55.671954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:55.686170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c99de95c-80dd-47b6-80c7-d3b4ce1d6289 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1313 microversion: 2.1 time: 0.429259 Oct 28 13:20:55.687314 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1959/3998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:55 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:56.289816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:56.291244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:56.298402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:56.299144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:56.299754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:56.301261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:56.301887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:56.302538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:56.561872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:56.572508 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-465f265d-004e-4a98-abf1-6b2ed5a0f2a4 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.286520 Oct 28 13:20:56.573658 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2040/3999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:56 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:20:56.714849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:56.715480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:56.720055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f95475c5-8eb1-47b5-8e04-19830f07a56a req-ec1d9496-13c0-4cae-a0f6-8f759458e08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561a4c75-30be-45bc-8f1f-02d9de17519d", "tag": "3b86f559-9d9c-4a08-a90e-4abd2b238750"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:56.731904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:56.732111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f95475c5-8eb1-47b5-8e04-19830f07a56a req-ec1d9496-13c0-4cae-a0f6-8f759458e08f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:56.732450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:56.732714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f95475c5-8eb1-47b5-8e04-19830f07a56a req-ec1d9496-13c0-4cae-a0f6-8f759458e08f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:56.732900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:56.733565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f95475c5-8eb1-47b5-8e04-19830f07a56a req-ec1d9496-13c0-4cae-a0f6-8f759458e08f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:56.735174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:56.738206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:56.738687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:56.747960 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f95475c5-8eb1-47b5-8e04-19830f07a56a req-ec1d9496-13c0-4cae-a0f6-8f759458e08f service nova] Creating event network-changed:3b86f559-9d9c-4a08-a90e-4abd2b238750 for instance 561a4c75-30be-45bc-8f1f-02d9de17519d on n-h2-862876-2 Oct 28 13:20:56.754227 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f95475c5-8eb1-47b5-8e04-19830f07a56a req-ec1d9496-13c0-4cae-a0f6-8f759458e08f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037279 Oct 28 13:20:56.755227 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2041/4000] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:20:57.061754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:57.074347 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4232322b-8308-4e7b-9095-c0d34b0b4d1f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1313 microversion: 2.1 time: 0.363771 Oct 28 13:20:57.075271 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1960/4001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:56 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:57.598681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:57.599413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:57.610547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:57.613800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:57.614381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:57.616382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:57.617684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:57.618584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:57.972238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:57.976226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=99 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:57.983892 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6b1bbe46-7b43-43f6-bae4-493d47182e0e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.390482 Oct 28 13:20:57.985109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2042/4002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:57 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:58.101762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:58.103190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:58.127393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:58.131684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:58.132499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:58.135513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:58.137696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:58.138330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:58.438202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:58.448244 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5fc88018-66a6-45ea-a249-f1c1d1338f86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1313 microversion: 2.1 time: 0.353019 Oct 28 13:20:58.448835 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1961/4003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:58 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:58.841759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-108d767f-a178-4b2e-ad6b-bc77b2d8fba9 req-b484a51b-cec8-4c62-8f1a-44f2a5ae86fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7", "tag": "590cf412-d77e-45b1-9450-e7e8a712224e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:20:58.857672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-108d767f-a178-4b2e-ad6b-bc77b2d8fba9 req-b484a51b-cec8-4c62-8f1a-44f2a5ae86fd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:58.858151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-108d767f-a178-4b2e-ad6b-bc77b2d8fba9 req-b484a51b-cec8-4c62-8f1a-44f2a5ae86fd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:58.858927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-108d767f-a178-4b2e-ad6b-bc77b2d8fba9 req-b484a51b-cec8-4c62-8f1a-44f2a5ae86fd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:58.877842 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-108d767f-a178-4b2e-ad6b-bc77b2d8fba9 req-b484a51b-cec8-4c62-8f1a-44f2a5ae86fd service nova] Creating event network-changed:590cf412-d77e-45b1-9450-e7e8a712224e for instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 on n-h2-862876-2 Oct 28 13:20:58.883978 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-108d767f-a178-4b2e-ad6b-bc77b2d8fba9 req-b484a51b-cec8-4c62-8f1a-44f2a5ae86fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045990 Oct 28 13:20:58.885089 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2043/4004] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:20:59.010027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:59.010897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:59.024749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:59.025026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:59.025455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:59.026155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:59.026667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:59.027384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:59.344389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:20:59.354881 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6b0be79-c055-4f8f-b39f-97726a709d15 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.348592 Oct 28 13:20:59.356231 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1962/4005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:59 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:20:59.470006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:20:59.475038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:20:59.476010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:20:59.483347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:59.483773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:59.484234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:20:59.484927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:20:59.485380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:20:59.485799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:00.079297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:00.090976 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60ddada7-7301-40d9-ab4a-4e9043664363 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1313 microversion: 2.1 time: 0.620458 Oct 28 13:21:00.093678 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2044/4006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:20:59 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:00.380323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:00.380943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:00.383040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:00.395064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:00.395720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:00.399640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:00.399640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:00.404768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:00.405284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:00.734789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:00.745752 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b4021c0-3252-47aa-bb25-f17629a443be tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.369054 Oct 28 13:21:00.746979 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1963/4007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:00 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:01.119169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:01.119792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:01.121741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=14 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:01.132491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:01.132999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:01.133450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:01.134160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:01.137041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:01.144227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:01.435317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:01.447382 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eaf3bb99-fe11-4bd2-9fb3-ceff405e49c3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1313 microversion: 2.1 time: 0.333844 Oct 28 13:21:01.448148 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2045/4008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:01 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:01.770540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:01.771763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:01.778631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:01.779156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:01.779648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:01.780353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:01.780984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:01.781469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:01.957802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:01.967380 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba62b8c6-b474-4f5c-bfd9-ef75a0488b8f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.200653 Oct 28 13:21:01.968345 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1964/4009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:01 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:02.223583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-158b436b-0255-4aec-b00e-1def436ab38e req-0fe71158-cf7e-4554-adf0-6e24faf380f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561a4c75-30be-45bc-8f1f-02d9de17519d", "name": "network-vif-plugged", "status": "completed", "tag": "3b86f559-9d9c-4a08-a90e-4abd2b238750"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:02.234530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-158b436b-0255-4aec-b00e-1def436ab38e req-0fe71158-cf7e-4554-adf0-6e24faf380f4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:02.235060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-158b436b-0255-4aec-b00e-1def436ab38e req-0fe71158-cf7e-4554-adf0-6e24faf380f4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:02.235491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-158b436b-0255-4aec-b00e-1def436ab38e req-0fe71158-cf7e-4554-adf0-6e24faf380f4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:02.248020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-158b436b-0255-4aec-b00e-1def436ab38e req-0fe71158-cf7e-4554-adf0-6e24faf380f4 service nova] Creating event network-vif-plugged:3b86f559-9d9c-4a08-a90e-4abd2b238750 for instance 561a4c75-30be-45bc-8f1f-02d9de17519d on n-h2-862876-2 Oct 28 13:21:02.255322 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-158b436b-0255-4aec-b00e-1def436ab38e req-0fe71158-cf7e-4554-adf0-6e24faf380f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Oct 28 13:21:02.255322 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2046/4010] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:02.472780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:02.473396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:02.479564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:02.480049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:02.480479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:02.481162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:02.481611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:02.482033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:02.668940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:02.678422 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3122fad4-a3ed-4a41-a984-f1b45a9d0ec0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1313 microversion: 2.1 time: 0.211079 Oct 28 13:21:02.680089 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1965/4011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:02 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:02.993883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:02.994720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:03.001445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:03.001936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:03.002376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:03.003598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:03.004068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:03.004496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:03.261900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:03.270384 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-df8b31cd-22f0-4386-a3bf-67ed46a1e481 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.281402 Oct 28 13:21:03.271088 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2047/4012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:02 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:03.703110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:03.703742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:03.710886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:03.711412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:03.711846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:03.712532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:03.713056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:03.713480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:03.871754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:03.882924 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-993d101e-dca1-4fd5-a38c-0e076087716f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1463 microversion: 2.1 time: 0.184148 Oct 28 13:21:03.884165 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1966/4013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:03 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1463 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:04.173673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:04.174923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:04.182552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:04.183080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:04.183522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:04.184222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:04.184674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:04.185406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:04.268296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a76b63f4-dacf-4c1d-976b-675f3872bb0b req-a96db8df-5b25-4cde-9cd6-476ee22d3be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7", "name": "network-vif-plugged", "status": "completed", "tag": "590cf412-d77e-45b1-9450-e7e8a712224e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:04.278426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a76b63f4-dacf-4c1d-976b-675f3872bb0b req-a96db8df-5b25-4cde-9cd6-476ee22d3be2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:04.279020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a76b63f4-dacf-4c1d-976b-675f3872bb0b req-a96db8df-5b25-4cde-9cd6-476ee22d3be2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:04.279487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a76b63f4-dacf-4c1d-976b-675f3872bb0b req-a96db8df-5b25-4cde-9cd6-476ee22d3be2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:04.290700 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a76b63f4-dacf-4c1d-976b-675f3872bb0b req-a96db8df-5b25-4cde-9cd6-476ee22d3be2 service nova] Creating event network-vif-plugged:590cf412-d77e-45b1-9450-e7e8a712224e for instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 on n-h2-862876-2 Oct 28 13:21:04.295538 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a76b63f4-dacf-4c1d-976b-675f3872bb0b req-a96db8df-5b25-4cde-9cd6-476ee22d3be2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030897 Oct 28 13:21:04.296139 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1967/4014] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:21:04.301242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:04.302012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:04.308309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:04.312628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:04.312628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:04.312628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:04.312628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:04.312628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:04.532306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:04.541498 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e95475e3-8bf1-4d0b-ab12-5c26f33eb6fa tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.244136 Oct 28 13:21:04.542215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1968/4015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:04 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:04.587589 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1148cec4-e916-4a57-825f-506eb8780c49 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1614 microversion: 2.1 time: 0.682666 Oct 28 13:21:04.588536 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2048/4016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:03 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1614 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:04.615863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:04.616033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:04.631043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:04.631823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:04.632482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:04.633192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:04.633832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:04.634446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:04.732257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4161ee38c3be41469b69919d3c445dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8968ed627a6040c494c82a1aabff6214', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:04.732257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] flavor_id is None. Assuming migration. {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 13:21:04.734368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 13:21:05.330411 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-236073a2-978b-4dc2-be7a-cd1e74ce2e28 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d/action" status: 202 len: 0 microversion: 2.1 time: 0.718084 Oct 28 13:21:05.332549 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1969/4017] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:21:04 2022] POST /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:21:05.341762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:05.351221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:05.366286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:05.370296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:05.378573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:05.378573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:05.378573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:05.378573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:05.567517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:05.575920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:05.577474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:05.585853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:05.591839 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d96eef08-4e61-4aad-98fc-2632cbbc7aff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1472 microversion: 2.1 time: 0.249001 Oct 28 13:21:05.592399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:05.592399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:05.592578 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2049/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:05 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:05.592693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:05.592693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:05.592693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:05.827474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:05.836528 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-22035a7c-233a-43f3-a6b2-9130389e5571 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1308 microversion: 2.1 time: 0.264902 Oct 28 13:21:05.837132 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1970/4019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:05 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:06.610875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:06.611486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:06.618868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:06.619352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:06.619784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:06.620543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:06.621127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:06.621526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:06.859450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:06.860708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:06.870239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:06.872267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:06.872981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:06.873423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:06.878559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:06.879075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:06.879654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:06.883356 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4cf94fa8-2aa6-493d-abbe-ba2af8607281 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1472 microversion: 2.1 time: 0.276330 Oct 28 13:21:06.884467 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2050/4020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:06 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:07.071393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:07.085153 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cc4c4196-e81e-4e64-84fe-dc38f2fe7096 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1489 microversion: 2.1 time: 0.229268 Oct 28 13:21:07.086113 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1971/4021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:06 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1489 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:07.112781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-89738670"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:07.116783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:07.124992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:07.125484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:07.126103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:07.127221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:07.127751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:07.128533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:07.396687 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0b24b503-a5e6-4b3a-86be-9427f9e48c75 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "PUT /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1073 microversion: 2.1 time: 0.289119 Oct 28 13:21:07.397351 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2051/4022] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:21:07 2022] PUT /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1073 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:07.419147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:07.420028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:07.434010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:07.439327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:07.442614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:07.443323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:07.443996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:07.444712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:07.490259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:07.907656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:07.908270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:07.916056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:07.916552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:07.916991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:07.917695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:07.918150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:07.918570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:07.997728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:08.007053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2e14dfc4-9295-4e8a-8415-d6d73f64cd3b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1499 microversion: 2.1 time: 0.594116 Oct 28 13:21:08.010111 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1972/4023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:07 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1499 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:08.032978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:08.033879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:08.040558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:08.041404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:08.041838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:08.042649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:08.043197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:08.043619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:08.256050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:08.271516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-880e51cd-7f5c-49d4-bfc7-f63cd0165460 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1472 microversion: 2.1 time: 0.362312 Oct 28 13:21:08.279558 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2052/4024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:07 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:08.331839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:08.354980 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5d2b3dda-40b1-4440-8f8e-ad3429a33357 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1499 microversion: 2.1 time: 0.325805 Oct 28 13:21:08.371275 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1973/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:08 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1499 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:08.382358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2dad8fb8-402f-4429-81e3-24751b292cef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:08.390093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dad8fb8-402f-4429-81e3-24751b292cef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:08.390897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dad8fb8-402f-4429-81e3-24751b292cef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:08.393347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2dad8fb8-402f-4429-81e3-24751b292cef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:08.424929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2dad8fb8-402f-4429-81e3-24751b292cef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:21:08.835500 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2dad8fb8-402f-4429-81e3-24751b292cef tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "POST /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7/action" status: 202 len: 0 microversion: 2.1 time: 0.456486 Oct 28 13:21:08.846919 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2053/4026] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:21:08 2022] POST /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:21:08.854446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:08.855274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:08.873279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:08.873864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:08.874461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:08.875445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:08.876071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:08.876501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:09.124354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:09.150197 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e357697-7fae-4721-8e8a-ca2e264f01eb tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.296710 Oct 28 13:21:09.150197 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1974/4027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:08 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:09.299343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:09.301772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:09.308991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:09.312642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:09.312642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:09.312642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:09.312642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:09.317058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:09.526782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:09.544561 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-af8db842-16a1-43f0-ad1f-73142134d789 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1472 microversion: 2.1 time: 0.249688 Oct 28 13:21:09.557322 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2054/4028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:09 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:10.171811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:10.179257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:10.185780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:10.187152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:10.187817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:10.188722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:10.193900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:10.194688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:10.473543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:10.482901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11445dba-f24e-4510-9160-5b36838fd437 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.315163 Oct 28 13:21:10.493630 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1975/4029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:10 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:10.571073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:10.571903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:10.579630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:10.580185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:10.580796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:10.582299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:10.583040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:10.583812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:10.985703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:10.994815 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-45a18e5e-ac2e-4e5c-a368-0cf392a25d68 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1472 microversion: 2.1 time: 0.427786 Oct 28 13:21:10.998782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2055/4030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:10 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:11.508568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:11.509317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:11.516302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:11.516788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:11.517218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:11.517902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:11.518355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:11.519335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:11.743384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:11.751608 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17930413-9059-4814-884d-5b8e262aa098 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.246945 Oct 28 13:21:11.752185 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1976/4031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:11 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:12.021483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:12.022087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:12.029223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:12.029715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:12.030148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:12.035840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:12.036332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:12.036765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:12.287285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:12.302612 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e9bb036-3b48-491f-9061-b42106ed8c1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.286827 Oct 28 13:21:12.308317 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2056/4032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:12 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:12.779628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:12.780243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:12.788335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:12.794014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:12.794689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:12.795430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:12.795891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:12.796310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:13.090293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:13.122863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-728d3080-d6f5-43ae-9ab1-7bfb7808ccbd tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.341856 Oct 28 13:21:13.127475 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1977/4033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:12 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:13.343295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:13.352080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:13.365792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:13.368644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:13.369721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:13.371070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:13.372805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:13.374262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:13.683324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:13.696716 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db4fc416-f5f2-482e-b868-a42624c3ab00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.358345 Oct 28 13:21:13.707175 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2057/4034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:13 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:14.161722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:14.162977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:14.174505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:14.175751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:14.176372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:14.177239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:14.177992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:14.178718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:14.742488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:14.743912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:14.764304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:14.775001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:14.775925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:14.776929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:14.778956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:14.781201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:14.894017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:14.917720 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c87ac836-8d6c-4d95-ae36-39c14659b6bc tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.752927 Oct 28 13:21:14.918438 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1978/4035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:14 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:15.263657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:15.278145 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6dfa80bc-fca7-447f-ad46-c776911f6038 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.542240 Oct 28 13:21:15.279070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2058/4036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:14 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:15.589196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1260182078", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "694d29a8-cb59-4765-ba4b-02e7232ace99"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:15.687586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] validate_networks() for [('694d29a8-cb59-4765-ba4b-02e7232ace99', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:21:15.951830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:15.952516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:15.961318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:15.961807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:15.962462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:15.963198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:15.963804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:15.964225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:15.968799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:16.203253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:16.230803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:21:16.231303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:21:16.231852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:21:16.232329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:21:16.232807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:21:16.236617 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-998ccff7-6280-423a-840b-de80585864d2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.288769 Oct 28 13:21:16.237226 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2059/4037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:15 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:16.244274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:16.244979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:16.245733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:16.246810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:16.251156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:16.251156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:16.273110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Getting quotas for project 8852f479f0d64166aa772c5ef83029e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:21:16.279673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Getting quotas for user be7d673f4d8e45be8dbe22474668246a and project 8852f479f0d64166aa772c5ef83029e8. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:21:16.293145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:21:16.295552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:21:16.304470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:16.305082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:16.314182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:16.314711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:16.324000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:16.332809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:16.334564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:16.335121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:16.540316 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0821a665-2d45-478b-b605-078dc882141d tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127179 Oct 28 13:21:16.548120 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1979/4038] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:21:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:21:16.553802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a7f3af22-2999-4f36-9c96-337ad93a48c0 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:16.560215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:16.561225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a7f3af22-2999-4f36-9c96-337ad93a48c0 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:16.577065 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6d46a8f1-5f3d-4c73-af20-d85107f5e071 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.274214 Oct 28 13:21:16.589099 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2060/4039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:16 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:16.686909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a7f3af22-2999-4f36-9c96-337ad93a48c0 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:16.703705 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a7f3af22-2999-4f36-9c96-337ad93a48c0 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1225 microversion: 2.1 time: 0.154204 Oct 28 13:21:16.705314 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1980/4040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:16 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:17.267940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:17.268615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:17.271918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:17.302383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:17.303947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:17.306332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:17.307999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:17.309028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:17.309265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:17.603628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:17.604253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:17.613095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:17.613830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:17.614412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:17.615341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:17.615944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:17.618011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:17.717473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:17.727932 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6beb256-765a-4981-9739-f9e8868d2981 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.464862 Oct 28 13:21:17.732282 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2061/4041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:17 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:17.741692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e44d775-d307-4138-8aea-c67c1feb3eba tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:17.742313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e44d775-d307-4138-8aea-c67c1feb3eba tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:17.864951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e44d775-d307-4138-8aea-c67c1feb3eba tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:17.874521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e44d775-d307-4138-8aea-c67c1feb3eba tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1225 microversion: 2.1 time: 0.140874 Oct 28 13:21:17.875699 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2062/4042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:17 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:17.886557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:17.899752 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28143ef7-2e2c-42d3-8c6b-160df8c0993e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.300472 Oct 28 13:21:17.900670 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1981/4043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:17 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:18.769267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:18.770042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:18.779196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:18.779791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:18.780306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:18.781086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:18.781777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:18.782395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:18.908787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:18.909448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:18.923295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:18.924056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:18.924659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:18.926692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:18.942730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:18.954921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:19.062893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:19.079329 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-26dce093-3c4b-48aa-bde9-6756e833d22e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.322724 Oct 28 13:21:19.080831 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2063/4044] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:18 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:19.085927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:19.086827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:19.095236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:19.095901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:19.096627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:19.097716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:19.098333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:19.098959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:19.458281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:19.469510 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27d23912-4dd6-479b-9074-ade538a9393b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.387342 Oct 28 13:21:19.471039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2064/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:19 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:20.082941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:20.099629 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62808bdb-d809-4f34-a9c7-d8df127515f6 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1229 microversion: 2.1 time: 1.193402 Oct 28 13:21:20.099629 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1982/4046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:18 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1229 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:20.122656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:20.122656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:20.133059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:20.138105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:20.138659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:20.139451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:20.139926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:20.140362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:20.423677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:20.436160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8735ef7-c778-4c23-9141-a537fa651ead tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.323759 Oct 28 13:21:20.448767 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2065/4047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:20 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:20.498919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:20.499742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:20.510614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:20.511671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:20.513543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:20.513543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:20.513543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:20.513952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:21.059608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:21.073633 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a8db5490-b85d-4332-9303-efc89cc4176d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.580704 Oct 28 13:21:21.089506 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1983/4048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:20 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:21.124478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:21.126372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:21.135873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:21.136798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:21.137475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:21.139206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:21.140129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:21.140788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:21.465887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:21.470981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:21.473294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:21.488252 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37955447-8e18-4583-b023-535602770e94 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1285 microversion: 2.1 time: 0.367113 Oct 28 13:21:21.493212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:21.495059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:21.498948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:21.500179 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2066/4049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:21 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1285 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:21.505315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:21.505315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:21.505315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:22.130183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:22.132640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:22.152092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:22.152598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:22.154161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:22.155342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:22.156061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:22.158164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:22.172640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:22.183957 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8195e49c-7393-4179-a037-3cdd6396c910 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.725333 Oct 28 13:21:22.187044 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1984/4050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:21 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:22.498598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:22.512550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:22.513949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:22.522653 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8d991db-f323-4db0-b276-a83c64c2e3d5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.410056 Oct 28 13:21:22.524111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:22.525901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:22.527497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:22.528169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2067/4051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:22 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:22.528876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:22.529965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:22.531076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:22.531748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:22.650086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:22.673141 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f342281f-4290-46aa-812f-cb9223e07661 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1283 microversion: 2.1 time: 0.163949 Oct 28 13:21:22.690028 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1985/4052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:22 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:23.225037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:23.225666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:23.232332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:23.233049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:23.233286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:23.233997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:23.234555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:23.238292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:23.555364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:23.557585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:23.558275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:23.568517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:23.569012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:23.569448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:23.569876 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-642d5331-fb60-4f5a-95cc-81ae4f46d4e2 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.360100 Oct 28 13:21:23.570150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:23.570604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:23.571115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:23.571779 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2068/4053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:23 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:23.700519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:23.701146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:23.707417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:23.708247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:23.708910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:23.709867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:23.710540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:23.711213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:24.005729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:24.024275 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-581d9ed7-f025-47e6-b3ed-bb1c222a8492 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.323939 Oct 28 13:21:24.024275 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2069/4054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:23 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:24.118703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:24.129342 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-572e0a19-e12c-4b68-b4f4-0e479d4d7a47 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.583543 Oct 28 13:21:24.129941 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1986/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:23 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:24.593965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:24.594579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:24.603035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:24.603601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:24.604287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:24.605109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:24.605663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:24.606449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:24.829073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:24.837985 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8bf85a1b-a7cf-4361-9b3f-599ef55b6798 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.247758 Oct 28 13:21:24.849479 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2070/4056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:24 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:25.046843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:25.048368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:25.055672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:25.056494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:25.057154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:25.058132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:25.058816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:25.059778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:25.157403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:25.158827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:25.173058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:25.175325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:25.176034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:25.177005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:25.178835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:25.181476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:25.318027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:25.326904 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dc770341-f79a-42fb-afec-13127bb7ff47 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.284827 Oct 28 13:21:25.327486 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1987/4057] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:25 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:25.368061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:25.380278 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7111b474-abcd-4dbd-aa8d-1f3f26d3e6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.227875 Oct 28 13:21:25.410875 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2071/4058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:25 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:25.416078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b4637f14-000c-4eaf-8450-0b7c23822ae0 req-efaa7bac-c574-4eac-9a58-5f9e73105138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e906d6e-08d8-4f7a-9dbc-7366ede93cb4", "tag": "c1f29631-ddc4-42b2-a94e-748241472fb7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:25.427490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b4637f14-000c-4eaf-8450-0b7c23822ae0 req-efaa7bac-c574-4eac-9a58-5f9e73105138 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:25.428208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b4637f14-000c-4eaf-8450-0b7c23822ae0 req-efaa7bac-c574-4eac-9a58-5f9e73105138 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:25.428779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b4637f14-000c-4eaf-8450-0b7c23822ae0 req-efaa7bac-c574-4eac-9a58-5f9e73105138 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:25.447808 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b4637f14-000c-4eaf-8450-0b7c23822ae0 req-efaa7bac-c574-4eac-9a58-5f9e73105138 service nova] Creating event network-changed:c1f29631-ddc4-42b2-a94e-748241472fb7 for instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 on n-h1-862876-2 Oct 28 13:21:25.453082 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b4637f14-000c-4eaf-8450-0b7c23822ae0 req-efaa7bac-c574-4eac-9a58-5f9e73105138 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040713 Oct 28 13:21:25.453856 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1988/4059] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:25.866113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:25.867568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:25.879566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:25.887599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:25.888541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:25.889441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:25.890158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:25.890876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:26.170556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:26.180074 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5b08f40c-99eb-4e40-9300-647269e9317b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.317998 Oct 28 13:21:26.183730 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2072/4060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:25 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:26.348983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:26.354169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:26.354904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:26.361747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:26.362288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:26.362718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:26.363435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:26.363892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:26.366767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:26.421373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:26.427911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:26.438384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:26.444233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:26.444696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:26.446129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:26.449254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:26.449869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:26.655671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:26.670464 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71560e51-8f24-4696-88e2-a98c2810c434 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.323371 Oct 28 13:21:26.673303 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1989/4061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:26 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:26.800113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:26.806525 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aad64dd7-4200-4abc-b265-e97444a0c48c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.399171 Oct 28 13:21:26.807230 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2073/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:26 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:27.207864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:27.208591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:27.210832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:27.221035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:27.221537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:27.225619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:27.225619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:27.225619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:27.225619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:27.494021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:27.503564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-21d107d4-8b91-4239-9d88-817028901605 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.299902 Oct 28 13:21:27.519889 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1990/4063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:27 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:27.698308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:27.699997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:27.708398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:27.709197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:27.714266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:27.714266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:27.714266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:27.714266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:27.832282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:27.833859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:27.840964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:27.842166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:27.842856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:27.843945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:27.844653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:27.845267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:27.866254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:27.866408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:27.868724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:27.876253 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-faf43685-ab1f-4284-8174-8e3adffad3e3 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.182660 Oct 28 13:21:27.893213 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2074/4064] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:27 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:28.209079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:28.225525 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eb67a6c8-2c37-4685-bdde-2f70692a2120 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1477 microversion: 2.1 time: 0.391288 Oct 28 13:21:28.226719 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1991/4065] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:27 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:28.529578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:28.530393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:28.541309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:28.541823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:28.542266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:28.543012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:28.543480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:28.543910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:28.757769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:28.766321 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-842a2a45-34b2-47d2-870e-35d7df1e7c0d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.242582 Oct 28 13:21:28.766927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2075/4066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:28 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:28.903707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:28.905144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:28.914843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:28.916906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:28.917733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:28.920478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:28.921917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:28.922545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:29.254499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:29.255232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:29.261616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:29.262247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:29.263037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:29.263798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:29.264325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:29.264835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:29.341884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:29.346295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f0f0fc9-170f-421a-b2dd-9f6c97b88ebc tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.447032 Oct 28 13:21:29.347289 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1992/4067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:28 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:29.473735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:29.478926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:29.486221 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-91a713a5-f82b-45db-b048-2f4f9a8986cc tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1476 microversion: 2.1 time: 0.236291 Oct 28 13:21:29.487525 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2076/4068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:29 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:29.793017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:29.793745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:29.806463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:29.807182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:29.807945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:29.809232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:29.809910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:29.810501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:29.986137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-86925ab5-e0d9-4042-b098-ddee340e227f req-8deb799d-6d85-4448-91e7-10fb58d5a88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561a4c75-30be-45bc-8f1f-02d9de17519d", "name": "network-vif-unplugged", "status": "completed", "tag": "3b86f559-9d9c-4a08-a90e-4abd2b238750"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:29.997940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-86925ab5-e0d9-4042-b098-ddee340e227f req-8deb799d-6d85-4448-91e7-10fb58d5a88c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:29.998422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-86925ab5-e0d9-4042-b098-ddee340e227f req-8deb799d-6d85-4448-91e7-10fb58d5a88c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:30.000666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-86925ab5-e0d9-4042-b098-ddee340e227f req-8deb799d-6d85-4448-91e7-10fb58d5a88c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:30.013836 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-86925ab5-e0d9-4042-b098-ddee340e227f req-8deb799d-6d85-4448-91e7-10fb58d5a88c service nova] Creating event network-vif-unplugged:3b86f559-9d9c-4a08-a90e-4abd2b238750 for instance 561a4c75-30be-45bc-8f1f-02d9de17519d on n-h1-862876-2 Oct 28 13:21:30.020786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:30.023928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-86925ab5-e0d9-4042-b098-ddee340e227f req-8deb799d-6d85-4448-91e7-10fb58d5a88c service nova] Instance 561a4c75-30be-45bc-8f1f-02d9de17519d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:21:30.036896 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-86925ab5-e0d9-4042-b098-ddee340e227f req-8deb799d-6d85-4448-91e7-10fb58d5a88c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054705 Oct 28 13:21:30.037123 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f0755395-b95b-457b-aa67-fb1edbcea82c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.250830 Oct 28 13:21:30.038291 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2077/4069] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:21:30.039295 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1993/4070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:29 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:30.370174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:30.371009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:30.377791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:30.381131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:30.381131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:30.381131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:30.381131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:30.381131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:30.514515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:30.515334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:30.522668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:30.523249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:30.523803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:30.524661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:30.525234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:30.525769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:30.533227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:30.541842 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0947c48f-4721-46ca-ab97-acf4458b8584 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.175435 Oct 28 13:21:30.561946 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2078/4071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:30 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:30.708887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:30.720292 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cc931da4-548f-4da5-9067-8f71767fd37d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1476 microversion: 2.1 time: 0.209448 Oct 28 13:21:30.721396 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1994/4072] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:30 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:31.063008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:31.064965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:31.074217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:31.074884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:31.078882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:31.078882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:31.078882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:31.078882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:31.245910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:31.254348 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-585d0559-0452-4df7-a2a1-782642b2d72c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.196057 Oct 28 13:21:31.255367 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2079/4073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:31 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:31.570293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:31.571018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:31.578124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:31.578619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:31.579085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:31.579827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:31.580270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:31.580737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:31.745478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:31.746736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:31.770055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:31.770816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:31.771493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:31.772883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:31.773557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:31.774379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:31.795630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:31.803589 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9d4455a-1dcc-4b8c-881b-ac9192598841 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.237241 Oct 28 13:21:31.804823 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1995/4074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:31 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:31.930869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ff667e61-e921-4922-9f9d-af3413538a28 req-70984147-356f-4681-87f7-5340acd640d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e906d6e-08d8-4f7a-9dbc-7366ede93cb4", "name": "network-vif-plugged", "status": "completed", "tag": "c1f29631-ddc4-42b2-a94e-748241472fb7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:31.940647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ff667e61-e921-4922-9f9d-af3413538a28 req-70984147-356f-4681-87f7-5340acd640d1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:31.941344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ff667e61-e921-4922-9f9d-af3413538a28 req-70984147-356f-4681-87f7-5340acd640d1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:31.942140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ff667e61-e921-4922-9f9d-af3413538a28 req-70984147-356f-4681-87f7-5340acd640d1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:31.955716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:31.956731 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ff667e61-e921-4922-9f9d-af3413538a28 req-70984147-356f-4681-87f7-5340acd640d1 service nova] Creating event network-vif-plugged:c1f29631-ddc4-42b2-a94e-748241472fb7 for instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 on n-h1-862876-2 Oct 28 13:21:31.963016 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ff667e61-e921-4922-9f9d-af3413538a28 req-70984147-356f-4681-87f7-5340acd640d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035759 Oct 28 13:21:31.964338 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1996/4075] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:21:31.966788 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5537aeae-0a5a-4153-b0a0-5e4aeacd3b01 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1476 microversion: 2.1 time: 0.226024 Oct 28 13:21:31.970832 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2080/4076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:31 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:32.089703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-350f9b04-5846-40da-9f44-c986aef53a52 req-917f0775-699f-4fb4-be09-75383f54f831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561a4c75-30be-45bc-8f1f-02d9de17519d", "tag": "3b86f559-9d9c-4a08-a90e-4abd2b238750"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:32.133683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-350f9b04-5846-40da-9f44-c986aef53a52 req-917f0775-699f-4fb4-be09-75383f54f831 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:32.134268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-350f9b04-5846-40da-9f44-c986aef53a52 req-917f0775-699f-4fb4-be09-75383f54f831 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:32.135533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-350f9b04-5846-40da-9f44-c986aef53a52 req-917f0775-699f-4fb4-be09-75383f54f831 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:32.163256 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-350f9b04-5846-40da-9f44-c986aef53a52 req-917f0775-699f-4fb4-be09-75383f54f831 service nova] Creating event network-changed:3b86f559-9d9c-4a08-a90e-4abd2b238750 for instance 561a4c75-30be-45bc-8f1f-02d9de17519d on n-h1-862876-2 Oct 28 13:21:32.171806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-350f9b04-5846-40da-9f44-c986aef53a52 req-917f0775-699f-4fb4-be09-75383f54f831 service nova] Instance 561a4c75-30be-45bc-8f1f-02d9de17519d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:21:32.183664 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-350f9b04-5846-40da-9f44-c986aef53a52 req-917f0775-699f-4fb4-be09-75383f54f831 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098990 Oct 28 13:21:32.184561 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1997/4077] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:32.279224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:32.279833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:32.290697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:32.291088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:32.291702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:32.292545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:32.293001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:32.293465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:32.543943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:32.554836 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7710e8b9-da26-479f-a244-3a97afdc799b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.279576 Oct 28 13:21:32.555432 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2081/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:32 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:32.828553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:32.830279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:32.840442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:32.841846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:32.842572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:32.843414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:32.843951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:32.844457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:32.996134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:32.997106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:33.027951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:33.031851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:33.033733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:33.035713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:33.037280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:33.039495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:33.225125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:33.234708 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd6738fe-383d-43c1-8690-be5475042049 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.410668 Oct 28 13:21:33.248049 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1998/4079] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:32 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:33.267081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:33.275819 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8f624f2-e124-4ef2-ad51-f5270a578a61 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1474 microversion: 2.1 time: 0.285697 Oct 28 13:21:33.276849 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2082/4080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:32 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1474 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:33.580000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:33.580636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:33.587462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:33.588001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:33.588429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:33.589111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:33.589558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:33.589978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:33.750833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:33.757261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-16760e47-d19b-44c2-b1ac-ddc0adf6daec tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.181160 Oct 28 13:21:33.757827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 1999/4081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:33 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:34.261126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:34.261782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:34.269713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:34.270268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:34.270809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:34.271872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:34.272557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:34.273302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:34.306235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:34.311968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:34.324959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:34.325867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:34.326560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:34.328012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:34.328697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:34.329333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:34.447174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:34.458324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d6074b5-0bc1-4e2e-b42c-5c98cec7dffd tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1325 microversion: 2.1 time: 0.201850 Oct 28 13:21:34.459685 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2083/4082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:34 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1325 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:34.783446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:34.784886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:34.791545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:34.792152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:34.792648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:34.793880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:34.794339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:34.794791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:34.876391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:34.887298 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9cbe0e1-7c13-482a-afd9-4d89e7b9eaeb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1474 microversion: 2.1 time: 0.589232 Oct 28 13:21:34.898343 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2000/4083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:34 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1474 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:35.069651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:35.079663 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4a65521-3d25-4ee9-b187-cdf25b41fde6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1509 microversion: 2.1 time: 0.301273 Oct 28 13:21:35.080271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2084/4084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:34 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:35.481554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:35.483074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:35.490778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.491567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.492071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:35.493032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.493568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.494054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:35.714815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:35.723582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7fba31d2-34ec-4a44-bc91-eed730b70967 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1522 microversion: 2.1 time: 0.245909 Oct 28 13:21:35.724166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2001/4085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:35 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:35.746786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:35.747791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:35.755028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.755735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.756485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:35.757357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.757981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.758551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:35.783438 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] HTTP exception thrown: Instance is not a member of specified network Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Request method failure captured: Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4/ips/invalid HTTP/1.1 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9dLOV-gPy-FG1uDQRqkBoKLDubh4y-xpOlu7iHDfNLdLcejCJuQQREAiO3zGrGnE8Qz141WxYkKWBl_BOATXezC4zZACt-tZazbXNITDrSFzFU1XIhP8aCU-j3fHCZrmzP3t3qjxdULn5VrGsEmpc-ji21AvlmqGj4m1fi78NOrsSA Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 8852f479f0d64166aa772c5ef83029e8 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8852f479f0d64166aa772c5ef83029e8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 8852f479f0d64166aa772c5ef83029e8 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerAddressesNegativeTestJSON-1358009678-project Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: be7d673f4d8e45be8dbe22474668246a Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1358009678-project Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance is not a member of specified network Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'server_id': '2e906d6e-08d8-4f7a-9dbc-7366ede93cb4', 'id': 'invalid'} Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 28 13:21:35.788454 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.792198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:35.792198 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d954aa8-d60a-4e5e-8cb3-c2edc4813839 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.047092 Oct 28 13:21:35.794621 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2085/4086] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:21:35 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4/ips/invalid => generated 91 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:21:35.800373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-030562e8-a0dc-48e8-96d5-49ecc65f4e5b tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:35.800846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-030562e8-a0dc-48e8-96d5-49ecc65f4e5b tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Failed to fetch instance by id 999 {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 13:21:35.801351 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-030562e8-a0dc-48e8-96d5-49ecc65f4e5b tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] HTTP exception thrown: Instance 999 could not be found. Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-030562e8-a0dc-48e8-96d5-49ecc65f4e5b tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Request method failure captured: Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9dLOV-gPy-FG1uDQRqkBoKLDubh4y-xpOlu7iHDfNLdLcejCJuQQREAiO3zGrGnE8Qz141WxYkKWBl_BOATXezC4zZACt-tZazbXNITDrSFzFU1XIhP8aCU-j3fHCZrmzP3t3qjxdULn5VrGsEmpc-ji21AvlmqGj4m1fi78NOrsSA Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 8852f479f0d64166aa772c5ef83029e8 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8852f479f0d64166aa772c5ef83029e8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 8852f479f0d64166aa772c5ef83029e8 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerAddressesNegativeTestJSON-1358009678-project Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: be7d673f4d8e45be8dbe22474668246a Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1358009678-project Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 999 could not be found. Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '999'} Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 13:21:35.803193 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:35.809514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-030562e8-a0dc-48e8-96d5-49ecc65f4e5b tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:35.809514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-030562e8-a0dc-48e8-96d5-49ecc65f4e5b tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009721 Oct 28 13:21:35.809514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2002/4087] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:21:35 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:21:35.815690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:35.816057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:35.821966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.822454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.822931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:35.823668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.824129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.824556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:35.850585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:21:35.913792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:35.914390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:35.920229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.920715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.921255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:35.921947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:35.922495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:35.922848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.086104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:36.095633 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e40d26e1-84f1-417c-8b4e-e12e80b5cf23 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1471 microversion: 2.1 time: 0.185606 Oct 28 13:21:36.096267 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2003/4088] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:35 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:36.107280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:36.108553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:36.119776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.120430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.121082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.121946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.122566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.123172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.389369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:36.400220 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-79c51c9f-4525-43e2-9aba-78f86dd95b4f tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1486 microversion: 2.1 time: 0.298036 Oct 28 13:21:36.415916 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2004/4089] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:36 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1486 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:36.425503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:36.426526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:36.435671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.436496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.437037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.437843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.438404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.438962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.485882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1e5ba04-0c42-44a4-a18a-1c2af791d341 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 204 len: 0 microversion: 2.1 time: 0.662295 Oct 28 13:21:36.487357 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2086/4090] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:35 2022] DELETE /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:21:36.500292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-466739145"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:36.510649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:36.527241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.530017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.530017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.530017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.530657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.531272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.734329 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-549db911-8dda-4285-b900-fdb6474e90cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d/action" status: 204 len: 0 microversion: 2.1 time: 0.316764 Oct 28 13:21:36.737034 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2005/4091] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:21:36 2022] POST /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d/action => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:21:36.745103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:36.745813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:36.747737 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27e1dec9-eb00-4a24-b072-6b1030aa7cd3 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "PUT /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1060 microversion: 2.1 time: 0.258065 Oct 28 13:21:36.748875 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2087/4092] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:21:36 2022] PUT /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1060 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:36.760595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:36.761378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:36.763693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.769954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.771210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.772832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.776919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.776919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.783087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.783584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.784058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:36.784765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:36.785223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:36.785647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:37.002238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:37.017723 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-892fdb7e-5de0-4873-8e37-0c157e01139b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1471 microversion: 2.1 time: 0.267467 Oct 28 13:21:37.018380 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2088/4093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:36 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:37.034724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:37.035362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:37.040414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:37.051351 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8faa2f0a-a9c9-4587-b16a-2c9bde8d625c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1528 microversion: 2.1 time: 0.311998 Oct 28 13:21:37.051936 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2006/4094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:36 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1528 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:37.061041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:37.061811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:37.064440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:37.068735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:37.069424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:37.070078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:37.418816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:37.433892 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23548bba-4877-489e-8af9-ab8adf30b272 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1487 microversion: 2.1 time: 0.414325 Oct 28 13:21:37.451807 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2089/4095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:37 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1487 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:37.463861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:37.465226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:37.474338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:37.475066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:37.475654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:37.476875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:37.478256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:37.478941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:37.692691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:37.701785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e401a09-6147-4734-9803-1776e5f137de tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1487 microversion: 2.1 time: 0.247912 Oct 28 13:21:37.702787 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2007/4096] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:37 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1487 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:37.726150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:37.726728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:37.732985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:37.733590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:37.734007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:37.734907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:37.735517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:37.735939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:37.776991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:21:37.846256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:38.048819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:38.053059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:38.066962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:38.074077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:38.075073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:38.077956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:38.078717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:38.079432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:38.278403 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b97c02e2-17d1-4a19-b6c4-64f8fb0948ac tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 204 len: 0 microversion: 2.1 time: 0.556688 Oct 28 13:21:38.282188 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2090/4097] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:37 2022] DELETE /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:21:38.288047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:38.288827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:38.297980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:38.298946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:38.300364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:38.301862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:38.302437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:38.302965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:38.467859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:38.479089 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-706bdeec-742b-471a-be57-a75145d00608 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1471 microversion: 2.1 time: 0.439062 Oct 28 13:21:38.482671 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2008/4098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:38 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:38.491163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:38.495282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1dc5336d-4f15-44f9-a709-d1a091a55cda req-fc38b68a-9d09-42d2-bbe2-4befa13cd6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561a4c75-30be-45bc-8f1f-02d9de17519d", "name": "network-vif-plugged", "status": "completed", "tag": "3b86f559-9d9c-4a08-a90e-4abd2b238750"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:38.501401 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63466cf2-f096-4160-84f1-b9d2414a024a tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1528 microversion: 2.1 time: 0.219672 Oct 28 13:21:38.502231 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2091/4099] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:38 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1528 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:38.507721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:38.508557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:38.511624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1dc5336d-4f15-44f9-a709-d1a091a55cda req-fc38b68a-9d09-42d2-bbe2-4befa13cd6d7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:38.512361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1dc5336d-4f15-44f9-a709-d1a091a55cda req-fc38b68a-9d09-42d2-bbe2-4befa13cd6d7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:38.513248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1dc5336d-4f15-44f9-a709-d1a091a55cda req-fc38b68a-9d09-42d2-bbe2-4befa13cd6d7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:38.515494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:38.516066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:38.516573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:38.517498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:38.518615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:38.519088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:38.520539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:38.535375 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1dc5336d-4f15-44f9-a709-d1a091a55cda req-fc38b68a-9d09-42d2-bbe2-4befa13cd6d7 service nova] Creating event network-vif-plugged:3b86f559-9d9c-4a08-a90e-4abd2b238750 for instance 561a4c75-30be-45bc-8f1f-02d9de17519d on n-h1-862876-2 Oct 28 13:21:38.544839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-1dc5336d-4f15-44f9-a709-d1a091a55cda req-fc38b68a-9d09-42d2-bbe2-4befa13cd6d7 service nova] Instance 561a4c75-30be-45bc-8f1f-02d9de17519d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:21:38.557158 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1dc5336d-4f15-44f9-a709-d1a091a55cda req-fc38b68a-9d09-42d2-bbe2-4befa13cd6d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072338 Oct 28 13:21:38.558092 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2009/4100] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:38.703779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:38.712224 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e688d167-2d38-4a21-9eb2-d02c303d545a tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1493 microversion: 2.1 time: 0.208716 Oct 28 13:21:38.712800 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2092/4101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:38 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:38.999097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-17a56839-8afd-4a71-9217-1a135bb9935c req-e55298ce-b095-4947-bb7c-1cda8ea5752f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e906d6e-08d8-4f7a-9dbc-7366ede93cb4", "name": "network-vif-deleted", "tag": "c1f29631-ddc4-42b2-a94e-748241472fb7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:39.010735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-17a56839-8afd-4a71-9217-1a135bb9935c req-e55298ce-b095-4947-bb7c-1cda8ea5752f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.013298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-17a56839-8afd-4a71-9217-1a135bb9935c req-e55298ce-b095-4947-bb7c-1cda8ea5752f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.013298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-17a56839-8afd-4a71-9217-1a135bb9935c req-e55298ce-b095-4947-bb7c-1cda8ea5752f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.026396 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-17a56839-8afd-4a71-9217-1a135bb9935c req-e55298ce-b095-4947-bb7c-1cda8ea5752f service nova] Creating event network-vif-deleted:c1f29631-ddc4-42b2-a94e-748241472fb7 for instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 on n-h1-862876-2 Oct 28 13:21:39.035016 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-17a56839-8afd-4a71-9217-1a135bb9935c req-e55298ce-b095-4947-bb7c-1cda8ea5752f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041603 Oct 28 13:21:39.036337 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2010/4102] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:39.507711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:39.509033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:39.517694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.518449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.519097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.520129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.524236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.524236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.534895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:39.534895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:39.549940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.550499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.551135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.552121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.552756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.553330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.591289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.592050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.592465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.592919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lazy-loading 'fault' on Instance uuid 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:21:39.689798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7d673f4d8e45be8dbe22474668246a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8852f479f0d64166aa772c5ef83029e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:39.701171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ec511f9-f009-442d-86cf-2214e97ce58c tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 200 len: 1315 microversion: 2.1 time: 0.175310 Oct 28 13:21:39.701781 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2011/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:39 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:39.773692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:39.775647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:39.785089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.785904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.786706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.787587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:39.788191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:39.788912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:39.881347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:39.893646 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49204748-4ac2-413f-809c-bfce623ef37f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1471 microversion: 2.1 time: 0.389357 Oct 28 13:21:39.907552 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2093/4104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:39 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:40.024334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:40.032402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07aac514-e7ab-42a3-b227-9ba532e03729 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1493 microversion: 2.1 time: 0.266147 Oct 28 13:21:40.041962 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2012/4105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:39 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1493 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:40.462242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-63b86cfc-b81a-48bc-bea7-4077db42fb53 req-e61a5eb5-a954-4c10-a8f3-b04e0c8f6a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7", "name": "network-vif-deleted", "tag": "590cf412-d77e-45b1-9450-e7e8a712224e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:40.473620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63b86cfc-b81a-48bc-bea7-4077db42fb53 req-e61a5eb5-a954-4c10-a8f3-b04e0c8f6a79 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:40.474101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63b86cfc-b81a-48bc-bea7-4077db42fb53 req-e61a5eb5-a954-4c10-a8f3-b04e0c8f6a79 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:40.474637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-63b86cfc-b81a-48bc-bea7-4077db42fb53 req-e61a5eb5-a954-4c10-a8f3-b04e0c8f6a79 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:40.486404 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-63b86cfc-b81a-48bc-bea7-4077db42fb53 req-e61a5eb5-a954-4c10-a8f3-b04e0c8f6a79 service nova] Creating event network-vif-deleted:590cf412-d77e-45b1-9450-e7e8a712224e for instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 on n-h2-862876-2 Oct 28 13:21:40.492080 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-63b86cfc-b81a-48bc-bea7-4077db42fb53 req-e61a5eb5-a954-4c10-a8f3-b04e0c8f6a79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033779 Oct 28 13:21:40.492846 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2094/4106] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:40.725831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:40.727626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] [instance: 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:40.742178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:40.742909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:40.743547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:40.744428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:40.745520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:40.747523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:40.774737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] HTTP exception thrown: Instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 could not be found. Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Request method failure captured: Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 HTTP/1.1 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9dLOV-gPy-FG1uDQRqkBoKLDubh4y-xpOlu7iHDfNLdLcejCJuQQREAiO3zGrGnE8Qz141WxYkKWBl_BOATXezC4zZACt-tZazbXNITDrSFzFU1XIhP8aCU-j3fHCZrmzP3t3qjxdULn5VrGsEmpc-ji21AvlmqGj4m1fi78NOrsSA Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 8852f479f0d64166aa772c5ef83029e8 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8852f479f0d64166aa772c5ef83029e8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8852f479f0d64166aa772c5ef83029e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 8852f479f0d64166aa772c5ef83029e8 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1358009678 Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerAddressesNegativeTestJSON-1358009678-project Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: be7d673f4d8e45be8dbe22474668246a Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1358009678-project Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 could not be found. Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '2e906d6e-08d8-4f7a-9dbc-7366ede93cb4'} Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 could not be found. Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 could not be found. Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:40.783218 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 could not be found. Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:40.790153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] Returning 404 to user: Instance 2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:40.792440 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-61f1f8a3-4de8-4e05-994a-75df44d66307 tempest-ServerAddressesNegativeTestJSON-1358009678 tempest-ServerAddressesNegativeTestJSON-1358009678-project] 10.222.0.25 "GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4" status: 404 len: 111 microversion: 2.1 time: 0.064724 Oct 28 13:21:40.796267 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2013/4107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:40 2022] GET /compute/v2.1/servers/2e906d6e-08d8-4f7a-9dbc-7366ede93cb4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:40.930925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:40.932557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:40.940996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:40.942056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:40.942671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:40.943591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:40.944575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:40.946997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:41.058004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:41.058625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:41.075608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:41.076114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:41.076556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:41.078365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:41.082939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:41.084005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:41.171292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:41.172613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:41.173078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:41.173536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:21:41.245742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:41.258231 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1fb20313-2661-4603-a215-67ad79b28d2d tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 200 len: 1309 microversion: 2.1 time: 0.204693 Oct 28 13:21:41.258848 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2014/4108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:41 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:41.448072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:41.459719 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b985aa38-4ad1-496e-9ae0-c32324737277 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1463 microversion: 2.1 time: 0.539527 Oct 28 13:21:41.460721 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2095/4109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:40 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1463 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:41.485077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:41.486060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:41.495380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:41.496237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:41.496901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:41.498242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:41.500723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:41.503329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:41.665942 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d097d80e-8fbf-4757-aa47-252a4c2494bd tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1614 microversion: 2.1 time: 0.185830 Oct 28 13:21:41.666651 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2015/4110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:41 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1614 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:41.696815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef2adef9-1d60-4e6c-b334-1feb72d98d4e tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '.version_select at 0x7f27b85470d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:41.700868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef2adef9-1d60-4e6c-b334-1feb72d98d4e tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:41.701356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef2adef9-1d60-4e6c-b334-1feb72d98d4e tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:41.701793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef2adef9-1d60-4e6c-b334-1feb72d98d4e tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:41.710521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef2adef9-1d60-4e6c-b334-1feb72d98d4e tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.018691 Oct 28 13:21:41.712390 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2096/4111] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:21:41 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:41.889524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2016597584", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:41.970862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:21:42.284265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.285701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.319462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.321660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.324782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.331708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.332888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.333437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.416431 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 HTTP/1.1 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7'} Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.425718 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.429572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.431440 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14a5ef7e-c735-489a-8a19-f85175b105db tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 404 len: 111 microversion: 2.1 time: 0.149024 Oct 28 13:21:42.437237 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2097/4112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:42 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.457034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.458983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.484083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.485289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.487748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.489155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.489961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.493459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.519958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:21:42.520399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:21:42.521153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:21:42.521712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:21:42.522304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:21:42.528570 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 HTTP/1.1 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7'} Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.531646 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.535721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.538916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.540223 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61c946a4-3483-46e5-9333-31a0fdc6c5f6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 404 len: 111 microversion: 2.1 time: 0.097173 Oct 28 13:21:42.543977 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2098/4113] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:42 2022] DELETE /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.544093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.544093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.544093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.544316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.544756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.545220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.553426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.554038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.574888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.575569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.576084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.577118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.577687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.579481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.587772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:21:42.597748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for user c3852e30767345639ee5d92350d2950a and project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:21:42.602674 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 HTTP/1.1 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7'} Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.606721 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.614451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.615286 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e90b58da-c160-45f5-a92f-db5fed558e80 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7" status: 404 len: 111 microversion: 2.1 time: 0.065348 Oct 28 13:21:42.624338 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2099/4114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:42 2022] GET /compute/v2.1/servers/967e45c5-c3d1-42a8-a655-8fb4ec7ed0e7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.628804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:21:42.636096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:21:42.643073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.643764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.688727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.689225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.689678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.690425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.692630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.693078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.717775 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd HTTP/1.1 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '184ff744-c5cd-4eca-8667-bcf3dd7e27dd'} Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.719662 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.723776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.726162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.727279 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb852308-64e0-493d-9553-d96ba3378b74 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 404 len: 111 microversion: 2.1 time: 0.101930 Oct 28 13:21:42.728027 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2100/4115] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:42 2022] DELETE /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.738109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.740638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 184ff744-c5cd-4eca-8667-bcf3dd7e27dd] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.750622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.751504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.752850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.753967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.754985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.756078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.781188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd HTTP/1.1 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '184ff744-c5cd-4eca-8667-bcf3dd7e27dd'} Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.783220 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 184ff744-c5cd-4eca-8667-bcf3dd7e27dd could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.793163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0fe8065-6072-44c9-8ac9-8c4ba9ea5ddf tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd" status: 404 len: 111 microversion: 2.1 time: 0.056250 Oct 28 13:21:42.794641 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2101/4116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:42 2022] GET /compute/v2.1/servers/184ff744-c5cd-4eca-8667-bcf3dd7e27dd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.800774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.801547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.809570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.810344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.810976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.811851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.812473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.813195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.827393 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dabc1ff2-833f-4724-bf83-d0046ed11cea tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941751 Oct 28 13:21:42.830122 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2016/4117] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:21:42.840257 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 HTTP/1.1 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '505ff1b7-1cf5-4ae5-8494-f1e9df121241'} Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.844938 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.848937 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.851567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.852663 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-29de35c9-3997-484e-8324-21a36035fe57 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 404 len: 111 microversion: 2.1 time: 0.056840 Oct 28 13:21:42.853409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2102/4118] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:42 2022] DELETE /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.868084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.868084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 505ff1b7-1cf5-4ae5-8494-f1e9df121241] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.870639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.871026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4aced5d1-db01-40a9-a9ca-e2ae1927adf5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.871358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.871895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.872243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4aced5d1-db01-40a9-a9ca-e2ae1927adf5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.872779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.873332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.873912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.890442 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 HTTP/1.1 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '505ff1b7-1cf5-4ae5-8494-f1e9df121241'} Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.893247 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 505ff1b7-1cf5-4ae5-8494-f1e9df121241 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9988adaa-ce4f-49dd-b53e-ed29e77e2a45 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241" status: 404 len: 111 microversion: 2.1 time: 0.036824 Oct 28 13:21:42.901716 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2103/4119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:42 2022] GET /compute/v2.1/servers/505ff1b7-1cf5-4ae5-8494-f1e9df121241 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.906200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.907149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.913990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.914611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.919785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.919785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.919785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.919785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.941973 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 HTTP/1.1 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bd61b5d2-16aa-4b8e-aff2-24ff59dfc068'} Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:42.943750 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:42.947298 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5a239cb-0d96-4198-9ef6-17101293ae4c tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 404 len: 111 microversion: 2.1 time: 0.044550 Oct 28 13:21:42.949265 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2104/4120] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:42 2022] DELETE /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:42.954694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:42.955765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: bd61b5d2-16aa-4b8e-aff2-24ff59dfc068] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:42.961831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:42.963719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.964337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.964842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:42.965686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:42.966237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:42.966730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.005133 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 HTTP/1.1 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bd61b5d2-16aa-4b8e-aff2-24ff59dfc068'} Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.012494 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.016485 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.016485 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.016485 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.016485 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:43.016485 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:43.016485 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. Oct 28 13:21:43.016485 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.020043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:43.022654 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7093afe-13b6-48d2-9054-949610504938 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068" status: 404 len: 111 microversion: 2.1 time: 0.070479 Oct 28 13:21:43.023719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2105/4121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:42 2022] GET /compute/v2.1/servers/bd61b5d2-16aa-4b8e-aff2-24ff59dfc068 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:43.037323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:43.039483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:43.055645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4aced5d1-db01-40a9-a9ca-e2ae1927adf5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:43.056222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.060823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.061423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.062385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.063594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.064163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.066335 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4aced5d1-db01-40a9-a9ca-e2ae1927adf5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1213 microversion: 2.1 time: 0.217139 Oct 28 13:21:43.074784 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2017/4122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:42 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1213 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:43.091981 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 HTTP/1.1 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4151c0d7-a98c-41a5-9826-a66b34d833c4'} Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:43.101992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:43.105313 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-97c37a71-6cbb-4416-b8d4-2b1115a79a8e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 404 len: 111 microversion: 2.1 time: 0.075180 Oct 28 13:21:43.110961 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2106/4123] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:43 2022] DELETE /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:43.120444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:43.121487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 4151c0d7-a98c-41a5-9826-a66b34d833c4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:43.130446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.131196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.131931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.133340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.133971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.134575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 HTTP/1.1 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4151c0d7-a98c-41a5-9826-a66b34d833c4'} Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:43.808180 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 4151c0d7-a98c-41a5-9826-a66b34d833c4 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:43.812721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25f14790-d506-413b-886c-c41334846ed1 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4" status: 404 len: 111 microversion: 2.1 time: 0.699749 Oct 28 13:21:43.817848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:43.818417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:43.823199 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2018/4124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:43 2022] GET /compute/v2.1/servers/4151c0d7-a98c-41a5-9826-a66b34d833c4 => generated 111 bytes in 704 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:43.826098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.827005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.829037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.829037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.829037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.829896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.853860 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d HTTP/1.1 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'e0ce0318-21cc-4df6-a6e8-985e68b6563d'} Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:43.862258 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.866268 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.882175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:43.882175 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d72bd2e1-07d2-4928-b1c6-025f4cfd832e tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 404 len: 111 microversion: 2.1 time: 0.060618 Oct 28 13:21:43.883597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:43.884210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: e0ce0318-21cc-4df6-a6e8-985e68b6563d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:43.894179 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2107/4125] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:43 2022] DELETE /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:43.896200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.896694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.897125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.897819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:43.905838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:43.906429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:43.933524 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d HTTP/1.1 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'e0ce0318-21cc-4df6-a6e8-985e68b6563d'} Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.935664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.940474 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.940474 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.940474 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.940474 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:43.940474 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:43.940474 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. Oct 28 13:21:43.940474 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.942436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance e0ce0318-21cc-4df6-a6e8-985e68b6563d could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:43.943649 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d2990fb-d04a-411a-9867-19b19885d420 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d" status: 404 len: 111 microversion: 2.1 time: 0.063046 Oct 28 13:21:43.956577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13b902c6-59c8-44d5-8048-afb5836578c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:43.957777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-13b902c6-59c8-44d5-8048-afb5836578c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 605a0992-422f-40a8-8c8a-8c3c3f00c598] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:43.963018 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2019/4126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:43 2022] GET /compute/v2.1/servers/e0ce0318-21cc-4df6-a6e8-985e68b6563d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:43.969674 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-13b902c6-59c8-44d5-8048-afb5836578c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13b902c6-59c8-44d5-8048-afb5836578c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598 HTTP/1.1 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '605a0992-422f-40a8-8c8a-8c3c3f00c598'} Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:43.971982 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.976149 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:43.976149 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:43.976149 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:43.976149 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:43.976149 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:43.976149 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:43.976149 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:43.977797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13b902c6-59c8-44d5-8048-afb5836578c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:43.980336 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13b902c6-59c8-44d5-8048-afb5836578c8 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598" status: 404 len: 111 microversion: 2.1 time: 0.028665 Oct 28 13:21:44.002948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-223ca5fd-5023-421b-bdaf-27d662e1708b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:44.003832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-223ca5fd-5023-421b-bdaf-27d662e1708b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: 605a0992-422f-40a8-8c8a-8c3c3f00c598] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:44.011895 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2108/4127] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:43 2022] DELETE /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:44.017573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-223ca5fd-5023-421b-bdaf-27d662e1708b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-223ca5fd-5023-421b-bdaf-27d662e1708b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598 HTTP/1.1 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '605a0992-422f-40a8-8c8a-8c3c3f00c598'} Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:44.020142 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:44.024239 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:44.024239 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:44.024239 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:44.024239 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. Oct 28 13:21:44.024239 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:21:44.025342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-223ca5fd-5023-421b-bdaf-27d662e1708b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance 605a0992-422f-40a8-8c8a-8c3c3f00c598 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:44.026607 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-223ca5fd-5023-421b-bdaf-27d662e1708b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598" status: 404 len: 111 microversion: 2.1 time: 0.027813 Oct 28 13:21:44.037210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:44.043532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:44.059151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2020/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:43 2022] GET /compute/v2.1/servers/605a0992-422f-40a8-8c8a-8c3c3f00c598 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:21:44.061438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:44.063074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:44.064420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:44.066264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:44.067360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:44.067946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:44.096968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d82843d-f5b8-41df-940d-36a2191ad6f3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:44.097751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d82843d-f5b8-41df-940d-36a2191ad6f3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:44.131706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:21:44.206433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d82843d-f5b8-41df-940d-36a2191ad6f3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:44.216575 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d82843d-f5b8-41df-940d-36a2191ad6f3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1213 microversion: 2.1 time: 0.123879 Oct 28 13:21:44.218712 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2021/4129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:44 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:44.688119 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cb7be632-5013-4604-b47f-8bbd24107bf0 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 204 len: 0 microversion: 2.1 time: 0.654450 Oct 28 13:21:44.689445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2109/4130] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:21:44 2022] DELETE /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:21:44.703264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:44.703264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:44.705162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:44.706233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:44.706898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:44.707599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:44.708050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:44.708466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:44.972019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:44.985366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eec6370e-93b1-47bc-ac77-640c11a57469 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1480 microversion: 2.1 time: 0.291034 Oct 28 13:21:44.986192 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2022/4131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:44 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1480 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:45.248170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:45.249331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:45.259142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:45.259505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:45.260008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:45.260718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:45.263361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:45.263815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:45.470328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:45.481288 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a572d77b-bf59-4f10-8947-aea88b448880 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1209 microversion: 2.1 time: 0.239626 Oct 28 13:21:45.484453 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2110/4132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:45 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1209 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:46.012614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:46.013773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:46.027471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:46.028044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:46.028805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:46.034306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:46.035011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:46.035661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:46.275014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:46.283897 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-993a06ae-3b35-4c9b-a566-16222a7acc98 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1480 microversion: 2.1 time: 0.276037 Oct 28 13:21:46.285109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2023/4133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:46 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1480 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:46.515497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:46.516783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:46.536508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:46.537079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:46.537433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:46.541317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:46.541843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:46.542284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:46.708531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:46.719319 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bea56c5f-c8d7-4098-b192-74b1d38b3b86 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1273 microversion: 2.1 time: 0.213082 Oct 28 13:21:46.720171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2111/4134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:46 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:47.179790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ca8b19b1-408b-44d0-9cc7-3ff269fab887 req-61b49b6f-1551-4ad4-b7c6-243535bbb50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d793914c-41a1-415c-93d3-9a2484acfe24", "name": "network-vif-deleted", "tag": "484df944-ae61-44a8-afba-183838a958a1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:47.198665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ca8b19b1-408b-44d0-9cc7-3ff269fab887 req-61b49b6f-1551-4ad4-b7c6-243535bbb50f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:47.199521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ca8b19b1-408b-44d0-9cc7-3ff269fab887 req-61b49b6f-1551-4ad4-b7c6-243535bbb50f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:47.201950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ca8b19b1-408b-44d0-9cc7-3ff269fab887 req-61b49b6f-1551-4ad4-b7c6-243535bbb50f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:47.221789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ca8b19b1-408b-44d0-9cc7-3ff269fab887 req-61b49b6f-1551-4ad4-b7c6-243535bbb50f service nova] Creating event network-vif-deleted:484df944-ae61-44a8-afba-183838a958a1 for instance d793914c-41a1-415c-93d3-9a2484acfe24 on n-h2-862876-2 Oct 28 13:21:47.228857 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ca8b19b1-408b-44d0-9cc7-3ff269fab887 req-61b49b6f-1551-4ad4-b7c6-243535bbb50f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060657 Oct 28 13:21:47.229891 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2024/4135] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:47.309353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:47.310184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:47.317539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:47.318763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:47.319392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:47.320109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:47.320877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:47.321450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:47.401891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:47.440863 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-edd3300a-1cc7-4ae6-82ac-cf14fb0bc31b tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1438 microversion: 2.1 time: 0.135862 Oct 28 13:21:47.454018 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2112/4136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:47 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1438 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:47.745222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:47.746313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:47.752110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:47.754339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:47.755031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:47.755621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:47.756483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:47.757089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:47.757684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:48.062782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:48.078368 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a385e79d-0743-4062-b6e3-186a4a6228a2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.338160 Oct 28 13:21:48.081180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2025/4137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:47 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:48.467850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:48.468994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:48.485272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:48.485901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:48.486349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:48.487794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:48.488260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:48.488687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:48.532827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:48.534347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:48.534959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:48.535669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lazy-loading 'fault' on Instance uuid d793914c-41a1-415c-93d3-9a2484acfe24 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:21:48.712332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28081081267d49ababe7e2bdb8a821c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208e49fa113b498d8679c37937014b8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:48.721951 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78f14f53-6dfc-47af-ac8d-0082e5c5a200 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 200 len: 1283 microversion: 2.1 time: 0.258337 Oct 28 13:21:48.722395 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2113/4138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:48 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 1283 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:49.107787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:49.109829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:49.119951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:49.120835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:49.121662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:49.122386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:49.123198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:49.123775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:49.749695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:49.751024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] [instance: d793914c-41a1-415c-93d3-9a2484acfe24] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:49.765811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:49.771752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:49.773331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:49.776328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:49.779258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:49.779787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:49.816006 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] HTTP exception thrown: Instance d793914c-41a1-415c-93d3-9a2484acfe24 could not be found. Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Request method failure captured: Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 HTTP/1.1 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Zq1mo_V8rbXWGEknIgKL4YK4FrxIdkVxHYpfGGVxyR5YYXeJB-jKmjM-5lG3iOgmOADFv6lGaq-DVFro_cJUk7cx2KptusANMhOAnHjL29bMmysix2P6S2st-7nr2UbS8uN-trygJkN72FuEZ1IlyUX1DJdT4mgifPma32zqWgfqM Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/208e49fa113b498d8679c37937014b8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_208e49fa113b498d8679c37937014b8e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/208e49fa113b498d8679c37937014b8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-1447394371 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 208e49fa113b498d8679c37937014b8e Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-1447394371 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 28081081267d49ababe7e2bdb8a821c9 Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-1447394371-project Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance d793914c-41a1-415c-93d3-9a2484acfe24 could not be found. Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'd793914c-41a1-415c-93d3-9a2484acfe24'} Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d793914c-41a1-415c-93d3-9a2484acfe24 could not be found. Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d793914c-41a1-415c-93d3-9a2484acfe24 could not be found. Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:21:49.822471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d793914c-41a1-415c-93d3-9a2484acfe24 could not be found. Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] Returning 404 to user: Instance d793914c-41a1-415c-93d3-9a2484acfe24 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:21:49.828779 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88e2e4df-0f90-4f16-9f20-275409dbe7b6 tempest-ServersTestJSON-1447394371 tempest-ServersTestJSON-1447394371-project] 10.222.0.25 "GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24" status: 404 len: 111 microversion: 2.1 time: 0.082293 Oct 28 13:21:49.838790 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2114/4139] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:49 2022] GET /compute/v2.1/servers/d793914c-41a1-415c-93d3-9a2484acfe24 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:21:49.968266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:49.988541 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-94c5ead0-b3c7-4a3b-b0fd-81ee8abc6082 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.879964 Oct 28 13:21:49.989831 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2026/4140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:49 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:50.621635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f26c4d21-6826-4286-ab4a-1eb8671adc9d req-1969c705-be0e-49ac-a7be-abc53cb54a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7711abb9-22f7-431d-ac87-1b7bd5d6334c", "tag": "034d6bc4-26a7-422a-866f-b39b001987e1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:50.663690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f26c4d21-6826-4286-ab4a-1eb8671adc9d req-1969c705-be0e-49ac-a7be-abc53cb54a9b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:50.668447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f26c4d21-6826-4286-ab4a-1eb8671adc9d req-1969c705-be0e-49ac-a7be-abc53cb54a9b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:50.669957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f26c4d21-6826-4286-ab4a-1eb8671adc9d req-1969c705-be0e-49ac-a7be-abc53cb54a9b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:50.678535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:50.697877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f26c4d21-6826-4286-ab4a-1eb8671adc9d req-1969c705-be0e-49ac-a7be-abc53cb54a9b service nova] Creating event network-changed:034d6bc4-26a7-422a-866f-b39b001987e1 for instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c on n-h1-862876-2 Oct 28 13:21:50.703397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f26c4d21-6826-4286-ab4a-1eb8671adc9d req-1969c705-be0e-49ac-a7be-abc53cb54a9b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095541 Oct 28 13:21:50.704493 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2115/4141] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:21:51.022166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:51.023519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:51.036131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:51.037087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:51.039344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:51.041002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:51.041474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:51.044188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:51.526591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:51.535564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5d41e542-202a-460b-844d-6339b648ee56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.517546 Oct 28 13:21:51.536613 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2027/4142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:51 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:52.561097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:52.561963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:52.575174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:52.579181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:52.579659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:52.580964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:52.581443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:52.581874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:52.771316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:52.780326 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-30421d5e-1a52-4856-9c70-0333b927ca35 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.224903 Oct 28 13:21:52.780910 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2116/4143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:52 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:53.807952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:53.809175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:53.812642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:53.823494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:53.823494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:53.823494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:53.823494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:53.823494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:53.823494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:54.021484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:54.047003 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9611667f-017e-4600-89e4-7437cd3a3e5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.239538 Oct 28 13:21:54.047702 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2028/4144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:53 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:55.073137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:55.074661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:55.080676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:55.083862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:55.084697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:55.085621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:55.086846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:55.087494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:55.088068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:55.231072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-669605964", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": "none"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:55.296678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:21:55.296678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:21:55.296678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:21:55.296678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:21:55.296678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:21:55.306820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:55.307398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:55.307902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:55.308974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:55.309441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:55.309865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:55.310355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:55.320792 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0861d455-06f3-43ca-8926-9f069c726efa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.252813 Oct 28 13:21:55.321381 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2029/4145] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:55 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:21:55.330911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Getting quotas for project 9b680155d34441a894c1520ecc27b58a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:21:55.335219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Getting quotas for user 496dc6b786604e2998a541bd39e5029c and project 9b680155d34441a894c1520ecc27b58a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:21:55.348599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:21:55.351106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:21:55.457361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e3f8aaef-7f76-4f3a-839d-0676a8e7ac32 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.556432 Oct 28 13:21:55.458889 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2117/4146] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:21:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 13:21:55.469031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00802bbb-bae9-4824-9b62-71423137b0bf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:55.469694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00802bbb-bae9-4824-9b62-71423137b0bf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:55.559585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00802bbb-bae9-4824-9b62-71423137b0bf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:55.569547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00802bbb-bae9-4824-9b62-71423137b0bf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:55.571666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00802bbb-bae9-4824-9b62-71423137b0bf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:55.573224 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00802bbb-bae9-4824-9b62-71423137b0bf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834" status: 200 len: 1277 microversion: 2.47 time: 0.108100 Oct 28 13:21:55.574029 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2030/4147] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:21:55 2022] GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:21:55.749671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1421622068", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": "none"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:55.807504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:21:55.808128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:21:55.808598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:21:55.809005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:21:55.809414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:21:55.818669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:55.819190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:55.819633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:55.820332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:55.820784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:55.821204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:55.837773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Getting quotas for project 9b680155d34441a894c1520ecc27b58a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:21:55.843365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Getting quotas for user 496dc6b786604e2998a541bd39e5029c and project 9b680155d34441a894c1520ecc27b58a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:21:55.856682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:21:55.859022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:21:56.066516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ee86d716-cd8f-48c9-a410-3f5f44a7f162 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.321634 Oct 28 13:21:56.067497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2118/4148] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:21:56.079796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-229f7afb-7bff-44b3-9c8d-53cfd9c5b592 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:56.082380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-229f7afb-7bff-44b3-9c8d-53cfd9c5b592 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:56.130915 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-229f7afb-7bff-44b3-9c8d-53cfd9c5b592 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "PUT /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 992 microversion: 2.47 time: 0.056163 Oct 28 13:21:56.131616 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2031/4149] 10.222.0.25 () {62 vars in 1297 bytes} [Fri Oct 28 13:21:56 2022] PUT /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 992 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:21:56.154394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-654e8ede-51d0-44b0-a1b6-826e7739c87d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:56.156854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-654e8ede-51d0-44b0-a1b6-826e7739c87d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:56.255728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-654e8ede-51d0-44b0-a1b6-826e7739c87d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:56.265798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-654e8ede-51d0-44b0-a1b6-826e7739c87d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:56.273344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-654e8ede-51d0-44b0-a1b6-826e7739c87d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:56.276625 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-654e8ede-51d0-44b0-a1b6-826e7739c87d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1278 microversion: 2.47 time: 0.128738 Oct 28 13:21:56.279542 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2119/4150] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:21:56 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:21:56.345089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:56.347214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:56.357143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:56.360695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:56.360695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:56.361193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:56.363809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:56.364513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:56.569671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:56.581430 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ebd8853f-f9bd-46ba-bd5f-7212001dac1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.240242 Oct 28 13:21:56.588890 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2032/4151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:56 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:57.304841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c8df03f-4097-4832-bc86-077739bd4650 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:57.306048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c8df03f-4097-4832-bc86-077739bd4650 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:57.383749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c8df03f-4097-4832-bc86-077739bd4650 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:57.392375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c8df03f-4097-4832-bc86-077739bd4650 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:57.393949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c8df03f-4097-4832-bc86-077739bd4650 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:57.395200 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c8df03f-4097-4832-bc86-077739bd4650 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1278 microversion: 2.47 time: 0.094258 Oct 28 13:21:57.395889 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2120/4152] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:21:57 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:21:57.604934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:57.605575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:57.612979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:57.613471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:57.613911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:57.614610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:57.615123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:57.615552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:57.798488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:57.807707 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-db6cd863-8838-49a3-9303-90c47621056e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.206644 Oct 28 13:21:57.808312 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2033/4153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:57 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:57.872218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7f9d1960-5255-4be0-b1c7-a5ac57b573bf req-7dbe1ab3-a8ce-479d-a39c-d2bddf3ac9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7711abb9-22f7-431d-ac87-1b7bd5d6334c", "name": "network-vif-plugged", "status": "completed", "tag": "034d6bc4-26a7-422a-866f-b39b001987e1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:21:57.884828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7f9d1960-5255-4be0-b1c7-a5ac57b573bf req-7dbe1ab3-a8ce-479d-a39c-d2bddf3ac9fa service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:57.885306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7f9d1960-5255-4be0-b1c7-a5ac57b573bf req-7dbe1ab3-a8ce-479d-a39c-d2bddf3ac9fa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:57.885738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7f9d1960-5255-4be0-b1c7-a5ac57b573bf req-7dbe1ab3-a8ce-479d-a39c-d2bddf3ac9fa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:57.899618 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7f9d1960-5255-4be0-b1c7-a5ac57b573bf req-7dbe1ab3-a8ce-479d-a39c-d2bddf3ac9fa service nova] Creating event network-vif-plugged:034d6bc4-26a7-422a-866f-b39b001987e1 for instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c on n-h1-862876-2 Oct 28 13:21:57.912836 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7f9d1960-5255-4be0-b1c7-a5ac57b573bf req-7dbe1ab3-a8ce-479d-a39c-d2bddf3ac9fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047539 Oct 28 13:21:57.913467 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2121/4154] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:58.426955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:58.426955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:58.443565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:58.447425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:58.452029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:58.452029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:58.453089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:58.453735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:58.519115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:21:58.585104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:58.593220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:58.594941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:58.596100 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91134ed9-5b6d-496c-980d-5bdac5248c68 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1274 microversion: 2.47 time: 0.177997 Oct 28 13:21:58.598813 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2034/4155] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:21:58 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:21:58.833557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:58.834188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:58.841611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:58.842108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:58.842558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:58.843305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:58.843759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:58.844391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:59.004116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3aa4736-ccec-4470-83e6-d28fdd95ba2e tempest-ComputeTenantNetworksTest-754505653 tempest-ComputeTenantNetworksTest-754505653-project] Calling method '.version_select at 0x7f27b853a280>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:59.020538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:59.028510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08b2f2ff-06df-4b92-a063-7db316f4d56a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1313 microversion: 2.1 time: 0.198832 Oct 28 13:21:59.029146 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2035/4156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:21:58 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:21:59.226981 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3aa4736-ccec-4470-83e6-d28fdd95ba2e tempest-ComputeTenantNetworksTest-754505653 tempest-ComputeTenantNetworksTest-754505653-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.566252 Oct 28 13:21:59.227597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2122/4157] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 13:21:58 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:59.240218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cce01427-fc32-4fae-9654-1fe09646c9f0 tempest-ComputeTenantNetworksTest-754505653 tempest-ComputeTenantNetworksTest-754505653-project] Calling method '.version_select at 0x7f27b883f670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:59.357528 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cce01427-fc32-4fae-9654-1fe09646c9f0 tempest-ComputeTenantNetworksTest-754505653 tempest-ComputeTenantNetworksTest-754505653-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/7e1b2f04-4aa3-445d-885f-3fe7091f682b" status: 200 len: 139 microversion: 2.1 time: 0.122783 Oct 28 13:21:59.358120 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2036/4158] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:21:59 2022] GET /compute/v2.1/os-tenant-networks/7e1b2f04-4aa3-445d-885f-3fe7091f682b => generated 139 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:21:59.627965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:21:59.628770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:21:59.642183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:59.642183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:59.642183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:59.644571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:21:59.655654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:21:59.656147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:21:59.754759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:59.768944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:59.771153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:21:59.772604 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50185746-100d-4a50-886e-6ba1de644da4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1338 microversion: 2.47 time: 0.149247 Oct 28 13:21:59.773554 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2123/4159] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:21:59 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1338 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:00.053872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:00.055307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:00.069811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.072812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.074503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.076536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.078084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.078716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.229188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.237180 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-980a84db-76e7-4155-b8cc-031719fcd934 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1463 microversion: 2.1 time: 0.188933 Oct 28 13:22:00.237826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2037/4160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:00 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:00.256590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:00.261850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.262640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Searching by: {'deleted': False, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:22:00.266463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:00.269510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.270016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.270132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:00.270507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.271269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.272380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.272814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.277452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.277957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.278427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.279156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.279613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.280247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.302381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:22:00.335557 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fcf3b5d8-c6e2-4e16-8421-6e91afe0374d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.083071 Oct 28 13:22:00.336197 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2124/4161] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:22:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:00.350937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:00.355841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.356632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Searching by: {'deleted': False, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:22:00.361870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.362805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.363219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.363933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.364462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.369991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.389755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.397903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Old instance type m1.heat2, new instance type m1.heat {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 13:22:00.402982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:22:00.406129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:22:00.406562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:22:00.407116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:22:00.407523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:22:00.407996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:22:00.454986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.462593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.463168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.463602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.706274 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82088e82-4698-4ef2-aebc-cc98fd16ba6b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.358508 Oct 28 13:22:00.706909 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2125/4162] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:22:00 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:00.731027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54b579f8-4a97-4f09-914e-7ff8fbf71ba1 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:00.739027 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54b579f8-4a97-4f09-914e-7ff8fbf71ba1 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011989 Oct 28 13:22:00.739640 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2126/4163] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:22:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:22:00.800743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:00.801723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:00.809727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.810216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.810720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.811456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.811942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.812387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.894414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.904590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.906154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:00.907298 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f37240e4-6c8c-40f0-920a-17e6aace84a3 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1348 microversion: 2.47 time: 0.111098 Oct 28 13:22:00.907855 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2127/4164] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:00 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:00.927615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ec8db9e-f4b5-437d-a74e-a175933963a4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c/action" status: 202 len: 0 microversion: 2.1 time: 0.665379 Oct 28 13:22:00.931775 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2038/4165] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:22:00 2022] POST /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:22:00.955735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:00.957225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:00.965079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.965852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.972571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:00.982911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:00.983427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:00.983972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:01.128999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:01.129658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:01.139092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:01.139707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:01.140252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:01.141043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:01.141784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:01.145484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:01.149711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:01.154645 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb1ee467-7f35-40f4-89e5-d8f33a996137 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1472 microversion: 2.1 time: 0.211547 Oct 28 13:22:01.155341 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2128/4166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:00 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:01.179407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:22:01.695482 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-85138a5d-8cd4-4e20-b623-857d06042d66 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "DELETE /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 204 len: 0 microversion: 2.1 time: 0.570602 Oct 28 13:22:01.699107 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2039/4167] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:22:01 2022] DELETE /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:22:01.711061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:01.711768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:01.720157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:01.721262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:01.723196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:01.723196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:01.723461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:01.723881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:01.883831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:01.894460 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce37a3f7-0473-405f-b90f-eb79115283e8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1608 microversion: 2.1 time: 0.191543 Oct 28 13:22:01.895256 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2129/4168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:01 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1608 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:01.951596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:01.953353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:01.968646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:01.969161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:01.969601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:01.971710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:01.972379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:01.972820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:02.057452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:02.066856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:02.068315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:02.069465 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1336 microversion: 2.47 time: 0.127832 Oct 28 13:22:02.070033 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2040/4169] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:01 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:02.179030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:02.180002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:02.186106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:02.186594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:02.187076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:02.187773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:02.188226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:02.188887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:02.335085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:02.343018 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1472 microversion: 2.1 time: 0.167907 Oct 28 13:22:02.343593 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2130/4170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:02 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:02.604495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:02.604495 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001291 Oct 28 13:22:02.604495 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2041/4171] 10.222.0.25 () {56 vars in 886 bytes} [Fri Oct 28 13:22:02 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 13:22:02.612414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:02.614549 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003320 Oct 28 13:22:02.615289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2131/4172] 10.222.0.25 () {54 vars in 1035 bytes} [Fri Oct 28 13:22:02 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 28 13:22:02.622422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:02.623611 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57dccd44-88fb-4460-b761-7aedf4fc8ca2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 28 13:22:02.624249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2042/4173] 10.222.0.25 () {54 vars in 1041 bytes} [Fri Oct 28 13:22:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:02.632986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:02.634203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44545b86-841a-4522-965e-d21b29731a59 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001494 Oct 28 13:22:02.634554 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2132/4174] 10.222.0.25 () {56 vars in 886 bytes} [Fri Oct 28 13:22:02 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 13:22:02.921489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:02.922867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:02.942887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:02.943732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:02.944499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:02.946492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:02.947490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:02.948474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:03.097182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:03.098450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:03.103594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:03.108578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:03.109819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:03.110252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:03.111002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:03.111516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:03.111975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:03.121633 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c41024ef-49c9-46ba-b7a0-bd3dccdb23b8 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1608 microversion: 2.1 time: 0.205303 Oct 28 13:22:03.122229 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2043/4175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:02 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1608 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:03.191768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:03.200706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:03.202212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:03.203390 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81926282-f3e8-4892-bf5e-93aa50ad6cbf tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1336 microversion: 2.47 time: 0.110911 Oct 28 13:22:03.204277 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2133/4176] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:03 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:03.366852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:03.367486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:03.373696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:03.374226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:03.374678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:03.375423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:03.375885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:03.376319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:03.615749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:03.626190 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26ad4fd2-bbc9-47da-97ce-bdbe43525a73 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1472 microversion: 2.1 time: 0.263879 Oct 28 13:22:03.627568 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2044/4177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:03 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:04.145941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:04.147303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:04.154339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.154864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.155485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.156190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.156650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.157073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.231224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:04.231841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:04.235342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:04.239536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.240237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.240911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.241686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.242211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.242708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.246190 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17aef0fd-7dc1-4d19-af63-1a44d6ebeb55 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1540 microversion: 2.1 time: 0.105106 Oct 28 13:22:04.263772 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2134/4178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:04 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1540 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:04.358894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:04.367933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:04.369435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:04.370666 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-efd557a5-9da1-45ab-8638-09cef3474d83 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1357 microversion: 2.47 time: 0.143349 Oct 28 13:22:04.371572 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2045/4179] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:04 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:04.401013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:04.404792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:04.412695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.413260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.413695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.414396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.415126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.415552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.547051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:22:04.547660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:22:04.548422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:22:04.549195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:22:04.560077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:22:04.652204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:04.653773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:04.671995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.676241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.677201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.678843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.679555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.680304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.826525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:04.838779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:04.843447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.846021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.846917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.850592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.851351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.852007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.931276 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d2284c1-da87-4aec-b611-74ecf4721b9d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "POST /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79/action" status: 202 len: 1079 microversion: 2.47 time: 0.534703 Oct 28 13:22:04.932158 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2135/4180] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:22:04 2022] POST /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79/action => generated 1079 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 13:22:04.954038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:04.955202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:04.971467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.972410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.972410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:04.976617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:04.977117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:04.977893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:05.073849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:05.084467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:05.086491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:05.088093 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c6d0f48-1538-46c3-9d27-61dabb3a4d93 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.138677 Oct 28 13:22:05.088812 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2136/4181] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:04 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:05.188019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:05.198619 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1278eb54-9749-4a6e-b34f-f41660823fe2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1472 microversion: 2.1 time: 0.552190 Oct 28 13:22:05.216532 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2046/4182] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:04 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:05.279723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:05.279723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:05.280049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e5f367d1-0c47-482f-a262-ed4589b5cc00 req-b49298ad-6c81-41ec-9a2c-9d8a3e7e587a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f245ed-032b-4be2-b55f-4cdd987d4e22", "name": "network-vif-deleted", "tag": "669987fb-3926-40d0-91ad-0a12b50186d3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:05.290420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:05.290970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:05.291408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:05.292661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:05.293138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:05.293566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:05.316284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e5f367d1-0c47-482f-a262-ed4589b5cc00 req-b49298ad-6c81-41ec-9a2c-9d8a3e7e587a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:05.318495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e5f367d1-0c47-482f-a262-ed4589b5cc00 req-b49298ad-6c81-41ec-9a2c-9d8a3e7e587a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:05.319556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e5f367d1-0c47-482f-a262-ed4589b5cc00 req-b49298ad-6c81-41ec-9a2c-9d8a3e7e587a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:05.351592 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e5f367d1-0c47-482f-a262-ed4589b5cc00 req-b49298ad-6c81-41ec-9a2c-9d8a3e7e587a service nova] Creating event network-vif-deleted:669987fb-3926-40d0-91ad-0a12b50186d3 for instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 on n-h1-862876-2 Oct 28 13:22:05.358574 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e5f367d1-0c47-482f-a262-ed4589b5cc00 req-b49298ad-6c81-41ec-9a2c-9d8a3e7e587a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093482 Oct 28 13:22:05.361039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2137/4183] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:05.469020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:05.480895 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cbc580be-55e0-47e7-94d1-8d43b60ba939 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1540 microversion: 2.1 time: 0.211471 Oct 28 13:22:05.481805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2047/4184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:05 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1540 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:06.119546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:06.121029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:06.130001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:06.130678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:06.131282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:06.132145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:06.133021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:06.135592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:06.194220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:06.227302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:06.233844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:06.271277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:06.274568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:06.276920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:06.279907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:06.282713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:06.284026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:06.284495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:06.292340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:06.293794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:06.295009 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de61b2b3-3c2c-41ec-9198-f58d7ff7c61f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.180639 Oct 28 13:22:06.302364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2138/4185] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:06 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:06.409718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:06.509615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:06.511226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:06.519231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:06.519873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:06.520597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:06.521464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:06.523149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:06.523149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:06.562111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:06.574521 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3375ef5-ea3b-4d0d-958f-91dbf407d8f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1472 microversion: 2.1 time: 0.351882 Oct 28 13:22:06.575652 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2048/4186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:06 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:06.606053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:06.616332 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11277607-5df7-4a0b-9501-410f97b3138b tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1251 microversion: 2.1 time: 0.110551 Oct 28 13:22:06.618831 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2139/4187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:06 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1251 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:07.325676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:07.326301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:07.334141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:07.334643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:07.335295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:07.336040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:07.336524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:07.336960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:07.424458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:07.433118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:07.435422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:07.437533 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-579d2d03-2ed4-4942-9b26-79bcfd31668d tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.115836 Oct 28 13:22:07.443015 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2049/4188] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:07 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:07.600632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:07.601635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:07.609766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:07.610627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:07.612623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:07.613424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:07.613976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:07.614406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:07.644080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:07.644769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:07.651315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:07.651815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:07.652344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:07.653639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:07.654111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:07.654558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:07.748881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:07.759537 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-472cbd46-0c6a-4364-a03f-f966f58a0f2e tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1251 microversion: 2.1 time: 0.119996 Oct 28 13:22:07.760593 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2050/4189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:07 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1251 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:07.821154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:07.833311 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9637b1b-7d29-4dc4-9525-44840c2ba20d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.236150 Oct 28 13:22:07.833927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2140/4190] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:07 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:08.466679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:08.473544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:08.483201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:08.484081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:08.484747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:08.486025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:08.486989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:08.487762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:08.491499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:08.562059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:08.570823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:08.572351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:08.573762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c46dbc59-2a2d-48d4-baae-995d4f23715b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.111836 Oct 28 13:22:08.575221 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2051/4191] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:08 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:08.786224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:08.787609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:08.796376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:08.797138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:08.797686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:08.798515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:08.799148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:08.799675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:08.867777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:08.867777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:08.874795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:08.874795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:08.874795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:08.874795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:08.874795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:08.874795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:08.882224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:08.891235 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d6ce1e9c-488d-407f-ad63-37b00fb564e5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1251 microversion: 2.1 time: 0.108982 Oct 28 13:22:08.892342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2141/4192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:08 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1251 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:09.142173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:09.150426 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-29e21d92-fa55-47cf-8854-cabde19b0e6b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.296071 Oct 28 13:22:09.151044 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2052/4193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:08 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:09.600906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:09.601515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:09.611090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:09.612186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:09.612638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:09.613486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:09.613945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:09.614372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:09.699040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:09.707757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:09.709204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:09.710389 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3f9d340-7476-4d72-80d8-cf911a318537 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.113434 Oct 28 13:22:09.711277 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2142/4194] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:09 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:09.918861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:09.920036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:09.931873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:09.932911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:09.934604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:09.935797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:09.936545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:09.937135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:10.006639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:10.015211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f6477cd1-a227-4165-9655-7a39077ec4c5 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1251 microversion: 2.1 time: 0.102422 Oct 28 13:22:10.019358 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2053/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:09 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1251 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:10.173565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:10.174315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:10.181339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:10.181831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:10.182266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:10.183003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:10.183814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:10.184398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:10.377193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:10.397130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:10.404888 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b8fd5f4f-dae9-4dd8-852b-e8f4d0988582 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.235235 Oct 28 13:22:10.405548 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2143/4196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:10 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:10.737063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:10.737732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:10.744241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:10.744737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:10.745223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:10.746184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:10.746788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:10.747237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:10.817573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:10.829168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:10.832072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:10.833310 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eb43e4b2-d238-4fad-9ca3-4112a2181260 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.100687 Oct 28 13:22:10.834068 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2054/4197] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:10 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:11.042334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:11.043034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:11.045719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=18 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:11.051780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:11.052370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:11.052808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:11.053493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:11.053944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:11.054363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:11.137086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:11.148756 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd80d7fb-ad78-43a7-9459-b8058f665bfd tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1251 microversion: 2.1 time: 0.111920 Oct 28 13:22:11.150122 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2144/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:11 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1251 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:11.431837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:11.433554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:11.443974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:11.444818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:11.445403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:11.446426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:11.447058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:11.447647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:11.714595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:11.724563 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3045463-9909-47fa-95fd-9e151fbce87f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.298357 Oct 28 13:22:11.741464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2055/4199] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:11 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:11.863635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:11.863635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:11.871759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:11.872577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:11.873189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:11.873993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:11.874581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:11.875263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:11.950372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:11.961964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:11.978183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:11.980595 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8637f94a-9339-4b4e-8f5c-1f04b4734996 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.122971 Oct 28 13:22:11.990110 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2145/4200] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:11 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:12.173123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:12.174405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:12.182657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:12.183328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:12.183929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:12.184730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:12.185296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:12.185819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:12.227084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:12.228027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:12.228735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:12.229405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lazy-loading 'fault' on Instance uuid 05f245ed-032b-4be2-b55f-4cdd987d4e22 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:22:12.327674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6653382d9a254ea2a40a635083080f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653d6f1ee82e4ad79c52e6b10416b7cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:12.351749 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cc7405bc-e22d-46dc-b18f-5c6fc0ce9738 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 200 len: 1256 microversion: 2.1 time: 0.183131 Oct 28 13:22:12.360015 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2056/4201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:12 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 1256 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:12.752990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:12.753918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:12.772124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:12.772124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:12.772124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:12.772124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:12.774066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:12.774669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:12.952796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:12.961616 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-efba73a4-9e29-4524-b8ac-e2b782842ed6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.216728 Oct 28 13:22:12.962450 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2146/4202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:12 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:13.010253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:13.011022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:13.019371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:13.020182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:13.020773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:13.021645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:13.022103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:13.022532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:13.131954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:13.140823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:13.146972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:13.148701 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-317fe53a-abce-4209-9435-85cceb45913a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.143016 Oct 28 13:22:13.150145 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2057/4203] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:13 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:13.384060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:13.384673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] [instance: 05f245ed-032b-4be2-b55f-4cdd987d4e22] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:13.391407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:13.392068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:13.392705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:13.393702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:13.394345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:13.394974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:13.411145 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] HTTP exception thrown: Instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 could not be found. Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Request method failure captured: Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 HTTP/1.1 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9a4JFG-mFJwLyslmyXbVidASpxmLOaTTjSWDSZee5XygZUTrX9Z34iacS3b-B3HFx1SUsNO5KLomGkzHjShjbWsgVm3M_OdDkgiHNCoeR2c9eL7-yDnsv3yj4_Q8JOISH2_rwFSlkyO0yh45WVqihZTmkoVu3VZ3VZemg4mKT0pNhQ Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 653d6f1ee82e4ad79c52e6b10416b7cd Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestBootFromVolume-422142165 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/653d6f1ee82e4ad79c52e6b10416b7cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/653d6f1ee82e4ad79c52e6b10416b7cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_653d6f1ee82e4ad79c52e6b10416b7cd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/653d6f1ee82e4ad79c52e6b10416b7cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestBootFromVolume-422142165 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 653d6f1ee82e4ad79c52e6b10416b7cd Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestBootFromVolume-422142165 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestBootFromVolume-422142165-project Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6653382d9a254ea2a40a635083080f12 Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestBootFromVolume-422142165-project Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 could not be found. Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '05f245ed-032b-4be2-b55f-4cdd987d4e22'} Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 could not be found. Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 could not be found. Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:22:13.412812 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:22:13.416841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:13.416841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:22:13.416841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:22:13.416841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:22:13.416841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:22:13.416841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 could not be found. Oct 28 13:22:13.416841 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:22:13.419028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Returning 404 to user: Instance 05f245ed-032b-4be2-b55f-4cdd987d4e22 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:22:13.420124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e37f4e6a-c259-4915-abb4-30a83ddba773 tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22" status: 404 len: 111 microversion: 2.1 time: 0.040152 Oct 28 13:22:13.421242 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2147/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:13 2022] GET /compute/v2.1/servers/05f245ed-032b-4be2-b55f-4cdd987d4e22 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:22:13.432232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61f87241-cc96-400c-82b5-b77dddc87d2d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] Calling method '.version_select at 0x7f27b88d0d30>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:13.559209 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-61f87241-cc96-400c-82b5-b77dddc87d2d tempest-ServersTestBootFromVolume-422142165 tempest-ServersTestBootFromVolume-422142165-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451927692" status: 202 len: 0 microversion: 2.1 time: 0.133026 Oct 28 13:22:13.559805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2058/4205] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:22:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451927692 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:22:13.986793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:13.987720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:14.017750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:14.018378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:14.019010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:14.021303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:14.022419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:14.023757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:14.176684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:14.177991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:14.200040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:14.201598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:14.204563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:14.215186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:14.217889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:14.218367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:14.315592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:14.336568 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8918f2d3-d2db-4144-a486-362e0233c42d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.354712 Oct 28 13:22:14.339057 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2148/4206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:13 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:14.457552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:14.471376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:14.473555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:14.475036 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-43aa2ef6-8223-4c2f-8df0-ffd477411a81 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.303031 Oct 28 13:22:14.477480 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2059/4207] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:14 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:15.362707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:15.364187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:15.378459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:15.379300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:15.379905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:15.387727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:15.388992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:15.389712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:15.506594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:15.508240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:15.523698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:15.524466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:15.531431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:15.533185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:15.533858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:15.538070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:15.707644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:15.720086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:15.722522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:15.724611 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-89b7be36-dccf-4d93-9612-0112cb25f941 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.224189 Oct 28 13:22:15.744079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2060/4208] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:15 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:15.860353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:15.870735 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ea425d5-0d80-4253-be66-13c0712cc740 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.511870 Oct 28 13:22:15.876324 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2149/4209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:15 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:16.752030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:16.752733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:16.759773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:16.760258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:16.760876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:16.761574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:16.762139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:16.762752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:16.906350 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 13:22:16.906966 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:22:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c (ip 10.222.0.25) !!! Oct 28 13:22:16.907128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:16.921885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:16.923743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:16.926784 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b677e49e-58c8-4a80-ae51-3f24b6930504 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.178612 Oct 28 13:22:16.927361 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2061/4210] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:16 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:16.933936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:16.934574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:16.948831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:16.949329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:16.949774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:16.950533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:16.950978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:16.960444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:17.331873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:17.348974 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-69bad0dc-6c82-42e0-a981-0cbe86bdde20 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.447669 Oct 28 13:22:17.350139 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2150/4211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:16 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:17.956305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:17.957289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:17.968527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:17.971261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:17.971733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:17.973784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:17.979186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:17.979738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:18.076253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:18.091051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:18.092510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:18.093707 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-09b60dfb-7f6c-4578-83c6-7dfe5aefd1a0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.142782 Oct 28 13:22:18.107234 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2062/4212] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:17 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:18.375414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:18.377829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:18.387996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:18.388915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:18.394554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:18.394554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:18.394554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:18.394554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:18.620675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:18.629217 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f677ce2-1b57-4456-a4b6-e217f62ae415 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.260312 Oct 28 13:22:18.630806 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2151/4213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:18 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:19.125785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:19.126715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:19.134401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:19.134983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:19.135429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:19.136136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:19.136598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:19.137032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:19.212407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:19.221007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:19.222442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:19.223641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-36a580e6-ebac-4a87-bfe4-aea36ff3bf5b tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.101962 Oct 28 13:22:19.224205 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2063/4214] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:19 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:19.654206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:19.655552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:19.665352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:19.666033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:19.666479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:19.667653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:19.668123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:19.668712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:19.873030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:19.883227 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5906eb16-0dc7-44d1-9c11-ea09be7055e9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.233386 Oct 28 13:22:19.884607 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2152/4215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:19 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:20.210701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:20.215279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:20.225581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.226097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.226637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:20.227283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.229724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.230300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:20.252440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:20.256859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:20.268097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.269172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.269825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:20.270775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.271428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.272075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:20.393182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:20.407037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:20.407037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:20.407501 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da755123-1692-40d3-a9f5-ade60bf7d13a tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.161141 Oct 28 13:22:20.408166 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2153/4216] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:20 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:20.513682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:20.526098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:20.529603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:20.532137 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a4a0a8e-c9fa-485a-9a76-0052afd8b3ef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2952 microversion: 2.32 time: 0.871218 Oct 28 13:22:20.532810 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2064/4217] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:19 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2952 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:20.561284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:20.561781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:20.569776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.570479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.571098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:20.571947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.575739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.575739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:20.735705 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ac31be6-09aa-4c7b-9fe5-844539bfb9c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.178699 Oct 28 13:22:20.736312 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2154/4218] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Oct 28 13:22:20 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf/os-interface => generated 1830 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:20.917539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:20.918153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:20.924748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.925237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.925673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:20.928327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:20.928327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:20.928327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:21.071503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:21.079429 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3ca2cad6-903b-41a6-92c1-c23a326bae56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.165728 Oct 28 13:22:21.080498 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2065/4219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:20 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:21.437685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:21.437685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:21.444978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:21.445736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:21.446178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:21.446898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:21.447798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:21.448398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:21.549377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:21.553030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:21.558266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:21.561245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:21.573233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e7a1308-1cbe-4622-b5fd-1c22f1abfe05 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.132414 Oct 28 13:22:21.573233 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2155/4220] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:21 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:22.104256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:22.104867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:22.107580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:22.113398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:22.113885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:22.114317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:22.115035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:22.115490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:22.115910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:22.259312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:22.268231 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-514c7228-da72-4b0b-a83c-49eec04a8dd3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.168577 Oct 28 13:22:22.268805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2066/4221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:22 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:22.593918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:22.594533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:22.601752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:22.608564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:22.608564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:22.608564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:22.608564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:22.608564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:22.677156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:22.686726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:22.688682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:22.691357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fff95e1a-4fbc-46a6-9b75-673a357b7cee tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.101099 Oct 28 13:22:22.693103 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2156/4222] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:22 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:23.291506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:23.292183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:23.300585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:23.301066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:23.301502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:23.302197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:23.302648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:23.303147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:23.435971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:23.443812 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7ee406b-09dd-459b-b16f-1e218c612990 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1477 microversion: 2.1 time: 0.156146 Oct 28 13:22:23.444390 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2067/4223] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:23 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:23.722663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:23.729032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:23.731455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:23.732205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:23.732918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:23.733807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:23.734457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:23.735045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:24.013936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:24.023114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:24.024700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:24.025976 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2543865-4f52-46db-a419-3fe736a09cfa tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.308731 Oct 28 13:22:24.039400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2157/4224] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:23 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:24.469200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:24.472168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:24.482612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:24.488386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:24.488949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:24.490341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:24.491779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:24.492292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:24.538437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:24.811708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:24.820866 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-981112f6-c9a0-417c-9fb4-1b60381fb9cd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1476 microversion: 2.1 time: 0.356928 Oct 28 13:22:24.822642 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2068/4225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:24 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1476 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:25.052786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:25.053395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:25.061250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:25.062097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:25.062505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:25.063289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:25.063857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:25.064662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:25.198669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:25.211085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:25.213538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:25.216578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-137d134f-d7ba-4e05-bca8-0f489156daed tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.167943 Oct 28 13:22:25.217878 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2158/4226] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:25 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:25.855311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:25.855936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:25.863594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:25.869866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:25.869866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:25.869866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:25.869866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:25.869866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:26.027219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:26.048001 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1edf0f69-eefe-4c9f-9628-dd6fc10c80ff tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1474 microversion: 2.1 time: 0.196894 Oct 28 13:22:26.048688 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2069/4227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:25 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1474 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:26.248438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:26.249069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:26.257713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:26.258576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:26.259294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:26.260465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:26.261170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:26.261827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:26.341623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:26.350576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:26.353015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:26.354207 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-673044ac-c07b-498b-bcfb-b46ab91667f9 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.110192 Oct 28 13:22:26.354734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2159/4228] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:26 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:27.074385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:27.075046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:27.084875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:27.085388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:27.085822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:27.086529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:27.097606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:27.097606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:27.382991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:27.383441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:27.394696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:27.395441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:27.395928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:27.396661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:27.397120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:27.397550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:27.633447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:27.652321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:27.654373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:27.656594 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da3d7dbd-3374-4e5c-a795-2874db5d0a43 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.277592 Oct 28 13:22:27.658061 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2160/4229] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:27 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:27.906472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-bc4702e3-1280-48fd-8b9a-15bdac737ac4 req-eda9f962-7809-42c4-8dec-fd75e4984cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7711abb9-22f7-431d-ac87-1b7bd5d6334c", "name": "network-vif-unplugged", "status": "completed", "tag": "034d6bc4-26a7-422a-866f-b39b001987e1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:27.925137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bc4702e3-1280-48fd-8b9a-15bdac737ac4 req-eda9f962-7809-42c4-8dec-fd75e4984cad service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:27.926685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bc4702e3-1280-48fd-8b9a-15bdac737ac4 req-eda9f962-7809-42c4-8dec-fd75e4984cad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:27.928314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-bc4702e3-1280-48fd-8b9a-15bdac737ac4 req-eda9f962-7809-42c4-8dec-fd75e4984cad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:27.952210 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-bc4702e3-1280-48fd-8b9a-15bdac737ac4 req-eda9f962-7809-42c4-8dec-fd75e4984cad service nova] Creating event network-vif-unplugged:034d6bc4-26a7-422a-866f-b39b001987e1 for instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c on n-h1-862876-2 Oct 28 13:22:27.961191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-bc4702e3-1280-48fd-8b9a-15bdac737ac4 req-eda9f962-7809-42c4-8dec-fd75e4984cad service nova] Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:22:27.971598 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-bc4702e3-1280-48fd-8b9a-15bdac737ac4 req-eda9f962-7809-42c4-8dec-fd75e4984cad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068687 Oct 28 13:22:27.972949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2161/4230] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:22:28.053752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:28.076604 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ecdd716a-e9ab-4d73-99f7-5bf81c691508 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1474 microversion: 2.1 time: 1.006794 Oct 28 13:22:28.078980 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2070/4231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:27 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1474 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:28.689636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:28.690965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:28.711735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:28.712588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:28.713200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:28.714482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:28.714992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:28.715599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:28.795886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:28.808773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:28.817158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:28.818307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ebe142b8-2c43-4c84-a9cf-94cfcb6981b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.134165 Oct 28 13:22:28.819436 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2162/4232] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:28 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:29.106087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:29.106087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:29.116200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.119535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.120328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.121793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.123312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.125598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.429319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:29.438232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-529d6e44-082d-4b8d-923c-1b768639f535 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1471 microversion: 2.1 time: 0.341547 Oct 28 13:22:29.456265 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2071/4233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:29 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:29.466185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:29.466720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:29.480839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.481491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.481934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.482641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.487322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.488450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.797973 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2846cac7-c6f0-4380-b350-7b3b14e5f429 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c/action" status: 204 len: 0 microversion: 2.1 time: 0.335708 Oct 28 13:22:29.799593 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2163/4234] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:22:29 2022] POST /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c/action => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:22:29.809871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:29.810627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:29.821226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.828286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.829022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.832274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.832951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.833548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.854361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:29.855388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:29.869378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.870390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.870985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.871667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:29.879388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:29.880074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:29.999456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:30.010392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:30.012207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:30.014659 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5282e10-5d31-4c5c-88f5-3e013dda9366 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.165890 Oct 28 13:22:30.032070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2164/4235] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:29 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:30.253515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:30.264112 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-904e27e2-4793-4d99-b6c1-0aa43d22cd17 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1471 microversion: 2.1 time: 0.459203 Oct 28 13:22:30.274079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2072/4236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:29 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:31.043219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:31.044430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:31.052891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:31.053649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:31.054364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:31.055294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:31.056026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:31.056664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:31.207056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:31.226396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:31.229332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:31.232060 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b7acc65-9614-4146-b019-37f55db913bc tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1366 microversion: 2.47 time: 0.192903 Oct 28 13:22:31.234677 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2165/4237] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:31 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:31.310634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:31.313187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:31.332932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:31.333732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:31.335008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:31.338888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:31.339553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:31.340398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:31.584413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:31.643690 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0074fe06-530c-4874-9e02-c2ba2783023b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1471 microversion: 2.1 time: 0.347619 Oct 28 13:22:31.649671 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2073/4238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:31 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1471 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:31.956543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ee02499f-ff7e-4fdf-b598-a1308ae55d6b req-5006ce9d-ab17-440f-9907-77626c2d125f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7711abb9-22f7-431d-ac87-1b7bd5d6334c", "name": "network-vif-plugged", "status": "completed", "tag": "034d6bc4-26a7-422a-866f-b39b001987e1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:32.003284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ee02499f-ff7e-4fdf-b598-a1308ae55d6b req-5006ce9d-ab17-440f-9907-77626c2d125f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:32.006637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ee02499f-ff7e-4fdf-b598-a1308ae55d6b req-5006ce9d-ab17-440f-9907-77626c2d125f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:32.006637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ee02499f-ff7e-4fdf-b598-a1308ae55d6b req-5006ce9d-ab17-440f-9907-77626c2d125f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:32.048529 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ee02499f-ff7e-4fdf-b598-a1308ae55d6b req-5006ce9d-ab17-440f-9907-77626c2d125f service nova] Creating event network-vif-plugged:034d6bc4-26a7-422a-866f-b39b001987e1 for instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c on n-h1-862876-2 Oct 28 13:22:32.063537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-ee02499f-ff7e-4fdf-b598-a1308ae55d6b req-5006ce9d-ab17-440f-9907-77626c2d125f service nova] Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:22:32.070869 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ee02499f-ff7e-4fdf-b598-a1308ae55d6b req-5006ce9d-ab17-440f-9907-77626c2d125f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119372 Oct 28 13:22:32.072634 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2166/4239] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:32.275493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:32.276350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:32.283699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:32.284355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:32.284964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:32.285817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:32.287044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:32.287734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:32.468107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:32.491333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:32.496256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:32.498237 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-84853af9-8140-4433-9680-7fed3d5ce360 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1384 microversion: 2.47 time: 0.232590 Oct 28 13:22:32.499257 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2074/4240] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:32 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1384 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:32.682006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:32.688117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:32.693542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:32.697900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:32.698094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:32.698710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:32.700156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:32.700751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:32.945102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:32.963190 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-391a5143-f260-482a-b8a3-c5effdfdb488 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1463 microversion: 2.1 time: 0.280684 Oct 28 13:22:32.964539 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2167/4241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:32 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:32.991077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:32.991869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:32.999419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:33.000344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:33.000786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:33.001525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:33.006489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:33.008977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:33.328648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:33.346291 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd24614e-d656-424b-913e-fa81422d10dd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1463 microversion: 2.1 time: 0.360544 Oct 28 13:22:33.347283 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2075/4242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:32 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1463 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:33.379178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cc6e11d2-3caf-4191-af0b-b737a3ad012d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'create', calling method: .version_select at 0x7f27b854e4c0>, body: {"keypair": {"name": "tempest-keypair-90065786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCggEFXMo8MMwIYFxAcvgU46BscEi2CMsuRc3eH2eT3A5rw3ngckbipU+V1wjBO5OFBVjs5Uqi/OmU5ak38Ol72PFIdGyP4zOEqQCDetIgIEUVIidOez0TmDWXqe9RHoGQ=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:33.420555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-cc6e11d2-3caf-4191-af0b-b737a3ad012d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for project 08c125dbce0f4df8bd795a00b219487c. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:22:33.435278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-cc6e11d2-3caf-4191-af0b-b737a3ad012d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for user c3852e30767345639ee5d92350d2950a and project 08c125dbce0f4df8bd795a00b219487c. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:22:33.526460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:33.528084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:33.537712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:33.538465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:33.539317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:33.540245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:33.540892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:33.541598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:33.590909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cc6e11d2-3caf-4191-af0b-b737a3ad012d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.219589 Oct 28 13:22:33.591534 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2168/4243] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:22:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:33.634160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:33.659181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:33.661028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:33.662462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95df9a04-9e0a-443a-8368-83c99a5f9958 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1372 microversion: 2.47 time: 0.140183 Oct 28 13:22:33.663468 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2076/4244] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:33 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1372 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:34.691892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:34.692509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:34.707436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:34.715212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:34.715759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:34.726572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:34.727204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:34.727655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:34.857360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:34.871941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:34.873388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:34.874587 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e1f4a61-c58d-4be4-aaa8-0179752df8b7 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1357 microversion: 2.47 time: 0.189025 Oct 28 13:22:34.884030 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2169/4245] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:34 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:34.906804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:34.912371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:34.913273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Searching by: {'deleted': False, 'project_id': '9b680155d34441a894c1520ecc27b58a'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:22:34.930055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:34.930564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:34.931027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:34.931794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:34.932223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:34.934729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:35.115334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:22:35.226933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:35.235294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:35.236068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:35.236666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:35.254989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:35.257502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:35.522086 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b886982-ad72-4e12-b979-4df787aef5d1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.619145 Oct 28 13:22:35.522682 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2077/4246] 10.222.0.25 () {60 vars in 1187 bytes} [Fri Oct 28 13:22:34 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:35.556847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:35.557362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:35.565227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:35.567251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:35.567848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:35.569189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:35.569817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:35.570251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:35.600905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:22:36.055564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-726093c6-0bae-4693-993e-94bddd3f4d06 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "DELETE /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 204 len: 0 microversion: 2.47 time: 0.502297 Oct 28 13:22:36.060646 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2170/4247] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:22:35 2022] DELETE /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:22:36.069205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:36.070122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:36.086970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:36.087724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:36.088204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:36.088943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:36.089400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:36.105367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:36.337290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:36.350157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:36.351912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:36.353322 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f56e208f-83dc-41e9-9898-84a193d02b6f tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1363 microversion: 2.47 time: 0.291090 Oct 28 13:22:36.354355 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2078/4248] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:36 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:37.384226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:37.386963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:37.414516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:37.415214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:37.415663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:37.419777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:37.424586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:37.425116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:37.482375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:37.718059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:37.730331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:37.737589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:37.740638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a6a55ce-343f-487c-9fda-d38f4b45fdd1 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1363 microversion: 2.47 time: 0.362547 Oct 28 13:22:37.764555 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2171/4249] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:37 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:38.222644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59cfeccb-90bb-430b-8678-9367261857c1 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '.version_select at 0x7f27b88e1940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:38.229192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cfeccb-90bb-430b-8678-9367261857c1 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:38.229910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cfeccb-90bb-430b-8678-9367261857c1 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:38.231331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59cfeccb-90bb-430b-8678-9367261857c1 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:38.260378 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59cfeccb-90bb-430b-8678-9367261857c1 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.041265 Oct 28 13:22:38.272042 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2079/4250] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:22:38 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:38.301820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea1790b1-37aa-411e-b653-b4a4947b4264 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:38.320115 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea1790b1-37aa-411e-b653-b4a4947b4264 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031468 Oct 28 13:22:38.337178 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2172/4251] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:22:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:38.337550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-620abd55-4ed6-4609-a725-1a7e72a3baf2 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-329072343", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:38.499680 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-620abd55-4ed6-4609-a725-1a7e72a3baf2 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.170506 Oct 28 13:22:38.500176 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2080/4252] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Oct 28 13:22:38 2022] POST /compute/v2.1/flavors => generated 498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:22:38.529186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-95597fb7-30f4-417c-ae0e-b1bfe02aba63 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:38.558206 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-95597fb7-30f4-417c-ae0e-b1bfe02aba63 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035070 Oct 28 13:22:38.559044 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2173/4253] 10.222.0.25 () {58 vars in 1182 bytes} [Fri Oct 28 13:22:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:22:38.773299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:38.774250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:38.783725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:38.786005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:38.790641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:38.792370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:38.793015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:38.793604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:38.830272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-505561736", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "148d627b-1bde-4839-9a23-ae59f3454702"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:38.938139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:38.939435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:38.940020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:38.940672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lazy-loading 'fault' on Instance uuid 00677a1f-3cba-4c74-8b03-85c28e493a79 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:22:38.959870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:22:39.243199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:39.257978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:39.265038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:39.266432 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28c30fb2-c033-40a5-8b1d-4315a2e9d6b0 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 200 len: 1368 microversion: 2.47 time: 0.499679 Oct 28 13:22:39.268760 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2081/4254] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:38 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 1368 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:39.452090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:22:39.452764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:22:39.453395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:22:39.453983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:22:39.454429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:22:39.476696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:39.476696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:39.477115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:39.477857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:39.478312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:39.482614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:39.527742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:22:39.531343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:39.538553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for user c3852e30767345639ee5d92350d2950a and project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:22:39.555836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:22:39.558397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:22:39.817373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9bee820f-c558-4e8e-b29a-4372378b90ed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991863 Oct 28 13:22:39.824306 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2174/4255] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:22:39.829694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57079864-8086-46cd-95d5-d82533b6d9c9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:39.830580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-57079864-8086-46cd-95d5-d82533b6d9c9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:39.953313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-57079864-8086-46cd-95d5-d82533b6d9c9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:39.964290 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57079864-8086-46cd-95d5-d82533b6d9c9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1278 microversion: 2.1 time: 0.139027 Oct 28 13:22:39.967169 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2082/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:39 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:40.192256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1175679781", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "29084255-b567-4665-aa20-c93928c0e825"}, {"uuid": "eb4c870a-1349-4158-8ba7-07977f3419f2"}, {"uuid": "29084255-b567-4665-aa20-c93928c0e825"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:40.302984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:40.302984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: 00677a1f-3cba-4c74-8b03-85c28e493a79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:40.324471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] validate_networks() for [('29084255-b567-4665-aa20-c93928c0e825', None, None, None, None, None), ('eb4c870a-1349-4158-8ba7-07977f3419f2', None, None, None, None, None), ('29084255-b567-4665-aa20-c93928c0e825', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:22:40.354005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:40.359189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:40.359871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:40.366169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:40.366169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:40.366169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:40.396461 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] HTTP exception thrown: Instance 00677a1f-3cba-4c74-8b03-85c28e493a79 could not be found. Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Request method failure captured: Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 HTTP/1.1 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9dyVXKa_3cqiBsjOzP9Y5_BxPdgzVdA3Ov3aMjn2oXeBUpJJsnaSEKtK25AyZKbmTXAYxUB6aG8AwylA-f7NzrKxu3ssULFHhgDkOC67NPk_UQ7_qk7kNTpCiSG1xUGa_si9AN9mGvzoanpicRa4KOHpj2oXPaa7VZjhQY6gBYFJII Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 9b680155d34441a894c1520ecc27b58a Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerShowV247Test-2003905304 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b680155d34441a894c1520ecc27b58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b680155d34441a894c1520ecc27b58a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9b680155d34441a894c1520ecc27b58a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9b680155d34441a894c1520ecc27b58a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerShowV247Test-2003905304 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 9b680155d34441a894c1520ecc27b58a Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerShowV247Test-2003905304 Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerShowV247Test-2003905304-project Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 496dc6b786604e2998a541bd39e5029c Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerShowV247Test-2003905304-project Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 00677a1f-3cba-4c74-8b03-85c28e493a79 could not be found. Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '00677a1f-3cba-4c74-8b03-85c28e493a79'} Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00677a1f-3cba-4c74-8b03-85c28e493a79 could not be found. Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00677a1f-3cba-4c74-8b03-85c28e493a79 could not be found. Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:22:40.399149 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00677a1f-3cba-4c74-8b03-85c28e493a79 could not be found. Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:40.404042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Returning 404 to user: Instance 00677a1f-3cba-4c74-8b03-85c28e493a79 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:22:40.408381 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f0156ab1-14de-474a-a58f-be00e17c0357 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79" status: 404 len: 111 microversion: 2.47 time: 0.107842 Oct 28 13:22:40.409443 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2083/4257] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:40 2022] GET /compute/v2.1/servers/00677a1f-3cba-4c74-8b03-85c28e493a79 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:22:40.417565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:40.418151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:40.425188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:40.425790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:40.426312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:40.429420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:40.429957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:40.432709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:40.468285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:22:40.935073 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-79564775-36d5-4845-be53-2583d384b0a2 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834" status: 204 len: 0 microversion: 2.47 time: 0.521186 Oct 28 13:22:40.939995 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2084/4258] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:22:40 2022] DELETE /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 13:22:40.950240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:40.952779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:40.959883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:40.963979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:40.965297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:40.966215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:40.966958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:40.971245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:41.107443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:41.114367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:41.117130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:41.123335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:41.129107 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7bf3b28-7afa-43c0-a3d8-626a8e4bfd14 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834" status: 200 len: 1362 microversion: 2.47 time: 0.183229 Oct 28 13:22:41.129872 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2085/4259] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:40 2022] GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:41.134654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c46a9990-1fc6-400e-94d7-d1d75aaa0beb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:41.135298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c46a9990-1fc6-400e-94d7-d1d75aaa0beb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:41.310959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c46a9990-1fc6-400e-94d7-d1d75aaa0beb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:41.324990 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c46a9990-1fc6-400e-94d7-d1d75aaa0beb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1278 microversion: 2.1 time: 0.192888 Oct 28 13:22:41.327284 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2086/4260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:41 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:42.157685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:42.158597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:42.178626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:22:42.179769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:22:42.180363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:22:42.181026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:22:42.181565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:22:42.183479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:42.186031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:42.186513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:42.191357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:42.192004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:42.192455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:42.206886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:42.208622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:42.209368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:42.210280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:42.210960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:42.211488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:42.259830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Getting quotas for project 08327cee9e9b485c934663e9348ece89. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:22:42.272420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Getting quotas for user 19e7bc5dab534d4ebb98469e3d630162 and project 08327cee9e9b485c934663e9348ece89. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:22:42.335619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:22:42.338457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:22:42.473365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:42.487663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:42.487663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:42.488497 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0f87e5b-ca26-43a5-8e90-ff9ac2de86c4 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834" status: 200 len: 1362 microversion: 2.47 time: 0.335698 Oct 28 13:22:42.505911 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2087/4261] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:42 2022] GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:42.530052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:42.531590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:42.568046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:42.568574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:42.573963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a998a6a-0677-4195-b597-7747de639174 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.389717 Oct 28 13:22:42.599903 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2175/4262] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:22:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:22:42.600473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:42.601442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:42.601934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:42.602447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:42.606339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6783c24-cb11-45a4-a87b-472cbf0f16b8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:42.612791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6783c24-cb11-45a4-a87b-472cbf0f16b8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:42.788824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6783c24-cb11-45a4-a87b-472cbf0f16b8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:42.807031 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6783c24-cb11-45a4-a87b-472cbf0f16b8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1213 microversion: 2.1 time: 0.197647 Oct 28 13:22:42.823325 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2176/4263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:42 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:42.840840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:42.851106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a94bbcd5-a29f-4119-b55c-7c90bd1a0883 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1274 microversion: 2.1 time: 0.343962 Oct 28 13:22:42.855414 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2088/4264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:42 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:43.553759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:43.554993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:43.566245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:43.569822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:43.570458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:43.571377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:43.574153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:43.574916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:43.684477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:43.691031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:43.692997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:43.697115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lazy-loading 'fault' on Instance uuid af0e6b85-b94f-421d-8e00-0885f52f4834 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:22:43.799905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:43.838676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad985767-7aa3-4653-8347-0897a125c84c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:43.840375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ad985767-7aa3-4653-8347-0897a125c84c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:43.849056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:43.859828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:43.862152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2fe7b441-a646-4453-a324-02191be9d7c8 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834" status: 200 len: 1367 microversion: 2.47 time: 0.312678 Oct 28 13:22:43.868960 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2177/4265] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:43 2022] GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:43.886166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:43.890691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:43.915631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:43.916417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:43.917400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:43.919954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:43.920438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:43.922291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:44.081497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:44.092624 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-02a008b0-bdc9-4360-aef9-f2d0e8653192 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1330 microversion: 2.1 time: 0.210256 Oct 28 13:22:44.103380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad985767-7aa3-4653-8347-0897a125c84c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:44.114950 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad985767-7aa3-4653-8347-0897a125c84c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1213 microversion: 2.1 time: 0.289287 Oct 28 13:22:44.118249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2178/4266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:43 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1330 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:44.118512 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2089/4267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:43 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1213 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:44.905940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:44.906546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:44.916980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:44.920035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:44.920943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:44.921822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:44.927464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:44.928108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:45.056011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:45.056774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:45.057480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:45.058675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lazy-loading 'fault' on Instance uuid af0e6b85-b94f-421d-8e00-0885f52f4834 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:22:45.121551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:45.122104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:45.124894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:45.135983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:45.136965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:45.139864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:45.141179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:45.142695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:45.148325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:45.148867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:45.150907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:45.153634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496dc6b786604e2998a541bd39e5029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b680155d34441a894c1520ecc27b58a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:45.158500 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eddd636f-f341-491e-95d0-0d9c19d21027 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834" status: 200 len: 1367 microversion: 2.47 time: 0.253408 Oct 28 13:22:45.170770 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2179/4268] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:44 2022] GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:45.172404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:45.175719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:45.190383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:45.192638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:45.203328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:45.206780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:45.207502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:45.208211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:45.332700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:45.340878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abd3193c-9418-4347-afd8-5b36336c1118 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1336 microversion: 2.1 time: 0.225021 Oct 28 13:22:45.341468 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2090/4269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:45 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1336 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:45.666306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:45.684652 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a058c2e2-9d11-4b86-a180-bc807116c045 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1217 microversion: 2.1 time: 0.522096 Oct 28 13:22:45.687493 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2180/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:45 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1217 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:46.193788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:46.195648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] [instance: af0e6b85-b94f-421d-8e00-0885f52f4834] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:46.218718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:46.218718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:46.218718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:46.218718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:46.219100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:46.223655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:46.293744 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] HTTP exception thrown: Instance af0e6b85-b94f-421d-8e00-0885f52f4834 could not be found. Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Request method failure captured: Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 HTTP/1.1 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9dyVXKa_3cqiBsjOzP9Y5_BxPdgzVdA3Ov3aMjn2oXeBUpJJsnaSEKtK25AyZKbmTXAYxUB6aG8AwylA-f7NzrKxu3ssULFHhgDkOC67NPk_UQ7_qk7kNTpCiSG1xUGa_si9AN9mGvzoanpicRa4KOHpj2oXPaa7VZjhQY6gBYFJII Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 9b680155d34441a894c1520ecc27b58a Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerShowV247Test-2003905304 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b680155d34441a894c1520ecc27b58a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b680155d34441a894c1520ecc27b58a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9b680155d34441a894c1520ecc27b58a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9b680155d34441a894c1520ecc27b58a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerShowV247Test-2003905304 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 9b680155d34441a894c1520ecc27b58a Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerShowV247Test-2003905304 Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerShowV247Test-2003905304-project Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 496dc6b786604e2998a541bd39e5029c Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerShowV247Test-2003905304-project Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance af0e6b85-b94f-421d-8e00-0885f52f4834 could not be found. Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'af0e6b85-b94f-421d-8e00-0885f52f4834'} Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af0e6b85-b94f-421d-8e00-0885f52f4834 could not be found. Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af0e6b85-b94f-421d-8e00-0885f52f4834 could not be found. Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:22:46.302489 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:46.307302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:22:46.307302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:22:46.307302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:22:46.307302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:22:46.307302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:22:46.307302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af0e6b85-b94f-421d-8e00-0885f52f4834 could not be found. Oct 28 13:22:46.307302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:22:46.310193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] Returning 404 to user: Instance af0e6b85-b94f-421d-8e00-0885f52f4834 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:22:46.311563 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83fb01ad-22f1-4d11-9fe9-fcc9931a1829 tempest-ServerShowV247Test-2003905304 tempest-ServerShowV247Test-2003905304-project] 10.222.0.25 "GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834" status: 404 len: 111 microversion: 2.47 time: 0.123002 Oct 28 13:22:46.317841 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2091/4271] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:46 2022] GET /compute/v2.1/servers/af0e6b85-b94f-421d-8e00-0885f52f4834 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:22:46.365563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:46.366174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:46.383940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:46.389820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:46.390547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:46.396593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:46.397564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:46.398686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:46.711576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:46.723771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:46.739911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:46.741306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:46.743336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:46.749400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:46.749400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:46.749400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:47.062034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:47.077070 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-797a7332-f98a-468e-84aa-0d6227dbc085 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1273 microversion: 2.1 time: 0.365227 Oct 28 13:22:47.077739 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2092/4272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:46 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:47.422194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:47.441581 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0ee538d-4984-47a3-a821-16b604b7c957 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1378 microversion: 2.1 time: 1.079897 Oct 28 13:22:47.461004 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2181/4273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:46 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1378 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:48.104515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:48.105702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:48.140646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:48.159054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:48.159765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:48.160710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:48.166662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:48.178529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:48.256197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-00bf2889-d07b-43dd-8d73-306e99556395 req-dd64cac2-a35f-429b-a88f-739545e86e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabb1b52-6f7c-45f9-a776-f88ddc095395", "tag": "70f775a5-4719-44ae-8dd6-fea5f71db071"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:48.284794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-00bf2889-d07b-43dd-8d73-306e99556395 req-dd64cac2-a35f-429b-a88f-739545e86e50 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:48.285252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-00bf2889-d07b-43dd-8d73-306e99556395 req-dd64cac2-a35f-429b-a88f-739545e86e50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:48.288886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-00bf2889-d07b-43dd-8d73-306e99556395 req-dd64cac2-a35f-429b-a88f-739545e86e50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:48.336516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-00bf2889-d07b-43dd-8d73-306e99556395 req-dd64cac2-a35f-429b-a88f-739545e86e50 service nova] Creating event network-changed:70f775a5-4719-44ae-8dd6-fea5f71db071 for instance dabb1b52-6f7c-45f9-a776-f88ddc095395 on n-h2-862876-2 Oct 28 13:22:48.361844 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-00bf2889-d07b-43dd-8d73-306e99556395 req-dd64cac2-a35f-429b-a88f-739545e86e50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112291 Oct 28 13:22:48.366027 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2182/4274] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:22:48.467693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:48.468383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:48.483174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:48.484233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:48.486979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:48.487936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:48.488562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:48.490777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:48.513427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:48.526807 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd95c4c3-24dd-4f80-9438-660bb7d11c7d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1271 microversion: 2.1 time: 0.424730 Oct 28 13:22:48.528079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2093/4275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:48 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1271 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:49.007629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:49.026329 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eec9fb56-19dd-4b44-9c0b-d87e0cb9d054 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1378 microversion: 2.1 time: 0.552783 Oct 28 13:22:49.029837 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2183/4276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:48 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1378 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:49.557051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:49.558053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:49.570709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:49.571238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:49.571682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:49.572398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:49.572857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:49.573312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:49.815545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:49.827273 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dbe0ec94-e72b-4fea-9485-94da1bcc84fb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1271 microversion: 2.1 time: 0.274014 Oct 28 13:22:49.831631 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2094/4277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:49 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:50.045797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:50.046396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:50.056539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:50.060417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:50.061041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:50.063529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:50.064345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:50.067015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:50.372334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:50.379365 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17bc5947-1e15-405d-966f-236b1c28090a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1378 microversion: 2.1 time: 0.337478 Oct 28 13:22:50.401182 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2184/4278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:50 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1378 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:50.682938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-11162836", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": "none"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:50.772290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:22:50.772778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:22:50.773247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:22:50.773663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:22:50.777649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:22:50.783745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:50.784234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:50.784678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:50.785414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:50.785857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:50.786460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:50.804453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Getting quotas for project 71e0d7eb4b6a43e58c869de2fe1389af. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:22:50.810025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Getting quotas for user 85b8080d7d134fed9ed3fd745fd00b7b and project 71e0d7eb4b6a43e58c869de2fe1389af. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:22:50.823041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:22:50.826013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:22:50.854209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:50.854893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:50.863562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:50.864160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:50.864602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:50.865763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:50.866226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:50.866653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:50.962213 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4f96060a-ded5-4f94-a090-6239371712c2 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.472706 Oct 28 13:22:50.963144 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2095/4279] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:22:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:22:50.976151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e58fe35a-8030-4c9c-b7cf-9b39dde769b0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:50.976774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e58fe35a-8030-4c9c-b7cf-9b39dde769b0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:51.083090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e58fe35a-8030-4c9c-b7cf-9b39dde769b0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:51.093556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e58fe35a-8030-4c9c-b7cf-9b39dde769b0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:51.099123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e58fe35a-8030-4c9c-b7cf-9b39dde769b0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:51.100396 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e58fe35a-8030-4c9c-b7cf-9b39dde769b0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1276 microversion: 2.57 time: 0.129023 Oct 28 13:22:51.103009 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2096/4280] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:50 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:51.127593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:51.145794 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c3690ff-eb32-47e9-aa05-800d3678ffac tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1313 microversion: 2.1 time: 0.296032 Oct 28 13:22:51.165909 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2185/4281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:50 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:51.403236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:51.404224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:51.424473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:51.425063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:51.425519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:51.426268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:51.426728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:51.427175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:51.708419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:51.722325 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-730bf9e6-1265-4883-a664-5efed60f2352 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1378 microversion: 2.1 time: 0.322878 Oct 28 13:22:51.730276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2097/4282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:51 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1378 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:52.129675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-def9e405-9a9e-42ac-a729-9ad324de2df3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:52.130237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-def9e405-9a9e-42ac-a729-9ad324de2df3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:52.178303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:52.179608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:52.195045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:52.195547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:52.195978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:52.198502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:52.202092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:52.202791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:52.230546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-def9e405-9a9e-42ac-a729-9ad324de2df3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:52.247971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:52.255799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-def9e405-9a9e-42ac-a729-9ad324de2df3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:52.258394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-def9e405-9a9e-42ac-a729-9ad324de2df3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:52.260117 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-def9e405-9a9e-42ac-a729-9ad324de2df3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1276 microversion: 2.57 time: 0.134647 Oct 28 13:22:52.261224 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2186/4283] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:52 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:52.495861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:52.510665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-85aa3fa2-e650-4f5d-9f4e-779f57c0de29 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1313 microversion: 2.1 time: 0.337713 Oct 28 13:22:52.511386 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2098/4284] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:52 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:52.748704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:52.749487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:52.768934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:52.773062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:52.774049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:52.775105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:52.775780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:52.776560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:53.080312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:53.089274 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88bff1dd-b2bf-478b-b40c-0c6a70d2c5ec tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1378 microversion: 2.1 time: 0.343831 Oct 28 13:22:53.090181 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2187/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:52 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1378 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:53.289904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:53.291254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:53.303757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:53.305400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:53.305400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:53.306619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:53.307293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:53.307916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:53.467736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:53.484368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:53.487472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:53.489134 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec37a93a-d530-40c3-bbdf-df7194fbb7d5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1272 microversion: 2.57 time: 0.205137 Oct 28 13:22:53.491471 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2099/4286] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:53 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:53.538068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:53.539285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:53.552759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:53.554489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:53.556582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:53.557532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:53.557991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:53.558428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:53.796251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:53.806390 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ee7874dd-ef5f-4390-994d-63152ee8aa2a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1334 microversion: 2.1 time: 0.274499 Oct 28 13:22:53.807763 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2188/4287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:53 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1334 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:54.113556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:54.114605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:54.116661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:54.123692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:54.126494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:54.130739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:54.131530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:54.132012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:54.134899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:54.470599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:54.492146 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0195fd1f-3781-4fc5-80fb-2258a43e690e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1378 microversion: 2.1 time: 0.373455 Oct 28 13:22:54.492146 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2100/4288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:54 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1378 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:54.520501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:54.521706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:54.530726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:54.531487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:54.532237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:54.533168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:54.533795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:54.534449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:54.685775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:54.706270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:54.711331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:54.712843 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d51acfe-ff8d-4095-896a-f491d7bbfff6 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1336 microversion: 2.57 time: 0.199734 Oct 28 13:22:54.713845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2189/4289] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:54 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1336 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:54.832887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:54.841622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:54.841622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:54.841622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:54.841622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:54.842814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:54.843496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:54.844152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:54.880306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5ce9f4c2-f30f-4642-b9d9-cb4a50adda74 req-39dbf5ca-d4fd-46a6-b4b2-aa421b4a3e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabb1b52-6f7c-45f9-a776-f88ddc095395", "name": "network-vif-plugged", "status": "completed", "tag": "70f775a5-4719-44ae-8dd6-fea5f71db071"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:54.902281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ce9f4c2-f30f-4642-b9d9-cb4a50adda74 req-39dbf5ca-d4fd-46a6-b4b2-aa421b4a3e8c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:54.905942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ce9f4c2-f30f-4642-b9d9-cb4a50adda74 req-39dbf5ca-d4fd-46a6-b4b2-aa421b4a3e8c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:54.906642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ce9f4c2-f30f-4642-b9d9-cb4a50adda74 req-39dbf5ca-d4fd-46a6-b4b2-aa421b4a3e8c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:54.926931 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5ce9f4c2-f30f-4642-b9d9-cb4a50adda74 req-39dbf5ca-d4fd-46a6-b4b2-aa421b4a3e8c service nova] Creating event network-vif-plugged:70f775a5-4719-44ae-8dd6-fea5f71db071 for instance dabb1b52-6f7c-45f9-a776-f88ddc095395 on n-h2-862876-2 Oct 28 13:22:54.948272 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5ce9f4c2-f30f-4642-b9d9-cb4a50adda74 req-39dbf5ca-d4fd-46a6-b4b2-aa421b4a3e8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068262 Oct 28 13:22:54.949642 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2190/4290] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:22:55.146385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:55.160636 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0dadff93-052d-4ffc-b671-e20f0dc5288b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.332548 Oct 28 13:22:55.167434 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2101/4291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:54 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:55.508032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:55.509171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:55.517356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:55.518093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:55.518532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:55.519286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:55.519770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:55.525421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:55.681705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-23466449-32fb-410c-8076-5ded199b61d4 req-448aaf77-ff50-46b1-a706-9dc42ad16e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "tag": "5f319c6d-48a9-4e33-b7d2-d090da053b03"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:55.705995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-23466449-32fb-410c-8076-5ded199b61d4 req-448aaf77-ff50-46b1-a706-9dc42ad16e00 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:55.707130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-23466449-32fb-410c-8076-5ded199b61d4 req-448aaf77-ff50-46b1-a706-9dc42ad16e00 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:55.709344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-23466449-32fb-410c-8076-5ded199b61d4 req-448aaf77-ff50-46b1-a706-9dc42ad16e00 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:55.743409 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-23466449-32fb-410c-8076-5ded199b61d4 req-448aaf77-ff50-46b1-a706-9dc42ad16e00 service nova] Creating event network-changed:5f319c6d-48a9-4e33-b7d2-d090da053b03 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:22:55.749909 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-23466449-32fb-410c-8076-5ded199b61d4 req-448aaf77-ff50-46b1-a706-9dc42ad16e00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073660 Oct 28 13:22:55.753915 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2102/4292] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:22:55.759960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:55.762182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:55.770555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:55.771119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:55.771556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:55.772257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:55.772956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:55.773383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:55.828429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:55.837653 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-342c45b4-03d7-4c8d-9083-a1a6fb966d00 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1378 microversion: 2.1 time: 0.333991 Oct 28 13:22:55.840608 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2191/4293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:55 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1378 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:55.913397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:55.923884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:55.928137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:55.929591 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30f1e751-85ee-4253-b05a-ab351dfd24fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1334 microversion: 2.57 time: 0.174532 Oct 28 13:22:55.948036 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2103/4294] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:55 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1334 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:56.185043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:56.185293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:56.210391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:56.210908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:56.211540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:56.216972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:56.217625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:56.218209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:56.570927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:56.588606 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87b673bd-19f1-4158-a4e6-4433dba4c53e tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.407718 Oct 28 13:22:56.600944 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2192/4295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:56 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:56.866138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:56.866138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:56.885299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:56.886095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:56.887623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:56.890081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:56.890997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:56.891810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:56.964385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:56.965545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:56.983581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:56.984088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:56.984549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:56.985849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:56.986302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:56.986811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:57.340965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:57.342785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2a7ea401-5fbd-4956-ab17-d8f66ea25f2d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1528 microversion: 2.1 time: 0.481565 Oct 28 13:22:57.343389 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2104/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:56 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1528 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:57.370996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:57.371167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:57.387564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:57.388279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:57.389867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:57.390870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:57.392468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:57.399119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:57.582547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:57.597882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:57.599638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:57.600815 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c90366a-9ab7-4478-bd55-e62461501c4e tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1334 microversion: 2.57 time: 0.640408 Oct 28 13:22:57.607877 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2193/4297] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:56 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1334 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:22:57.631435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:57.632100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:57.632797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:57.641705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:57.644930 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5764146b-48e8-4fb1-80e5-c88630297a4e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1528 microversion: 2.1 time: 0.277187 Oct 28 13:22:57.645657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:57.646263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:57.646896 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2105/4298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:57 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1528 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:57.648351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:57.651093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:57.653503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:57.668528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9ec34b3-1eb2-4247-80d3-5a081da3217c tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:57.702635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:57.806598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9ec34b3-1eb2-4247-80d3-5a081da3217c tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/148d627b-1bde-4839-9a23-ae59f3454702" status: 202 len: 0 microversion: 2.1 time: 0.142241 Oct 28 13:22:57.807240 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2106/4299] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:22:57 2022] DELETE /compute/v2.1/flavors/148d627b-1bde-4839-9a23-ae59f3454702 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:22:57.815238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54c8454d-2511-4597-9a72-c23863ee27ab tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:57.871030 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54c8454d-2511-4597-9a72-c23863ee27ab tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059453 Oct 28 13:22:57.871971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2107/4300] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:22:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:57.892763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:57.895386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:57.908272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:57.908686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:57.909497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:57.909836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:57.927910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:57.928436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:57.967272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:57.968473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:57.983375 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-71670d53-51e9-4678-a5f2-36f9a6c57b0d tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.349279 Oct 28 13:22:57.984249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2194/4301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:57 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:57.987527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Old instance type tempest-test_resize_flavor_-329072343, new instance type m1.heat {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 13:22:57.996903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:22:57.997371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:22:57.997887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:22:58.006349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:22:58.006349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:22:58.052087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:22:58.151502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-224094ac-fc37-4101-9ed1-cd6a012c4a10 req-74ab1a1f-a67c-405d-8255-3c797c45c2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "tag": "0da07d7c-bc0e-449e-9e9f-a6b0a3823b03"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:58.171646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-224094ac-fc37-4101-9ed1-cd6a012c4a10 req-74ab1a1f-a67c-405d-8255-3c797c45c2b0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:58.172249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-224094ac-fc37-4101-9ed1-cd6a012c4a10 req-74ab1a1f-a67c-405d-8255-3c797c45c2b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:58.172957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-224094ac-fc37-4101-9ed1-cd6a012c4a10 req-74ab1a1f-a67c-405d-8255-3c797c45c2b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:58.184826 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-224094ac-fc37-4101-9ed1-cd6a012c4a10 req-74ab1a1f-a67c-405d-8255-3c797c45c2b0 service nova] Creating event network-changed:0da07d7c-bc0e-449e-9e9f-a6b0a3823b03 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:22:58.190907 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-224094ac-fc37-4101-9ed1-cd6a012c4a10 req-74ab1a1f-a67c-405d-8255-3c797c45c2b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043407 Oct 28 13:22:58.191713 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2195/4302] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:22:58.254269 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd6a3ccb-9e81-4a1e-977e-76fc7e0ed068 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395/action" status: 202 len: 0 microversion: 2.1 time: 0.368174 Oct 28 13:22:58.258058 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2108/4303] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:22:57 2022] POST /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:22:58.264069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:58.264779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:58.272009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:58.272507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:58.272942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:58.273653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:58.274110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:58.274539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:58.628731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:58.629357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:58.637836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:58.638254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:58.642223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:58.643243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:58.644071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:58.644513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:58.717024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:58.728191 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6849f2fc-b690-4850-98fc-bed0dca5f412 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1537 microversion: 2.1 time: 0.468330 Oct 28 13:22:58.729763 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2196/4304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:58 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1537 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:22:58.794807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:58.814412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:58.818319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:58.820386 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a24645ed-9136-4d6a-b9ca-0569870bae4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1355 microversion: 2.57 time: 0.195094 Oct 28 13:22:58.833481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2109/4305] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:58 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1355 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:58.849131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:22:58.852632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:58.859275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:58.859917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:58.860455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:58.861274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:58.861912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:58.862469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:58.982730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:22:58.983852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:22:58.985138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:22:58.987669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:22:58.990130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:22:59.019139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:59.019139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:59.028049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.029069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.029939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:59.031282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.032253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.032837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:59.304075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:59.312539 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ae44f403-b9f0-4d9d-bed7-4777f9656480 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.302944 Oct 28 13:22:59.313835 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2110/4306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:59 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:22:59.342293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:59.349898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.350639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.351266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:59.351815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.352735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.353365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:59.432198 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1cc5115f-f625-4dc7-87f8-e6a2ad49f3dc tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "POST /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79/action" status: 202 len: 1136 microversion: 2.57 time: 0.587784 Oct 28 13:22:59.449426 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2197/4307] 10.222.0.25 () {62 vars in 1320 bytes} [Fri Oct 28 13:22:58 2022] POST /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79/action => generated 1136 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 13:22:59.464834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:59.466396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:59.480299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.481845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.482656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:59.484782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.485740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.486856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:59.616192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:59.625377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:59.626961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:22:59.628271 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c315f10d-dede-43bf-9cbf-38e6cc7a5a3a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.173099 Oct 28 13:22:59.628908 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2111/4308] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:22:59 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:22:59.760566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:22:59.761537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:22:59.784298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.784939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.785488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:22:59.786221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:22:59.786682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:22:59.787202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:00.146503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:00.155594 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ec7c0ba-4f53-433e-9c8c-fcca5d8b09e7 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1537 microversion: 2.1 time: 0.407781 Oct 28 13:23:00.157732 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2198/4309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:22:59 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1537 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:00.233564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7f73a952-ae67-4676-90e0-f277eee8e7a8 req-293f5469-eec0-4bdf-8fce-3a049e375bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "tag": "002df4bc-e508-4413-b74b-aa7b70107153"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:00.244647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7f73a952-ae67-4676-90e0-f277eee8e7a8 req-293f5469-eec0-4bdf-8fce-3a049e375bcd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:00.245242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7f73a952-ae67-4676-90e0-f277eee8e7a8 req-293f5469-eec0-4bdf-8fce-3a049e375bcd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:00.249745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7f73a952-ae67-4676-90e0-f277eee8e7a8 req-293f5469-eec0-4bdf-8fce-3a049e375bcd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:00.259900 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7f73a952-ae67-4676-90e0-f277eee8e7a8 req-293f5469-eec0-4bdf-8fce-3a049e375bcd service nova] Creating event network-changed:002df4bc-e508-4413-b74b-aa7b70107153 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:23:00.281092 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7f73a952-ae67-4676-90e0-f277eee8e7a8 req-293f5469-eec0-4bdf-8fce-3a049e375bcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052044 Oct 28 13:23:00.284633 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2112/4310] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:00.340010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:00.340674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:00.350347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:00.353035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:00.355597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:00.358396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:00.358894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:00.359481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:00.661579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:00.662577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:00.671210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:00.671774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:00.672230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:00.673013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:00.673574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:00.674007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:00.697398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:00.711687 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-316289ba-610d-4c90-b2d3-16ac6e4ccba5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.377182 Oct 28 13:23:00.712932 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2199/4311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:00 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:00.765774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:00.774507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:00.776093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:00.777486 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-384d2d3e-4d90-4396-804b-15cd63bd49a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.123924 Oct 28 13:23:00.791401 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2113/4312] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:00 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:01.182488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:01.183771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:01.193175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:01.193945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:01.194490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:01.195481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:01.196173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:01.196908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:01.493747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:01.503598 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-487b2aae-d906-4111-87a7-f30a5698170c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1537 microversion: 2.1 time: 0.325283 Oct 28 13:23:01.504313 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2200/4313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:01 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1537 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:01.742397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:01.743541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:01.746812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:01.749159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=16 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:01.760559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:01.761284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:01.763528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:01.764817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:01.767551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:01.771464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:01.804631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:01.805916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:01.813345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:01.814962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:01.815936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:01.817697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:01.818408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:01.819243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:01.955307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:01.966652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:01.968218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:01.970704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c19cf676-6c1e-4acd-a316-d0b1cb5ebfa5 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.170240 Oct 28 13:23:01.984125 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2201/4314] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:01 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:02.051146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:02.060342 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c03a2e92-8b46-4421-be7a-fe570bd331d0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.324005 Oct 28 13:23:02.063657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2114/4315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:01 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:02.527939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:02.529445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:02.535433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=20 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:02.536904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:02.537864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:02.538304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:02.539070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:02.539892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:02.540326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:02.676003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:02.684164 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6379a2c-f537-4f53-abaa-3e163a39817a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1537 microversion: 2.1 time: 0.160622 Oct 28 13:23:02.685169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2202/4316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:02 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:02.997547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:02.998263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:03.006237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:03.006850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:03.007363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:03.008132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:03.008664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:03.009093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:03.082337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:03.090048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:03.091430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:03.092875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:03.094097 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8a9dc800-b019-4ff6-8d35-f6ea30e27bf0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.100577 Oct 28 13:23:03.095299 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2115/4317] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:02 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:03.111370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:03.111370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:03.111370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:03.111370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:03.111370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:03.111370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:03.111370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:03.417901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:03.425964 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94c29d3c-a08f-4915-89d9-d99099c9c5d5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.339994 Oct 28 13:23:03.427206 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2203/4318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:03 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:03.708598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:03.709235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:03.715508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:03.716224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:03.716825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:03.717747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:03.718379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:03.718830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:04.124261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:04.125868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:04.127004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:04.135870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:04.139989 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7c3ac47-8975-4a9c-be3a-f0587f43f522 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1537 microversion: 2.1 time: 0.433789 Oct 28 13:23:04.139989 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2116/4319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:03 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1537 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:04.158444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:04.159182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:04.160054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:04.160535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:04.163717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:04.258912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:04.268765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:04.270396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:04.271681 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5f8be2e-38c9-45ff-b1f2-1252b8dbecfd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.153406 Oct 28 13:23:04.272439 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2204/4320] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:04 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:04.458515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:04.458515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:04.464424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:04.465798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:04.466251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:04.467008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:04.467470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:04.467898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:04.753620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:04.766935 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fe1a39f5-d55a-4824-b5e9-d80592f43609 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.314401 Oct 28 13:23:04.768082 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2117/4321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:04 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:05.164887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:05.166739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:05.179282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:05.186081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:05.188168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:05.188168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:05.188168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:05.188563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:05.298982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:05.304723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:05.319760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:05.323240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:05.324496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:05.328176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:05.330156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:05.332559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:05.434392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:05.443041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:05.444731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:05.446121 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b5ba371-5ef3-4a80-8c53-1f7ab7b4cbb0 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.152750 Oct 28 13:23:05.447226 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2118/4322] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:05 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:05.450398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:05.458672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46c4def1-5b7b-4d9e-bddc-4398498e9b2c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.299815 Oct 28 13:23:05.459452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2205/4323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:05 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:05.792039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:05.792561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:05.798874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:05.799376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:05.799805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:05.800513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:05.801108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:05.803914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:06.017086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:06.028704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f235f33c-6739-4a41-9f5d-58d245b1c7ba tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.239163 Oct 28 13:23:06.030412 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2119/4324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:05 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:06.476598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:06.477105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:06.488654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:06.489982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:06.497422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:06.500141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:06.500674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:06.501104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:06.501842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:06.502446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:06.503343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:06.503945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:06.504859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:06.505441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:06.506053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:06.509462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:06.628130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:06.637516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:06.639365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:06.640544 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f9f61d9-3cfc-48b7-b197-cab1644ed49b tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.168181 Oct 28 13:23:06.641220 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2206/4325] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:06 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:06.819254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:06.830582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06fd71ef-341a-41d6-886f-7ef42ba0658f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.346036 Oct 28 13:23:06.839498 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2120/4326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:06 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:07.052554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:07.057016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:07.060204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:07.061715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:07.062443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:07.063129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:07.064068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:07.064732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:07.065403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:07.275847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:07.286007 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8800c229-34db-4b6a-aa32-3afc3882098c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.237208 Oct 28 13:23:07.287202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2207/4327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:07 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:07.676789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:07.678482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:07.689796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:07.690962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:07.692065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:07.692810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:07.693280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:07.693716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:07.814647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:07.825412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:07.826922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:07.828233 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0d354ac6-5a44-45c8-8c90-74c0457fdc7c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.159720 Oct 28 13:23:07.829392 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2121/4328] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:07 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:07.855797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:07.857110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:07.865748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:07.866337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:07.866914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:07.867915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:07.868658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:07.869100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:08.021827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:08.033260 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9b8154d-7286-4cee-a9c4-a484524660ab tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.181920 Oct 28 13:23:08.034476 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2208/4329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:07 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:08.309943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:08.310634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:08.317509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:08.321386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:08.321386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:08.321386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:08.321713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:08.321916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:08.573746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:08.584961 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-438f6fb2-a00f-48b9-831f-bf9ae36761c8 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.279196 Oct 28 13:23:08.586194 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2122/4330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:08 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:08.854566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:08.856428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:08.886732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:08.888202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:08.890100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:08.892638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:08.895241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:08.895659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:09.013336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:09.024629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:09.027397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:09.029141 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f6ad278-db16-4401-a120-f803c3bffa38 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.178535 Oct 28 13:23:09.030506 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2123/4331] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:08 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:09.058680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:09.059670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:09.074054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:09.075516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:09.078089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:09.081263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:09.083551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:09.084291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:09.164400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4bacdb16-cc92-45ec-987c-139258fcfae6 req-9b96c3a2-31a1-4b63-ad27-6cb90ab31c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "name": "network-vif-plugged", "status": "completed", "tag": "0da07d7c-bc0e-449e-9e9f-a6b0a3823b03"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:09.186265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4bacdb16-cc92-45ec-987c-139258fcfae6 req-9b96c3a2-31a1-4b63-ad27-6cb90ab31c62 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:09.188959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4bacdb16-cc92-45ec-987c-139258fcfae6 req-9b96c3a2-31a1-4b63-ad27-6cb90ab31c62 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:09.188959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4bacdb16-cc92-45ec-987c-139258fcfae6 req-9b96c3a2-31a1-4b63-ad27-6cb90ab31c62 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:09.210920 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4bacdb16-cc92-45ec-987c-139258fcfae6 req-9b96c3a2-31a1-4b63-ad27-6cb90ab31c62 service nova] Creating event network-vif-plugged:0da07d7c-bc0e-449e-9e9f-a6b0a3823b03 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:23:09.219290 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4bacdb16-cc92-45ec-987c-139258fcfae6 req-9b96c3a2-31a1-4b63-ad27-6cb90ab31c62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.392942 Oct 28 13:23:09.220152 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2209/4332] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:09.331664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:09.340503 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31112b79-50ab-449f-8773-dc481cf02466 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.285743 Oct 28 13:23:09.344433 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2124/4333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:09 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:09.614046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:09.615342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:09.626462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:09.626951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:09.627412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:09.628142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:09.628602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:09.629026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:09.644682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:09.863486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:09.878656 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-16cea792-7ac8-4e1b-aa0c-eb2887f59504 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.270575 Oct 28 13:23:09.889601 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2210/4334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:09 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:10.055734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:10.056346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:10.063961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:10.064440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:10.065041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:10.065731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:10.066182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:10.066632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:10.082791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:10.134115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:10.142789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:10.144289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:10.145462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0fd71d2b-aa13-44e2-b099-e7ca289be693 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.093685 Oct 28 13:23:10.146058 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2125/4335] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:10 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:10.368132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:10.368835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:10.375093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:10.375614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:10.376046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:10.376728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:10.377179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:10.377614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:10.566476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:10.574692 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e009588e-7712-4c4b-800e-68d794d8fea9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.211523 Oct 28 13:23:10.582378 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2211/4336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:10 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:10.902849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:10.903658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:10.910094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:10.910973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:10.911494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:10.912353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:10.913044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:10.913527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:11.172995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:11.173530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:11.184787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:11.185166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:11.185804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:11.186852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:11.187665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:11.188251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:11.196140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:11.214762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5d65226-4c9e-4c48-b5e1-a99d4cfc04af tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.315937 Oct 28 13:23:11.217818 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2126/4337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:10 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:11.276429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:11.285021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8c25fc31-94fc-4e16-b1cc-81400534c36a req-e7cc9e25-d2c5-490a-927e-6e051a420256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "name": "network-vif-plugged", "status": "completed", "tag": "5f319c6d-48a9-4e33-b7d2-d090da053b03"}, {"server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "name": "network-vif-plugged", "status": "completed", "tag": "002df4bc-e508-4413-b74b-aa7b70107153"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:11.295002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c25fc31-94fc-4e16-b1cc-81400534c36a req-e7cc9e25-d2c5-490a-927e-6e051a420256 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:11.295716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c25fc31-94fc-4e16-b1cc-81400534c36a req-e7cc9e25-d2c5-490a-927e-6e051a420256 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:11.296317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c25fc31-94fc-4e16-b1cc-81400534c36a req-e7cc9e25-d2c5-490a-927e-6e051a420256 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:11.297814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:11.304925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:11.307349 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c87831f5-aabd-4909-9f25-11494901ff4f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.139002 Oct 28 13:23:11.307966 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2212/4338] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:11 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:11.313904 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8c25fc31-94fc-4e16-b1cc-81400534c36a req-e7cc9e25-d2c5-490a-927e-6e051a420256 service nova] Creating event network-vif-plugged:5f319c6d-48a9-4e33-b7d2-d090da053b03 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:23:11.314653 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8c25fc31-94fc-4e16-b1cc-81400534c36a req-e7cc9e25-d2c5-490a-927e-6e051a420256 service nova] Creating event network-vif-plugged:002df4bc-e508-4413-b74b-aa7b70107153 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:23:11.323348 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8c25fc31-94fc-4e16-b1cc-81400534c36a req-e7cc9e25-d2c5-490a-927e-6e051a420256 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042092 Oct 28 13:23:11.324693 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2127/4339] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:23:11.600046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:11.601411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:11.609611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:11.610395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:11.610859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:11.611727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:11.612658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:11.613244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:11.773434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:11.781967 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54452a27-4d11-4669-8e1c-86e47b2a7f12 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.186315 Oct 28 13:23:11.782566 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2213/4340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:11 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:12.248227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:12.248949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:12.257665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:12.258310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:12.258783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:12.259499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:12.259964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:12.263053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:12.338555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:12.340036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:12.359081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:12.360544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:12.362116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:12.363189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:12.363892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:12.364654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:12.437334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:12.452775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:12.454196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:12.455221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:12.456648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c0628ea-1901-4c4e-84ea-1d12bd2bed5a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.123079 Oct 28 13:23:12.470782 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71b9d945-5d83-4f23-9587-1e6f01c30d5a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1355 microversion: 2.1 time: 0.226959 Oct 28 13:23:12.471214 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2214/4341] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:12 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:12.472955 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2128/4342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:12 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1355 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:12.805712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:12.806345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:12.813015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:12.813809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:12.814246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:12.815071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:12.815464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:12.815888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:12.965774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:12.974791 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4bd02626-87af-45ca-aaf5-4b7d788947f6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.173150 Oct 28 13:23:12.976634 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2215/4343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:12 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:13.484581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:13.485981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:13.494353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.495119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.495749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.496655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.497181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.497678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.499272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:13.499881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:13.507378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.507884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.508339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.512806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.512806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.512806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.576350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:13.587861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:13.589518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:13.590782 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fbf6be01-c200-42a0-9f69-3e03d3adb25a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.110982 Oct 28 13:23:13.591352 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2129/4344] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:13 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:13.690016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:13.698341 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9eec071e-c64c-42fd-8a29-04beec714e73 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1804 microversion: 2.1 time: 0.203018 Oct 28 13:23:13.699005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2216/4345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:13 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1804 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:13.723056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:13.723904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:13.731899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.732500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.732933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.733626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.734080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.734579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.758963 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71b3817a-a3e0-4f46-8045-b3a76dc0e4f3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f/ips" status: 200 len: 217 microversion: 2.1 time: 0.040757 Oct 28 13:23:13.759557 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2130/4346] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:23:13 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f/ips => generated 217 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:13.772189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:13.772681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:13.778678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.779191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.779627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.780291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:13.780738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:13.781153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:13.806558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:23:13.998682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:13.999262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:14.005633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:14.006117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:14.006568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:14.007269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:14.007725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:14.008181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:14.153807 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b2b1d35-13c9-4b6e-b48c-60143c7e531a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 204 len: 0 microversion: 2.1 time: 0.385201 Oct 28 13:23:14.160563 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2217/4347] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:23:13 2022] DELETE /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:23:14.168939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:14.171443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:14.178643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:14.179909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:14.180502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:14.181536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:14.182224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:14.183339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:14.188554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:14.201512 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf9f55cd-a684-45c3-8feb-ea3037658de5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.206667 Oct 28 13:23:14.202090 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2131/4348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:13 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:14.412383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:14.420566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94afc975-a6bb-40df-82a3-e2fb2c2b6090 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1810 microversion: 2.1 time: 0.258654 Oct 28 13:23:14.421286 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2218/4349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:14 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1810 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:14.617761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:14.618936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:14.627013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:14.627517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:14.627979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:14.628670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:14.629122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:14.629539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:14.701264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:14.712732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:14.714869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:14.716365 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d51d8a53-6666-4fbd-be97-cd06db619a74 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.102652 Oct 28 13:23:14.718170 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2132/4350] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:14 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:15.233362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:15.234601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:15.255050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:15.255576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:15.256203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:15.257118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:15.257580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:15.258179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:15.448367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:15.449408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:15.458911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:15.460454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:15.463138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:15.464946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:15.466076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:15.466914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:15.527231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:15.559558 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1520e6fa-3aed-4ec6-9932-4e2cc93679b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.335947 Oct 28 13:23:15.561197 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2219/4351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:15 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:15.725447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:15.736009 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c1d793e-5476-4aa3-aa6e-94c48ae5b3a3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1810 microversion: 2.1 time: 0.291856 Oct 28 13:23:15.740641 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2133/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:15 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1810 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:15.745550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:15.746171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:15.752789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:15.753480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:15.754086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:15.755118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:15.755722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:15.756330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:15.856266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:15.865229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:15.866693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:15.868017 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01bbcd8b-7633-4fd1-962c-aab82955fd0a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.126580 Oct 28 13:23:15.875850 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2220/4353] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:15 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:16.514352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0fef311b-85fc-4abf-90d3-08b37fbfdc11 req-5e3660fa-efc7-4048-bf05-45267a6aecbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "name": "network-vif-deleted", "tag": "002df4bc-e508-4413-b74b-aa7b70107153"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:16.524871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0fef311b-85fc-4abf-90d3-08b37fbfdc11 req-5e3660fa-efc7-4048-bf05-45267a6aecbd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:16.525682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0fef311b-85fc-4abf-90d3-08b37fbfdc11 req-5e3660fa-efc7-4048-bf05-45267a6aecbd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:16.526113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0fef311b-85fc-4abf-90d3-08b37fbfdc11 req-5e3660fa-efc7-4048-bf05-45267a6aecbd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:16.539997 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0fef311b-85fc-4abf-90d3-08b37fbfdc11 req-5e3660fa-efc7-4048-bf05-45267a6aecbd service nova] Creating event network-vif-deleted:002df4bc-e508-4413-b74b-aa7b70107153 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:23:16.552690 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0fef311b-85fc-4abf-90d3-08b37fbfdc11 req-5e3660fa-efc7-4048-bf05-45267a6aecbd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037174 Oct 28 13:23:16.552690 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2134/4354] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:16.600243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:16.602302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:16.630655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:16.631122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:16.639411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:16.640455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:16.641536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:16.643056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:16.771203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:16.771993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:16.781344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:16.781828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:16.782269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:16.782998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:16.783459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:16.783997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:16.942503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:16.951071 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1deaf1ae-58d8-46b9-8559-e762396bb1b0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.370403 Oct 28 13:23:16.951922 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2221/4355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:16 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:16.956393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:16.957618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:16.958433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:16.965665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:16.965827 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0610043d-6e6c-4389-9d4e-b5dcf8146db6 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1674 microversion: 2.1 time: 0.199044 Oct 28 13:23:16.966736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:16.968151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2135/4356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:16 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:16.969919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:16.983859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:16.985528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:16.986013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:17.079210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:17.090276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:17.092199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:17.093388 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9e450b89-79a4-4442-a4ab-21ab20efdd28 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.140321 Oct 28 13:23:17.094951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2222/4357] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:16 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:18.002772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:18.004081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:18.006201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:18.006504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:18.027164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:18.027638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:18.041992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:18.041992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:18.041992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:18.041992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:18.042416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:18.042416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:18.042416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:18.042416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:18.042767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:18.042767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:18.170039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:18.196845 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3fa8c52-e4f9-4255-9cec-8677e9c45bda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1611 microversion: 2.1 time: 0.205791 Oct 28 13:23:18.197447 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2223/4358] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:17 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1611 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:18.209682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:18.223590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:18.240572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:18.243026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:18.243615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:18.244926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:18.246639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:18.247396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:18.378528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:18.381598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:18.386936 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dee2d244-285d-4025-b217-2a9965c9c484 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.396355 Oct 28 13:23:18.392198 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2136/4359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:17 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:18.392926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:18.394560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:18.395864 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5289b268-cfc8-427e-80ce-a70d097abd3f tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.193299 Oct 28 13:23:18.410220 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2224/4360] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:18 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:18.576823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e88ed433-608d-49b5-bb16-85b50a754657 req-c6e8fee6-951a-483a-be45-42917ced42db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "name": "network-vif-deleted", "tag": "0da07d7c-bc0e-449e-9e9f-a6b0a3823b03"}, {"server_uuid": "4c3f1c2d-64af-4612-b57a-d59438fc342f", "name": "network-vif-deleted", "tag": "5f319c6d-48a9-4e33-b7d2-d090da053b03"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:18.587535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e88ed433-608d-49b5-bb16-85b50a754657 req-c6e8fee6-951a-483a-be45-42917ced42db service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:18.588039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e88ed433-608d-49b5-bb16-85b50a754657 req-c6e8fee6-951a-483a-be45-42917ced42db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:18.591218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e88ed433-608d-49b5-bb16-85b50a754657 req-c6e8fee6-951a-483a-be45-42917ced42db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:18.605391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e88ed433-608d-49b5-bb16-85b50a754657 req-c6e8fee6-951a-483a-be45-42917ced42db service nova] Creating event network-vif-deleted:0da07d7c-bc0e-449e-9e9f-a6b0a3823b03 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:23:18.605391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e88ed433-608d-49b5-bb16-85b50a754657 req-c6e8fee6-951a-483a-be45-42917ced42db service nova] Creating event network-vif-deleted:5f319c6d-48a9-4e33-b7d2-d090da053b03 for instance 4c3f1c2d-64af-4612-b57a-d59438fc342f on n-h2-862876-2 Oct 28 13:23:18.622693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e88ed433-608d-49b5-bb16-85b50a754657 req-c6e8fee6-951a-483a-be45-42917ced42db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047908 Oct 28 13:23:18.635081 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2137/4361] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:19.227809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:19.229004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:19.237475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:19.238300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:19.238957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:19.239735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:19.240190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:19.240613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:19.245317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:19.276549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:19.277384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:19.277480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:19.277882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lazy-loading 'fault' on Instance uuid 4c3f1c2d-64af-4612-b57a-d59438fc342f {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:23:19.336677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:19.349900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b45702e1-6fa1-4ca0-a3a6-2b8855d9a381 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 200 len: 1303 microversion: 2.1 time: 0.126395 Oct 28 13:23:19.350554 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2225/4362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:19 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:19.429139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:19.429772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:19.433933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:19.434675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:19.445405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:19.452791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:19.461394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:19.462131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:19.462975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:19.463895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:19.464505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:19.465894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:19.466368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:19.466823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:19.471337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:19.472099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:19.597888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:19.607395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:19.608851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:19.611264 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5e8d7f9-67ea-4dee-ad9f-076fd51260a1 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.190416 Oct 28 13:23:19.612005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2226/4363] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:19 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:19.736063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:19.748602 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a9e6731-c7eb-4415-b479-dcbbe579e8db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.330687 Oct 28 13:23:19.750113 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2138/4364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:19 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:20.379329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:20.380089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:20.394283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:20.394808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:20.395303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:20.396294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:20.396935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:20.397348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:20.445601 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] HTTP exception thrown: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Request method failure captured: Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f HTTP/1.1 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9eZsT418PwLaEOlrd1g6jntiLDhQHLqQTIUcGT7sDVI6iAdtCPHdCN3dPyFVxRENTdMNWF1lkuvQ8ONRPBttSuWqRW1y9J-PFgTy2dGusPTe25FlHrOD6OnvqsQ6i2UHnoUqaQx-qhXTwbzjXLFF_ut-_I63FmT9tN-_BxCHRAtn54 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08327cee9e9b485c934663e9348ece89", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08327cee9e9b485c934663e9348ece89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestMultiNic-732627997 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestMultiNic-732627997-project Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 19e7bc5dab534d4ebb98469e3d630162 Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestMultiNic-732627997-project Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4c3f1c2d-64af-4612-b57a-d59438fc342f'} Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:23:20.454622 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Returning 404 to user: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-168a55de-4f1e-4dcc-9ac7-035de9a67968 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 404 len: 111 microversion: 2.1 time: 0.078477 Oct 28 13:23:20.459460 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2227/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:20 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:23:20.637632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:20.639755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:20.651204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:20.662410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:20.662410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:20.662410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:20.662410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:20.662410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:20.779718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:20.780683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:20.790835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:20.791707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:20.792525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:20.793417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:20.795250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:20.795923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:20.890796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:20.912738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:20.917018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:20.925573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-692f5076-9a69-4b98-a619-2b948bd25667 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.284758 Oct 28 13:23:20.925573 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2139/4366] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:20 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:21.122669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:21.137353 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae0a50f3-f3b1-4030-99ff-672744d61c5c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.363735 Oct 28 13:23:21.152232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2228/4367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:20 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:21.957605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:21.958448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:21.970171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:21.970526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:21.970988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:21.971691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:21.972144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:21.972570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:22.112678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:22.124113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:22.136202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:22.136202 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08d7f15a-2888-4286-b845-acf3fbb86366 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.174688 Oct 28 13:23:22.136202 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2140/4368] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:21 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:22.166717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:22.168662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:22.177299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:22.178633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:22.179430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:22.180677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:22.181748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:22.182430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:22.413171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:22.421395 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b351420c-8e48-4782-9acf-56df743f817f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.259374 Oct 28 13:23:22.422683 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2229/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:22 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:23.155410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:23.156086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:23.165495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:23.166205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:23.166637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:23.167524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:23.168227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:23.168655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:23.257480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:23.277451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:23.278963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:23.288651 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fe3d1096-7767-4f26-9875-7d3b90b860cf tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.137757 Oct 28 13:23:23.290338 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2141/4370] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:23 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:23.446650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:23.449772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:23.459427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:23.460270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:23.461712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:23.462833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:23.463447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:23.464024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:23.746510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:23.755891 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66401b4c-9da8-4ed5-91c1-d0690db2762c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.314127 Oct 28 13:23:23.758085 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2230/4371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:23 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:24.318791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:24.319423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:24.334584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:24.335201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:24.335644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:24.336369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:24.336832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:24.337265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:24.448878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:24.457460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:24.458920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:24.460101 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-db6157cb-478d-44c6-bd99-606a18d80610 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.146611 Oct 28 13:23:24.460718 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2142/4372] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:24 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:24.783050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:24.786032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:24.790669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:24.791195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:24.791636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:24.792324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:24.793071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:24.793508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:24.936974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:24.947066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-24202347-0083-426c-8ac1-dd20e7e6e80f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.167362 Oct 28 13:23:24.960472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2231/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:24 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:25.488485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:25.489843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:25.501479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:25.502843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:25.503505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:25.504445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:25.505132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:25.505839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:25.579133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:25.587575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:25.589066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:25.590236 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eaea8684-1ff6-44fd-b77f-42a14244fa31 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1364 microversion: 2.57 time: 0.108708 Oct 28 13:23:25.590814 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2143/4374] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:25 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1364 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:25.978520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:25.978520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:25.983533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:25.984128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:25.985378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:25.987332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:25.988160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:25.988670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:26.297581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:26.306986 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c557a4b7-649f-4945-b5b1-e6ccb6412b93 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1542 microversion: 2.1 time: 0.336547 Oct 28 13:23:26.307788 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2232/4375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:25 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1542 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:26.639901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:26.644793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:26.672119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:26.672119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:26.681377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:26.682664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:26.684726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:26.685340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:26.713339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:26.828605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:26.854846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:26.862439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:26.863814 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0823b6a-9e7f-45b2-b2a1-88c8b34142b4 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1382 microversion: 2.57 time: 0.246747 Oct 28 13:23:26.864410 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2144/4376] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:26 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1382 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:27.348853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:27.349697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:27.372164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:27.376101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:27.378057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:27.381610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:27.382247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:27.385134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:27.726235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:27.766860 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e4a8df51-32f7-475b-b0a4-a624b39b7243 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1541 microversion: 2.1 time: 0.421969 Oct 28 13:23:27.767750 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2233/4377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:27 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1541 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:27.782975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1659050459", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "7afbf83e-dd27-46d5-8635-4c1ca3374ffb"}, {"uuid": "f065a8fa-0f39-4b29-a46d-779e425415b5"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:27.863197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:27.919593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:27.929536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:27.957569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:27.960560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:27.960560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:27.962195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:27.962887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:27.963695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:27.997826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] validate_networks() for [('7afbf83e-dd27-46d5-8635-4c1ca3374ffb', None, None, None, None, None), ('f065a8fa-0f39-4b29-a46d-779e425415b5', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:23:28.057367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:28.069298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:28.075529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:28.080502 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5a05a1a2-6989-45cf-9bb7-09249a09ed64 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1370 microversion: 2.57 time: 0.191530 Oct 28 13:23:28.082343 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2234/4378] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:27 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:28.800017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:28.800768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:28.818694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:28.821066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:28.823253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:28.824703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:28.827669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:28.829033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:29.083181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:29.097224 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c79be29-24de-481c-ba63-ba63af584520 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1473 microversion: 2.1 time: 0.302083 Oct 28 13:23:29.098281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2235/4379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:28 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1473 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:29.122034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:29.122794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:29.152992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:29.156290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:29.156290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:29.161099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:29.161909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:29.162482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:29.358729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:29.371623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:29.371623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:29.373389 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c65deae-f291-420d-99ca-6b2b00a3e3fb tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1370 microversion: 2.57 time: 0.257246 Oct 28 13:23:29.373987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2236/4380] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:29 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:29.645051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:23:29.645801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:23:29.647784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:23:29.648463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:23:29.649564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:23:29.663711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:29.664462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:29.665170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:29.666192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:29.666985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:29.667832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:29.703848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Getting quotas for project 08327cee9e9b485c934663e9348ece89. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:23:29.708764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Getting quotas for user 19e7bc5dab534d4ebb98469e3d630162 and project 08327cee9e9b485c934663e9348ece89. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:23:29.731718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:23:29.734979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:23:30.001898 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-268bab34-22b4-4efd-8e60-4503756c09a9 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235693 Oct 28 13:23:30.006583 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2145/4381] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:23:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:23:30.020659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f81ba334-cc26-40fb-92f7-ee3f37de9dc7 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:30.021909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f81ba334-cc26-40fb-92f7-ee3f37de9dc7 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:30.132111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:30.132748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:30.137340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f81ba334-cc26-40fb-92f7-ee3f37de9dc7 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:30.154461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.158202 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f81ba334-cc26-40fb-92f7-ee3f37de9dc7 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1213 microversion: 2.1 time: 0.142540 Oct 28 13:23:30.159666 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2237/4382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:30 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:30.160949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.161409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.162158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.166548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.167288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.376730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:30.388750 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f0761b7-98ca-46c8-9e54-789ea6e45e49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1470 microversion: 2.1 time: 0.267254 Oct 28 13:23:30.388750 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2146/4383] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:30 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:30.404855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:30.406903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:30.426485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.427011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.427380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:30.428350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:30.429182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.429935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.432813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.434662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.443266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.445472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.446155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.448696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.450535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.451180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.549318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:30.570493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.570493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.570493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.570803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:30.571036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.571036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.571036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.573202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:30.574653 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a2acaa1-4a4c-448f-9ea3-cce83406d3fd tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1355 microversion: 2.57 time: 0.177079 Oct 28 13:23:30.576030 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2238/4384] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:30 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1355 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:30.607335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:30.607907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:30.622653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.624333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.627816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.630001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:30.630523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:30.631494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:30.689482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for project 08c125dbce0f4df8bd795a00b219487c. Resources: {'cores', 'ram'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:23:30.709562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for user c3852e30767345639ee5d92350d2950a and project 08c125dbce0f4df8bd795a00b219487c. Resources: {'cores', 'ram'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:23:30.743802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:23:31.242130 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fa5b9249-3fb4-42dc-a7ea-4c526237e0a7 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 204 len: 0 microversion: 2.57 time: 0.636193 Oct 28 13:23:31.245003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2239/4385] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:23:30 2022] DELETE /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 13:23:31.314795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5fbc52d2-6331-4c60-9692-22b8f4fbf0f5 req-16e4cf7e-ba7f-47b4-95bf-ccb2da5625b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabb1b52-6f7c-45f9-a776-f88ddc095395", "name": "network-vif-unplugged", "status": "completed", "tag": "70f775a5-4719-44ae-8dd6-fea5f71db071"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:31.331279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fbc52d2-6331-4c60-9692-22b8f4fbf0f5 req-16e4cf7e-ba7f-47b4-95bf-ccb2da5625b0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:31.331987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fbc52d2-6331-4c60-9692-22b8f4fbf0f5 req-16e4cf7e-ba7f-47b4-95bf-ccb2da5625b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:31.333683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fbc52d2-6331-4c60-9692-22b8f4fbf0f5 req-16e4cf7e-ba7f-47b4-95bf-ccb2da5625b0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:31.393768 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5fbc52d2-6331-4c60-9692-22b8f4fbf0f5 req-16e4cf7e-ba7f-47b4-95bf-ccb2da5625b0 service nova] Creating event network-vif-unplugged:70f775a5-4719-44ae-8dd6-fea5f71db071 for instance dabb1b52-6f7c-45f9-a776-f88ddc095395 on n-h2-862876-2 Oct 28 13:23:31.406886 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b03de69-fb1b-4049-bd8a-750493cfa0bb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395/action" status: 202 len: 0 microversion: 2.1 time: 0.972680 Oct 28 13:23:31.411395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2147/4386] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:23:30 2022] POST /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395/action => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:23:31.415075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-5fbc52d2-6331-4c60-9692-22b8f4fbf0f5 req-16e4cf7e-ba7f-47b4-95bf-ccb2da5625b0 service nova] Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:23:31.435273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5fbc52d2-6331-4c60-9692-22b8f4fbf0f5 req-16e4cf7e-ba7f-47b4-95bf-ccb2da5625b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186105 Oct 28 13:23:31.440327 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2240/4387] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:31.451912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:31.455615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:31.456850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c4cf862-8994-4d18-8558-ea992b5598e4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:31.457658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c4cf862-8994-4d18-8558-ea992b5598e4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:31.482712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:31.487541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:31.489474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:31.496467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:31.502330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:31.503805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:31.772367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:31.775963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:31.784082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:31.794424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:31.802229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-587ac603-8619-4d4b-ac94-b2b7f747c6ec tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1361 microversion: 2.57 time: 0.355831 Oct 28 13:23:31.803098 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2241/4388] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:31 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1361 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:23:31.814682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:31.815325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:31.841222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c4cf862-8994-4d18-8558-ea992b5598e4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:31.845255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:31.845749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:31.846194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:31.846922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:31.848388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:31.851439 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c4cf862-8994-4d18-8558-ea992b5598e4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1213 microversion: 2.1 time: 0.437846 Oct 28 13:23:31.851612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:31.871431 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2148/4389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:31 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1213 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:32.557417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:32.571341 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-89081ab5-aeb9-4c3c-9e96-ccec2cd8a70d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1469 microversion: 2.1 time: 0.765425 Oct 28 13:23:32.572588 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2242/4390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:31 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1469 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:32.838607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:32.847179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:32.865694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:32.866913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:32.867586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:32.869292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:32.870464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:32.871285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:32.881297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:32.881868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:32.895732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:32.898017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:32.900146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:32.903290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:32.903778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:32.904617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:33.016553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:33.037633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a0e74e33-f0f7-4923-9de2-b6edfa6bd971 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1265 microversion: 2.1 time: 0.159108 Oct 28 13:23:33.053221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2243/4391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:32 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:33.076927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:33.093456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:33.099999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:33.124030 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a7a549ad-2864-4cbb-8bdf-bb9a5b152b9c tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1361 microversion: 2.57 time: 0.267756 Oct 28 13:23:33.142863 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2149/4392] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:32 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:33.606988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:33.607785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:33.627924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:33.628436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:33.628870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:33.632193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:33.633852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:33.637363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:33.969165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:33.982109 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d1804c5-4fd3-4931-baa5-1dd7d5027073 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1469 microversion: 2.1 time: 0.383347 Oct 28 13:23:33.982109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2244/4393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:33 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1469 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:34.063371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:34.065112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:34.073513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:34.074010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:34.085710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:34.085710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:34.085710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:34.085710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:34.153171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:34.160605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:34.161488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:34.164212 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5600105-dcad-48b8-9705-9fe0bf871e4b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1271 microversion: 2.1 time: 0.106082 Oct 28 13:23:34.166008 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2150/4394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:34 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:34.168901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:34.169391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:34.169825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:34.170556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:34.171052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:34.171662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:34.210521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:34.211397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:34.212167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:34.213170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lazy-loading 'fault' on Instance uuid da282986-7cdf-405c-8782-3645cbb6aa79 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:23:34.279817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:34.289089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:34.290532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85b8080d7d134fed9ed3fd745fd00b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0d7eb4b6a43e58c869de2fe1389af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:34.291927 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eebc9fdb-afc7-4a60-a699-02e4a949c79a tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 200 len: 1366 microversion: 2.57 time: 0.136696 Oct 28 13:23:34.294986 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2245/4395] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:34 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:23:34.714372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f5ed4b74-5abc-422a-b016-0af5019e31fb req-b63668eb-8dd1-4186-8ad3-6b80c076237a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabb1b52-6f7c-45f9-a776-f88ddc095395", "name": "network-vif-plugged", "status": "completed", "tag": "70f775a5-4719-44ae-8dd6-fea5f71db071"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:34.736328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f5ed4b74-5abc-422a-b016-0af5019e31fb req-b63668eb-8dd1-4186-8ad3-6b80c076237a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:34.738050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f5ed4b74-5abc-422a-b016-0af5019e31fb req-b63668eb-8dd1-4186-8ad3-6b80c076237a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:34.743859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f5ed4b74-5abc-422a-b016-0af5019e31fb req-b63668eb-8dd1-4186-8ad3-6b80c076237a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:34.774577 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f5ed4b74-5abc-422a-b016-0af5019e31fb req-b63668eb-8dd1-4186-8ad3-6b80c076237a service nova] Creating event network-vif-plugged:70f775a5-4719-44ae-8dd6-fea5f71db071 for instance dabb1b52-6f7c-45f9-a776-f88ddc095395 on n-h2-862876-2 Oct 28 13:23:34.784388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-f5ed4b74-5abc-422a-b016-0af5019e31fb req-b63668eb-8dd1-4186-8ad3-6b80c076237a service nova] Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:23:34.792341 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f5ed4b74-5abc-422a-b016-0af5019e31fb req-b63668eb-8dd1-4186-8ad3-6b80c076237a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081621 Oct 28 13:23:34.793964 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2151/4396] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:35.009565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:35.011834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:35.032986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:35.033798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:35.034544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:35.035488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:35.036176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:35.036939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:35.191344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:35.193279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:35.201183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:35.202071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:35.203425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:35.204337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:35.204953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:35.205544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:35.316902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:35.327463 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1bb93a8-a5be-40ae-aba2-062b1e9b831d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1469 microversion: 2.1 time: 0.324011 Oct 28 13:23:35.329218 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2246/4397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:35 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:35.337562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:35.338179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] [instance: da282986-7cdf-405c-8782-3645cbb6aa79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:35.352652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:35.353334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:35.353784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:35.355600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:35.356095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:35.356584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:35.395070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] HTTP exception thrown: Instance da282986-7cdf-405c-8782-3645cbb6aa79 could not be found. Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Request method failure captured: Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 HTTP/1.1 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9eq6b1JO20Ra0dxF3sS3boGEvjLcYwfSx4DQFxP8Pnkhc-gHN18pzYbJVi4SGupIMqRYLYeRmj1T3nwaihlaEe--223K7O29rRpdUoshIlIlL3gSbbPPcl69NH5VGCPpz_7o-TeWCQCCtbC2g9FKsrIIJvgxCoIBs8LMxYDlUAYWMQ Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.57 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 71e0d7eb4b6a43e58c869de2fe1389af Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerShowV257Test-2073442296 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71e0d7eb4b6a43e58c869de2fe1389af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/71e0d7eb4b6a43e58c869de2fe1389af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_71e0d7eb4b6a43e58c869de2fe1389af", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/71e0d7eb4b6a43e58c869de2fe1389af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerShowV257Test-2073442296 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 71e0d7eb4b6a43e58c869de2fe1389af Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerShowV257Test-2073442296 Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerShowV257Test-2073442296-project Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 85b8080d7d134fed9ed3fd745fd00b7b Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerShowV257Test-2073442296-project Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance da282986-7cdf-405c-8782-3645cbb6aa79 could not be found. Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'da282986-7cdf-405c-8782-3645cbb6aa79'} Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da282986-7cdf-405c-8782-3645cbb6aa79 could not be found. Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da282986-7cdf-405c-8782-3645cbb6aa79 could not be found. Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:23:35.399371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:35.405206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:35.405206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:23:35.405206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:23:35.405206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:23:35.405206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:23:35.405206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da282986-7cdf-405c-8782-3645cbb6aa79 could not be found. Oct 28 13:23:35.405206 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:35.411718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] Returning 404 to user: Instance da282986-7cdf-405c-8782-3645cbb6aa79 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:23:35.422221 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf310118-336e-40ee-a8f5-7aac71bbd1d3 tempest-ServerShowV257Test-2073442296 tempest-ServerShowV257Test-2073442296-project] 10.222.0.25 "GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79" status: 404 len: 111 microversion: 2.57 time: 0.082803 Oct 28 13:23:35.422221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2247/4398] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:23:35 2022] GET /compute/v2.1/servers/da282986-7cdf-405c-8782-3645cbb6aa79 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:23:35.470415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:35.481026 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b11d5be6-51d2-4e78-ad7e-b7064a5c1bd5 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1313 microversion: 2.1 time: 0.293233 Oct 28 13:23:35.485506 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2152/4399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:35 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:36.367548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:36.368212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:36.372851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:36.381157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:36.382066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:36.383487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:36.384389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:36.385092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:36.386003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:36.505169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:36.505713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:36.513575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:36.514635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:36.515358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:36.516891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:36.517852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:36.518473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:36.698739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:36.710165 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82deabc8-4c7c-46fa-9511-7ab5e8c5990d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1469 microversion: 2.1 time: 0.356993 Oct 28 13:23:36.730211 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2248/4400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:36 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:36.824708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:36.840542 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3fb0c03-c5e4-4bca-9d1f-a9ed08267791 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.337336 Oct 28 13:23:36.841543 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2153/4401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:36 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:37.737366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:37.738092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:37.745457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:37.746129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:37.746560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:37.747408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:37.747901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:37.748384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:37.889931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:38.113988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:38.123428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8cff966-bbf3-4ac6-b459-472498143c67 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.259980 Oct 28 13:23:38.139532 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2154/4402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:37 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:38.415749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:38.424136 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c991705-f10a-45bb-b3fd-a09b5128c2e2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1535 microversion: 2.1 time: 0.691921 Oct 28 13:23:38.427287 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2249/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:37 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1535 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:39.147023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:39.147779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:39.166114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:39.166626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:39.167110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:39.167823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:39.168281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:39.168710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:39.401491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-17876771-cd6a-4692-b90d-fcbf2354371c req-fd8953c5-1ab7-4b31-af38-62716db09743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b8c67f-7f2b-4502-bbda-11938ac14839", "tag": "f9c72eb3-acd7-4876-a341-a906ed4f69dc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:39.425864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-17876771-cd6a-4692-b90d-fcbf2354371c req-fd8953c5-1ab7-4b31-af38-62716db09743 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:39.427750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-17876771-cd6a-4692-b90d-fcbf2354371c req-fd8953c5-1ab7-4b31-af38-62716db09743 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:39.428621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-17876771-cd6a-4692-b90d-fcbf2354371c req-fd8953c5-1ab7-4b31-af38-62716db09743 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:39.449545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:39.452156 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-17876771-cd6a-4692-b90d-fcbf2354371c req-fd8953c5-1ab7-4b31-af38-62716db09743 service nova] Creating event network-changed:f9c72eb3-acd7-4876-a341-a906ed4f69dc for instance a8b8c67f-7f2b-4502-bbda-11938ac14839 on n-h2-862876-2 Oct 28 13:23:39.459003 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-17876771-cd6a-4692-b90d-fcbf2354371c req-fd8953c5-1ab7-4b31-af38-62716db09743 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.448221 Oct 28 13:23:39.461894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4578484-51b8-4612-b612-0f8efd7db50f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.317051 Oct 28 13:23:39.462021 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2155/4404] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:23:39.462105 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2250/4405] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:39 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:39.469251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:39.471358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:39.481418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:39.482553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:39.483106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:39.484975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:39.490350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:39.490350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:39.768638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:39.776489 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8b065ea6-6677-4f70-be89-253e0ff5204b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1535 microversion: 2.1 time: 0.314600 Oct 28 13:23:39.777406 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2156/4406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:39 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1535 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:40.490281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:40.490281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:40.499464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:40.506411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:40.507255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:40.507913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:40.508994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:40.509817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:40.510513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:40.811493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:40.812852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:40.820429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=5 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:40.824888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:40.825582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:40.826265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:40.832690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:40.840848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:40.841603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:40.842532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:40.870214 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a94ad25b-277b-4a9a-8fbf-696df7a2b5a0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.389163 Oct 28 13:23:40.884539 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2251/4407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:40 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:41.026841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d4bb0284-5af4-42bd-8b88-657e831dd36f req-140e3735-4a44-4e39-9a12-f83969fc0e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabb1b52-6f7c-45f9-a776-f88ddc095395", "name": "network-vif-unplugged", "status": "completed", "tag": "70f775a5-4719-44ae-8dd6-fea5f71db071"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:41.048370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4bb0284-5af4-42bd-8b88-657e831dd36f req-140e3735-4a44-4e39-9a12-f83969fc0e7d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:41.050218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4bb0284-5af4-42bd-8b88-657e831dd36f req-140e3735-4a44-4e39-9a12-f83969fc0e7d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:41.050661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4bb0284-5af4-42bd-8b88-657e831dd36f req-140e3735-4a44-4e39-9a12-f83969fc0e7d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:41.083372 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d4bb0284-5af4-42bd-8b88-657e831dd36f req-140e3735-4a44-4e39-9a12-f83969fc0e7d service nova] Creating event network-vif-unplugged:70f775a5-4719-44ae-8dd6-fea5f71db071 for instance dabb1b52-6f7c-45f9-a776-f88ddc095395 on n-h2-862876-2 Oct 28 13:23:41.097877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d4bb0284-5af4-42bd-8b88-657e831dd36f req-140e3735-4a44-4e39-9a12-f83969fc0e7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075296 Oct 28 13:23:41.099018 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2252/4408] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:23:41.224536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:41.237365 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e117b52-5542-473f-99b7-430c22572f63 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1528 microversion: 2.1 time: 0.436945 Oct 28 13:23:41.251761 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2157/4409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:40 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1528 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:41.263383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:41.264572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:41.271990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:41.272512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:41.272952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:41.273650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:41.274359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:41.274809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:41.896930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:41.897556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:41.902414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:41.906507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:41.907040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:41.907535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:41.908201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:41.908659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:41.909086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:42.072272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:42.083472 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-950e3953-6ff6-4ae1-af9c-b4b379a9296a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1528 microversion: 2.1 time: 0.825288 Oct 28 13:23:42.085072 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2253/4410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:41 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1528 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:42.087808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:42.101798 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a663d1ea-2236-4d03-8a2f-29c61b342ce3 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.208173 Oct 28 13:23:42.110108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-208933db-3a68-4121-ac98-4ec03c03fee4 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:42.113549 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2158/4411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:41 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:42.123615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-208933db-3a68-4121-ac98-4ec03c03fee4 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] HTTP exception thrown: Flavor 148d627b-1bde-4839-9a23-ae59f3454702 could not be found. Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-208933db-3a68-4121-ac98-4ec03c03fee4 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Request method failure captured: Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/flavors/148d627b-1bde-4839-9a23-ae59f3454702 HTTP/1.1 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9cukOzfULnCjSJn2o9KSnlWkWa8Mh6Q3peZxb1Thv0iacGPtN273yU7es7XzJJD0CXJ3Cq9cdpdMUNOyPSFLfh0dwKLlTDZ2bXNuLYS1MwUNIbcBcTbDJX0MJQ3RxCCarZtmFgGSSfT-d9nE6mFE2Z330RNSkF8xH8JtFrLbgN95j0 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 8968ed627a6040c494c82a1aabff6214 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MigrationsAdminTest-1954809758 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8968ed627a6040c494c82a1aabff6214"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8968ed627a6040c494c82a1aabff6214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8968ed627a6040c494c82a1aabff6214", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8968ed627a6040c494c82a1aabff6214"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MigrationsAdminTest-1954809758 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 8968ed627a6040c494c82a1aabff6214 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MigrationsAdminTest-1954809758 Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MigrationsAdminTest-1954809758-project-admin Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4161ee38c3be41469b69919d3c445dba Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MigrationsAdminTest-1954809758-project-admin Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor 148d627b-1bde-4839-9a23-ae59f3454702 could not be found. Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '148d627b-1bde-4839-9a23-ae59f3454702'} Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 148d627b-1bde-4839-9a23-ae59f3454702 could not be found. Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 148d627b-1bde-4839-9a23-ae59f3454702 could not be found. Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:42.134455 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 148d627b-1bde-4839-9a23-ae59f3454702 could not be found. Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-208933db-3a68-4121-ac98-4ec03c03fee4 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Returning 404 to user: Flavor 148d627b-1bde-4839-9a23-ae59f3454702 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-208933db-3a68-4121-ac98-4ec03c03fee4 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/148d627b-1bde-4839-9a23-ae59f3454702" status: 404 len: 109 microversion: 2.1 time: 0.030301 Oct 28 13:23:42.139403 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2254/4412] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:23:42 2022] DELETE /compute/v2.1/flavors/148d627b-1bde-4839-9a23-ae59f3454702 => generated 109 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:23:42.276941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1387492958", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:42.370629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:23:42.669848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f5bdc810-2d38-41b6-a20d-58efe969eecc req-4c0d9140-3933-4864-b410-2eb6f0892ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b8c67f-7f2b-4502-bbda-11938ac14839", "tag": "d421f557-d2d1-4ae9-a4d4-ebfe391915f2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:42.702200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f5bdc810-2d38-41b6-a20d-58efe969eecc req-4c0d9140-3933-4864-b410-2eb6f0892ce9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:42.711472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f5bdc810-2d38-41b6-a20d-58efe969eecc req-4c0d9140-3933-4864-b410-2eb6f0892ce9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:42.711472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f5bdc810-2d38-41b6-a20d-58efe969eecc req-4c0d9140-3933-4864-b410-2eb6f0892ce9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:42.722448 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f5bdc810-2d38-41b6-a20d-58efe969eecc req-4c0d9140-3933-4864-b410-2eb6f0892ce9 service nova] Creating event network-changed:d421f557-d2d1-4ae9-a4d4-ebfe391915f2 for instance a8b8c67f-7f2b-4502-bbda-11938ac14839 on n-h2-862876-2 Oct 28 13:23:42.755023 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f5bdc810-2d38-41b6-a20d-58efe969eecc req-4c0d9140-3933-4864-b410-2eb6f0892ce9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062629 Oct 28 13:23:42.758651 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2255/4413] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:43.004524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:23:43.005066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:23:43.005593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:23:43.006228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:23:43.006854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:23:43.022977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:43.027270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:43.027957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:43.038525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:43.038525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:43.038525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:43.069254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:23:43.084682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Getting quotas for user c3852e30767345639ee5d92350d2950a and project 08c125dbce0f4df8bd795a00b219487c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:23:43.114132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:23:43.118658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:23:43.130414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7934d522-499f-44e3-a304-05e7f20e9eea req-5e21cf02-36f5-4c57-885d-86bb66a1954b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabb1b52-6f7c-45f9-a776-f88ddc095395", "name": "network-vif-plugged", "status": "completed", "tag": "70f775a5-4719-44ae-8dd6-fea5f71db071"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:43.186252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7934d522-499f-44e3-a304-05e7f20e9eea req-5e21cf02-36f5-4c57-885d-86bb66a1954b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:43.188361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7934d522-499f-44e3-a304-05e7f20e9eea req-5e21cf02-36f5-4c57-885d-86bb66a1954b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:43.189160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7934d522-499f-44e3-a304-05e7f20e9eea req-5e21cf02-36f5-4c57-885d-86bb66a1954b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:43.202433 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7934d522-499f-44e3-a304-05e7f20e9eea req-5e21cf02-36f5-4c57-885d-86bb66a1954b service nova] Creating event network-vif-plugged:70f775a5-4719-44ae-8dd6-fea5f71db071 for instance dabb1b52-6f7c-45f9-a776-f88ddc095395 on n-h2-862876-2 Oct 28 13:23:43.229532 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7934d522-499f-44e3-a304-05e7f20e9eea req-5e21cf02-36f5-4c57-885d-86bb66a1954b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088035 Oct 28 13:23:43.229532 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2256/4414] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:43.235787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:43.237269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:43.247285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:43.248368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:43.249025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:43.250708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:43.251586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:43.252230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:43.377853 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8bc33e9-06cd-497b-9867-4b685430fcb1 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102380 Oct 28 13:23:43.382968 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2159/4415] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:23:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:23:43.396021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b091c641-a643-4464-8ec1-40f52ae5c16f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:43.401096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b091c641-a643-4464-8ec1-40f52ae5c16f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:43.655382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b091c641-a643-4464-8ec1-40f52ae5c16f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:43.663725 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b091c641-a643-4464-8ec1-40f52ae5c16f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1213 microversion: 2.1 time: 0.272592 Oct 28 13:23:43.675935 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2160/4416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:43 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:43.970618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:43.995328 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a0a2c2e-fe1c-4f22-b7fa-9a5297c69a98 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.770578 Oct 28 13:23:44.009787 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2257/4417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:43 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:44.696783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e299421-fc21-418a-ba58-31b18ffbc2b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:44.697398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0e299421-fc21-418a-ba58-31b18ffbc2b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:44.857967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e299421-fc21-418a-ba58-31b18ffbc2b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:44.866326 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e299421-fc21-418a-ba58-31b18ffbc2b5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1213 microversion: 2.1 time: 0.173508 Oct 28 13:23:44.867813 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2161/4418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:44 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:45.022371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:45.023695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:45.031134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:45.032349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:45.032349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:45.036883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:45.036883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:45.036883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:45.454371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:45.472116 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2037db96-ca2e-4462-bfa5-8c89523dbcdb tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.453769 Oct 28 13:23:45.483841 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2258/4419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:45 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:45.889820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:45.890564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:45.904654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:45.910329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:45.911037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:45.911999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:45.912679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:45.915060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:46.075066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:46.087028 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bfdb9725-9528-4d24-93da-f25cc3a521a9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1209 microversion: 2.1 time: 0.200536 Oct 28 13:23:46.087676 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2162/4420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:45 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1209 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:46.498328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:46.500184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:46.509097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:46.509945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:46.510568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:46.511901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:46.512746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:46.513480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:46.804112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:46.813934 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61669dd7-4b7b-4f52-af08-a6ace9da3e0a tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.319412 Oct 28 13:23:46.814776 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2259/4421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:46 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:47.122625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:47.122625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:47.146104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:47.147293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:47.148174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:47.149145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:47.149779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:47.150508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:47.170492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:47.294450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:47.342497 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-525c7267-51e2-4d40-8509-333ade462613 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1273 microversion: 2.1 time: 0.231869 Oct 28 13:23:47.345383 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2163/4422] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:47 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:47.837040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:47.838216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:47.846442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:47.847194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:47.847788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:47.848657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:47.849288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:47.849869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:48.368715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:48.369342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:48.389788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:48.390329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:48.390793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:48.395689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:48.396648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:48.398162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:48.889778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:48.901651 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-068332a8-fc00-446e-b580-4a8b6f18fd29 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1271 microversion: 2.1 time: 0.538080 Oct 28 13:23:48.902235 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2164/4423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:48 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1271 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:48.923718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:48.947974 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-96363b09-4f28-41ce-a76a-c2409675611f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 1.108497 Oct 28 13:23:48.948686 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2260/4424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:47 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:49.928169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:49.929398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:49.940367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:49.951574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:49.952273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:49.953890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:49.954511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:49.955124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:49.974282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:49.975381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:50.003791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:50.003791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:50.003791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:50.003791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:50.003791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:50.003791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:50.411768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:50.456777 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-09d96ca5-2d90-4f42-a24f-bd1cd438bc1a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1313 microversion: 2.1 time: 0.533057 Oct 28 13:23:50.461549 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2165/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:49 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:50.517636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:50.525645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:50.528363 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14531fb1-bc3b-4086-8675-c5b3abe5dfda tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.558599 Oct 28 13:23:50.531552 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2261/4426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:49 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:51.073738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7bcc071f-79f1-4df6-a5ad-b6feb2f9950e req-18eacd95-8b28-42e1-bf0d-e1f7b9cf2bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8c67f-7f2b-4502-bbda-11938ac14839", "name": "network-vif-plugged", "status": "completed", "tag": "f9c72eb3-acd7-4876-a341-a906ed4f69dc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:51.095723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7bcc071f-79f1-4df6-a5ad-b6feb2f9950e req-18eacd95-8b28-42e1-bf0d-e1f7b9cf2bac service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:51.096604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7bcc071f-79f1-4df6-a5ad-b6feb2f9950e req-18eacd95-8b28-42e1-bf0d-e1f7b9cf2bac service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:51.097239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7bcc071f-79f1-4df6-a5ad-b6feb2f9950e req-18eacd95-8b28-42e1-bf0d-e1f7b9cf2bac service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:51.129254 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7bcc071f-79f1-4df6-a5ad-b6feb2f9950e req-18eacd95-8b28-42e1-bf0d-e1f7b9cf2bac service nova] Creating event network-vif-plugged:f9c72eb3-acd7-4876-a341-a906ed4f69dc for instance a8b8c67f-7f2b-4502-bbda-11938ac14839 on n-h2-862876-2 Oct 28 13:23:51.138926 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7bcc071f-79f1-4df6-a5ad-b6feb2f9950e req-18eacd95-8b28-42e1-bf0d-e1f7b9cf2bac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069678 Oct 28 13:23:51.147083 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2166/4427] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:51.501686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:51.502853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:51.517798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:51.520166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:51.522531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:51.523599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:51.525120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:51.526252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:51.815641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b928c1e4-025d-4d47-80bd-0b0b775f1257 req-60c956c8-a3e0-412a-901a-d8f95e50e756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:51.843150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b928c1e4-025d-4d47-80bd-0b0b775f1257 req-60c956c8-a3e0-412a-901a-d8f95e50e756 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:51.845442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b928c1e4-025d-4d47-80bd-0b0b775f1257 req-60c956c8-a3e0-412a-901a-d8f95e50e756 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:51.845887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b928c1e4-025d-4d47-80bd-0b0b775f1257 req-60c956c8-a3e0-412a-901a-d8f95e50e756 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:51.866386 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b928c1e4-025d-4d47-80bd-0b0b775f1257 req-60c956c8-a3e0-412a-901a-d8f95e50e756 service nova] Creating event network-changed:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h1-862876-2 Oct 28 13:23:51.872641 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b928c1e4-025d-4d47-80bd-0b0b775f1257 req-60c956c8-a3e0-412a-901a-d8f95e50e756 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489739 Oct 28 13:23:51.875061 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2262/4428] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:51.881778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:51.882838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:51.890842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:51.891599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:51.903105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:51.904224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:51.907302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:51.907747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:52.185296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:52.196187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-783f7ee5-6132-4f83-a07f-bc5c6022ece8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1313 microversion: 2.1 time: 0.707376 Oct 28 13:23:52.197152 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2167/4429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:51 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1313 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:52.285393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:52.297164 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bdbf8c6-5208-42e8-98df-9db9d9a4a8a4 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.420424 Oct 28 13:23:52.300297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2263/4430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:51 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:53.158858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-fd801372-d0e5-4271-9fe9-c6cd376a7e11 req-51eacbec-881a-4689-9277-302eef01689d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8c67f-7f2b-4502-bbda-11938ac14839", "name": "network-vif-plugged", "status": "completed", "tag": "d421f557-d2d1-4ae9-a4d4-ebfe391915f2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:53.164076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:53.171926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fd801372-d0e5-4271-9fe9-c6cd376a7e11 req-51eacbec-881a-4689-9277-302eef01689d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:53.172469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fd801372-d0e5-4271-9fe9-c6cd376a7e11 req-51eacbec-881a-4689-9277-302eef01689d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:53.172897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fd801372-d0e5-4271-9fe9-c6cd376a7e11 req-51eacbec-881a-4689-9277-302eef01689d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:53.185226 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fd801372-d0e5-4271-9fe9-c6cd376a7e11 req-51eacbec-881a-4689-9277-302eef01689d service nova] Creating event network-vif-plugged:d421f557-d2d1-4ae9-a4d4-ebfe391915f2 for instance a8b8c67f-7f2b-4502-bbda-11938ac14839 on n-h2-862876-2 Oct 28 13:23:53.194954 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-fd801372-d0e5-4271-9fe9-c6cd376a7e11 req-51eacbec-881a-4689-9277-302eef01689d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036306 Oct 28 13:23:53.199068 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2168/4431] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:53.224461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:53.225069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:53.232677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:53.233300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:53.234036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:53.234737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:53.235223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:53.235640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:53.343220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:53.345179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:53.353443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:53.353997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:53.354576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:53.356824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:53.357721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:53.359483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:53.767296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:53.781876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62c01a53-a0a4-46d7-8ed2-9ee1fbfa5c26 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.455380 Oct 28 13:23:53.782538 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2169/4432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:53 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:53.896466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:53.912484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f002e13-3a46-4e54-b3db-be553d97d79e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1313 microversion: 2.1 time: 0.693622 Oct 28 13:23:53.914095 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2264/4433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:53 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:54.814073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:54.818169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:54.841693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:54.844511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:54.846902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:54.847876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:54.848715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:54.852965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:54.853642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:54.862198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:23:54.941472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:54.942094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:54.958617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:54.967136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:54.967627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:54.968423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:54.968897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:54.969325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:55.387489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:55.396639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8ceeea0-327d-49ec-8b6f-695de3762846 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1334 microversion: 2.1 time: 0.586932 Oct 28 13:23:55.401230 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2170/4434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:54 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1334 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:55.665394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:55.683147 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef8ce9cf-6973-4c35-82ee-47f3a8199be8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1313 microversion: 2.1 time: 0.746015 Oct 28 13:23:55.684079 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2265/4435] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:54 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:56.428596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:56.429225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:56.441826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:56.442852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:56.449452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:56.449452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:56.449452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:56.449452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:56.712137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:56.713358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:56.721864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:56.722364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:56.722824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:56.723525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:56.723979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:56.724396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:56.834608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:56.852723 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5630ab4a-836b-4d6c-9858-d2eb64a27a5c tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1669 microversion: 2.1 time: 0.424356 Oct 28 13:23:56.860577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2171/4436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:56 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1669 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:56.883749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:56.884469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:56.905252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:56.906082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:56.911607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:56.912770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:56.914576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:56.915521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:56.989587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f017471e-a49b-4b69-b066-5cb873b4db12 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839/ips" status: 200 len: 179 microversion: 2.1 time: 0.110487 Oct 28 13:23:56.992789 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2172/4437] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:23:56 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839/ips => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:57.011262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:57.012195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:57.028673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:57.029584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:57.030232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:57.031544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:57.037462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:57.038201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:57.134878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:23:57.200469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:57.216033 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1e8a8545-58ef-435e-8481-ce89f90eb712 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1313 microversion: 2.1 time: 0.504106 Oct 28 13:23:57.216987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2266/4438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:56 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:57.234563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c021ee9f-54df-413e-bd63-28bfd77e7d34 req-4a2f7408-d428-461f-9866-94a72736aa68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "name": "network-vif-plugged", "status": "completed", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:23:57.267605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c021ee9f-54df-413e-bd63-28bfd77e7d34 req-4a2f7408-d428-461f-9866-94a72736aa68 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:57.268333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c021ee9f-54df-413e-bd63-28bfd77e7d34 req-4a2f7408-d428-461f-9866-94a72736aa68 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:57.268974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c021ee9f-54df-413e-bd63-28bfd77e7d34 req-4a2f7408-d428-461f-9866-94a72736aa68 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:57.331272 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c021ee9f-54df-413e-bd63-28bfd77e7d34 req-4a2f7408-d428-461f-9866-94a72736aa68 service nova] Creating event network-vif-plugged:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h1-862876-2 Oct 28 13:23:57.353841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c021ee9f-54df-413e-bd63-28bfd77e7d34 req-4a2f7408-d428-461f-9866-94a72736aa68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135249 Oct 28 13:23:57.354403 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2267/4439] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:23:57.768919 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7db509ec-d950-484e-a5e4-c5356b0b5aa0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 204 len: 0 microversion: 2.1 time: 0.767987 Oct 28 13:23:57.775808 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2173/4440] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:23:56 2022] DELETE /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:23:57.780572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:57.781801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:57.797832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:57.800038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:57.800697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:57.801700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:57.802348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:57.803019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:58.238222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:58.239026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:58.252922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:58.254184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:58.254184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:58.254581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:58.255081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:58.255593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:58.567933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:58.584926 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cc7dfb75-b9e9-4404-8aad-f0fbf4f99a9a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1313 microversion: 2.1 time: 0.351148 Oct 28 13:23:58.585548 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2174/4441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:58 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:23:58.781014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:58.789292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de582cb8-81e5-4b48-8930-71ef2bda2539 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1675 microversion: 2.1 time: 1.014762 Oct 28 13:23:58.789883 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2268/4442] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:57 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1675 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:59.615592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:59.622031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:59.630602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:59.631799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:59.632366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:59.633494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:59.633962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:59.634395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:59.819825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:59.822213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:59.831470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:59.835405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:59.836089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:59.836988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:59.837696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:59.841653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:59.859614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:23:59.868707 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ce0d152-aa79-4b00-b9cc-09feb2f4f6d4 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1462 microversion: 2.1 time: 0.260609 Oct 28 13:23:59.891144 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2175/4443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:59 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1462 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:23:59.903608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:23:59.904532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:23:59.916384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:59.919575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:59.920206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:23:59.921138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:23:59.924049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:23:59.924672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:00.314466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:00.324579 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e90c08a-7302-4134-851d-47a89508f29f tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1675 microversion: 2.1 time: 0.509297 Oct 28 13:24:00.329719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2269/4444] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:59 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1675 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:00.381044 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-acbee85e-4a86-4d48-ac10-bfcb0f12aed3 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1613 microversion: 2.1 time: 0.488723 Oct 28 13:24:00.387162 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2176/4445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:23:59 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1613 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:00.406799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:00.407287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:00.418602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:00.421642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:00.421642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:00.421642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:00.421642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:00.421642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:00.525727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4161ee38c3be41469b69919d3c445dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8968ed627a6040c494c82a1aabff6214', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:00.526595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] flavor_id is None. Assuming migration. {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 13:24:00.530831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 13:24:01.014879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ad373213-2589-40b7-a55d-438ab2263715 req-e233b24c-1551-410a-bba9-0891cc2c48df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8c67f-7f2b-4502-bbda-11938ac14839", "name": "network-vif-deleted", "tag": "d421f557-d2d1-4ae9-a4d4-ebfe391915f2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:01.053215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad373213-2589-40b7-a55d-438ab2263715 req-e233b24c-1551-410a-bba9-0891cc2c48df service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:01.053617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad373213-2589-40b7-a55d-438ab2263715 req-e233b24c-1551-410a-bba9-0891cc2c48df service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:01.054056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad373213-2589-40b7-a55d-438ab2263715 req-e233b24c-1551-410a-bba9-0891cc2c48df service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:01.101113 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ad373213-2589-40b7-a55d-438ab2263715 req-e233b24c-1551-410a-bba9-0891cc2c48df service nova] Creating event network-vif-deleted:d421f557-d2d1-4ae9-a4d4-ebfe391915f2 for instance a8b8c67f-7f2b-4502-bbda-11938ac14839 on n-h2-862876-2 Oct 28 13:24:01.115116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ad373213-2589-40b7-a55d-438ab2263715 req-e233b24c-1551-410a-bba9-0891cc2c48df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107325 Oct 28 13:24:01.127182 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2177/4446] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:01.357657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:01.359501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:01.370149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:01.379019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:01.379019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:01.379019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:01.379019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:01.379019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:01.465355 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a43c9692-2fd1-4418-842d-b8bec6f8d879 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112/action" status: 202 len: 0 microversion: 2.1 time: 1.063001 Oct 28 13:24:01.480544 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2270/4447] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:24:00 2022] POST /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112/action => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:24:01.492427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:01.495585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:01.509573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:01.510072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:01.510510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:01.511250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:01.511710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:01.512139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:02.285615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:02.291434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:02.294452 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bcce0211-e10c-4af1-9e5a-92103dcf8310 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1496 microversion: 2.1 time: 0.941396 Oct 28 13:24:02.296432 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2178/4448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:01 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1496 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:02.304899 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b64d15da-708e-4a0c-95e8-dbc4bba49c75 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1471 microversion: 2.1 time: 0.823159 Oct 28 13:24:02.305948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2271/4449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:01 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1471 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:03.159682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8c257cec-a390-493d-94e6-de6301c86bb3 req-4564db34-53fc-4652-b1ba-43119dfbefe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8c67f-7f2b-4502-bbda-11938ac14839", "name": "network-vif-deleted", "tag": "f9c72eb3-acd7-4876-a341-a906ed4f69dc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:03.174180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c257cec-a390-493d-94e6-de6301c86bb3 req-4564db34-53fc-4652-b1ba-43119dfbefe3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:03.174961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c257cec-a390-493d-94e6-de6301c86bb3 req-4564db34-53fc-4652-b1ba-43119dfbefe3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:03.175802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8c257cec-a390-493d-94e6-de6301c86bb3 req-4564db34-53fc-4652-b1ba-43119dfbefe3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:03.220382 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8c257cec-a390-493d-94e6-de6301c86bb3 req-4564db34-53fc-4652-b1ba-43119dfbefe3 service nova] Creating event network-vif-deleted:f9c72eb3-acd7-4876-a341-a906ed4f69dc for instance a8b8c67f-7f2b-4502-bbda-11938ac14839 on n-h2-862876-2 Oct 28 13:24:03.246418 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8c257cec-a390-493d-94e6-de6301c86bb3 req-4564db34-53fc-4652-b1ba-43119dfbefe3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099617 Oct 28 13:24:03.247123 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2179/4450] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:03.322782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:03.323395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:03.339678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:03.340950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:03.341681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:03.344716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:03.345042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:03.350883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:03.351494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:03.351956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:03.371962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:03.372478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:03.372928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:03.390521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:03.406449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:03.406449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:03.475059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:03.475584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:03.477603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:03.479576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lazy-loading 'fault' on Instance uuid a8b8c67f-7f2b-4502-bbda-11938ac14839 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:24:03.562667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7bc5dab534d4ebb98469e3d630162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08327cee9e9b485c934663e9348ece89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:03.577408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f34671b0-dfaa-471c-ad46-23de36e59f30 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 200 len: 1303 microversion: 2.1 time: 0.259414 Oct 28 13:24:03.578559 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2272/4451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:03 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 1303 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:03.997132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:04.039461 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97436757-e0f4-4b44-8699-567a279f4127 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1471 microversion: 2.1 time: 0.702295 Oct 28 13:24:04.040811 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2180/4452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:03 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:04.487782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-290332620", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "bf35035f-0673-465a-97f1-d57f21aec178"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:04.568135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] validate_networks() for [('bf35035f-0673-465a-97f1-d57f21aec178', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:24:04.609566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:04.613978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:04.620674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:04.621454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:04.622065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:04.623648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:04.625038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:04.625827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:04.641194 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] HTTP exception thrown: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Request method failure captured: Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 HTTP/1.1 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9eZsT418PwLaEOlrd1g6jntiLDhQHLqQTIUcGT7sDVI6iAdtCPHdCN3dPyFVxRENTdMNWF1lkuvQ8ONRPBttSuWqRW1y9J-PFgTy2dGusPTe25FlHrOD6OnvqsQ6i2UHnoUqaQx-qhXTwbzjXLFF_ut-_I63FmT9tN-_BxCHRAtn54 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08327cee9e9b485c934663e9348ece89", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08327cee9e9b485c934663e9348ece89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 19e7bc5dab534d4ebb98469e3d630162 Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a8b8c67f-7f2b-4502-bbda-11938ac14839'} Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:04.642900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Returning 404 to user: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3818c529-83dd-4491-bd22-cb7081193824 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 404 len: 111 microversion: 2.1 time: 0.040482 Oct 28 13:24:04.647715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2181/4453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:04 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:24:05.069847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:05.070801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:05.081213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:05.082036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:05.082679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:05.087355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:05.088095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:05.088874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:05.132752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:05.448266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:24:05.448824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:24:05.450007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:24:05.450007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:24:05.452931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:24:05.471424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:05.472707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:05.473394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:05.474635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:05.475426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:05.476088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:05.502166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Getting quotas for project 94e78fd9e71345bea4a3fe0785815508. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:24:05.509709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Getting quotas for user 9659887abef14867bf442376933dd732 and project 94e78fd9e71345bea4a3fe0785815508. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:24:05.524594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:24:05.527388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:24:05.885890 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5dc09ac8-b9b7-4328-b5e5-8aef6275c261 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520398 Oct 28 13:24:05.887777 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2273/4454] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:24:05.906673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cebc91ed-34d5-41a7-be01-df0a54abb0d6 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:05.927758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cebc91ed-34d5-41a7-be01-df0a54abb0d6 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:06.159471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:06.177729 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c34b7901-9ef3-45b3-9f65-fdcd8b3250c5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1471 microversion: 2.1 time: 1.106766 Oct 28 13:24:06.182025 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2182/4455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:05 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1471 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:06.195595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cebc91ed-34d5-41a7-be01-df0a54abb0d6 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:06.217842 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cebc91ed-34d5-41a7-be01-df0a54abb0d6 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1227 microversion: 2.1 time: 0.321895 Oct 28 13:24:06.224525 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2274/4456] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:05 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1227 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:07.221980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:07.223286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:07.249891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1830ee25-9cdd-4a57-ad50-7a6a87dce14a tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:07.250530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1830ee25-9cdd-4a57-ad50-7a6a87dce14a tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:07.250802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:07.251721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:07.252832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:07.259270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:07.261963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:07.263688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:07.362062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1830ee25-9cdd-4a57-ad50-7a6a87dce14a tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:07.388323 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1830ee25-9cdd-4a57-ad50-7a6a87dce14a tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1227 microversion: 2.1 time: 0.147043 Oct 28 13:24:07.392807 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2275/4457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:07 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1227 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:07.782279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:07.790295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9d3a27b6-f746-47b5-9f17-629344342935 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1471 microversion: 2.1 time: 0.589135 Oct 28 13:24:07.792994 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2183/4458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:07 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1471 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:08.418636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:08.418636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:08.427732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:08.428233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:08.428676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:08.429411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:08.429903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:08.430330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:08.715580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:08.731171 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2548128-e4ca-479e-9819-0914dbeb036e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1231 microversion: 2.1 time: 0.320762 Oct 28 13:24:08.741708 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2276/4459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:08 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1231 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:08.825616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:08.826227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:08.834481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:08.835046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:08.835483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:08.836190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:08.836645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:08.837066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.132757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:09.142860 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87d22603-e2d4-4d8c-a05f-aae4e7069e1c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.320937 Oct 28 13:24:09.144738 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2184/4460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:08 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:09.497901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:09.498690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:09.509879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:09.511356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.511858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.512294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.513004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.513459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.513881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.575993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] HTTP exception thrown: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Request method failure captured: Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 HTTP/1.1 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9eZsT418PwLaEOlrd1g6jntiLDhQHLqQTIUcGT7sDVI6iAdtCPHdCN3dPyFVxRENTdMNWF1lkuvQ8ONRPBttSuWqRW1y9J-PFgTy2dGusPTe25FlHrOD6OnvqsQ6i2UHnoUqaQx-qhXTwbzjXLFF_ut-_I63FmT9tN-_BxCHRAtn54 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08327cee9e9b485c934663e9348ece89", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08327cee9e9b485c934663e9348ece89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 19e7bc5dab534d4ebb98469e3d630162 Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'a8b8c67f-7f2b-4502-bbda-11938ac14839'} Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:09.577743 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Returning 404 to user: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a8b2fdbc-f667-4f30-bada-bffbb9ba224b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 404 len: 111 microversion: 2.1 time: 0.093140 Oct 28 13:24:09.591642 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2277/4461] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:24:09 2022] DELETE /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:24:09.593925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:09.593925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: a8b8c67f-7f2b-4502-bbda-11938ac14839] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:09.598069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.598648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.599118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.599833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.600295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.600722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.622075 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] HTTP exception thrown: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Request method failure captured: Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 HTTP/1.1 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9eZsT418PwLaEOlrd1g6jntiLDhQHLqQTIUcGT7sDVI6iAdtCPHdCN3dPyFVxRENTdMNWF1lkuvQ8ONRPBttSuWqRW1y9J-PFgTy2dGusPTe25FlHrOD6OnvqsQ6i2UHnoUqaQx-qhXTwbzjXLFF_ut-_I63FmT9tN-_BxCHRAtn54 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08327cee9e9b485c934663e9348ece89", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08327cee9e9b485c934663e9348ece89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 19e7bc5dab534d4ebb98469e3d630162 Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'a8b8c67f-7f2b-4502-bbda-11938ac14839'} Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.623710 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Returning 404 to user: Instance a8b8c67f-7f2b-4502-bbda-11938ac14839 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:09.628448 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f0ea79d9-a28d-4813-8fee-21e300fe64c0 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839" status: 404 len: 111 microversion: 2.1 time: 0.038841 Oct 28 13:24:09.633717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:09.634231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:09.641802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.647105 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2185/4462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:09 2022] GET /compute/v2.1/servers/a8b8c67f-7f2b-4502-bbda-11938ac14839 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:24:09.647441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.648063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.648983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.649627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.650440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.670106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] HTTP exception thrown: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Request method failure captured: Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f HTTP/1.1 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9eZsT418PwLaEOlrd1g6jntiLDhQHLqQTIUcGT7sDVI6iAdtCPHdCN3dPyFVxRENTdMNWF1lkuvQ8ONRPBttSuWqRW1y9J-PFgTy2dGusPTe25FlHrOD6OnvqsQ6i2UHnoUqaQx-qhXTwbzjXLFF_ut-_I63FmT9tN-_BxCHRAtn54 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08327cee9e9b485c934663e9348ece89", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08327cee9e9b485c934663e9348ece89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 19e7bc5dab534d4ebb98469e3d630162 Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4c3f1c2d-64af-4612-b57a-d59438fc342f'} Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:09.675404 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.681033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Returning 404 to user: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:09.683919 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da213e02-481c-44e3-998d-7ba5d4a56d56 tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 404 len: 111 microversion: 2.1 time: 0.053950 Oct 28 13:24:09.696721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:09.702583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] [instance: 4c3f1c2d-64af-4612-b57a-d59438fc342f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:09.704235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2278/4463] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:24:09 2022] DELETE /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:24:09.711378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.713999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.714613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.715558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.716222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.716824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.740257 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] HTTP exception thrown: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Request method failure captured: Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f HTTP/1.1 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9eZsT418PwLaEOlrd1g6jntiLDhQHLqQTIUcGT7sDVI6iAdtCPHdCN3dPyFVxRENTdMNWF1lkuvQ8ONRPBttSuWqRW1y9J-PFgTy2dGusPTe25FlHrOD6OnvqsQ6i2UHnoUqaQx-qhXTwbzjXLFF_ut-_I63FmT9tN-_BxCHRAtn54 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08327cee9e9b485c934663e9348ece89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08327cee9e9b485c934663e9348ece89", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08327cee9e9b485c934663e9348ece89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 08327cee9e9b485c934663e9348ece89 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersTestMultiNic-732627997 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 19e7bc5dab534d4ebb98469e3d630162 Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersTestMultiNic-732627997-project Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '4c3f1c2d-64af-4612-b57a-d59438fc342f'} Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:09.741841 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.748596 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:09.748596 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:09.748596 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:09.748596 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:09.748596 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:09.748596 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. Oct 28 13:24:09.748596 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:09.752303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] Returning 404 to user: Instance 4c3f1c2d-64af-4612-b57a-d59438fc342f could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:09.753639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f701835-e19c-4010-938d-e7216c0f209b tempest-ServersTestMultiNic-732627997 tempest-ServersTestMultiNic-732627997-project] 10.222.0.25 "GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f" status: 404 len: 111 microversion: 2.1 time: 0.060819 Oct 28 13:24:09.757868 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2186/4464] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:09 2022] GET /compute/v2.1/servers/4c3f1c2d-64af-4612-b57a-d59438fc342f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:24:09.767765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:09.768411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:09.788951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.789382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.789838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:09.790568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:09.791069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:09.791508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:10.171605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:10.173244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:10.180847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:10.181711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:10.182666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:10.183767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:10.185089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:10.185827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:10.405627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:10.437960 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-194ac3d1-b828-4e46-b9a1-fb4f2ec6ea43 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.268591 Oct 28 13:24:10.440041 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2187/4465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:10 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:10.542785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:10.571451 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3a9f451c-86a3-455b-92ac-71249bf937e9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1287 microversion: 2.1 time: 0.814082 Oct 28 13:24:10.582793 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2279/4466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:09 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1287 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:11.478608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:11.479273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:11.503120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:11.506896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:11.506896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:11.506896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:11.506896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:11.508162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:11.611606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:11.613488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:11.625759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:11.626630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:11.627339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:11.628269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:11.628940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:11.630262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:11.756075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:11.766190 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69a1f881-0793-48ea-9e14-432f4d4b4a28 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.301493 Oct 28 13:24:11.767013 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2188/4467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:11 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:11.813707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:11.822280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4e60c9b-f20f-4bb9-856c-c25bb122f6e5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1285 microversion: 2.1 time: 0.215237 Oct 28 13:24:11.823088 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2280/4468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:11 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:12.792052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:12.792678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:12.812119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:12.812625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:12.813068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:12.820782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:12.822207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:12.822669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:12.857784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:12.858467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:12.881667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:12.885955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:12.886722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:12.887672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:12.888340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:12.888938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:13.207471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:13.212361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:13.241586 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58c88ec0-a221-4088-86ee-f6a222c53dbb tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1327 microversion: 2.1 time: 0.385433 Oct 28 13:24:13.242737 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2281/4469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:12 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1327 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:13.563822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:13.578231 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-522530a4-1608-44da-b02e-b7215d9cb063 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.792218 Oct 28 13:24:13.591203 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2189/4470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:12 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:14.048456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9ccc8192-280d-44c3-8518-ca4177afb60c req-372d1347-a003-4aaa-9da1-de302ed8aa9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc", "tag": "85cf6c00-6d2e-4d72-9252-6505dd7262bc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:14.072749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9ccc8192-280d-44c3-8518-ca4177afb60c req-372d1347-a003-4aaa-9da1-de302ed8aa9c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:14.078522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9ccc8192-280d-44c3-8518-ca4177afb60c req-372d1347-a003-4aaa-9da1-de302ed8aa9c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:14.078522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9ccc8192-280d-44c3-8518-ca4177afb60c req-372d1347-a003-4aaa-9da1-de302ed8aa9c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:14.103304 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9ccc8192-280d-44c3-8518-ca4177afb60c req-372d1347-a003-4aaa-9da1-de302ed8aa9c service nova] Creating event network-changed:85cf6c00-6d2e-4d72-9252-6505dd7262bc for instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc on n-h2-862876-2 Oct 28 13:24:14.111633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9ccc8192-280d-44c3-8518-ca4177afb60c req-372d1347-a003-4aaa-9da1-de302ed8aa9c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067355 Oct 28 13:24:14.118505 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2282/4471] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:14.271234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:14.273083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:14.300483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:14.301473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:14.302237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:14.303317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:14.311410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:14.311410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:14.605961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:14.607185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:14.614762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:14.615803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:14.616594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:14.617506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:14.618694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:14.619344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:14.896406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:14.917854 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-96d24c61-e97c-4398-9e7e-a539c4ecaf49 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.315557 Oct 28 13:24:14.921072 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2283/4472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:14 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:14.973997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:14.991495 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3e4ca500-61a2-48ab-8edd-3112dbff1373 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1327 microversion: 2.1 time: 0.725721 Oct 28 13:24:14.994259 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2190/4473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:14 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1327 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:15.945058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:15.946463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:15.968073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:15.970459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:15.971194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:15.971856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:15.972773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:15.973450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:15.974065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:16.018486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:16.019135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:16.026162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:16.027172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:16.027826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:16.028792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:16.029457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:16.030121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:16.359542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:16.371302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a32e7795-5f47-46ac-8a07-e9a45cd51e59 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1327 microversion: 2.1 time: 0.357895 Oct 28 13:24:16.372262 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2191/4474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:16 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1327 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:16.817450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:16.825847 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0ba96bd-d42d-4a7e-aed8-30aefdf0a699 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.885624 Oct 28 13:24:16.835521 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2284/4475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:15 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:17.396517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:17.397142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:17.409589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:17.412623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:17.413154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:17.413916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:17.414392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:17.423425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:17.865923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:17.866467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:17.879850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:17.881392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:17.881894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:17.882341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:17.894163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:17.895902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:17.896371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:18.305742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:18.323211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c11cbc56-9be7-4ef9-b044-e5b3390ce174 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1327 microversion: 2.1 time: 0.928830 Oct 28 13:24:18.332882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2192/4476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:17 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1327 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:18.385949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:18.399219 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-beb8bd6c-241e-418c-8eee-79c4e13d7043 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.544340 Oct 28 13:24:18.409803 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2285/4477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:17 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:19.132989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-eb40e9fd-b225-4543-a27d-ced47ae932a3 req-a87ba784-f2da-418e-acb4-996cd2e8964d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc", "name": "network-vif-plugged", "status": "completed", "tag": "85cf6c00-6d2e-4d72-9252-6505dd7262bc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:19.144432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eb40e9fd-b225-4543-a27d-ced47ae932a3 req-a87ba784-f2da-418e-acb4-996cd2e8964d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:19.144910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eb40e9fd-b225-4543-a27d-ced47ae932a3 req-a87ba784-f2da-418e-acb4-996cd2e8964d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:19.145575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eb40e9fd-b225-4543-a27d-ced47ae932a3 req-a87ba784-f2da-418e-acb4-996cd2e8964d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:19.159402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-eb40e9fd-b225-4543-a27d-ced47ae932a3 req-a87ba784-f2da-418e-acb4-996cd2e8964d service nova] Creating event network-vif-plugged:85cf6c00-6d2e-4d72-9252-6505dd7262bc for instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc on n-h2-862876-2 Oct 28 13:24:19.168811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-eb40e9fd-b225-4543-a27d-ced47ae932a3 req-a87ba784-f2da-418e-acb4-996cd2e8964d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035517 Oct 28 13:24:19.172951 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2193/4478] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:19.357826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:19.358519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:19.369727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:19.370467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:19.374245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:19.375313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:19.375858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:19.376299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:19.424250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:19.425224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:19.433892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:19.437523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:19.438204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:19.445911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:19.445911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:19.445911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:19.617471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:19.626917 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1f47b05-507f-4d6c-b1d2-57ce6ab25761 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1327 microversion: 2.1 time: 0.272776 Oct 28 13:24:19.627609 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2286/4479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:19 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1327 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:19.709921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:19.719763 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-04540542-f103-4146-84bb-515d4a86afed tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.299623 Oct 28 13:24:19.720345 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2194/4480] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:19 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:20.649975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:20.650763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:20.657870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:20.658388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:20.659083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:20.659786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:20.665614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:20.665614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:20.743544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:20.744813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:20.754532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:20.760491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:20.761440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:20.762811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:20.763486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:20.764187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:20.981338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:20.999921 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc718f37-522a-4c43-98f0-836ca807b07a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.259795 Oct 28 13:24:21.003936 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2195/4481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:20 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:21.075341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:21.091251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f400a869-291b-43cd-b505-73f83215dbd5 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1327 microversion: 2.1 time: 0.444908 Oct 28 13:24:21.092176 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2287/4482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:20 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1327 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:22.036109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:22.036667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:22.055294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:22.068376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:22.068611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:22.069371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:22.069844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:22.083382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:22.113872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:22.115163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:22.126057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:22.130279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:22.143845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:22.148115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:22.149662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:22.150216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:22.321968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:22.328477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:22.334230 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11fb338c-1258-4674-8ece-8da82e403032 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.298406 Oct 28 13:24:22.335442 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2196/4483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:22 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:22.338628 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-769abdc8-2578-4377-8a3e-bac990415010 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1527 microversion: 2.1 time: 0.228547 Oct 28 13:24:22.339308 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2288/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:22 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1527 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:22.368553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:22.369483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:22.377981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:22.378490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:22.378976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:22.379702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:22.380403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:22.380727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:22.652306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:22.661082 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-09679f27-0f7a-414d-832e-6d521f91409b tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1527 microversion: 2.1 time: 0.296923 Oct 28 13:24:22.661662 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2197/4485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:22 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1527 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:23.051969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:23.052832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:23.109130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.110473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.111131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.112062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.114370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.116368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.160359 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] HTTP exception thrown: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Request method failure captured: Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc HTTP/1.1 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9f0-twiG7_7RmCEPOnG0ACKfjTGr7uOlxtZVcggBAIANBIICWO8TP4c8AMgWOOTn0ZP51vcOeerWQkgXema2u06gF_kDJlem-cQPqB1GTKjx7IPpSYWb6mhuNMo1UXzl-3HXV6dscWHan_idwPSkH_DFtm2E894eKxzy4TzK1kMszg Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d525efee311c4d58b06c3bb015970941 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1989480023 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d525efee311c4d58b06c3bb015970941"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d525efee311c4d58b06c3bb015970941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d525efee311c4d58b06c3bb015970941", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d525efee311c4d58b06c3bb015970941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1989480023 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d525efee311c4d58b06c3bb015970941 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1989480023 Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1989480023-project Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ac89fe42e5194b7382d1243cbf558e1a Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1989480023-project Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc'} Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:23.166312 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.172491 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.175854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Returning 404 to user: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:23.176844 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9413ac4c-f836-4b87-8fc1-90df33548293 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 404 len: 111 microversion: 2.1 time: 0.496588 Oct 28 13:24:23.177827 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2289/4486] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:24:22 2022] DELETE /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 111 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:24:23.194129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:23.196271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:23.205586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.208001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.210214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.215119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.219620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.220428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.359254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:23.360632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:23.386308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.397615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.397615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.397615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.397615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.397615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.577899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:23.610045 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca334bb5-c20b-4d41-aed9-253b9a6f1210 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1527 microversion: 2.1 time: 0.424903 Oct 28 13:24:23.622987 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2198/4487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:23 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1527 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:23.634658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Action: 'update', calling method: >, body: {"server": {"name": "6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc_new"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:23.637174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:23.644975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.645887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.656560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.656560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.656560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.656560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.665038 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] HTTP exception thrown: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Request method failure captured: Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: request: PUT /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc HTTP/1.1 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 64 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9f0-twiG7_7RmCEPOnG0ACKfjTGr7uOlxtZVcggBAIANBIICWO8TP4c8AMgWOOTn0ZP51vcOeerWQkgXema2u06gF_kDJlem-cQPqB1GTKjx7IPpSYWb6mhuNMo1UXzl-3HXV6dscWHan_idwPSkH_DFtm2E894eKxzy4TzK1kMszg Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d525efee311c4d58b06c3bb015970941 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1989480023 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d525efee311c4d58b06c3bb015970941"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d525efee311c4d58b06c3bb015970941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d525efee311c4d58b06c3bb015970941", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d525efee311c4d58b06c3bb015970941"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1989480023 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d525efee311c4d58b06c3bb015970941 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1989480023 Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1989480023-project Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ac89fe42e5194b7382d1243cbf558e1a Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1989480023-project Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: {"server": {"name": "6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc_new"}} Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc', 'body': {'server': {'name': '6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc_new'}}} Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:24:23.667276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:23.671172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:23.673656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] Returning 404 to user: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:23.674984 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c72852e-2de8-4319-b36f-d0e09b9ef7a2 tempest-ServersNegativeTestMultiTenantJSON-1989480023 tempest-ServersNegativeTestMultiTenantJSON-1989480023-project] 10.222.0.25 "PUT /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 404 len: 111 microversion: 2.1 time: 0.044288 Oct 28 13:24:23.676044 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2199/4488] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:24:23 2022] PUT /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:24:23.681211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:23.686706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:23.687595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:23.692917 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-674f31b4-0678-4e65-8f1d-15b950150821 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.338241 Oct 28 13:24:23.695367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.695803 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2290/4489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:23 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:23.696207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.696815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.697694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:23.699023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:23.699023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:23.754115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:24:23.812156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:24.281824 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb452a43-cb7d-432d-9275-5b53912e6c74 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 204 len: 0 microversion: 2.1 time: 0.599301 Oct 28 13:24:24.283158 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2200/4490] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:24:23 2022] DELETE /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:24:24.297244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:24.299098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:24.313528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:24.314265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:24.314886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:24.315762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:24.318500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:24.319143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:24.704025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:24.725054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:24.726312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:24.727680 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d76272e-6b66-4e9a-9d25-02a8035d9af9 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1533 microversion: 2.1 time: 0.434747 Oct 28 13:24:24.728555 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2291/4491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:24 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1533 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:24.747340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:24.749065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:24.749065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:24.749341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:24.751684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:24.752323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:25.021917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:25.046071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0954c119-7290-4b21-b01e-d5717482c9a6 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1476 microversion: 2.1 time: 0.325477 Oct 28 13:24:25.055794 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2201/4492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:24 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1476 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:25.770434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:25.771096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:25.785764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:25.792615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:25.793406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:25.794332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:25.798419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:25.799172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:25.929217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:25.930397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:25.938176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:25.939032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:25.939716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:25.940661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:25.941333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:25.941981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:25.980052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:24:26.441418 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-513c084b-80c0-47cd-aed8-85e717cb8749 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 204 len: 0 microversion: 2.32 time: 0.514993 Oct 28 13:24:26.446017 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2202/4493] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:24:25 2022] DELETE /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:24:26.454392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:26.456465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:26.465764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:26.466019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:26.468850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:26.470432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:26.471109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:26.471698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:26.496145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:26.514246 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81bb9b86-37ad-4cb8-8d39-4ef095fdb22e tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1533 microversion: 2.1 time: 0.758054 Oct 28 13:24:26.529956 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2292/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:25 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1533 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:26.534059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:26.537660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:26.553241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:26.557123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:26.557815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:26.559705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:26.564725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:26.566880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:26.924355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:26.960232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c9862ae7-7aab-495b-b940-bd137e65a59a tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1475 microversion: 2.1 time: 0.514845 Oct 28 13:24:26.963126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2203/4495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:26 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:27.352374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:27.368140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:27.369649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:27.370990 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bdc6fcd3-2b93-4ba8-baa3-7507c41948c1 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2958 microversion: 2.32 time: 0.851790 Oct 28 13:24:27.371552 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2293/4496] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:26 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2958 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:27.542968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:27.551529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:27.583188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:27.583188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:27.583188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:27.587243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:27.589747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:27.591541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:27.822610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:27.836799 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f785c16f-aba0-4ab1-b051-cc42af3fa292 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1533 microversion: 2.1 time: 0.301229 Oct 28 13:24:27.838072 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2204/4497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:27 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1533 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:27.934626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-15bdfbdc-620a-46d1-b826-0c6086d6fd19 req-a75810cb-9398-4b64-8e69-f9431ee07a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:27.936195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-15bdfbdc-620a-46d1-b826-0c6086d6fd19 req-a75810cb-9398-4b64-8e69-f9431ee07a38 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:27.936781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-15bdfbdc-620a-46d1-b826-0c6086d6fd19 req-a75810cb-9398-4b64-8e69-f9431ee07a38 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:27.937469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-15bdfbdc-620a-46d1-b826-0c6086d6fd19 req-a75810cb-9398-4b64-8e69-f9431ee07a38 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:27.950866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-15bdfbdc-620a-46d1-b826-0c6086d6fd19 req-a75810cb-9398-4b64-8e69-f9431ee07a38 service nova] Creating event network-vif-unplugged:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h2-862876-2 Oct 28 13:24:27.956892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-15bdfbdc-620a-46d1-b826-0c6086d6fd19 req-a75810cb-9398-4b64-8e69-f9431ee07a38 service nova] Instance a6d1f37a-6a9b-4105-976e-294d3e753112 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:24:27.968425 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-15bdfbdc-620a-46d1-b826-0c6086d6fd19 req-a75810cb-9398-4b64-8e69-f9431ee07a38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047455 Oct 28 13:24:27.969033 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2294/4498] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:27.991859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:27.992489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:27.999381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:27.999872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:28.000311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:28.001005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:28.001466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:28.001928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:28.187825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:28.196665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9dbb4e81-8160-4319-ae32-8c9ca518aded tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1475 microversion: 2.1 time: 0.208663 Oct 28 13:24:28.205830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2205/4499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:27 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1475 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:28.413195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:28.414125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:28.423912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:28.424701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:28.425317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:28.426249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:28.426914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:28.427357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:28.864121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:28.865909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:28.871648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:28.878904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:28.879585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:28.880035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:28.880763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:28.881220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:28.881640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:28.923548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:28.924054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:28.924495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:28.924957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lazy-loading 'fault' on Instance uuid 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:24:28.972936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9659887abef14867bf442376933dd732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e78fd9e71345bea4a3fe0785815508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:28.988571 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0de1fa6c-dcb3-4815-847f-10a50f534a46 tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 200 len: 1317 microversion: 2.1 time: 0.131123 Oct 28 13:24:28.989326 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2206/4500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:28 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 1317 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:29.219903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:29.220536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:29.228010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:29.228552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:29.229180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:29.230229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:29.234182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:29.234182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:29.404238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:29.438402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:29.449530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:29.453713 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-958bda35-4ac4-479f-b631-9426eca74236 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2958 microversion: 2.32 time: 1.046102 Oct 28 13:24:29.454409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2295/4501] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:28 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2958 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:29.823350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:29.844878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a7cfd6e-3463-40c4-b00e-d14eea1934f8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1475 microversion: 2.1 time: 0.621859 Oct 28 13:24:29.845837 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2207/4502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:29 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:29.990822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc", "name": "network-vif-deleted", "tag": "85cf6c00-6d2e-4d72-9252-6505dd7262bc"}, {"name": "network-changed", "server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:30.013283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:30.014953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] [instance: 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:30.027651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:30.028155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:30.028603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:30.029391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:30.029884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:30.030312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:30.033678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:30.034163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:30.034595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:30.083629 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] HTTP exception thrown: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Request method failure captured: Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc HTTP/1.1 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9fmVNe0aNU0zoWaWKQau4ysCmmTJaq2zaX57dKaS9cTmHuUFadDbHc2FXrxZ8Se50S23x-P0KE1h1m04z8Qr8XfCLcpAkn7obd_zgNfXZqn9e73TzgmFc3JrwiN919EjFn0b0eZuHLyTDqvharTPZbr6vyCkO2UUbRa5mE66h1ARMA Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 94e78fd9e71345bea4a3fe0785815508 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-53601619 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e78fd9e71345bea4a3fe0785815508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94e78fd9e71345bea4a3fe0785815508"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94e78fd9e71345bea4a3fe0785815508", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94e78fd9e71345bea4a3fe0785815508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-53601619 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 94e78fd9e71345bea4a3fe0785815508 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-53601619 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestMultiTenantJSON-53601619-project Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 9659887abef14867bf442376933dd732 Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-53601619-project Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc'} Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:30.085833 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:24:30.091879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] Returning 404 to user: Instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:24:30.094511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-af2fa158-39e6-42b7-80c6-54db5185e8dc tempest-ServersNegativeTestMultiTenantJSON-53601619 tempest-ServersNegativeTestMultiTenantJSON-53601619-project] 10.222.0.25 "GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc" status: 404 len: 111 microversion: 2.1 time: 0.083035 Oct 28 13:24:30.095165 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2208/4503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:30 2022] GET /compute/v2.1/servers/6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:24:30.097654 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] Creating event network-vif-deleted:85cf6c00-6d2e-4d72-9252-6505dd7262bc for instance 6ccc61a6-f05b-4f4d-a962-c3edfcd79ffc on n-h2-862876-2 Oct 28 13:24:30.098292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] Creating event network-changed:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h2-862876-2 Oct 28 13:24:30.105090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] Instance a6d1f37a-6a9b-4105-976e-294d3e753112 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:24:30.127779 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0c3819ca-96ad-47e1-af66-5ea17dc9e00d req-80472e3a-7abc-41c6-a031-c1dfa8e43595 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.134978 Oct 28 13:24:30.127779 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2296/4504] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:30.482002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:30.482611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:30.494296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:30.500474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:30.502440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:30.503361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:30.504394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:30.506707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:30.873629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:30.874914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:30.883871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:30.890334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:30.891041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:30.891962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:30.892587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:30.894782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:31.160913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:31.175234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:31.178942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:31.181621 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-497af9ee-4434-4a81-a0e0-a45a45dc0034 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2958 microversion: 2.32 time: 0.703227 Oct 28 13:24:31.183572 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2209/4505] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:30 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2958 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:31.401412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:31.421757 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1fd7641f-b114-4c45-8a71-53c00a00355e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1475 microversion: 2.1 time: 0.545662 Oct 28 13:24:31.445831 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2297/4506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:30 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1475 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:32.215363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:32.215888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:32.233537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:32.239081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:32.239770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:32.240536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:32.241011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:32.241443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:32.452817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:32.460161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:32.502556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:32.502556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:32.502556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:32.503289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:32.503867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:32.506639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:32.605498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:32.627091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:32.629610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:32.632575 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd703c56-1fea-4124-9174-c0c10578b4c4 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2937 microversion: 2.32 time: 0.422748 Oct 28 13:24:32.633727 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2210/4507] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:32 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2937 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:32.862967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:32.881575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e8b86b9-4b2d-4df1-8c75-8ac1a4d649d2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1473 microversion: 2.1 time: 0.432221 Oct 28 13:24:32.883146 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2298/4508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:32 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1473 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:33.018461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ae47f5fc-7edd-48e8-bd36-eb616d6d9b85 req-9fe4e803-e124-4810-b7e1-433a8b986099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-unplugged", "status": "completed", "tag": "aa4b0395-5a41-4684-922b-b72b520b96b8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:33.038761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ae47f5fc-7edd-48e8-bd36-eb616d6d9b85 req-9fe4e803-e124-4810-b7e1-433a8b986099 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:33.042303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ae47f5fc-7edd-48e8-bd36-eb616d6d9b85 req-9fe4e803-e124-4810-b7e1-433a8b986099 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:33.042964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ae47f5fc-7edd-48e8-bd36-eb616d6d9b85 req-9fe4e803-e124-4810-b7e1-433a8b986099 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:33.069052 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ae47f5fc-7edd-48e8-bd36-eb616d6d9b85 req-9fe4e803-e124-4810-b7e1-433a8b986099 service nova] Creating event network-vif-unplugged:aa4b0395-5a41-4684-922b-b72b520b96b8 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:33.076472 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ae47f5fc-7edd-48e8-bd36-eb616d6d9b85 req-9fe4e803-e124-4810-b7e1-433a8b986099 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062776 Oct 28 13:24:33.078434 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2211/4509] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:33.664960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:33.666152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:33.675192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:33.677883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:33.677883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:33.677883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:33.678687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:33.679312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:33.911918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:33.913680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:33.935443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:33.937099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:33.937995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:33.938911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:33.939719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:33.940706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:34.503195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:34.516593 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-049d0c41-f2b6-4b9d-88d3-378397f545f0 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1470 microversion: 2.1 time: 0.609196 Oct 28 13:24:34.518492 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2212/4510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:33 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1470 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:34.531874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1f7fa2c5-d3c4-4983-92b8-acad19e5061e req-ad75f3e2-9293-4147-967a-e1e629753ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-deleted", "tag": "c906a364-1c73-4835-a3cb-a92097af050c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:34.591103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1f7fa2c5-d3c4-4983-92b8-acad19e5061e req-ad75f3e2-9293-4147-967a-e1e629753ecd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:34.591820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1f7fa2c5-d3c4-4983-92b8-acad19e5061e req-ad75f3e2-9293-4147-967a-e1e629753ecd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:34.592508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1f7fa2c5-d3c4-4983-92b8-acad19e5061e req-ad75f3e2-9293-4147-967a-e1e629753ecd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:34.616031 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1f7fa2c5-d3c4-4983-92b8-acad19e5061e req-ad75f3e2-9293-4147-967a-e1e629753ecd service nova] Creating event network-vif-deleted:c906a364-1c73-4835-a3cb-a92097af050c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:34.634695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1f7fa2c5-d3c4-4983-92b8-acad19e5061e req-ad75f3e2-9293-4147-967a-e1e629753ecd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114875 Oct 28 13:24:34.639362 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2213/4511] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:34.672067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:34.675990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:34.695745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:34.697506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:34.698124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:34.703758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:34.704742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:34.705393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:35.042260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:35.056403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:35.058264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:35.062672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d3a201b0-155e-4f7a-b153-f5cd7747dee0 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2869 microversion: 2.32 time: 1.401609 Oct 28 13:24:35.064818 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2299/4512] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:33 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2869 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:35.135044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9e3a0c87-e770-436f-82dc-ab6e055bf92f req-058f77a3-3964-42bd-a891-a5d7cd561ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-unplugged", "status": "completed", "tag": "bffbf9ff-87ff-46cb-a6a2-b5138ecb6120"}, {"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-unplugged", "status": "completed", "tag": "216191b8-6f5e-47bd-9d63-06490921d508"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:35.150865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e3a0c87-e770-436f-82dc-ab6e055bf92f req-058f77a3-3964-42bd-a891-a5d7cd561ad2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:35.153672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e3a0c87-e770-436f-82dc-ab6e055bf92f req-058f77a3-3964-42bd-a891-a5d7cd561ad2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:35.154792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9e3a0c87-e770-436f-82dc-ab6e055bf92f req-058f77a3-3964-42bd-a891-a5d7cd561ad2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:35.195717 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9e3a0c87-e770-436f-82dc-ab6e055bf92f req-058f77a3-3964-42bd-a891-a5d7cd561ad2 service nova] Creating event network-vif-unplugged:bffbf9ff-87ff-46cb-a6a2-b5138ecb6120 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:35.196814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9e3a0c87-e770-436f-82dc-ab6e055bf92f req-058f77a3-3964-42bd-a891-a5d7cd561ad2 service nova] Creating event network-vif-unplugged:216191b8-6f5e-47bd-9d63-06490921d508 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:35.204117 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9e3a0c87-e770-436f-82dc-ab6e055bf92f req-058f77a3-3964-42bd-a891-a5d7cd561ad2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.077252 Oct 28 13:24:35.205355 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2300/4513] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:24:35.205981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:35.436579 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-047cd820-e1f9-4230-a379-fbf420460464 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "POST /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112/action" status: 202 len: 0 microversion: 2.1 time: 0.792167 Oct 28 13:24:35.438700 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2214/4514] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:24:34 2022] POST /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:24:35.459199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:35.461222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:35.477630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:35.478136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:35.478588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:35.479386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:35.479845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:35.484247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:35.497428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:36.111009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:36.112106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:36.130918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:36.131426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:36.132610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:36.148170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:36.148170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:36.154194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:36.728516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:36.745319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:36.748891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:36.749622 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f30dfdca-04bb-441b-89c1-686ae2ec8b0a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2534 microversion: 2.32 time: 0.651438 Oct 28 13:24:36.750410 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2215/4515] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:36 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2534 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:36.755596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1b7704e2-8cc0-4741-98a6-84fe71d33325 req-0974a38f-6313-4e32-87ca-2a0137589df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-deleted", "tag": "bffbf9ff-87ff-46cb-a6a2-b5138ecb6120"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:36.767349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1b7704e2-8cc0-4741-98a6-84fe71d33325 req-0974a38f-6313-4e32-87ca-2a0137589df8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:36.768341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1b7704e2-8cc0-4741-98a6-84fe71d33325 req-0974a38f-6313-4e32-87ca-2a0137589df8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:36.769296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1b7704e2-8cc0-4741-98a6-84fe71d33325 req-0974a38f-6313-4e32-87ca-2a0137589df8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:36.787142 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1b7704e2-8cc0-4741-98a6-84fe71d33325 req-0974a38f-6313-4e32-87ca-2a0137589df8 service nova] Creating event network-vif-deleted:bffbf9ff-87ff-46cb-a6a2-b5138ecb6120 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:36.793336 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1b7704e2-8cc0-4741-98a6-84fe71d33325 req-0974a38f-6313-4e32-87ca-2a0137589df8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041277 Oct 28 13:24:36.794544 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2216/4516] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:37.270220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3df91061-6376-467e-9ceb-317f7edd7b92 req-26d3cf3b-3160-47ff-991f-161a3e42bab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a1ba3d-63f3-4bcb-b866-ef09c515046c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:37.311643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3df91061-6376-467e-9ceb-317f7edd7b92 req-26d3cf3b-3160-47ff-991f-161a3e42bab6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:37.312769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3df91061-6376-467e-9ceb-317f7edd7b92 req-26d3cf3b-3160-47ff-991f-161a3e42bab6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:37.315418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3df91061-6376-467e-9ceb-317f7edd7b92 req-26d3cf3b-3160-47ff-991f-161a3e42bab6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:37.349559 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3df91061-6376-467e-9ceb-317f7edd7b92 req-26d3cf3b-3160-47ff-991f-161a3e42bab6 service nova] Creating event network-vif-unplugged:a2a1ba3d-63f3-4bcb-b866-ef09c515046c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:37.366840 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3df91061-6376-467e-9ceb-317f7edd7b92 req-26d3cf3b-3160-47ff-991f-161a3e42bab6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100497 Oct 28 13:24:37.367873 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2217/4517] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:37.667159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:37.688421 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-312a44f5-c1b1-45dc-b229-9ebbe4bcce31 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 2.244197 Oct 28 13:24:37.703577 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2301/4518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:35 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:37.783159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:37.785335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:37.826365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:37.828349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:37.830680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:37.833279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:37.839495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:37.841320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:38.717690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:38.718419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:38.736720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:38.746043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:38.746718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:38.749316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:38.758381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:38.764094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:39.018920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:39.038221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:39.041570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:39.045437 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f1c4652-2123-4afc-b58a-020ad95e7214 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 2373 microversion: 2.32 time: 1.267589 Oct 28 13:24:39.050514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2218/4519] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:37 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 2373 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:39.062965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a287c04e-dec2-453c-8ec8-caa170ad34ad req-e0fca4ce-0056-42ef-a23b-20cc3b009871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-deleted", "tag": "aa4b0395-5a41-4684-922b-b72b520b96b8"}, {"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-deleted", "tag": "216191b8-6f5e-47bd-9d63-06490921d508"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:39.086312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a287c04e-dec2-453c-8ec8-caa170ad34ad req-e0fca4ce-0056-42ef-a23b-20cc3b009871 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:39.091510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a287c04e-dec2-453c-8ec8-caa170ad34ad req-e0fca4ce-0056-42ef-a23b-20cc3b009871 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:39.092252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a287c04e-dec2-453c-8ec8-caa170ad34ad req-e0fca4ce-0056-42ef-a23b-20cc3b009871 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:39.127416 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a287c04e-dec2-453c-8ec8-caa170ad34ad req-e0fca4ce-0056-42ef-a23b-20cc3b009871 service nova] Creating event network-vif-deleted:aa4b0395-5a41-4684-922b-b72b520b96b8 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:39.128108 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a287c04e-dec2-453c-8ec8-caa170ad34ad req-e0fca4ce-0056-42ef-a23b-20cc3b009871 service nova] Creating event network-vif-deleted:216191b8-6f5e-47bd-9d63-06490921d508 for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:39.149154 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a287c04e-dec2-453c-8ec8-caa170ad34ad req-e0fca4ce-0056-42ef-a23b-20cc3b009871 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096613 Oct 28 13:24:39.153971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2219/4520] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:39.386982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:39.402418 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b96415e5-095d-4389-9b16-d2e10f922761 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 0.688745 Oct 28 13:24:39.405987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2302/4521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:38 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:39.775738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9a572dd8-199d-40e7-b537-181ae03b12e3 req-2efcb114-0fe7-4d0b-8848-d1b98fd0974a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "name": "network-vif-plugged", "status": "completed", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:39.792205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9a572dd8-199d-40e7-b537-181ae03b12e3 req-2efcb114-0fe7-4d0b-8848-d1b98fd0974a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:39.792934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9a572dd8-199d-40e7-b537-181ae03b12e3 req-2efcb114-0fe7-4d0b-8848-d1b98fd0974a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:39.793528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9a572dd8-199d-40e7-b537-181ae03b12e3 req-2efcb114-0fe7-4d0b-8848-d1b98fd0974a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:39.811492 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9a572dd8-199d-40e7-b537-181ae03b12e3 req-2efcb114-0fe7-4d0b-8848-d1b98fd0974a service nova] Creating event network-vif-plugged:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h2-862876-2 Oct 28 13:24:39.818114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-9a572dd8-199d-40e7-b537-181ae03b12e3 req-2efcb114-0fe7-4d0b-8848-d1b98fd0974a service nova] Instance a6d1f37a-6a9b-4105-976e-294d3e753112 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:24:39.839533 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9a572dd8-199d-40e7-b537-181ae03b12e3 req-2efcb114-0fe7-4d0b-8848-d1b98fd0974a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068025 Oct 28 13:24:39.841025 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2220/4522] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:40.089182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:40.089798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:40.116898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:40.117619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:40.118219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:40.119145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:40.124986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:40.125903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:40.394228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:40.410675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:40.412128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:40.413318 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94ce9d19-2c7e-497a-9167-0ff531bb39da tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.335020 Oct 28 13:24:40.413881 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2303/4523] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:40 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:40.429979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:40.431363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:40.449488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:40.449982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:40.450698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:40.451134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:40.452627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:40.453083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:41.168284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:41.178008 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4bfb1653-02e5-483f-bd63-f12f537eb53b tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 0.749878 Oct 28 13:24:41.187029 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2221/4524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:40 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:41.188320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-af52949d-63fc-42fc-8a11-0ae0890f336e req-d1556933-b39b-484a-879f-d74e9f488571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31e02c-74ff-4b92-9790-edc0459908bf", "name": "network-vif-deleted", "tag": "a2a1ba3d-63f3-4bcb-b866-ef09c515046c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:41.224488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af52949d-63fc-42fc-8a11-0ae0890f336e req-d1556933-b39b-484a-879f-d74e9f488571 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:41.224997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af52949d-63fc-42fc-8a11-0ae0890f336e req-d1556933-b39b-484a-879f-d74e9f488571 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:41.225452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af52949d-63fc-42fc-8a11-0ae0890f336e req-d1556933-b39b-484a-879f-d74e9f488571 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:41.283160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-af52949d-63fc-42fc-8a11-0ae0890f336e req-d1556933-b39b-484a-879f-d74e9f488571 service nova] Creating event network-vif-deleted:a2a1ba3d-63f3-4bcb-b866-ef09c515046c for instance 6e31e02c-74ff-4b92-9790-edc0459908bf on n-h1-862876-2 Oct 28 13:24:41.303591 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-af52949d-63fc-42fc-8a11-0ae0890f336e req-d1556933-b39b-484a-879f-d74e9f488571 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118984 Oct 28 13:24:41.312367 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2304/4525] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:24:41.440538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:41.441160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:41.462156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:41.462896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:41.463360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:41.465748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:41.470334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:41.471103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:41.769034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:41.787252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:41.788781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:41.810438 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c4a642aa-0de5-434e-a89f-a36190edc103 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.354682 Oct 28 13:24:41.812315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2222/4526] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:41 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:42.206207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:42.207580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:42.230844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:42.237293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:42.238206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:42.239828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:42.243148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:42.246862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:42.727975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:42.745283 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-289e6b41-f89f-43dd-87c1-f39d5406c6fd tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 0.540823 Oct 28 13:24:42.746625 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2305/4527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:42 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:42.841630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:42.842257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:42.865360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:42.869010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:42.869296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:42.870192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:42.872478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:42.873792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:43.141981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:43.158674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:43.168862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:43.168862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dd01cd80-1597-4d28-9892-e994bf3d11de tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.324108 Oct 28 13:24:43.168862 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2223/4528] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:42 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:43.769239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:43.770369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:43.776013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=58 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:43.804284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:43.804971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:43.807373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:43.808147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:43.809850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:43.810330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:44.197163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:44.198355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:44.217274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:44.231202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:44.231785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:44.232585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:44.233066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:44.233493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:44.331669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:44.381768 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3fdfe439-84ba-4c7b-b506-e6e278b0761c tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 0.609698 Oct 28 13:24:44.402821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2306/4529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:43 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:44.728119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:44.741010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:44.743357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:44.745131 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14e23b6e-a275-484c-bfc4-d9c230fb6465 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.552546 Oct 28 13:24:44.769367 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2224/4530] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:44 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:24:45.410769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:45.412912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:45.433138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:45.433876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:45.434333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:45.435108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:45.436128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:45.436560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:45.572252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c24ceece-acc6-4aaa-927b-fd99c6fd0a37 req-5ec1101f-fec5-44da-b56e-305a2da3180a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:45.628237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c24ceece-acc6-4aaa-927b-fd99c6fd0a37 req-5ec1101f-fec5-44da-b56e-305a2da3180a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:45.632490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c24ceece-acc6-4aaa-927b-fd99c6fd0a37 req-5ec1101f-fec5-44da-b56e-305a2da3180a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:45.644895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c24ceece-acc6-4aaa-927b-fd99c6fd0a37 req-5ec1101f-fec5-44da-b56e-305a2da3180a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:45.743205 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c24ceece-acc6-4aaa-927b-fd99c6fd0a37 req-5ec1101f-fec5-44da-b56e-305a2da3180a service nova] Creating event network-vif-unplugged:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h1-862876-2 Oct 28 13:24:45.770772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-c24ceece-acc6-4aaa-927b-fd99c6fd0a37 req-5ec1101f-fec5-44da-b56e-305a2da3180a service nova] Instance a6d1f37a-6a9b-4105-976e-294d3e753112 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:24:45.811742 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c24ceece-acc6-4aaa-927b-fd99c6fd0a37 req-5ec1101f-fec5-44da-b56e-305a2da3180a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.242091 Oct 28 13:24:45.812938 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2225/4531] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:45.820221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:45.821114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:45.838729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:45.839642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:45.840245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:45.841882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:45.842511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:45.843311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:45.981900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:46.000894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:46.004921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:46.011919 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7370cafa-b015-476d-886d-9b100d4eb970 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.196839 Oct 28 13:24:46.012767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2226/4532] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:45 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:46.058895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:46.069629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-692db2a8-286c-4bc1-8c84-a4d2fd206929 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 0.663167 Oct 28 13:24:46.095222 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2307/4533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:45 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:47.053199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:47.053945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:47.068728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:47.069617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:47.070303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:47.071278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:47.071967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:47.075360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:47.094505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:47.096214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:47.121725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:47.122608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:47.123863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:47.124819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:47.125503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:47.127900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:47.617982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:47.636455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:47.661390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:47.662793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3493f40-fe63-4502-9e78-890be535859c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.613714 Oct 28 13:24:47.668369 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2227/4534] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:47 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:47.886714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-10a1b234-30d6-423f-9c8d-e436860e4fbb req-76d27138-2ca9-40d1-b78c-4995081ec83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:47.892441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:47.914260 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d6889b90-a912-4e19-a422-542b73b95884 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 0.824175 Oct 28 13:24:47.919430 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2308/4535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:47 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:47.922569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-10a1b234-30d6-423f-9c8d-e436860e4fbb req-76d27138-2ca9-40d1-b78c-4995081ec83f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:47.925884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-10a1b234-30d6-423f-9c8d-e436860e4fbb req-76d27138-2ca9-40d1-b78c-4995081ec83f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:47.926591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-10a1b234-30d6-423f-9c8d-e436860e4fbb req-76d27138-2ca9-40d1-b78c-4995081ec83f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:47.961185 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-10a1b234-30d6-423f-9c8d-e436860e4fbb req-76d27138-2ca9-40d1-b78c-4995081ec83f service nova] Creating event network-changed:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h1-862876-2 Oct 28 13:24:47.978850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-10a1b234-30d6-423f-9c8d-e436860e4fbb req-76d27138-2ca9-40d1-b78c-4995081ec83f service nova] Instance a6d1f37a-6a9b-4105-976e-294d3e753112 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:24:48.005995 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-10a1b234-30d6-423f-9c8d-e436860e4fbb req-76d27138-2ca9-40d1-b78c-4995081ec83f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121698 Oct 28 13:24:48.006829 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2228/4536] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:24:48.695457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:48.696079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:48.710646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:48.711197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:48.711617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:48.712338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:48.718115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:48.718115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:48.947807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:48.948513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:48.958662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:48.959182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:48.964090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:48.965063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:48.967605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:48.969607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:49.214562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:49.251395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:49.260897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:49.262462 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86d7c927-32b8-46a4-842e-6f18937c1fa3 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.570945 Oct 28 13:24:49.266497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2309/4537] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:48 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:49.900927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:49.920818 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-278e9580-ec66-4075-95a4-07fa93c56ff8 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1469 microversion: 2.1 time: 0.966990 Oct 28 13:24:49.948435 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2229/4538] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:48 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1469 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:50.026798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1646694574", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:50.172470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:24:50.293733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:50.294706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:50.312589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:50.313087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:50.313522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:50.314216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:50.314879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:50.315456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:50.485458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:50.496195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:50.499062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:50.501685 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-642e3771-ef3c-4089-b49b-ad9b427b6cc5 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.212587 Oct 28 13:24:50.502385 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2230/4539] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:50 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:24:50.953907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:50.958051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:50.989387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:50.989990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:50.990630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:50.992552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:50.996527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:50.997154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:51.538150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:51.548448 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eee4bad2-ef66-4c7f-904e-1084b3ce2749 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1462 microversion: 2.1 time: 0.597598 Oct 28 13:24:51.549175 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2231/4540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:50 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1462 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:51.571370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:51.579301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:51.604206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:51.605609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:51.606719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:51.608452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:51.610960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:51.611820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:51.882102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:51.895562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:51.897032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:51.898246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb7387ee-e88f-4a33-a8ce-4f1cc8e63c7a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.348135 Oct 28 13:24:51.899400 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2232/4541] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:51 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:51.915042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:51.916077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:51.928066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:51.928943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:51.934412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:51.934412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:51.934412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:51.934412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:51.983961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:24:51.985298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:24:51.986404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:24:51.987182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:24:51.991945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:24:52.016650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:52.017628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:52.019675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:52.023012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:52.023795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:52.025211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:52.088634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Getting quotas for project d2ba03bae2274b809dce51c3de85426f. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:24:52.108158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Getting quotas for user c1f11a4e6a32473dac2afea955f8fae8 and project d2ba03bae2274b809dce51c3de85426f. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:24:52.156092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:24:52.166412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:24:52.359682 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8b33ec36-baf1-4faf-a4f8-94988b421f75 tempest-MigrationsAdminTest-1954809758 tempest-MigrationsAdminTest-1954809758-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1613 microversion: 2.1 time: 0.451560 Oct 28 13:24:52.365325 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2233/4542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:51 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1613 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:52.399074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:52.399590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:52.401837 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-360d6bfc-3b7b-4e60-a6a8-f83504e9a2dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.383371 Oct 28 13:24:52.407294 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2310/4543] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:24:52.418726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:52.419546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:52.423990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:52.424972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:52.425665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:52.426276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:52.439061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:24:52.439175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e253386f-48c3-4ffa-9ee2-2fc1aa1e8ebd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:52.439274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e253386f-48c3-4ffa-9ee2-2fc1aa1e8ebd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:52.543219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:24:52.759696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e253386f-48c3-4ffa-9ee2-2fc1aa1e8ebd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:52.774659 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e253386f-48c3-4ffa-9ee2-2fc1aa1e8ebd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1214 microversion: 2.1 time: 0.354369 Oct 28 13:24:52.780372 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2311/4544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:52 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:52.930973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:52.931596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:52.945303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:52.946578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:52.952521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:52.953559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:52.954233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:52.954861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:53.039979 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f3f66c1b-0338-41d8-9fe2-37df4668b070 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 204 len: 0 microversion: 2.1 time: 0.646234 Oct 28 13:24:53.040917 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2234/4545] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:24:52 2022] DELETE /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:24:53.049937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:53.051001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:53.069707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:53.070214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:53.074127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:53.075390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:53.076594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:53.079130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:53.366908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:53.410067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:53.417596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:53.427702 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00f6b1bc-448f-4ba3-8ca0-3a9195025bef tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.500526 Oct 28 13:24:53.428478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2312/4546] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:52 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:53.593504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:53.603090 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5fd9a9d-70cd-450d-8ead-99ca02b20568 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1468 microversion: 2.1 time: 0.557891 Oct 28 13:24:53.607826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2235/4547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:53 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:53.804061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd736ab8-daa5-4f27-9a36-dceefaadfab9 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:53.809719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd736ab8-daa5-4f27-9a36-dceefaadfab9 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:53.934493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd736ab8-daa5-4f27-9a36-dceefaadfab9 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:53.945639 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd736ab8-daa5-4f27-9a36-dceefaadfab9 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1214 microversion: 2.1 time: 0.147284 Oct 28 13:24:53.947173 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2313/4548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:53 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:54.455916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:54.456532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:54.466458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:54.467092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:54.467510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:54.468217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:54.468685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:54.469092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:54.638479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:54.639711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:54.656714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:54.656714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:54.656714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:54.656714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:54.658423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:54.658918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:54.940021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:54.990706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:55.025994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:55.027682 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7714bdb-952b-45d3-926e-c3b217492086 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.575614 Oct 28 13:24:55.039186 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2236/4549] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:54 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:55.062492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:55.065674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:55.077890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:55.087658 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf53e578-307b-4114-a248-312bff7a8647 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1468 microversion: 2.1 time: 0.453642 Oct 28 13:24:55.088864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2314/4550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:54 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:55.089482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:55.090310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:55.092798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:55.093788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:55.095446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:55.095886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:55.327025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:55.359758 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aadd59b8-9d59-45d2-9ec8-ea601cce120f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1210 microversion: 2.1 time: 0.308248 Oct 28 13:24:55.362462 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2237/4551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:55 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1210 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:56.053876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:56.055254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:56.065204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:56.069842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:56.070564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:56.071618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:56.075676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:56.080241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:56.118195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:56.118888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:56.134607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:56.135179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:56.135620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:56.136338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:56.140206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:56.140666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:56.349468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:56.366292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:56.368289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:56.371589 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-97b4d1c7-4954-46bb-b964-b28b12448150 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.321589 Oct 28 13:24:56.374115 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2315/4552] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:56 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:56.389408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:56.390329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:56.421151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:56.428266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:56.430577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:56.433707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:56.433707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:56.434445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:56.818704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:56.828876 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-578f3aa8-909d-441c-b78e-031dffb1316f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1274 microversion: 2.1 time: 0.443199 Oct 28 13:24:56.848968 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2316/4553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:56 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1274 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:57.011289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4b306762-034c-4aff-98ec-aabc28f836a8 req-54f961c5-bf16-4411-a13b-e1b982bc8b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "name": "network-vif-plugged", "status": "completed", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:57.037069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4b306762-034c-4aff-98ec-aabc28f836a8 req-54f961c5-bf16-4411-a13b-e1b982bc8b0c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:57.037812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4b306762-034c-4aff-98ec-aabc28f836a8 req-54f961c5-bf16-4411-a13b-e1b982bc8b0c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:57.038394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4b306762-034c-4aff-98ec-aabc28f836a8 req-54f961c5-bf16-4411-a13b-e1b982bc8b0c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:57.077146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4b306762-034c-4aff-98ec-aabc28f836a8 req-54f961c5-bf16-4411-a13b-e1b982bc8b0c service nova] Creating event network-vif-plugged:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h1-862876-2 Oct 28 13:24:57.098123 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4b306762-034c-4aff-98ec-aabc28f836a8 req-54f961c5-bf16-4411-a13b-e1b982bc8b0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090261 Oct 28 13:24:57.107157 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2317/4554] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:24:57.405226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:57.405877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:57.418559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:57.419094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:57.419582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:57.420298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:57.420759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:57.421185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:57.761123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:57.769426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:57.771805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:57.782848 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40cf1fa3-2ee6-48df-b27b-d046dbf7cd02 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.382359 Oct 28 13:24:57.784060 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2318/4555] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:57 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:57.859946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:57.861127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:57.873729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:57.879573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:57.887049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:57.889756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:57.890635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:57.893481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:58.124904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:58.144202 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47d6cf2e-1fbd-48be-abc3-caf6502ede60 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1272 microversion: 2.1 time: 0.284942 Oct 28 13:24:58.147943 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2319/4556] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:57 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:24:58.163526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:58.173402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e57c9fe4-8e55-49d1-8451-94d460ecd2e5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1468 microversion: 2.1 time: 2.059762 Oct 28 13:24:58.185065 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2238/4557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:56 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1468 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:58.814332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:58.814997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:58.826135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:58.832821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:58.833326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:58.837704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:58.838608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:58.839103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:59.124572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:59.166950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9203003b-67c1-49cd-b534-9e14b52910b6 req-0f7b97b9-cfba-492b-9f43-e54a53b6b82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:59.176858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:59.185031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:59.188781 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e72597b5-c402-48de-aae7-7085fc5a272e tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.378975 Oct 28 13:24:59.190894 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2320/4558] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:24:58 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:24:59.195065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9203003b-67c1-49cd-b534-9e14b52910b6 req-0f7b97b9-cfba-492b-9f43-e54a53b6b82d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:59.197432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9203003b-67c1-49cd-b534-9e14b52910b6 req-0f7b97b9-cfba-492b-9f43-e54a53b6b82d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:59.199189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9203003b-67c1-49cd-b534-9e14b52910b6 req-0f7b97b9-cfba-492b-9f43-e54a53b6b82d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:59.208785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:59.210368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:59.236083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:59.237161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:59.242380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:59.242380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:59.247280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:59.249041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:59.254941 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9203003b-67c1-49cd-b534-9e14b52910b6 req-0f7b97b9-cfba-492b-9f43-e54a53b6b82d service nova] Creating event network-vif-unplugged:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h1-862876-2 Oct 28 13:24:59.269639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9203003b-67c1-49cd-b534-9e14b52910b6 req-0f7b97b9-cfba-492b-9f43-e54a53b6b82d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106337 Oct 28 13:24:59.277387 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2239/4559] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:24:59.296745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:24:59.299820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:24:59.315838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:59.321653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:59.322721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:59.324173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:59.328046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:59.328822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:59.645260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:24:59.661076 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b6a3fdb8-4eda-4b87-b621-4abf6ec80b56 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1426 microversion: 2.1 time: 0.382073 Oct 28 13:24:59.681154 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2240/4560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:59 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1426 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:24:59.755619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5fece3b0-a2df-4f1f-bac8-e700717dea53 req-135afd78-a222-4d84-b59c-47715a1b09ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1f37a-6a9b-4105-976e-294d3e753112", "name": "network-vif-deleted", "tag": "6d3994cd-7578-414e-9c16-b1a08694f0a2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:24:59.778345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5fece3b0-a2df-4f1f-bac8-e700717dea53 req-135afd78-a222-4d84-b59c-47715a1b09ae service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:24:59.779655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5fece3b0-a2df-4f1f-bac8-e700717dea53 req-135afd78-a222-4d84-b59c-47715a1b09ae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:24:59.780315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5fece3b0-a2df-4f1f-bac8-e700717dea53 req-135afd78-a222-4d84-b59c-47715a1b09ae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:24:59.812939 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5fece3b0-a2df-4f1f-bac8-e700717dea53 req-135afd78-a222-4d84-b59c-47715a1b09ae service nova] Creating event network-vif-deleted:6d3994cd-7578-414e-9c16-b1a08694f0a2 for instance a6d1f37a-6a9b-4105-976e-294d3e753112 on n-h1-862876-2 Oct 28 13:24:59.829402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5fece3b0-a2df-4f1f-bac8-e700717dea53 req-135afd78-a222-4d84-b59c-47715a1b09ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082850 Oct 28 13:24:59.835076 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2241/4561] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:25:00.224893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:00.227957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:00.247762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:00.251338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:00.254850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:00.262253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:00.262253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:00.262253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:00.503038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:00.505379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:00.514307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-31c64bd1-6915-4fc9-9975-0351494e6c1a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1272 microversion: 2.1 time: 1.321739 Oct 28 13:25:00.523193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:00.524960 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2321/4562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:24:59 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1272 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:00.537580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:00.541153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:00.546135 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8cdb05ee-0787-4ac7-b81b-0b9cfe303d75 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.325467 Oct 28 13:25:00.563517 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2242/4563] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:00 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:25:00.692167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:00.692715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:00.702339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:00.703318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:00.703970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:00.704899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:00.705526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:00.706145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:00.752624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:00.753136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:00.753731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:00.754248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lazy-loading 'fault' on Instance uuid a6d1f37a-6a9b-4105-976e-294d3e753112 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:25:01.001429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:01.021176 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-038b774c-91c5-466c-81a4-182203ea56fa tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 200 len: 1303 microversion: 2.1 time: 0.332873 Oct 28 13:25:01.021795 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2322/4564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:00 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 1303 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:01.547190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:01.547819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:01.568930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:01.580048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:01.580669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:01.591658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:01.592162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:01.597658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:01.601145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:01.608489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:01.610932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:01.611713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:01.616790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:01.621109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:01.621948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:01.622424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:01.632458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:01.797590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:01.821614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:01.831403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:01.835823 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-02bd45b6-5dd2-4ddf-bc97-eae96379c7ea tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.260206 Oct 28 13:25:01.838873 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2323/4565] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:01 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:25:02.047069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:02.047702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: a6d1f37a-6a9b-4105-976e-294d3e753112] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:02.056186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:02.059777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.061637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.065788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:02.066551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.067544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.067982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:02.146410 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] HTTP exception thrown: Instance a6d1f37a-6a9b-4105-976e-294d3e753112 could not be found. Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Request method failure captured: Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 HTTP/1.1 Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ctTrgo1z_409RnhwUliL3zUJdpA1z6RB6wom4wmmK4V30Izgkt4vk-9FOHKMKLTUyeOYWHtAbVR6d635mqoS6EGjZ5lNmaz-dgQc98Lfj_9p2-CmcFJXySS-DhiP7Yrnzs_o7uVh8uRr1CfxUjvyNpWAmcptnhMdWnoe9YYpY6yKA Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c125dbce0f4df8bd795a00b219487c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c3852e30767345639ee5d92350d2950a Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance a6d1f37a-6a9b-4105-976e-294d3e753112 could not be found. Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'a6d1f37a-6a9b-4105-976e-294d3e753112'} Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d1f37a-6a9b-4105-976e-294d3e753112 could not be found. Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d1f37a-6a9b-4105-976e-294d3e753112 could not be found. Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:02.157576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d1f37a-6a9b-4105-976e-294d3e753112 could not be found. Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:02.165294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Returning 404 to user: Instance a6d1f37a-6a9b-4105-976e-294d3e753112 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:02.175921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:02.181210 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd40804b-10ed-42ec-90b0-63723876156e tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112" status: 404 len: 111 microversion: 2.1 time: 0.118552 Oct 28 13:25:02.185586 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2324/4566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:02 2022] GET /compute/v2.1/servers/a6d1f37a-6a9b-4105-976e-294d3e753112 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:25:02.188194 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ae1d42a-4851-4f52-9234-14f69a1a699f tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1314 microversion: 2.1 time: 0.646387 Oct 28 13:25:02.195804 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2243/4567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:01 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:02.209284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:02.209923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:02.243134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.243736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.244195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:02.244941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.245402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.245829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:02.345642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:25:02.839680 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f464e82-6842-4ea2-9f52-7c11d49d0f90 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 204 len: 0 microversion: 2.1 time: 0.653376 Oct 28 13:25:02.841013 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2325/4568] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:25:02 2022] DELETE /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:25:02.850090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:02.852173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:02.868324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:02.869441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:02.884664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.885058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.885964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.890300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:02.890300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.890300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.890668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.891357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:02.892266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:02.892825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:02.896390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:02.897992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:03.024663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:03.034979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:03.036426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:03.045493 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40dca7b5-a578-430e-9571-e36dd1771866 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.175220 Oct 28 13:25:03.046123 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2326/4569] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:02 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:25:03.221364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:03.221854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:03.236463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:03.236907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:03.237355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:03.238066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:03.238787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:03.238984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:03.468183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:03.495169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ed0f7211-d233-48fd-b00a-3afd35cdd128 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1534 microversion: 2.1 time: 0.648980 Oct 28 13:25:03.498819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2244/4570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:02 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1534 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:03.511636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0f620633-d8c6-4743-b14c-896cd86c914e req-27454cce-ab38-4c63-bdd9-63a566718bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19002f60-5a25-4476-a548-8a979af98a72", "tag": "88de4033-93a4-4a6a-95bb-da9633860e24"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:03.514082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:03.522728 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-915be983-bce2-48ad-b7c2-e8daa1547bce tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1314 microversion: 2.1 time: 0.305310 Oct 28 13:25:03.523345 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2327/4571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:03 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:25:03.567490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0f620633-d8c6-4743-b14c-896cd86c914e req-27454cce-ab38-4c63-bdd9-63a566718bf1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:03.572979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0f620633-d8c6-4743-b14c-896cd86c914e req-27454cce-ab38-4c63-bdd9-63a566718bf1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:03.573904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0f620633-d8c6-4743-b14c-896cd86c914e req-27454cce-ab38-4c63-bdd9-63a566718bf1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:03.603297 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0f620633-d8c6-4743-b14c-896cd86c914e req-27454cce-ab38-4c63-bdd9-63a566718bf1 service nova] Creating event network-changed:88de4033-93a4-4a6a-95bb-da9633860e24 for instance 19002f60-5a25-4476-a548-8a979af98a72 on n-h2-862876-2 Oct 28 13:25:03.615634 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0f620633-d8c6-4743-b14c-896cd86c914e req-27454cce-ab38-4c63-bdd9-63a566718bf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113126 Oct 28 13:25:03.616630 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2245/4572] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:04.072305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:04.072925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:04.089812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:04.092336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:04.093000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:04.093601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:04.094497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:04.095146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:04.095733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:04.239181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:04.249138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:04.250580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:04.251827 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5cfaf8b9-3d5d-4259-918f-4457bdf75702 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.183815 Oct 28 13:25:04.257157 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2328/4573] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:04 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:25:04.549932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:04.550789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:04.558513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:04.567212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:04.567959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:04.569096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:04.571264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:04.573060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:04.573562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:04.575396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:04.595795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:04.596588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:04.597798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:04.598897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:04.600224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:04.600867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:05.202070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:05.206469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:05.230189 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37658a3a-3cd4-4024-b278-1d44c768dab3 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1534 microversion: 2.1 time: 0.708022 Oct 28 13:25:05.231379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-474a5ac7-568c-4bdd-8719-968c9befe2cd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1314 microversion: 2.1 time: 0.685557 Oct 28 13:25:05.239597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2329/4574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:04 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:25:05.256947 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2246/4575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:04 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1534 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:05.280268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:05.280972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:05.300388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:05.300904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:05.305333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:05.305333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:05.305333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:05.305333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:05.711765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:05.740227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:05.745582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:05.745582 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-08a4b8ae-1abe-453e-a1ff-9d06e5353b9c tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.467458 Oct 28 13:25:05.745582 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2330/4576] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:05 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:25:05.768267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-386993d5-dded-4fb2-b895-d9a7c40d3b17 req-fba02e5c-c26d-456a-a0d4-debf6cef15f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabb1b52-6f7c-45f9-a776-f88ddc095395", "name": "network-vif-deleted", "tag": "70f775a5-4719-44ae-8dd6-fea5f71db071"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:05.793086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-386993d5-dded-4fb2-b895-d9a7c40d3b17 req-fba02e5c-c26d-456a-a0d4-debf6cef15f3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:05.794287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-386993d5-dded-4fb2-b895-d9a7c40d3b17 req-fba02e5c-c26d-456a-a0d4-debf6cef15f3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:05.797113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-386993d5-dded-4fb2-b895-d9a7c40d3b17 req-fba02e5c-c26d-456a-a0d4-debf6cef15f3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:05.817512 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-386993d5-dded-4fb2-b895-d9a7c40d3b17 req-fba02e5c-c26d-456a-a0d4-debf6cef15f3 service nova] Creating event network-vif-deleted:70f775a5-4719-44ae-8dd6-fea5f71db071 for instance dabb1b52-6f7c-45f9-a776-f88ddc095395 on n-h2-862876-2 Oct 28 13:25:05.829239 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-386993d5-dded-4fb2-b895-d9a7c40d3b17 req-fba02e5c-c26d-456a-a0d4-debf6cef15f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066592 Oct 28 13:25:05.831881 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2247/4577] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:06.271959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:06.272765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:06.274443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:06.275366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:06.286151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:06.289505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:06.290198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:06.292405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:06.293298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:06.294779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:06.295014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:06.295283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:06.295729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:06.296505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:06.296886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:06.297315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:06.391532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:06.392032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:06.393304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:06.393304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lazy-loading 'fault' on Instance uuid dabb1b52-6f7c-45f9-a776-f88ddc095395 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:25:06.649274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:06.662997 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e98522e-f3bd-419a-bbae-b4fa66503e88 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1314 microversion: 2.1 time: 0.396080 Oct 28 13:25:06.663979 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2331/4578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:06 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:06.766571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:06.774358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:06.775289 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a7e3a0b0-f6ae-4f16-9755-15ec0de0b17f tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1368 microversion: 2.1 time: 0.508071 Oct 28 13:25:06.787745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:06.788098 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2248/4579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:06 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1368 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:25:06.796168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:06.797044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:06.797771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:06.798544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:06.799052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:06.804195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:06.968078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:06.995737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:07.000391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:07.001784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-447086ac-3a9c-46f5-8b50-d43a246e0c1a tempest-ExtensionsTest-1737319771 tempest-ExtensionsTest-1737319771-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:07.003613 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-447086ac-3a9c-46f5-8b50-d43a246e0c1a tempest-ExtensionsTest-1737319771 tempest-ExtensionsTest-1737319771-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.218925 Oct 28 13:25:07.004466 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2249/4580] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Oct 28 13:25:06 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:07.005898 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-15e916b4-6b21-4c6a-b3c0-4a8f21963da8 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1605 microversion: 2.32 time: 0.236573 Oct 28 13:25:07.024289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2332/4581] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:06 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1605 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:25:07.026688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b214c5ef-0a56-45cc-9fce-20e496c004e5 tempest-ExtensionsTest-1737319771 tempest-ExtensionsTest-1737319771-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:07.030085 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b214c5ef-0a56-45cc-9fce-20e496c004e5 tempest-ExtensionsTest-1737319771 tempest-ExtensionsTest-1737319771-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.019606 Oct 28 13:25:07.031813 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2250/4582] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Oct 28 13:25:07 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:25:07.693077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:07.695007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:07.730493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:07.731341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:07.734906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:07.735649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:07.736295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:07.739129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:07.804200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:07.804907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:07.835894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:07.837295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:07.839273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:07.843462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:07.845674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:07.849368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:07.957731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:07.958896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:07.961737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:07.963746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lazy-loading 'fault' on Instance uuid dabb1b52-6f7c-45f9-a776-f88ddc095395 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:25:08.170895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:08.181523 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-495a1679-68e1-4e85-80b3-a6146e7f53dd tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1314 microversion: 2.1 time: 0.495076 Oct 28 13:25:08.183729 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2333/4583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:07 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:08.191002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:08.191969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:08.199412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:08.200218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:08.201458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:08.204977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:08.205786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:08.206566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:08.228014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:08.241670 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-516c5650-54b7-4382-b0d4-ec2f0d623916 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 200 len: 1368 microversion: 2.1 time: 0.442279 Oct 28 13:25:08.256725 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2251/4584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:07 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:08.312826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:08.313587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:08.314183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:08.314864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lazy-loading 'fault' on Instance uuid 6e31e02c-74ff-4b92-9790-edc0459908bf {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:25:08.367474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:08.381341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:08.383116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd4a046d9214c8d819c65dd78ba6bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fd700fc2044c19c2fcc6e6ccc48ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:08.384972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d70604cb-5be4-46f2-8a43-60b3a2d2bb16 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 200 len: 1610 microversion: 2.32 time: 0.198114 Oct 28 13:25:08.385857 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2334/4585] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:08 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 1610 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:25:09.211369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:09.213807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:09.229555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:09.231011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:09.231707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:09.233152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:09.233778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:09.235096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:09.270540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:09.271215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: dabb1b52-6f7c-45f9-a776-f88ddc095395] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:09.286786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:09.293378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:09.294089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:09.295827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:09.296725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:09.297309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:09.345500 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] HTTP exception thrown: Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 could not be found. Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Request method failure captured: Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 HTTP/1.1 Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ctTrgo1z_409RnhwUliL3zUJdpA1z6RB6wom4wmmK4V30Izgkt4vk-9FOHKMKLTUyeOYWHtAbVR6d635mqoS6EGjZ5lNmaz-dgQc98Lfj_9p2-CmcFJXySS-DhiP7Yrnzs_o7uVh8uRr1CfxUjvyNpWAmcptnhMdWnoe9YYpY6yKA Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c125dbce0f4df8bd795a00b219487c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c3852e30767345639ee5d92350d2950a Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 could not be found. Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'dabb1b52-6f7c-45f9-a776-f88ddc095395'} Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 could not be found. Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 could not be found. Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:09.349425 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.354884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:09.354884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:09.354884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:09.354884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:09.354884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:09.354884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 could not be found. Oct 28 13:25:09.354884 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.356350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Returning 404 to user: Instance dabb1b52-6f7c-45f9-a776-f88ddc095395 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:09.357709 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e281445b-f57a-49af-a192-29940be77dfb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395" status: 404 len: 111 microversion: 2.1 time: 0.093230 Oct 28 13:25:09.358785 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2335/4586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:09 2022] GET /compute/v2.1/servers/dabb1b52-6f7c-45f9-a776-f88ddc095395 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:25:09.373969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e1a96072-afde-4172-a1d6-94f3187147c2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '.version_select at 0x7f27b83b3670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:09.456208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e1a96072-afde-4172-a1d6-94f3187147c2 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90065786" status: 202 len: 0 microversion: 2.1 time: 0.090591 Oct 28 13:25:09.458542 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2336/4587] 10.222.0.25 () {58 vars in 1215 bytes} [Fri Oct 28 13:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90065786 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:25:09.473551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:09.486180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:09.518561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:09.519185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:09.519643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:09.520389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:09.520846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:09.521273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:09.581621 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] HTTP exception thrown: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Request method failure captured: Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf HTTP/1.1 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Y-JLec2-1lvgb5m12T9E3a2-vpzT1uRrbRWXKkCw3OArsFA4j-gw9OJ0v6mD71fUY4XIabhBC71bRRgO36KLg59Yr_U4lUdq86Pd3xbM_Y4lmxmWf1oyfP6NZXSXLHWSCEh2az5Fc2gPCgTLHjd-it3P85gUQu3NF0eUpic0fHlvo Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7c7fd700fc2044c19c2fcc6e6ccc48ae Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c7fd700fc2044c19c2fcc6e6ccc48ae", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7c7fd700fc2044c19c2fcc6e6ccc48ae Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TaggedBootDevicesTest-1161923093-project Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 9bd4a046d9214c8d819c65dd78ba6bf1 Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TaggedBootDevicesTest-1161923093-project Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6e31e02c-74ff-4b92-9790-edc0459908bf'} Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.594101 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:09.603795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Returning 404 to user: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:09.605193 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d120331a-93f9-4f86-b8d7-a68ddf7abd12 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 404 len: 111 microversion: 2.32 time: 0.141485 Oct 28 13:25:09.608445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2337/4588] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:09 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:25:09.635322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4efea830-9123-422a-b2b2-5207a136143a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '.version_select at 0x7f27b83b33a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:09.744912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:09.759857 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c0a77de-de74-4343-bc1e-2c4e143ed1b8 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1314 microversion: 2.1 time: 0.552375 Oct 28 13:25:09.766816 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2252/4589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:09 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:09.796912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ede1c182-1ebb-41b3-832b-57bff7d5e511 req-b112440c-3370-4a6b-b371-21a7faf7c497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19002f60-5a25-4476-a548-8a979af98a72", "name": "network-vif-plugged", "status": "completed", "tag": "88de4033-93a4-4a6a-95bb-da9633860e24"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:09.811890 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4efea830-9123-422a-b2b2-5207a136143a tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706623388" status: 204 len: 0 microversion: 2.32 time: 0.194088 Oct 28 13:25:09.813331 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2338/4590] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706623388 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:25:09.854952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ede1c182-1ebb-41b3-832b-57bff7d5e511 req-b112440c-3370-4a6b-b371-21a7faf7c497 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:09.856867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ede1c182-1ebb-41b3-832b-57bff7d5e511 req-b112440c-3370-4a6b-b371-21a7faf7c497 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:09.859960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ede1c182-1ebb-41b3-832b-57bff7d5e511 req-b112440c-3370-4a6b-b371-21a7faf7c497 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:09.868679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:09.891214 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ede1c182-1ebb-41b3-832b-57bff7d5e511 req-b112440c-3370-4a6b-b371-21a7faf7c497 service nova] Creating event network-vif-plugged:88de4033-93a4-4a6a-95bb-da9633860e24 for instance 19002f60-5a25-4476-a548-8a979af98a72 on n-h2-862876-2 Oct 28 13:25:09.923300 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ede1c182-1ebb-41b3-832b-57bff7d5e511 req-b112440c-3370-4a6b-b371-21a7faf7c497 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150309 Oct 28 13:25:09.923710 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2253/4591] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:10.792658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:10.793694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:10.809567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:10.812895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:10.814501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:10.817282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:10.817996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:10.818508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:11.483472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:11.503898 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c131b02-8fe5-4ae5-b9bb-69c7323fb12a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1314 microversion: 2.1 time: 0.713526 Oct 28 13:25:11.509238 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2339/4592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:10 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:12.549184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:12.549823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:12.559395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:12.561992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:12.561992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:12.561992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:12.562301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:12.562591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:12.751348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:12.761987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfa4f3a2-93e8-455f-859b-f69409ada989 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1464 microversion: 2.1 time: 0.232719 Oct 28 13:25:12.762976 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2254/4593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:12 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1464 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:12.790537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80eb6338-5b0f-4a34-8150-f8524f3a76c0", "device": "/dev/sdb"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:12.791279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:12.793903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:12.794456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:12.794593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:12.799574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:12.800288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:12.800910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:12.801890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:12.802573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:12.803205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:12.806121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:12.810597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:12.813544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:12.813544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:12.813544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:12.813544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:12.813544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:12.852194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:25:13.319930 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60495e09-3de0-4f32-9c83-bd46ec56fdf9 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 204 len: 0 microversion: 2.1 time: 0.532389 Oct 28 13:25:13.326279 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2255/4594] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:25:12 2022] DELETE /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:25:13.331469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:13.332926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:13.340278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:13.341024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:13.341725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:13.342923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:13.343843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:13.344521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:13.697980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:13.706932 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a74e4da-79dd-4aa6-8375-de2ad9bd3498 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1469 microversion: 2.1 time: 0.381417 Oct 28 13:25:13.708689 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2256/4595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:13 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:13.965542 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c46980b6-5f2b-4ca7-92b0-694302dfd17a tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "POST /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.182748 Oct 28 13:25:13.966561 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2340/4596] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:25:12 2022] POST /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72/os-volume_attachments => generated 194 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:14.730933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:14.731560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:14.744289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:14.744793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:14.745227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:14.751596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:14.752095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:14.752549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:15.480104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:15.492667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7f125ef-941e-443a-b7e6-14bfc3c7daca tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1469 microversion: 2.1 time: 0.765759 Oct 28 13:25:15.503371 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2257/4597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:14 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1469 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:15.660355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0d88eb10-88b4-4eb8-a954-29af8fd09e3e req-3f22a0f5-7b50-43fe-b97d-79b8a20c706b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7711abb9-22f7-431d-ac87-1b7bd5d6334c", "name": "network-vif-deleted", "tag": "034d6bc4-26a7-422a-866f-b39b001987e1"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:15.685871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d88eb10-88b4-4eb8-a954-29af8fd09e3e req-3f22a0f5-7b50-43fe-b97d-79b8a20c706b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:15.686914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d88eb10-88b4-4eb8-a954-29af8fd09e3e req-3f22a0f5-7b50-43fe-b97d-79b8a20c706b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:15.688847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d88eb10-88b4-4eb8-a954-29af8fd09e3e req-3f22a0f5-7b50-43fe-b97d-79b8a20c706b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:15.752521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0d88eb10-88b4-4eb8-a954-29af8fd09e3e req-3f22a0f5-7b50-43fe-b97d-79b8a20c706b service nova] Creating event network-vif-deleted:034d6bc4-26a7-422a-866f-b39b001987e1 for instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c on n-h1-862876-2 Oct 28 13:25:15.759965 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0d88eb10-88b4-4eb8-a954-29af8fd09e3e req-3f22a0f5-7b50-43fe-b97d-79b8a20c706b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103509 Oct 28 13:25:15.760923 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2341/4598] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:16.525582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:16.527088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:16.537862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:16.539320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:16.543203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:16.544537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:16.546392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:16.547261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:16.667699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:16.670616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:16.672695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:16.673474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lazy-loading 'fault' on Instance uuid 7711abb9-22f7-431d-ac87-1b7bd5d6334c {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:25:16.970319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:16.980734 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35b042c2-69ea-4159-acf5-7bc1566e1ab5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 200 len: 1303 microversion: 2.1 time: 0.456348 Oct 28 13:25:16.984735 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2258/4599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:16 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 1303 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:18.008595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:18.010164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 7711abb9-22f7-431d-ac87-1b7bd5d6334c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:18.032181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:18.032896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:18.033523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:18.034415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:18.035097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:18.035729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:18.099382 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] HTTP exception thrown: Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c could not be found. Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Request method failure captured: Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c HTTP/1.1 Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ctTrgo1z_409RnhwUliL3zUJdpA1z6RB6wom4wmmK4V30Izgkt4vk-9FOHKMKLTUyeOYWHtAbVR6d635mqoS6EGjZ5lNmaz-dgQc98Lfj_9p2-CmcFJXySS-DhiP7Yrnzs_o7uVh8uRr1CfxUjvyNpWAmcptnhMdWnoe9YYpY6yKA Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c125dbce0f4df8bd795a00b219487c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c3852e30767345639ee5d92350d2950a Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c could not be found. Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7711abb9-22f7-431d-ac87-1b7bd5d6334c'} Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c could not be found. Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c could not be found. Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:18.106480 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:18.112524 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:18.112524 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:18.112524 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:18.112524 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:18.112524 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:18.112524 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c could not be found. Oct 28 13:25:18.112524 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:18.116696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Returning 404 to user: Instance 7711abb9-22f7-431d-ac87-1b7bd5d6334c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:18.120479 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d027e69-a6f8-4f46-8d78-dd1324e74b26 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c" status: 404 len: 111 microversion: 2.1 time: 0.118462 Oct 28 13:25:18.133621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:18.134865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:18.140421 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2342/4600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:18 2022] GET /compute/v2.1/servers/7711abb9-22f7-431d-ac87-1b7bd5d6334c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:25:18.147746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:18.151739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:18.152424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:18.153346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:18.155285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:18.159802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:18.239433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:25:18.687636 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-45c3b0d7-a237-4b36-a84c-f6aa8fe92ebb tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "DELETE /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 204 len: 0 microversion: 2.1 time: 0.560486 Oct 28 13:25:18.693562 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2259/4601] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:25:18 2022] DELETE /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:25:18.701544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:18.703042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:18.725894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:18.726448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:18.727417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:18.731380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:18.732096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:18.734929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:19.815951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:19.831255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8dee5a01-90c7-4642-a91f-a5683736c5f5 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1469 microversion: 2.1 time: 1.130723 Oct 28 13:25:19.831255 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2343/4602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:18 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1469 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:20.663963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:20.664438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:20.689731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:20.691946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:20.692652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:20.693426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:20.696028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:20.696478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:20.745219 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] HTTP exception thrown: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Request method failure captured: Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf HTTP/1.1 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9Y-JLec2-1lvgb5m12T9E3a2-vpzT1uRrbRWXKkCw3OArsFA4j-gw9OJ0v6mD71fUY4XIabhBC71bRRgO36KLg59Yr_U4lUdq86Pd3xbM_Y4lmxmWf1oyfP6NZXSXLHWSCEh2az5Fc2gPCgTLHjd-it3P85gUQu3NF0eUpic0fHlvo Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7c7fd700fc2044c19c2fcc6e6ccc48ae Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c7fd700fc2044c19c2fcc6e6ccc48ae", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7c7fd700fc2044c19c2fcc6e6ccc48ae Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TaggedBootDevicesTest-1161923093-project Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 9bd4a046d9214c8d819c65dd78ba6bf1 Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TaggedBootDevicesTest-1161923093-project Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6e31e02c-74ff-4b92-9790-edc0459908bf'} Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:20.748038 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.752975 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.755239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Returning 404 to user: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:20.757899 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd5df0e4-eaa7-4263-a3f4-e7c688084d34 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 404 len: 111 microversion: 2.32 time: 0.104866 Oct 28 13:25:20.765464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2260/4603] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:25:20 2022] DELETE /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:25:20.777469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:20.778235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] [instance: 6e31e02c-74ff-4b92-9790-edc0459908bf] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:20.792960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:20.799335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:20.800275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:20.801323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:20.802296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:20.802965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:20.827925 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] HTTP exception thrown: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Request method failure captured: Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf HTTP/1.1 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9Y-JLec2-1lvgb5m12T9E3a2-vpzT1uRrbRWXKkCw3OArsFA4j-gw9OJ0v6mD71fUY4XIabhBC71bRRgO36KLg59Yr_U4lUdq86Pd3xbM_Y4lmxmWf1oyfP6NZXSXLHWSCEh2az5Fc2gPCgTLHjd-it3P85gUQu3NF0eUpic0fHlvo Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7c7fd700fc2044c19c2fcc6e6ccc48ae Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7c7fd700fc2044c19c2fcc6e6ccc48ae", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7c7fd700fc2044c19c2fcc6e6ccc48ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7c7fd700fc2044c19c2fcc6e6ccc48ae Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1161923093 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TaggedBootDevicesTest-1161923093-project Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 9bd4a046d9214c8d819c65dd78ba6bf1 Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TaggedBootDevicesTest-1161923093-project Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6e31e02c-74ff-4b92-9790-edc0459908bf'} Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.830435 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] Returning 404 to user: Instance 6e31e02c-74ff-4b92-9790-edc0459908bf could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32f0dc8e-1661-45a1-beb4-952ca05c2f63 tempest-TaggedBootDevicesTest-1161923093 tempest-TaggedBootDevicesTest-1161923093-project] 10.222.0.25 "GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf" status: 404 len: 111 microversion: 2.32 time: 0.062228 Oct 28 13:25:20.843604 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2344/4604] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:25:20 2022] GET /compute/v2.1/servers/6e31e02c-74ff-4b92-9790-edc0459908bf => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:25:20.853067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:20.854460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:20.867900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:20.868766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:20.871249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:20.874130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:20.876572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:20.877392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:21.791941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:21.806509 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-82798e64-e2bc-4fff-b903-9b0fb454f2da tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1469 microversion: 2.1 time: 0.956516 Oct 28 13:25:21.813015 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2261/4605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:20 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1469 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:22.832947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:22.837678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:22.843595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:22.844103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:22.844552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:22.847826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:22.852146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:22.853082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:23.055207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:23.111913 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e9f0a44-4bde-4e33-8046-76ea013c7696 tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1427 microversion: 2.1 time: 0.278952 Oct 28 13:25:23.112615 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2345/4606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:22 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1427 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:23.542041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8e801e43-d979-4391-a845-ca4fdd3cb79e req-e1a950a7-0912-45c3-8871-f67f8056db6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561a4c75-30be-45bc-8f1f-02d9de17519d", "name": "network-vif-deleted", "tag": "3b86f559-9d9c-4a08-a90e-4abd2b238750"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:23.584577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e801e43-d979-4391-a845-ca4fdd3cb79e req-e1a950a7-0912-45c3-8871-f67f8056db6f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:23.585308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e801e43-d979-4391-a845-ca4fdd3cb79e req-e1a950a7-0912-45c3-8871-f67f8056db6f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:23.586224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e801e43-d979-4391-a845-ca4fdd3cb79e req-e1a950a7-0912-45c3-8871-f67f8056db6f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:23.664839 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8e801e43-d979-4391-a845-ca4fdd3cb79e req-e1a950a7-0912-45c3-8871-f67f8056db6f service nova] Creating event network-vif-deleted:3b86f559-9d9c-4a08-a90e-4abd2b238750 for instance 561a4c75-30be-45bc-8f1f-02d9de17519d on n-h1-862876-2 Oct 28 13:25:23.701459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8e801e43-d979-4391-a845-ca4fdd3cb79e req-e1a950a7-0912-45c3-8871-f67f8056db6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163032 Oct 28 13:25:23.705285 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2262/4607] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:24.142179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:24.143552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:24.158113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:24.158609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:24.159073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:24.159788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:24.160245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:24.160670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:24.254766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:24.264595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:24.265455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:24.265940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lazy-loading 'fault' on Instance uuid 561a4c75-30be-45bc-8f1f-02d9de17519d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:25:24.503953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3852e30767345639ee5d92350d2950a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c125dbce0f4df8bd795a00b219487c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:24.522291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-744b0678-faee-47c4-8803-105bc38e4a5d tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 200 len: 1303 microversion: 2.1 time: 0.383662 Oct 28 13:25:24.532696 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2346/4608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:24 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 1303 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:25.296339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75478313-548c-4c29-bc07-4f565a1626a9 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'create', calling method: .version_select at 0x7f27b8b97dc0>, body: {"keypair": {"name": "tempest-keypair-1980747019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHvb1T1C1OKd/NTDsjrT9Wii7ZGuZMitclWvfWsCG5kz4nMraslvREbiXqh42MhK5I55jSvmlYTMpFUfOLuCawOL7+eZSYgb2l7uSbF3Xu9Xai5UioFsqq6DqdT5v4ywQ=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:25.332838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-75478313-548c-4c29-bc07-4f565a1626a9 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for project c7dec96587614543843d0c86c3e4adb6. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:25:25.342459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-75478313-548c-4c29-bc07-4f565a1626a9 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for user 3cf94118fc4e458e9e1163a03be85c50 and project c7dec96587614543843d0c86c3e4adb6. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:25:25.463397 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75478313-548c-4c29-bc07-4f565a1626a9 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.413645 Oct 28 13:25:25.465241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2263/4609] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:25:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:25.565767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:25.567104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] [instance: 561a4c75-30be-45bc-8f1f-02d9de17519d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:25.579702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:25.586014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:25.586014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:25.586014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:25.586014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:25.586014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:25.601012 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] HTTP exception thrown: Instance 561a4c75-30be-45bc-8f1f-02d9de17519d could not be found. Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Request method failure captured: Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d HTTP/1.1 Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ctTrgo1z_409RnhwUliL3zUJdpA1z6RB6wom4wmmK4V30Izgkt4vk-9FOHKMKLTUyeOYWHtAbVR6d635mqoS6EGjZ5lNmaz-dgQc98Lfj_9p2-CmcFJXySS-DhiP7Yrnzs_o7uVh8uRr1CfxUjvyNpWAmcptnhMdWnoe9YYpY6yKA Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_08c125dbce0f4df8bd795a00b219487c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/08c125dbce0f4df8bd795a00b219487c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 08c125dbce0f4df8bd795a00b219487c Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-MigrationsAdminTest-1689238923 Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c3852e30767345639ee5d92350d2950a Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-MigrationsAdminTest-1689238923-project Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 561a4c75-30be-45bc-8f1f-02d9de17519d could not be found. Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '561a4c75-30be-45bc-8f1f-02d9de17519d'} Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561a4c75-30be-45bc-8f1f-02d9de17519d could not be found. Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561a4c75-30be-45bc-8f1f-02d9de17519d could not be found. Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:25.602624 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561a4c75-30be-45bc-8f1f-02d9de17519d could not be found. Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] Returning 404 to user: Instance 561a4c75-30be-45bc-8f1f-02d9de17519d could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-610b30ab-cb48-4e16-971e-4a88226ad3db tempest-MigrationsAdminTest-1689238923 tempest-MigrationsAdminTest-1689238923-project] 10.222.0.25 "GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d" status: 404 len: 111 microversion: 2.1 time: 0.054071 Oct 28 13:25:25.614406 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2347/4610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:25 2022] GET /compute/v2.1/servers/561a4c75-30be-45bc-8f1f-02d9de17519d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:25:31.831662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2114898882", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac494844-a111-46b7-ba85-59a91ca923b5"}], "security_groups": [{"name": "tempest-securitygroup--1409376488"}], "key_name": "tempest-keypair-1980747019", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:32.166105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] validate_networks() for [('ac494844-a111-46b7-ba85-59a91ca923b5', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:25:33.174881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:25:33.176315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:25:33.176823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:25:33.177849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:25:33.178498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:25:33.180927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:33.192654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:33.196716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:33.196716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:33.196716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:33.196716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:33.196716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:33.218838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for project c7dec96587614543843d0c86c3e4adb6. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:25:33.225730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for user 3cf94118fc4e458e9e1163a03be85c50 and project c7dec96587614543843d0c86c3e4adb6. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:25:33.242917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:25:33.246237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:25:33.477003 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b799744-ff15-4226-945d-c7ef0e374464 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.656832 Oct 28 13:25:33.486318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2264/4611] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:25:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:25:33.497569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cef6a9e4-20f4-4b5a-b2dd-34e55a645265 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:33.498238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cef6a9e4-20f4-4b5a-b2dd-34e55a645265 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:33.645255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cef6a9e4-20f4-4b5a-b2dd-34e55a645265 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:33.659449 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cef6a9e4-20f4-4b5a-b2dd-34e55a645265 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1238 microversion: 2.1 time: 0.164946 Oct 28 13:25:33.661139 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2348/4612] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:33 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1238 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:34.376704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-162662441", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:34.487619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] validate_networks() for None {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:25:34.685514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85b5e1ae-c292-4f92-ac64-02695719aad5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:34.686182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-85b5e1ae-c292-4f92-ac64-02695719aad5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:34.796402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-85b5e1ae-c292-4f92-ac64-02695719aad5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:34.802929 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85b5e1ae-c292-4f92-ac64-02695719aad5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1238 microversion: 2.1 time: 0.120929 Oct 28 13:25:34.805869 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2349/4613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:34 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1238 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:35.120213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:25:35.120701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:25:35.121269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:25:35.121686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:25:35.122178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:25:35.141712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:35.142211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:35.145866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:35.147330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:35.148783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:35.149940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:35.212994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Getting quotas for project 2a0a12ba7ca34d3bbe9672a399ea7d0e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:25:35.228745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Getting quotas for user 402713e4c25b49998301697e583a1b3c and project 2a0a12ba7ca34d3bbe9672a399ea7d0e. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:25:35.270801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:25:35.270801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:25:35.453910 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-167a20ba-afbf-4d7f-a409-fea452dfc5a7 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287509 Oct 28 13:25:35.460315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2265/4614] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:25:35.464900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b703420f-1ff6-46bf-b3e7-79594cda8e37 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:35.466267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b703420f-1ff6-46bf-b3e7-79594cda8e37 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:35.579541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b703420f-1ff6-46bf-b3e7-79594cda8e37 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:35.582552 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b703420f-1ff6-46bf-b3e7-79594cda8e37 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1221 microversion: 2.1 time: 0.121496 Oct 28 13:25:35.595508 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2350/4615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:35 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:25:35.826940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:35.827622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:35.834863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:35.835354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:35.835876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:35.836528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:35.836982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:35.837401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:36.053596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:36.069264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a5a62cb-a111-49b1-9e8e-596f5ee5f2eb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1242 microversion: 2.1 time: 0.243639 Oct 28 13:25:36.070212 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2266/4616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:35 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:36.617095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5e2c509-83b5-434f-9605-fe17b847c82b tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:36.617859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a5e2c509-83b5-434f-9605-fe17b847c82b tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:36.620593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:36.839673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a5e2c509-83b5-434f-9605-fe17b847c82b tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:36.862357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5e2c509-83b5-434f-9605-fe17b847c82b tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1221 microversion: 2.1 time: 0.250027 Oct 28 13:25:36.883621 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2351/4617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:36 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:37.096170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:37.096876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:37.127582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aac6cbdf-23fa-4efb-bce6-abe00c7a2370 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1290 microversion: 2.1 time: 0.247293 Oct 28 13:25:37.362929 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2267/4618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:37 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1290 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:37.900161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:37.900776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:37.959887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:37.960335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:37.960745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:37.962301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:37.974886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:37.975365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:38.375789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:38.376410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:38.399169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:38.399662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:38.400095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:38.400799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:38.401253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:38.401672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:38.451716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:38.460883 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-205ec5c7-5d87-4c7f-bd35-9a438e0f32d4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1225 microversion: 2.1 time: 0.568838 Oct 28 13:25:38.472481 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2352/4619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:37 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1225 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:38.780684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:38.801038 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27c896cd-afb5-4309-9025-18940c4c9655 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1296 microversion: 2.1 time: 0.437311 Oct 28 13:25:38.801739 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2268/4620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:38 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1296 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:39.494010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:39.495664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:39.512200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:39.512997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:39.514549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:39.515755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:39.520825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:39.521522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:39.651929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:39.668673 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8af0e41c-82e4-4364-b752-3c4d4b656513 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1273 microversion: 2.1 time: 0.178933 Oct 28 13:25:39.671806 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2353/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:39 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:39.828322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:39.829025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:39.857666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:39.859420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:39.861881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:39.862841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:39.865645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:39.866276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:40.582669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:40.596151 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5806057-2a1b-4f49-9827-3723f664f9b5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.773781 Oct 28 13:25:40.596746 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2269/4622] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:39 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:40.702793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:40.703395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:40.721014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:40.721436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:40.727086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:40.730297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:40.732089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:40.732555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:40.912881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:40.924583 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-56c5ec14-0833-4708-8f52-379f102a3a1f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1279 microversion: 2.1 time: 0.225775 Oct 28 13:25:40.925211 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2354/4623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:40 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:41.622776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:41.624547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:41.639162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:41.642668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:41.643510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:41.646142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:41.647077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:41.649217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:41.699903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:41.960668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:41.961418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:41.982118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:41.982855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:41.983732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:41.988739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:41.989607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:41.990270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:42.133905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:42.155830 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a67505bb-75bd-47e5-80b7-f7d6ff2b0fb4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1279 microversion: 2.1 time: 0.199240 Oct 28 13:25:42.156782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2355/4624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:41 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:25:42.188245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c07336d8-20cf-4a10-a822-88d7d9c972d1 req-56cd8afc-4397-4eab-bf74-60db190d6298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f35a4c2-2658-4948-873b-c44e0e7ad80f", "tag": "d49d8d00-ce40-4925-b7b6-07f94ab7209e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:42.201805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c07336d8-20cf-4a10-a822-88d7d9c972d1 req-56cd8afc-4397-4eab-bf74-60db190d6298 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:42.202377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c07336d8-20cf-4a10-a822-88d7d9c972d1 req-56cd8afc-4397-4eab-bf74-60db190d6298 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:42.202850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c07336d8-20cf-4a10-a822-88d7d9c972d1 req-56cd8afc-4397-4eab-bf74-60db190d6298 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:42.204323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:42.223721 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c07336d8-20cf-4a10-a822-88d7d9c972d1 req-56cd8afc-4397-4eab-bf74-60db190d6298 service nova] Creating event network-changed:d49d8d00-ce40-4925-b7b6-07f94ab7209e for instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f on n-h1-862876-2 Oct 28 13:25:42.226815 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ba05e62-8ace-4d93-9dbc-15266e1d5593 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.607965 Oct 28 13:25:42.229676 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2270/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:41 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:25:42.240937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c07336d8-20cf-4a10-a822-88d7d9c972d1 req-56cd8afc-4397-4eab-bf74-60db190d6298 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057066 Oct 28 13:25:42.241531 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2356/4626] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:25:43.182215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:43.183529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:43.201181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:43.201744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:43.202200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:43.206657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:43.207538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:43.208003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:43.257847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:43.258608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:43.272173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:43.272173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:43.272173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:43.272173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:43.272173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:43.272173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:43.585120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:43.599740 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-845bb558-0262-4485-9fb3-7ee7b9db9bca tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.421806 Oct 28 13:25:43.603374 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2271/4627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:43 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:43.974604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:43.986945 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c5a1abf-9991-455b-837b-d16defbbe5ed tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.735391 Oct 28 13:25:43.991407 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2357/4628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:43 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:44.642231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:44.642231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:44.662235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:44.671569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:44.672024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:44.672762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:44.673236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:44.673633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:44.892797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:44.902302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5459dc2-fd31-4acf-99a6-e4a2e6dcca56 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.279984 Oct 28 13:25:44.910525 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2272/4629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:44 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:45.019918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:45.021133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:45.030628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:45.049554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:45.051675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:45.053570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:45.054148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:45.056210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:45.134908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-85cfacb3-8052-4e6a-a8bc-4aec23aa23db req-d348a494-acb1-46b1-a03c-d89ad5a1e594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85223fa1-c394-45f4-a520-bc41b9b31a5a", "tag": "80e25752-02ab-4048-b4d4-4fa1bb4f9f9c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:45.156254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-85cfacb3-8052-4e6a-a8bc-4aec23aa23db req-d348a494-acb1-46b1-a03c-d89ad5a1e594 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:45.157276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-85cfacb3-8052-4e6a-a8bc-4aec23aa23db req-d348a494-acb1-46b1-a03c-d89ad5a1e594 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:45.157910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-85cfacb3-8052-4e6a-a8bc-4aec23aa23db req-d348a494-acb1-46b1-a03c-d89ad5a1e594 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:45.178059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:45.186183 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-85cfacb3-8052-4e6a-a8bc-4aec23aa23db req-d348a494-acb1-46b1-a03c-d89ad5a1e594 service nova] Creating event network-changed:80e25752-02ab-4048-b4d4-4fa1bb4f9f9c for instance 85223fa1-c394-45f4-a520-bc41b9b31a5a on n-h1-862876-2 Oct 28 13:25:45.208032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-85cfacb3-8052-4e6a-a8bc-4aec23aa23db req-d348a494-acb1-46b1-a03c-d89ad5a1e594 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086356 Oct 28 13:25:45.211333 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2273/4630] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:45.804300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:45.821272 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f264339-e394-4549-8f45-a46931b19eb5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.810076 Oct 28 13:25:45.821930 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2358/4631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:45 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:45.926035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=16 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:45.931962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:45.939054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:45.950242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:45.951535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:45.952732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:45.954349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:45.955337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:45.956738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:46.176457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:46.195382 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce66359c-0293-4a9c-b1b3-9a9f350c97fc tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.269977 Oct 28 13:25:46.196313 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2274/4632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:45 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:46.848521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:46.849146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:46.863166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:46.864006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:46.864621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:46.865519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:46.873482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:46.877287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:46.877287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:47.222422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:47.223215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:47.238870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:47.242589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:47.242589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:47.243444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:47.246451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:47.247501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:47.474258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:47.483416 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-792c397c-aa41-4af8-a4f4-43bed5fbeb24 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.638708 Oct 28 13:25:47.495560 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2359/4633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:46 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:47.585494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:47.604835 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54002298-1821-4993-bf96-381751e4e030 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.386676 Oct 28 13:25:47.618777 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2275/4634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:47 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:48.519406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:48.520250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:48.557437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=50 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:25:48.565416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:48.566161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:48.566720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:48.567597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:48.568604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:48.569242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:48.643133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:48.644561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:48.667588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:48.668125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:48.679592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:48.680703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:48.681363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:48.693881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:49.181505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:49.204045 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-57739f77-0b4a-4f35-b91b-51f7e632bec7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.689866 Oct 28 13:25:49.216433 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2360/4635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:48 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:49.275435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:49.284034 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4e0bb7a7-ccd4-4f17-b46f-4eedbe1d9671 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.649770 Oct 28 13:25:49.284782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2276/4636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:48 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:25:50.247263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:50.247263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:50.265310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:50.266442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:50.271032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:50.271032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:50.271032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:50.271032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:50.311597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:50.312379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:50.348533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:50.351672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:50.352220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:50.353702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:50.354210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:50.354621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:50.632356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:50.654434 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-751c782e-3a94-4c98-a6de-ea13204f8965 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.347284 Oct 28 13:25:50.659603 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2277/4637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:50 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:50.912119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:50.931284 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7980c433-1547-4135-b280-977d82e8e1bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.687875 Oct 28 13:25:50.931928 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2361/4638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:50 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:51.652331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9c7e4287-16b0-4208-8086-238e5c02f264 req-b22d3a94-a5f8-4994-abc8-86a6dcdbfda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f35a4c2-2658-4948-873b-c44e0e7ad80f", "name": "network-vif-plugged", "status": "completed", "tag": "d49d8d00-ce40-4925-b7b6-07f94ab7209e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:51.663168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c7e4287-16b0-4208-8086-238e5c02f264 req-b22d3a94-a5f8-4994-abc8-86a6dcdbfda7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:51.663706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c7e4287-16b0-4208-8086-238e5c02f264 req-b22d3a94-a5f8-4994-abc8-86a6dcdbfda7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:51.666069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c7e4287-16b0-4208-8086-238e5c02f264 req-b22d3a94-a5f8-4994-abc8-86a6dcdbfda7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:51.681828 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9c7e4287-16b0-4208-8086-238e5c02f264 req-b22d3a94-a5f8-4994-abc8-86a6dcdbfda7 service nova] Creating event network-vif-plugged:d49d8d00-ce40-4925-b7b6-07f94ab7209e for instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f on n-h1-862876-2 Oct 28 13:25:51.682089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:51.682757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:51.690635 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9c7e4287-16b0-4208-8086-238e5c02f264 req-b22d3a94-a5f8-4994-abc8-86a6dcdbfda7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046355 Oct 28 13:25:51.707371 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2278/4639] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:51.736934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:51.740029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:51.741025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:51.746130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:51.747450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:51.748119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:51.960242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:51.961534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:51.979315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:51.980051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:51.984046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:51.984046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:51.989864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:51.991114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:52.159679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:52.172963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ffaae8b4-add2-4937-b636-e813da86d5aa tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.493938 Oct 28 13:25:52.179949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2362/4640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:51 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:52.328835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:52.343251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e93f20f-bac9-4808-a4e2-38a34a5082b4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1364 microversion: 2.1 time: 0.387748 Oct 28 13:25:52.347565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2279/4641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:51 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:53.201072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:53.208528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:53.216269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:53.216765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:53.217203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:53.217910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:53.218370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:53.218821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:53.366317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:53.367076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:53.375713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:53.376124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:53.376772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:53.377633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:53.378262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:53.378874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:53.391516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:53.399876 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6335f4c5-924e-4d49-afb8-7de9780640c8 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.203072 Oct 28 13:25:53.404197 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2363/4642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:53 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:53.718370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6ccda16b-99ea-413f-a211-e541efd07a10 req-b06db773-2542-4d1f-b861-9802c0d23905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85223fa1-c394-45f4-a520-bc41b9b31a5a", "name": "network-vif-plugged", "status": "completed", "tag": "80e25752-02ab-4048-b4d4-4fa1bb4f9f9c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:53.727913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6ccda16b-99ea-413f-a211-e541efd07a10 req-b06db773-2542-4d1f-b861-9802c0d23905 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:53.728904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6ccda16b-99ea-413f-a211-e541efd07a10 req-b06db773-2542-4d1f-b861-9802c0d23905 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:53.729521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6ccda16b-99ea-413f-a211-e541efd07a10 req-b06db773-2542-4d1f-b861-9802c0d23905 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:53.730576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:53.739383 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5636e771-5e76-47bc-8310-22cb97a8780d tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1550 microversion: 2.1 time: 0.377444 Oct 28 13:25:53.752801 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6ccda16b-99ea-413f-a211-e541efd07a10 req-b06db773-2542-4d1f-b861-9802c0d23905 service nova] Creating event network-vif-plugged:80e25752-02ab-4048-b4d4-4fa1bb4f9f9c for instance 85223fa1-c394-45f4-a520-bc41b9b31a5a on n-h1-862876-2 Oct 28 13:25:53.758179 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2280/4643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:53 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1550 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:53.762846 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6ccda16b-99ea-413f-a211-e541efd07a10 req-b06db773-2542-4d1f-b861-9802c0d23905 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048729 Oct 28 13:25:53.763641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:53.763930 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2364/4644] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:25:53.764491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:53.771951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:53.772648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:53.773292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:53.780684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:53.780684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:53.780684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:53.985548 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-350905fa-4dd0-44f5-bc26-f00ad18fab7b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225863 Oct 28 13:25:53.990887 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2281/4645] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:25:53 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:54.430540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:54.432419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:54.444267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:54.444769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:54.445310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:54.446021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:54.446534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:54.449459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:54.680861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:54.690073 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b72c1f23-15c8-40b9-8642-beb5d8b5c3e4 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1321 microversion: 2.1 time: 0.266985 Oct 28 13:25:54.691002 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2365/4646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:54 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:55.690147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-367cf6b6-b070-4eea-b3f2-ca85b57ef48b req-3907257c-10ba-43a2-8b36-9b6246f342b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f35a4c2-2658-4948-873b-c44e0e7ad80f", "tag": "d49d8d00-ce40-4925-b7b6-07f94ab7209e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:55.707719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-367cf6b6-b070-4eea-b3f2-ca85b57ef48b req-3907257c-10ba-43a2-8b36-9b6246f342b2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:55.708207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-367cf6b6-b070-4eea-b3f2-ca85b57ef48b req-3907257c-10ba-43a2-8b36-9b6246f342b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:55.709917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-367cf6b6-b070-4eea-b3f2-ca85b57ef48b req-3907257c-10ba-43a2-8b36-9b6246f342b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:55.716468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:55.721695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:55.733290 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-367cf6b6-b070-4eea-b3f2-ca85b57ef48b req-3907257c-10ba-43a2-8b36-9b6246f342b2 service nova] Creating event network-changed:d49d8d00-ce40-4925-b7b6-07f94ab7209e for instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f on n-h1-862876-2 Oct 28 13:25:55.750971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:55.750971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:55.750971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:55.750971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:55.750971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:55.750971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:55.751441 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-367cf6b6-b070-4eea-b3f2-ca85b57ef48b req-3907257c-10ba-43a2-8b36-9b6246f342b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057033 Oct 28 13:25:55.751441 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2282/4647] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:25:56.304919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:56.318626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19976184-f68f-4c29-8be1-944535a88494 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1471 microversion: 2.1 time: 0.607243 Oct 28 13:25:56.322318 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2366/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:55 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1471 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:56.773147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0b42013-0d16-4bfe-ae5e-16910274c9cf tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:56.773823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0b42013-0d16-4bfe-ae5e-16910274c9cf tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] [instance: eaec5fd6-5717-42a4-a02d-0466602e7058] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:56.798215 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d0b42013-0d16-4bfe-ae5e-16910274c9cf tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] HTTP exception thrown: Instance eaec5fd6-5717-42a4-a02d-0466602e7058 could not be found. Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0b42013-0d16-4bfe-ae5e-16910274c9cf tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Request method failure captured: Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/eaec5fd6-5717-42a4-a02d-0466602e7058/action HTTP/1.1 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 15 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9hNNKaMKxXmtOU6-22oAIREz7PyXUqHoVtFRcvgjALMi8uYgkJTQlt9X1aBsGQhCH-vbJhi8Utu5mcK3BQUJwrBqsiMTuHBYBhrCAvHzTxaUiSyCsyu9GymJzuw-o4qeEf9xxinp0K3yS2eMSJ2C01TZoGMSqA5Hv-y9oo0MFw6MGk Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3e9f65d83254f40aae74eda2ce4cc01", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3ecd738598d54f558db954e980462575 Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: {"migrate": {}} Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance eaec5fd6-5717-42a4-a02d-0466602e7058 could not be found. Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'eaec5fd6-5717-42a4-a02d-0466602e7058', 'body': {'migrate': {}}} Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaec5fd6-5717-42a4-a02d-0466602e7058 could not be found. Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaec5fd6-5717-42a4-a02d-0466602e7058 could not be found. Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:56.800301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:25:56.804706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:25:56.804706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:25:56.804706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:25:56.804706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:25:56.804706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaec5fd6-5717-42a4-a02d-0466602e7058 could not be found. Oct 28 13:25:56.804706 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:25:56.808214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0b42013-0d16-4bfe-ae5e-16910274c9cf tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Returning 404 to user: Instance eaec5fd6-5717-42a4-a02d-0466602e7058 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:25:56.809471 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0b42013-0d16-4bfe-ae5e-16910274c9cf tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/eaec5fd6-5717-42a4-a02d-0466602e7058/action" status: 404 len: 111 microversion: 2.1 time: 0.431988 Oct 28 13:25:56.810311 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2283/4649] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:25:56 2022] POST /compute/v2.1/servers/eaec5fd6-5717-42a4-a02d-0466602e7058/action => generated 111 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:25:57.040336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1797727552", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:25:57.131365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:25:57.644731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:25:57.645502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:25:57.646151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:25:57.646569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:25:57.647016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:25:57.676320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:57.676918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:57.677377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:57.678437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:25:57.679218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:25:57.679745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:25:57.734899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Getting quotas for project 2a0a12ba7ca34d3bbe9672a399ea7d0e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:25:57.752567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Getting quotas for user 402713e4c25b49998301697e583a1b3c and project 2a0a12ba7ca34d3bbe9672a399ea7d0e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:25:57.795171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:25:57.807551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:25:58.126055 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a39b342b-f12d-4695-b7f0-4677e675c0fe tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.090648 Oct 28 13:25:58.143144 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2367/4650] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:25:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:25:58.155267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8d9cae4-8b5c-4bf4-af93-707e1fc1df80 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:58.156656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a8d9cae4-8b5c-4bf4-af93-707e1fc1df80 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:58.489902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a8d9cae4-8b5c-4bf4-af93-707e1fc1df80 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:58.515321 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a8d9cae4-8b5c-4bf4-af93-707e1fc1df80 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1222 microversion: 2.1 time: 0.363896 Oct 28 13:25:58.517535 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2284/4651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:58 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1222 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:25:59.564622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f6f7343-3a6e-4547-a8eb-366dfb840301 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:25:59.568797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f6f7343-3a6e-4547-a8eb-366dfb840301 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:25:59.639212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4f6f7343-3a6e-4547-a8eb-366dfb840301 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:25:59.652302 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f6f7343-3a6e-4547-a8eb-366dfb840301 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1222 microversion: 2.1 time: 0.110336 Oct 28 13:25:59.653796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2368/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:25:59 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:00.684281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:00.686176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:00.699568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:00.704196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:00.704196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:00.704196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:00.704196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:00.704196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:00.842574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:00.860755 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-02b3df15-f414-4773-afa4-c2b0ceba0f2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1218 microversion: 2.1 time: 0.182440 Oct 28 13:26:00.861523 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2285/4653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:00 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:01.900544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:01.901930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:01.913653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:01.914454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:01.915165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:01.916366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:01.917055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:01.917696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:02.083501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:02.092788 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e07dac3-77fb-4221-82e8-ccf0903d50cb tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1282 microversion: 2.1 time: 0.197719 Oct 28 13:26:02.100541 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2369/4654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:01 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:03.136248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:03.137516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:03.158362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:03.160534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:03.161004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:03.161742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:03.162215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:03.162708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:03.293636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:03.312648 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-913b13b5-2729-4c4c-9a2c-831b6d58eb36 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1280 microversion: 2.1 time: 0.180551 Oct 28 13:26:03.314682 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2286/4655] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:03 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:04.348169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:04.374003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:04.409810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:04.411695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:04.417737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:04.420117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:04.422898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:04.424247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:04.469300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-618275446", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "b8809e1a-7408-486a-8fe6-467899e363d2"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:04.578823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] validate_networks() for [('b8809e1a-7408-486a-8fe6-467899e363d2', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:26:05.034946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:05.058774 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c4d9492e-f00f-48c3-bff7-d738fa96ac2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.726008 Oct 28 13:26:05.059606 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2370/4656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:04 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:06.085551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:06.087166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:06.099504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:06.100952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:06.101411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:06.102148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:06.102620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:06.103083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:06.156502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:06.395981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:26:06.396835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:26:06.397421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:26:06.398373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:26:06.399892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:26:06.403108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:06.442085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:06.447650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:06.450271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:06.454366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:06.457841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:06.458391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:06.553496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Getting quotas for project e30bb4edd8cc4eff88444ca688c4e862. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:26:06.567105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Getting quotas for user 361c7be5f66a48e9b3b283d063b89ff3 and project e30bb4edd8cc4eff88444ca688c4e862. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:26:06.598395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:26:06.602428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:26:06.608262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:06.624076 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-62b30cc4-7375-40f7-abff-db61180d9098 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.542873 Oct 28 13:26:06.627280 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2371/4657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:06 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:06.636506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d426e3a-b00a-4ece-870e-b23f7c475309 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Action: 'create', calling method: .version_select at 0x7f27b95013a0>, body: {"keypair": {"name": "tempest-keypair-62101537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICz/2bFTpfNRg0FPc5VgD94WQmYcHVyykpBRi95Ilnk6MvQCcCKj4uS+9AZ0nBzPPhtbv8sWjst9gFVKOLwWX3Yvo5+0VWVI3DcSmxyvhF00hw6j24Hiw/7Yc9FgDzhoA=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:06.667398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2d426e3a-b00a-4ece-870e-b23f7c475309 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Getting quotas for project 65e39c3cdf0f4775a64d93ddcba5bbc5. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:26:06.679721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2d426e3a-b00a-4ece-870e-b23f7c475309 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Getting quotas for user 81b9280d754a41c5949836f84f7bfa8b and project 65e39c3cdf0f4775a64d93ddcba5bbc5. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:26:06.788604 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d426e3a-b00a-4ece-870e-b23f7c475309 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.158988 Oct 28 13:26:06.789800 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2372/4658] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:26:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 13:26:06.797563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5df8dea1-a4c4-427e-803c-964c98a3a42e req-59059a64-66c3-4693-963f-5f4d3e499805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed92221-9378-48f5-8fe1-66eca5fcefdc", "tag": "bc3838ab-d3aa-44b7-9569-04c8528b3d28"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:06.805317 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a103b2ce-1684-4c32-b2d2-92dc26cebfef tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340244 Oct 28 13:26:06.815085 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2287/4659] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:26:06.830629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42da18c2-232e-43dd-8089-8ef4d47c9b6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:06.831586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-42da18c2-232e-43dd-8089-8ef4d47c9b6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:06.836112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5df8dea1-a4c4-427e-803c-964c98a3a42e req-59059a64-66c3-4693-963f-5f4d3e499805 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:06.836112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5df8dea1-a4c4-427e-803c-964c98a3a42e req-59059a64-66c3-4693-963f-5f4d3e499805 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:06.836112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5df8dea1-a4c4-427e-803c-964c98a3a42e req-59059a64-66c3-4693-963f-5f4d3e499805 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:06.875845 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5df8dea1-a4c4-427e-803c-964c98a3a42e req-59059a64-66c3-4693-963f-5f4d3e499805 service nova] Creating event network-changed:bc3838ab-d3aa-44b7-9569-04c8528b3d28 for instance fed92221-9378-48f5-8fe1-66eca5fcefdc on n-h2-862876-2 Oct 28 13:26:06.886432 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5df8dea1-a4c4-427e-803c-964c98a3a42e req-59059a64-66c3-4693-963f-5f4d3e499805 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094912 Oct 28 13:26:06.888082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2373/4660] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:06.943820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42da18c2-232e-43dd-8089-8ef4d47c9b6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:06.953883 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42da18c2-232e-43dd-8089-8ef4d47c9b6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1218 microversion: 2.1 time: 0.136590 Oct 28 13:26:06.969421 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2288/4661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:06 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:07.653279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:07.654220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:07.663870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:07.664776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:07.665081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:07.665961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:07.666258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:07.666668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:07.703570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:07.922381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:07.956578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a833a0fb-c07b-43fa-bea4-9c7a97809d82 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.306912 Oct 28 13:26:07.958883 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2374/4662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:07 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:07.985401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e885255d-f299-4093-9fe2-ebcf4cae41ed tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:07.986703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e885255d-f299-4093-9fe2-ebcf4cae41ed tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:08.060615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e885255d-f299-4093-9fe2-ebcf4cae41ed tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:08.081401 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e885255d-f299-4093-9fe2-ebcf4cae41ed tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1218 microversion: 2.1 time: 0.094769 Oct 28 13:26:08.081401 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2289/4663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:07 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:08.985617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:08.986231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:08.999540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:09.000040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:09.007451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:09.010913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:09.011697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:09.012491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:09.096193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:09.097067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:09.105055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:09.105601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:09.106035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:09.106954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:09.107418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:09.107840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:09.242272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:09.255372 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9e4e15eb-304e-4a4b-a8a1-299721a46bec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1270 microversion: 2.1 time: 0.165426 Oct 28 13:26:09.256825 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2290/4664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:09 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:09.363798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:09.374870 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3d6e8b5-45c4-46b5-a2d2-6d6942b43437 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.395742 Oct 28 13:26:09.375485 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2375/4665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:08 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:10.290292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:10.292121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:10.319863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:10.326980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:10.326980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:10.326980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:10.326980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:10.332463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:10.409083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:10.409796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:10.421210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:10.423537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:10.423537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:10.424362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:10.425429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:10.426486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:10.488831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:10.500868 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8f5c545-269b-48ec-8d41-9a5b896ff369 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1288 microversion: 2.1 time: 0.222526 Oct 28 13:26:10.503768 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2291/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:10 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1288 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:10.755301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-104292237", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2ab70cb2-8e44-401a-bf73-83babd72564a"}, {"port": "585cc549-1b07-4522-85cf-a1914cce9d33", "tag": "port-1"}, {"port": "34ff3a2e-4c23-4038-b121-e08b82372578", "tag": "port-2"}, {"uuid": "39f80ce5-df8e-44c3-92ef-d0292e959705", "tag": "net-1"}, {"uuid": "39f80ce5-df8e-44c3-92ef-d0292e959705"}, {"uuid": "d6537734-19e9-47e3-a6ad-783d910759ef", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d6537734-19e9-47e3-a6ad-783d910759ef", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "cf4b156a-2057-4003-9e6d-af741895da7e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5ca7f3aa-19ba-4ad5-9a21-3a617fb7507a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6dd3e489-ad72-4886-902b-7e03987236e8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1282587631"}], "key_name": "tempest-keypair-62101537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:10.845299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:10.856754 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68008990-f8b6-4c11-a47f-98b61c1eada0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.457855 Oct 28 13:26:10.879075 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2376/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:10 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:10.954889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] validate_networks() for [('2ab70cb2-8e44-401a-bf73-83babd72564a', None, None, None, None, None), (None, None, '585cc549-1b07-4522-85cf-a1914cce9d33', None, None, None), (None, None, '34ff3a2e-4c23-4038-b121-e08b82372578', None, None, None), ('39f80ce5-df8e-44c3-92ef-d0292e959705', None, None, None, None, None), ('39f80ce5-df8e-44c3-92ef-d0292e959705', None, None, None, None, None), ('d6537734-19e9-47e3-a6ad-783d910759ef', '10.2.2.100', None, None, None, None), ('d6537734-19e9-47e3-a6ad-783d910759ef', '10.2.2.200', None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:26:11.529894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:11.530680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:11.549889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:11.550545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:11.551105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:11.557225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:11.557225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:11.557225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:12.420263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:12.440006 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d877ec2-2b7a-488b-92a9-d11a31e219d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1318 microversion: 2.1 time: 0.908397 Oct 28 13:26:12.440006 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2377/4668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:11 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1318 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:12.455509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:12.456795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:12.472057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:12.473772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:12.474545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:12.475535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:12.476203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:12.477727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:12.755702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:12.764529 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1470ce60-4414-4adf-9a10-bf021d68e33c tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.327849 Oct 28 13:26:12.766186 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2378/4669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:12 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:13.457759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:13.458659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:13.469470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:13.470032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:13.470487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:13.474608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:13.475174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:13.475771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:13.794293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:13.813550 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01374fe6-5ed4-4d9c-882f-17553c940173 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1318 microversion: 2.1 time: 0.351380 Oct 28 13:26:13.813550 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2379/4670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:13 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:13.817279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-cba0848f-6a4b-4f0f-a89d-73213c39c031 req-658ebf20-fcd9-49d9-a257-8a54a4fbf1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49aaf8ce-7f94-4845-adb9-c2157aa98218", "tag": "ab3ae769-a5fe-454f-bd9c-3dbe23411c79"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:13.835035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cba0848f-6a4b-4f0f-a89d-73213c39c031 req-658ebf20-fcd9-49d9-a257-8a54a4fbf1d5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:13.840666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cba0848f-6a4b-4f0f-a89d-73213c39c031 req-658ebf20-fcd9-49d9-a257-8a54a4fbf1d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:13.841185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cba0848f-6a4b-4f0f-a89d-73213c39c031 req-658ebf20-fcd9-49d9-a257-8a54a4fbf1d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:13.873342 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-cba0848f-6a4b-4f0f-a89d-73213c39c031 req-658ebf20-fcd9-49d9-a257-8a54a4fbf1d5 service nova] Creating event network-changed:ab3ae769-a5fe-454f-bd9c-3dbe23411c79 for instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 on n-h2-862876-2 Oct 28 13:26:13.878621 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-cba0848f-6a4b-4f0f-a89d-73213c39c031 req-658ebf20-fcd9-49d9-a257-8a54a4fbf1d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069779 Oct 28 13:26:13.879289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2380/4671] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:13.884595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:13.894027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:13.903586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:13.904088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:13.908385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:13.909039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:13.909690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:13.910293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:14.189455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:14.200577 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e6998ee9-bf87-4740-ad81-4e6da447426d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.319902 Oct 28 13:26:14.201431 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2381/4672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:13 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:14.256458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fa2d18f9-9463-44e3-bb0c-2936e81e9c2f req-6dc11725-8868-441d-964e-d7e399d1c3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed92221-9378-48f5-8fe1-66eca5fcefdc", "name": "network-vif-plugged", "status": "completed", "tag": "bc3838ab-d3aa-44b7-9569-04c8528b3d28"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:14.268820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fa2d18f9-9463-44e3-bb0c-2936e81e9c2f req-6dc11725-8868-441d-964e-d7e399d1c3f7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:14.269689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fa2d18f9-9463-44e3-bb0c-2936e81e9c2f req-6dc11725-8868-441d-964e-d7e399d1c3f7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:14.270490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fa2d18f9-9463-44e3-bb0c-2936e81e9c2f req-6dc11725-8868-441d-964e-d7e399d1c3f7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:14.283931 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fa2d18f9-9463-44e3-bb0c-2936e81e9c2f req-6dc11725-8868-441d-964e-d7e399d1c3f7 service nova] Creating event network-vif-plugged:bc3838ab-d3aa-44b7-9569-04c8528b3d28 for instance fed92221-9378-48f5-8fe1-66eca5fcefdc on n-h2-862876-2 Oct 28 13:26:14.289893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fa2d18f9-9463-44e3-bb0c-2936e81e9c2f req-6dc11725-8868-441d-964e-d7e399d1c3f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037157 Oct 28 13:26:14.291259 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2382/4673] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:14.831781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:14.833315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:14.840572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:14.841303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:14.841985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:14.842811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:14.843489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:14.844131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:15.028460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:15.043355 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-59942fa6-1b1a-4824-93c8-e96fece3edd0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1318 microversion: 2.1 time: 0.216914 Oct 28 13:26:15.044593 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2383/4674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:14 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:15.226831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:15.230887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:15.238539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:15.239496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:15.240207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:15.241290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:15.243000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:15.243652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:15.412130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:15.422149 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9343994e-cef4-4eef-8cef-5ecf43d23947 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1322 microversion: 2.1 time: 0.199506 Oct 28 13:26:15.422789 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2384/4675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:15 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:15.862242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:26:15.862737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:26:15.864636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:26:15.865398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:26:15.865990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:26:15.876168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:15.876833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:15.877476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:15.878390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:15.879243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:15.879842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:15.895606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=87 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:15.911620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Getting quotas for project 65e39c3cdf0f4775a64d93ddcba5bbc5. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:26:15.919869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Getting quotas for user 81b9280d754a41c5949836f84f7bfa8b and project 65e39c3cdf0f4775a64d93ddcba5bbc5. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:26:16.067026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:16.067651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:16.085468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:16.098683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:16.098683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:16.105469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:16.112054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:16.112513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:16.176600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:26:16.185300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='cf4b156a-2057-4003-9e6d-af741895da7e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5ca7f3aa-19ba-4ad5-9a21-3a617fb7507a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6dd3e489-ad72-4886-902b-7e03987236e8',volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:26:16.653074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:16.671377 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bf11edc-59fa-4bdc-8335-48d661becae3 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1318 microversion: 2.1 time: 0.600979 Oct 28 13:26:16.686546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2385/4676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:16 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:16.686546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:16.686546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:16.687640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:16.687961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:16.688664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:16.689657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:16.690354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:16.690971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:16.704758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:16.891799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:16.910425 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2092bdc8-fa3f-40c9-8268-eb792dcaf45e tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1472 microversion: 2.1 time: 0.236135 Oct 28 13:26:16.911138 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2386/4677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:16 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:16.932920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:16.934258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:16.940583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:16.941082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:16.941726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:16.942424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:16.943087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:16.943677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:16.968862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lazy-loading 'flavor' on Instance uuid fed92221-9378-48f5-8fe1-66eca5fcefdc {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:26:17.466868 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2db1410b-8e2b-4950-a60d-fde63d7ea08c tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc/action" status: 202 len: 0 microversion: 2.1 time: 0.537388 Oct 28 13:26:17.471859 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2387/4678] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:26:16 2022] POST /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:26:17.479039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:17.484650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:17.491893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:17.492876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:17.493694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:17.494815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:17.495446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:17.496073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:17.930444 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26436095-c42e-47fb-94dc-d4dd7b5712fb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.179301 Oct 28 13:26:17.941151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2292/4679] 10.222.0.25 () {62 vars in 1189 bytes} [Fri Oct 28 13:26:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 7191 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 13:26:17.954425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:17.955414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:17.965940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:17.969262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:17.969997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:17.971075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:17.971951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:17.972611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:18.052034 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54015d9d-76a5-46a7-95b5-75be1fce5ac5 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1631 microversion: 2.1 time: 0.578240 Oct 28 13:26:18.057124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2388/4680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:17 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1631 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:18.063864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-dc0dcc2b-8c80-4559-92b9-72f3b51e3a68 req-a6e4c407-237f-40e6-97b3-904e04d9808e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aaf8ce-7f94-4845-adb9-c2157aa98218", "name": "network-vif-plugged", "status": "completed", "tag": "ab3ae769-a5fe-454f-bd9c-3dbe23411c79"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:18.080119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dc0dcc2b-8c80-4559-92b9-72f3b51e3a68 req-a6e4c407-237f-40e6-97b3-904e04d9808e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:18.080119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dc0dcc2b-8c80-4559-92b9-72f3b51e3a68 req-a6e4c407-237f-40e6-97b3-904e04d9808e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:18.080649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dc0dcc2b-8c80-4559-92b9-72f3b51e3a68 req-a6e4c407-237f-40e6-97b3-904e04d9808e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:18.095177 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-dc0dcc2b-8c80-4559-92b9-72f3b51e3a68 req-a6e4c407-237f-40e6-97b3-904e04d9808e service nova] Creating event network-vif-plugged:ab3ae769-a5fe-454f-bd9c-3dbe23411c79 for instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 on n-h2-862876-2 Oct 28 13:26:18.102905 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-dc0dcc2b-8c80-4559-92b9-72f3b51e3a68 req-a6e4c407-237f-40e6-97b3-904e04d9808e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042935 Oct 28 13:26:18.104114 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2389/4681] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:18.112178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63ca2c03-fbcf-4ce1-9bbd-591a4e0ba186 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:18.115788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63ca2c03-fbcf-4ce1-9bbd-591a4e0ba186 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:18.223921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63ca2c03-fbcf-4ce1-9bbd-591a4e0ba186 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:18.234867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63ca2c03-fbcf-4ce1-9bbd-591a4e0ba186 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:18.238205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63ca2c03-fbcf-4ce1-9bbd-591a4e0ba186 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:18.240579 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63ca2c03-fbcf-4ce1-9bbd-591a4e0ba186 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1283 microversion: 2.42 time: 0.133255 Oct 28 13:26:18.241452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2390/4682] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:18 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1283 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:18.547030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:18.560846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a60a5554-6411-4e80-9531-cf97be77b281 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1318 microversion: 2.1 time: 0.615057 Oct 28 13:26:18.564983 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2293/4683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:17 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:18.707947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-503421068", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "c4689017-4c59-433b-b5ae-2466c081832b"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:18.767620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] validate_networks() for [('c4689017-4c59-433b-b5ae-2466c081832b', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:26:19.082591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:19.083951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:19.093478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.094267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.095024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.095740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.096415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.097054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.291983 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bc5ff26-5f66-4849-814d-ada0018185a6 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1614 microversion: 2.1 time: 0.212981 Oct 28 13:26:19.294518 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2294/4684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:19 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1614 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:19.299979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-594d05fe-8c0f-4cec-b791-9a73a6dba791 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:19.300910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-594d05fe-8c0f-4cec-b791-9a73a6dba791 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:19.391850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-594d05fe-8c0f-4cec-b791-9a73a6dba791 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:19.407726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-594d05fe-8c0f-4cec-b791-9a73a6dba791 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:19.409552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-594d05fe-8c0f-4cec-b791-9a73a6dba791 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:19.411106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-594d05fe-8c0f-4cec-b791-9a73a6dba791 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1283 microversion: 2.42 time: 0.115079 Oct 28 13:26:19.432359 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2295/4685] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:19 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1283 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:19.442884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:19.445705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:19.469695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.469695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.469695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.469695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.469695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.469695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.530884 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] HTTP exception thrown: Cannot 'migrate' instance fed92221-9378-48f5-8fe1-66eca5fcefdc while it is in vm_state suspended Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Request method failure captured: Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc/action HTTP/1.1 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 15 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9hNNKaMKxXmtOU6-22oAIREz7PyXUqHoVtFRcvgjALMi8uYgkJTQlt9X1aBsGQhCH-vbJhi8Utu5mcK3BQUJwrBqsiMTuHBYBhrCAvHzTxaUiSyCsyu9GymJzuw-o4qeEf9xxinp0K3yS2eMSJ2C01TZoGMSqA5Hv-y9oo0MFw6MGk Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3e9f65d83254f40aae74eda2ce4cc01", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3ecd738598d54f558db954e980462575 Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: {"migrate": {}} Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'migrate' instance fed92221-9378-48f5-8fe1-66eca5fcefdc while it is in vm_state suspended Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'fed92221-9378-48f5-8fe1-66eca5fcefdc', 'body': {'migrate': {}}} Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fed92221-9378-48f5-8fe1-66eca5fcefdc in vm_state suspended. Cannot resize while the instance is in this state. Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:26:19.532666 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance fed92221-9378-48f5-8fe1-66eca5fcefdc while it is in vm_state suspended Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance fed92221-9378-48f5-8fe1-66eca5fcefdc while it is in vm_state suspended Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Returning 409 to user: Cannot 'migrate' instance fed92221-9378-48f5-8fe1-66eca5fcefdc while it is in vm_state suspended {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63cc082d-ed49-4fb1-9281-838f27a00a64 tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc/action" status: 409 len: 148 microversion: 2.1 time: 0.102668 Oct 28 13:26:19.537215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2296/4686] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:26:19 2022] POST /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc/action => generated 148 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:26:19.553094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b06055e-5928-4f49-97b0-d278ea7807dc tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b06055e-5928-4f49-97b0-d278ea7807dc tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Request method failure captured: Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a/action HTTP/1.1 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 39 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9hNNKaMKxXmtOU6-22oAIREz7PyXUqHoVtFRcvgjALMi8uYgkJTQlt9X1aBsGQhCH-vbJhi8Utu5mcK3BQUJwrBqsiMTuHBYBhrCAvHzTxaUiSyCsyu9GymJzuw-o4qeEf9xxinp0K3yS2eMSJ2C01TZoGMSqA5Hv-y9oo0MFw6MGk Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3e9f65d83254f40aae74eda2ce4cc01", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3ecd738598d54f558db954e980462575 Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: {"os-resetState": {"state": "invalid"}} Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '85223fa1-c394-45f4-a520-bc41b9b31a5a', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:26:19.564671 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b06055e-5928-4f49-97b0-d278ea7807dc tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:19.569593 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b06055e-5928-4f49-97b0-d278ea7807dc tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a/action" status: 400 len: 144 microversion: 2.1 time: 0.019283 Oct 28 13:26:19.571982 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2297/4687] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:26:19 2022] POST /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:26:19.579720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31c7ff83-d37a-4fcf-9254-5e3c807877af tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31c7ff83-d37a-4fcf-9254-5e3c807877af tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Request method failure captured: Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a/action HTTP/1.1 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 31 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9hNNKaMKxXmtOU6-22oAIREz7PyXUqHoVtFRcvgjALMi8uYgkJTQlt9X1aBsGQhCH-vbJhi8Utu5mcK3BQUJwrBqsiMTuHBYBhrCAvHzTxaUiSyCsyu9GymJzuw-o4qeEf9xxinp0K3yS2eMSJ2C01TZoGMSqA5Hv-y9oo0MFw6MGk Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3e9f65d83254f40aae74eda2ce4cc01", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3ecd738598d54f558db954e980462575 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: {"os-resetState": {"state": 1}} Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '85223fa1-c394-45f4-a520-bc41b9b31a5a', 'body': {'os-resetState': {'state': 1}}} Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 1 Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 13:26:19.587999 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31c7ff83-d37a-4fcf-9254-5e3c807877af tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:19.593068 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31c7ff83-d37a-4fcf-9254-5e3c807877af tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a/action" status: 400 len: 120 microversion: 2.1 time: 0.016462 Oct 28 13:26:19.595531 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2298/4688] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:26:19 2022] POST /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:26:19.600790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:19.601405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:19.607893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.608386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.608819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.609502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.610124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.610706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.638609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:26:19.639168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:26:19.639662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:26:19.640075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:26:19.640505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:26:19.654969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.655746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.656398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.657541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.658436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.659066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.673013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:19.683162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Getting quotas for project 508f0e1757154dcc96b003a1b4a88c2c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:26:19.689514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Getting quotas for user 7010fb8619d4425e81d44cd6cdc41f3d and project 508f0e1757154dcc96b003a1b4a88c2c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:26:19.702684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:19.707169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:26:19.710507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:26:19.877402 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f56f33ac-9c6e-4f43-87f4-fa53bc1e0556 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384769 Oct 28 13:26:19.878267 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2391/4689] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:26:19.884192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe82e594-ab7c-4571-b793-62989f0b9d0d tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:19.887533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe82e594-ab7c-4571-b793-62989f0b9d0d tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Failed to fetch instance by id 999 {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 13:26:19.888203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-fe82e594-ab7c-4571-b793-62989f0b9d0d tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe82e594-ab7c-4571-b793-62989f0b9d0d tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Request method failure captured: Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 37 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9hNNKaMKxXmtOU6-22oAIREz7PyXUqHoVtFRcvgjALMi8uYgkJTQlt9X1aBsGQhCH-vbJhi8Utu5mcK3BQUJwrBqsiMTuHBYBhrCAvHzTxaUiSyCsyu9GymJzuw-o4qeEf9xxinp0K3yS2eMSJ2C01TZoGMSqA5Hv-y9oo0MFw6MGk Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c3e9f65d83254f40aae74eda2ce4cc01", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c3e9f65d83254f40aae74eda2ce4cc01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c3e9f65d83254f40aae74eda2ce4cc01 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1069444749 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3ecd738598d54f558db954e980462575 Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1069444749-project-admin Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: {"os-resetState": {"state": "error"}} Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 999 could not be found. Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:19.906314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:26:19.913316 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:26:19.913316 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 13:26:19.913316 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:26:19.913316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe82e594-ab7c-4571-b793-62989f0b9d0d tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:19.913316 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe82e594-ab7c-4571-b793-62989f0b9d0d tempest-ServersAdminNegativeTestJSON-1069444749 tempest-ServersAdminNegativeTestJSON-1069444749-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.028425 Oct 28 13:26:19.913316 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2392/4690] 10.222.0.25 () {60 vars in 1179 bytes} [Fri Oct 28 13:26:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:26:19.917378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b58215b5-cf04-4b38-a0a9-daf5e9306d2b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:19.918060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b58215b5-cf04-4b38-a0a9-daf5e9306d2b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:19.919166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:19.942577 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ade7ea1-d620-40f5-b7be-d618c0e3689f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1318 microversion: 2.1 time: 0.344996 Oct 28 13:26:19.950141 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2299/4691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:19 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:19.968078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:19.968856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:19.989839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.990728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.991096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:19.991810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:19.992269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:19.992696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:20.013538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b58215b5-cf04-4b38-a0a9-daf5e9306d2b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:20.023280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b58215b5-cf04-4b38-a0a9-daf5e9306d2b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1215 microversion: 2.1 time: 0.113634 Oct 28 13:26:20.024283 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2393/4692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:19 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:20.072233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:26:20.446048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:20.446657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:20.454414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:20.455236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:20.455680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:20.456554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:20.457185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:20.457784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:20.573221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:20.587657 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-21701cf0-a773-44e7-be3f-3e467827c37f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 204 len: 0 microversion: 2.1 time: 0.635986 Oct 28 13:26:20.591947 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2300/4693] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:26:19 2022] DELETE /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:26:20.592119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:20.600346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:20.604659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:20.606339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:20.607554 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c684315-ed8e-4759-b2d0-dd8d8f029c60 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1525 microversion: 2.42 time: 0.166487 Oct 28 13:26:20.619020 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2394/4694] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:20 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:26:20.621974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:20.622648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:20.623450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:20.624311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:20.636915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:20.636915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:20.792265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:20.800901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f148b5ec-1469-432e-bd15-eecc375b16a0 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1469 microversion: 2.1 time: 0.207541 Oct 28 13:26:20.801479 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2301/4695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:20 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:20.975694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:20.976603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:20.984712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:20.985633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:20.986289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:20.987605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:20.988480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:20.989132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:21.056533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cceb6d5e-ef29-47a5-bd6c-246a6e178be7 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:21.057539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cceb6d5e-ef29-47a5-bd6c-246a6e178be7 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:21.190420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cceb6d5e-ef29-47a5-bd6c-246a6e178be7 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:21.212545 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cceb6d5e-ef29-47a5-bd6c-246a6e178be7 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1215 microversion: 2.1 time: 0.168332 Oct 28 13:26:21.213144 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2302/4696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:21 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:21.250554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:21.259662 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8a11357-cb08-4bac-9a94-0aa50bca29d2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1507 microversion: 2.1 time: 0.288305 Oct 28 13:26:21.260261 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2395/4697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:20 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:21.640540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:21.642183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:21.650733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:21.651632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:21.653099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:21.658524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:21.659705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:21.661303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:21.808745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:21.825112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:21.826764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:21.840137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:21.844695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:21.845043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:21.848328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:21.848328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:21.849838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:21.851889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:21.852487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:21.856411 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb55c278-781d-4bc9-a6ef-85ab26ebcebe tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1517 microversion: 2.42 time: 0.221316 Oct 28 13:26:21.859243 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2303/4698] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:21 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:22.234716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:22.235367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:22.241820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:22.242313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:22.246721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:22.246721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:22.246721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:22.246721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:22.338288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:22.357389 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8445939d-0be2-4b25-a172-f42d9a664378 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1469 microversion: 2.1 time: 0.533645 Oct 28 13:26:22.359243 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2396/4699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:21 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1469 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:22.420598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:22.442428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c85c2c86-65b2-4820-9ae7-0f0cb74fce51 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1219 microversion: 2.1 time: 0.211907 Oct 28 13:26:22.443799 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2304/4700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:22 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:22.889887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:22.890499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:22.912833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:22.912833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:22.912833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:22.912833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:22.912833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:22.912833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:22.993166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:23.030067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:23.037326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:23.038556 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-26a5dfe0-f2e5-4805-bc07-a098ff29c826 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1581 microversion: 2.42 time: 0.154920 Oct 28 13:26:23.065581 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2397/4701] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:22 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1581 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:23.401755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e49822dc-a71a-4fc6-a4da-0b4f67138c49 req-dcc2a10e-d51a-4174-9b4d-5557b9d55b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed92221-9378-48f5-8fe1-66eca5fcefdc", "name": "network-vif-deleted", "tag": "bc3838ab-d3aa-44b7-9569-04c8528b3d28"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:23.403243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:23.407112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:23.458061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:23.458061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:23.459539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:23.462584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e49822dc-a71a-4fc6-a4da-0b4f67138c49 req-dcc2a10e-d51a-4174-9b4d-5557b9d55b6b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:23.463350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:23.466556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:23.468922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:23.469378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e49822dc-a71a-4fc6-a4da-0b4f67138c49 req-dcc2a10e-d51a-4174-9b4d-5557b9d55b6b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:23.471397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e49822dc-a71a-4fc6-a4da-0b4f67138c49 req-dcc2a10e-d51a-4174-9b4d-5557b9d55b6b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:23.515532 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e49822dc-a71a-4fc6-a4da-0b4f67138c49 req-dcc2a10e-d51a-4174-9b4d-5557b9d55b6b service nova] Creating event network-vif-deleted:bc3838ab-d3aa-44b7-9569-04c8528b3d28 for instance fed92221-9378-48f5-8fe1-66eca5fcefdc on n-h2-862876-2 Oct 28 13:26:23.527651 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e49822dc-a71a-4fc6-a4da-0b4f67138c49 req-dcc2a10e-d51a-4174-9b4d-5557b9d55b6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135477 Oct 28 13:26:23.546593 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2398/4702] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:23.554551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:23.555619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:23.564032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:23.565238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:23.565951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:23.567007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:23.573000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:23.573000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:23.665390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:23.692632 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b7fbcae-3529-46c8-8aad-47f79ca97cc4 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1267 microversion: 2.1 time: 0.144142 Oct 28 13:26:23.693456 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2399/4703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:23 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:23.755284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:23.771315 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a77cbdf0-b4b9-4778-8922-a1f64fc56e2d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1427 microversion: 2.1 time: 0.386229 Oct 28 13:26:23.789100 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2305/4704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:23 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1427 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:24.082801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:24.083432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:24.093964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:24.094458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:24.094917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:24.095612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:24.098313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:24.102728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:24.246894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:24.263830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:24.272970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:24.274187 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79a907e4-1799-42a2-b8ac-9960e35227d3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1591 microversion: 2.42 time: 0.198281 Oct 28 13:26:24.283518 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2400/4705] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:24 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1591 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:24.719598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:24.720831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:24.736720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:24.737469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:24.738072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:24.739097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:24.741781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:24.743223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:24.797503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:24.798134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:24.820057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:24.824455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:24.824455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:24.824455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:24.829933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:24.830387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:24.898296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:24.899236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:24.900376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:24.901021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lazy-loading 'fault' on Instance uuid fed92221-9378-48f5-8fe1-66eca5fcefdc {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:26:24.957798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:24.983284 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b7ec0b1-ee4d-487e-a809-2aa1587c237a tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 200 len: 1312 microversion: 2.1 time: 0.179121 Oct 28 13:26:24.984611 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2401/4706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:24 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:25.012418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:25.048508 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9213ab64-d5fd-42ef-9135-4ddfd207a94f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1273 microversion: 2.1 time: 0.334654 Oct 28 13:26:25.057946 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2306/4707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:24 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1273 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:25.313454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:25.314371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:25.329766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:25.330591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:25.331230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:25.332761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:25.333412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:25.334008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:25.525453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:25.542478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:25.545605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:25.551709 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86538391-d7c0-492c-b3f2-22103e672b3e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1591 microversion: 2.42 time: 0.243645 Oct 28 13:26:25.562796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2402/4708] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:25 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1591 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:26.000872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:26.001965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: fed92221-9378-48f5-8fe1-66eca5fcefdc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:26.014886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:26.019447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.020018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.020596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.024182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.024672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.026915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.062186 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] HTTP exception thrown: Instance fed92221-9378-48f5-8fe1-66eca5fcefdc could not be found. Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Request method failure captured: Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc HTTP/1.1 Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9hMSO2FWid4hq7VKT3VF4NFOrmhyhetbsC6MqLVt-zCp_UzxIHf5-eyDyUAd00vCVq_B3tiieAlJX7EAC7mWIPwY7iUD7e9-Nud-mjVpUSMH1eTrvgRIRiWxGqv0bhRDfhVvwxIPSXy6LssloSvut9MOy-RFNqw4VKniklDZS7qhlY Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 2a0a12ba7ca34d3bbe9672a399ea7d0e Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-355214289 Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a0a12ba7ca34d3bbe9672a399ea7d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a0a12ba7ca34d3bbe9672a399ea7d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a0a12ba7ca34d3bbe9672a399ea7d0e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a0a12ba7ca34d3bbe9672a399ea7d0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-355214289 Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 2a0a12ba7ca34d3bbe9672a399ea7d0e Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-355214289 Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-355214289-project Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 402713e4c25b49998301697e583a1b3c Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-355214289-project Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance fed92221-9378-48f5-8fe1-66eca5fcefdc could not be found. Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'fed92221-9378-48f5-8fe1-66eca5fcefdc'} Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed92221-9378-48f5-8fe1-66eca5fcefdc could not be found. Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed92221-9378-48f5-8fe1-66eca5fcefdc could not be found. Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:26.067249 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed92221-9378-48f5-8fe1-66eca5fcefdc could not be found. Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Returning 404 to user: Instance fed92221-9378-48f5-8fe1-66eca5fcefdc could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:26.072721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c2fa44e-53fe-4175-81b3-523c52dc5829 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc" status: 404 len: 111 microversion: 2.1 time: 0.073877 Oct 28 13:26:26.082990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:26.083529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:26.094213 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2307/4709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:25 2022] GET /compute/v2.1/servers/fed92221-9378-48f5-8fe1-66eca5fcefdc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:26:26.102375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.106247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.108484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.109325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.109798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.111728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.112017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:26.112449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:26.135574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.139370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.139886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.140636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.141380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.155102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.242382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:26:26.590723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:26.599742 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-493a1d80-9e2d-4161-a46e-75f15f1fe220 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.504303 Oct 28 13:26:26.603595 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2308/4710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:26 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:26.609467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:26.610091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:26.617296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.618066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.629344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.629344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.629344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.629344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.686616 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-396219b0-59fb-45f9-b145-8024b37b30a3 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "DELETE /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 204 len: 0 microversion: 2.1 time: 0.608490 Oct 28 13:26:26.691510 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2403/4711] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:26:26 2022] DELETE /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:26:26.699785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:26.700653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:26.719021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.722959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.723567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:26.726972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:26.727521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:26.732676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:27.135762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:27.150803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:27.152449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:27.156640 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-743e75a2-fba7-49e2-b31c-742d68eafde0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1659 microversion: 2.42 time: 0.551620 Oct 28 13:26:27.160265 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2309/4712] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:26 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1659 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:27.244839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:27.255700 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e11edbd8-e354-410c-9938-227e40626b0d tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1477 microversion: 2.1 time: 0.560278 Oct 28 13:26:27.255700 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2404/4713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:26 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1477 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:27.629745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:27.630472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:27.655811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:27.656772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:27.657231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:27.662020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:27.662523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:27.666171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:28.191707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:28.192982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:28.208689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:28.209551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:28.210306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:28.213279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:28.213948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:28.215258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:28.307710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:28.327757 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dcb25696-60e4-4dc6-b886-3d356569df0b tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.705551 Oct 28 13:26:28.331095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2310/4714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:27 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:28.338571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:28.339576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:28.346586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:28.371117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:28.372588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:28.376954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:28.378630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:28.380168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:29.364021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:29.378633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:29.381897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:29.387725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-41b1de6b-e8ae-4a10-9a15-f2d011c6ecce tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1706 microversion: 2.42 time: 1.201129 Oct 28 13:26:29.391199 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2405/4715] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:28 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1706 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:29.399432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:29.411424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:29.429731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:29.438075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:29.438549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:29.439940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:29.440801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:29.441411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:29.673211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:29.704471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:29.716501 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a83953b9-795a-4582-9dc6-a4a5ac07d0c5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.321278 Oct 28 13:26:29.717146 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2406/4716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:29 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:29.785418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:29.798661 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f979a5a-028d-4c22-919c-4bb3d3a4125f tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1477 microversion: 2.1 time: 1.465482 Oct 28 13:26:29.801355 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2311/4717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:28 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1477 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:30.171696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-83497eae-a5f0-46ef-b50b-1e2f1c5c3163 req-7195597b-a088-4763-a0a1-7e9ec417b55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85223fa1-c394-45f4-a520-bc41b9b31a5a", "name": "network-vif-deleted", "tag": "80e25752-02ab-4048-b4d4-4fa1bb4f9f9c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:30.196256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:30.205411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-83497eae-a5f0-46ef-b50b-1e2f1c5c3163 req-7195597b-a088-4763-a0a1-7e9ec417b55d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:30.206182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-83497eae-a5f0-46ef-b50b-1e2f1c5c3163 req-7195597b-a088-4763-a0a1-7e9ec417b55d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:30.207531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-83497eae-a5f0-46ef-b50b-1e2f1c5c3163 req-7195597b-a088-4763-a0a1-7e9ec417b55d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:30.245599 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-83497eae-a5f0-46ef-b50b-1e2f1c5c3163 req-7195597b-a088-4763-a0a1-7e9ec417b55d service nova] Creating event network-vif-deleted:80e25752-02ab-4048-b4d4-4fa1bb4f9f9c for instance 85223fa1-c394-45f4-a520-bc41b9b31a5a on n-h1-862876-2 Oct 28 13:26:30.285931 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-83497eae-a5f0-46ef-b50b-1e2f1c5c3163 req-7195597b-a088-4763-a0a1-7e9ec417b55d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120263 Oct 28 13:26:30.292675 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2407/4718] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:30.424969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:30.426648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:30.441258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:30.444436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:30.444436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:30.444668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:30.453031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:30.453572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:30.547352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:30.547952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:30.566596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:30.571384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:30.571850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:30.572613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:30.578524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:30.582615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:30.677335 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de487d80-c58f-4da0-97fc-84e872c2e622 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/ips" status: 200 len: 146 microversion: 2.1 time: 0.129477 Oct 28 13:26:30.678442 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2408/4719] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:26:30 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/ips => generated 146 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:30.744433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:30.745392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:30.757574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:30.758082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:30.758523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:30.759263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:30.759734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:30.760934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:31.107580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:31.118071 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-783a40a7-cc38-444c-b035-5442fdd91552 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.378108 Oct 28 13:26:31.119588 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2409/4720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:30 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:31.141095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:31.142432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:31.205556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:31.205556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:31.205556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:31.205556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:31.205556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:31.205556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:31.210669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=22 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:31.232149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:31.246251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:31.247125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:31.248463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:31.249151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lazy-loading 'fault' on Instance uuid 85223fa1-c394-45f4-a520-bc41b9b31a5a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:26:31.313953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '402713e4c25b49998301697e583a1b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a0a12ba7ca34d3bbe9672a399ea7d0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:31.323038 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0352a5d0-65d6-4b35-a6e3-06fbd0a2cb02 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 200 len: 1311 microversion: 2.1 time: 0.202063 Oct 28 13:26:31.329394 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2410/4721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:31 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:31.988509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:31.993619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:32.005825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:32.012086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:32.016462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4fa08370-8ac6-4186-af61-96e8be35567f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1706 microversion: 2.42 time: 1.597313 Oct 28 13:26:32.017585 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2312/4722] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:30 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1706 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:32.146158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:32.147717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:32.161885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:32.162715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:32.163394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:32.164761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:32.170172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:32.170172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:32.350296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:32.353076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:32.353702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] [instance: 85223fa1-c394-45f4-a520-bc41b9b31a5a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:32.362477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:32.365565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:32.368118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:32.371187 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e7f612c-f2eb-446f-95f7-37352d35c0bb tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.229261 Oct 28 13:26:32.371933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:32.372704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:32.373470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:32.390409 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] HTTP exception thrown: Instance 85223fa1-c394-45f4-a520-bc41b9b31a5a could not be found. Oct 28 13:26:32.392505 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2411/4723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:32 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Request method failure captured: Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a HTTP/1.1 Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9hMSO2FWid4hq7VKT3VF4NFOrmhyhetbsC6MqLVt-zCp_UzxIHf5-eyDyUAd00vCVq_B3tiieAlJX7EAC7mWIPwY7iUD7e9-Nud-mjVpUSMH1eTrvgRIRiWxGqv0bhRDfhVvwxIPSXy6LssloSvut9MOy-RFNqw4VKniklDZS7qhlY Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 2a0a12ba7ca34d3bbe9672a399ea7d0e Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-355214289 Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a0a12ba7ca34d3bbe9672a399ea7d0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a0a12ba7ca34d3bbe9672a399ea7d0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a0a12ba7ca34d3bbe9672a399ea7d0e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a0a12ba7ca34d3bbe9672a399ea7d0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-355214289 Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 2a0a12ba7ca34d3bbe9672a399ea7d0e Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-355214289 Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-355214289-project Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 402713e4c25b49998301697e583a1b3c Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-355214289-project Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 85223fa1-c394-45f4-a520-bc41b9b31a5a could not be found. Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '85223fa1-c394-45f4-a520-bc41b9b31a5a'} Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85223fa1-c394-45f4-a520-bc41b9b31a5a could not be found. Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85223fa1-c394-45f4-a520-bc41b9b31a5a could not be found. Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:32.392792 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85223fa1-c394-45f4-a520-bc41b9b31a5a could not be found. Oct 28 13:26:32.398196 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:32.405022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] Returning 404 to user: Instance 85223fa1-c394-45f4-a520-bc41b9b31a5a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:32.405022 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-853db003-00cc-4648-891b-851eb5dadc20 tempest-ServersAdminNegativeTestJSON-355214289 tempest-ServersAdminNegativeTestJSON-355214289-project] 10.222.0.25 "GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a" status: 404 len: 111 microversion: 2.1 time: 0.051559 Oct 28 13:26:32.405820 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2313/4724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:32 2022] GET /compute/v2.1/servers/85223fa1-c394-45f4-a520-bc41b9b31a5a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:26:32.892323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6795d4f6-dcea-4c6f-8d9a-3bf3b4f8a487 req-443d8756-c525-4eae-89ba-6072c9e0e4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e81ec9-aef3-4739-a8b0-3b21ec3ee56d", "tag": "0a8d53df-eec3-4cad-9045-1b55ca3133af"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:32.920685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6795d4f6-dcea-4c6f-8d9a-3bf3b4f8a487 req-443d8756-c525-4eae-89ba-6072c9e0e4c1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:32.923534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6795d4f6-dcea-4c6f-8d9a-3bf3b4f8a487 req-443d8756-c525-4eae-89ba-6072c9e0e4c1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:32.923968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6795d4f6-dcea-4c6f-8d9a-3bf3b4f8a487 req-443d8756-c525-4eae-89ba-6072c9e0e4c1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:32.992555 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6795d4f6-dcea-4c6f-8d9a-3bf3b4f8a487 req-443d8756-c525-4eae-89ba-6072c9e0e4c1 service nova] Creating event network-changed:0a8d53df-eec3-4cad-9045-1b55ca3133af for instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d on n-h1-862876-2 Oct 28 13:26:33.023259 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6795d4f6-dcea-4c6f-8d9a-3bf3b4f8a487 req-443d8756-c525-4eae-89ba-6072c9e0e4c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135654 Oct 28 13:26:33.024092 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2412/4725] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:33.044454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:33.045074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:33.059115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:33.061417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:33.061861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:33.062576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:33.063054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:33.063499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:33.400248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:33.401663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:33.414554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:33.423110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:33.423680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:33.424525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:33.425009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:33.425437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:33.697205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:33.730643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:33.732264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:33.765208 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4ebdad6-3a6d-4f22-ae7f-b479adfd55c4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1753 microversion: 2.42 time: 0.709779 Oct 28 13:26:33.766503 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2314/4726] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:33 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1753 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:33.934716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:33.962233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a7e25910-8438-49c2-8ca2-78cf332e4744 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.566114 Oct 28 13:26:33.967844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2413/4727] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:33 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:34.797702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:34.799828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:34.806856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:34.807356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:34.807829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:34.808585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:34.809033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:34.809825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:35.000712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:35.006308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:35.015634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:35.016826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:35.017485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:35.018624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:35.019333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:35.020172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:35.282216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:35.297182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:35.297182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:35.297182 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3120b05-7904-4ce2-af92-781ba475f31b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1800 microversion: 2.42 time: 0.503687 Oct 28 13:26:35.301249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2315/4728] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:34 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1800 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:35.307810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:35.318710 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0270e80-18e8-4245-9af8-24279f981df0 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.323293 Oct 28 13:26:35.324176 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2414/4729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:34 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:35.950010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5042b5e-bc7e-4e18-be21-b73f4d008330"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:35.952042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:35.988880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:35.989361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:35.994072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:36.000851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:36.001770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:36.005095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:36.326788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:36.328282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:36.340882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:36.342600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:36.343304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:36.344287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:36.344919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:36.345530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:36.704332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:36.727214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:36.729195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:36.731356 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5089ab07-c897-4e32-a252-f812b9854a37 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1800 microversion: 2.42 time: 0.409530 Oct 28 13:26:36.736221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2415/4730] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:36 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1800 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:26:36.743579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:36.744461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:36.756832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:36.762559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:36.762559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:36.763163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:36.764135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:36.764973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:37.030876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a447a179-07f2-41de-8727-a87ad0e23e5e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.086457 Oct 28 13:26:37.039884 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2316/4731] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:26:35 2022] POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-volume_attachments => generated 194 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:37.059122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:37.069801 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d6980328-624c-4ac3-a602-e2c84bc93c96 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.332250 Oct 28 13:26:37.069801 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2416/4732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:36 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:37.764878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:37.774452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:37.793480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:37.796581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:37.797218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:37.798138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:37.800076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:37.800693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:38.095948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:38.096378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:38.107305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:38.112096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:38.113360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:38.115655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:38.118831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:38.119557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:38.422025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:38.442142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:38.445502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:38.447950 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0a947991-de82-4c5a-9fe7-0756a4db0569 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1847 microversion: 2.42 time: 0.688689 Oct 28 13:26:38.449195 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2317/4733] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:37 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1847 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:38.618520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:38.628298 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-12f06dbb-b847-40be-9cfb-b1ac14eaefa6 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.538525 Oct 28 13:26:38.631529 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2417/4734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:38 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:39.474664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:39.475462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:39.485437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:39.489453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:39.492449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:39.492449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:39.492449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:39.492449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:39.496250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:39.657046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:39.658802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:39.669556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:39.672097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:39.674317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:39.676745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:39.679432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:39.680835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:39.801122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:39.821814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:39.823301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:39.825665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a03d8bd0-da3f-478e-82d4-558fba13ff3b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1847 microversion: 2.42 time: 0.355519 Oct 28 13:26:39.826496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2318/4735] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:39 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1847 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:40.066635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:40.076621 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e732ff92-babf-44f1-a369-9f691090c8bf tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.424942 Oct 28 13:26:40.078094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2418/4736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:39 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:40.086257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f85523ac-399c-4de9-972a-7ee9944e3934 req-77e2ad0b-30f3-404b-b24b-0eb5c7fc1fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "08737e4b-2e2f-4bce-8fe2-9864e3a719de"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:40.096779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f85523ac-399c-4de9-972a-7ee9944e3934 req-77e2ad0b-30f3-404b-b24b-0eb5c7fc1fe8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.097500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f85523ac-399c-4de9-972a-7ee9944e3934 req-77e2ad0b-30f3-404b-b24b-0eb5c7fc1fe8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.098506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f85523ac-399c-4de9-972a-7ee9944e3934 req-77e2ad0b-30f3-404b-b24b-0eb5c7fc1fe8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.116307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f85523ac-399c-4de9-972a-7ee9944e3934 req-77e2ad0b-30f3-404b-b24b-0eb5c7fc1fe8 service nova] Creating event network-changed:08737e4b-2e2f-4bce-8fe2-9864e3a719de for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:26:40.122529 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f85523ac-399c-4de9-972a-7ee9944e3934 req-77e2ad0b-30f3-404b-b24b-0eb5c7fc1fe8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042914 Oct 28 13:26:40.123255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.124027 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2419/4737] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:40.128241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.128747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.129192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.129942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.130406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.130865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.134114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-04f91999-f719-4c05-870b-3eb11d48f456 req-640d2acd-2909-498f-8f10-359aea9748dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e81ec9-aef3-4739-a8b0-3b21ec3ee56d", "name": "network-vif-plugged", "status": "completed", "tag": "0a8d53df-eec3-4cad-9045-1b55ca3133af"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:40.149145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-04f91999-f719-4c05-870b-3eb11d48f456 req-640d2acd-2909-498f-8f10-359aea9748dc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.150898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-04f91999-f719-4c05-870b-3eb11d48f456 req-640d2acd-2909-498f-8f10-359aea9748dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.152275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-04f91999-f719-4c05-870b-3eb11d48f456 req-640d2acd-2909-498f-8f10-359aea9748dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.165633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-04f91999-f719-4c05-870b-3eb11d48f456 req-640d2acd-2909-498f-8f10-359aea9748dc service nova] Creating event network-vif-plugged:0a8d53df-eec3-4cad-9045-1b55ca3133af for instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d on n-h1-862876-2 Oct 28 13:26:40.172045 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-04f91999-f719-4c05-870b-3eb11d48f456 req-640d2acd-2909-498f-8f10-359aea9748dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046011 Oct 28 13:26:40.173142 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2420/4738] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:40.206433 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6bd4d6a7-34b0-4ad6-ae57-5508d76fbdb6 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.349313 Oct 28 13:26:40.219322 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2319/4739] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:26:39 2022] GET /compute/v2.1/os-services => generated 944 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:40.227303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.232987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.233510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.234013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.234951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.235421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.235910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.292370 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-72f339d3-b8be-484f-a830-94f0d23c343c tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.069227 Oct 28 13:26:40.295872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2421/4740] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Oct 28 13:26:40 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:40.307308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.312059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.317072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.317911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.319054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.320891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.325935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.361258 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8169bdee-e1a9-41cc-b24c-fb923e1369cf tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.058491 Oct 28 13:26:40.370251 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2320/4741] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:26:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:40.376504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.380408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.380915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.381368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.382078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.382537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.385908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.439610 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a720c9f6-1209-4314-918d-dae2a2350702 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-862876-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.068436 Oct 28 13:26:40.449064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2422/4742] 10.222.0.25 () {58 vars in 1194 bytes} [Fri Oct 28 13:26:40 2022] GET /compute/v2.1/os-services?host=n-d-862876-2&binary=xxx => generated 16 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:26:40.455117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.459949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.465054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.469419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.469419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.469419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.469419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.590412 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8db82c36-f13c-4c53-806d-a6f8a79c0ef4 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.140644 Oct 28 13:26:40.609172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.612354 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2321/4743] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:26:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:40.614355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.614884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.620072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.620307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.621552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.622003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.702689 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e6c759f-4e2f-4803-bcd9-81313bc108a7 tempest-ServicesAdminNegativeTestJSON-399041320 tempest-ServicesAdminNegativeTestJSON-399041320-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.100217 Oct 28 13:26:40.707221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2423/4744] 10.222.0.25 () {58 vars in 1198 bytes} [Fri Oct 28 13:26:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:26:40.858638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.859508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:40.872541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.874556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.876965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.882081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:40.882902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:40.884927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-67ffd764-cc5c-4fe5-aa9d-e89a5e2115c3 tempest-ServicesAdminNegativeTestJSON-1948728112 tempest-ServicesAdminNegativeTestJSON-1948728112-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-67ffd764-cc5c-4fe5-aa9d-e89a5e2115c3 tempest-ServicesAdminNegativeTestJSON-1948728112 tempest-ServicesAdminNegativeTestJSON-1948728112-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5700841568d3469db0214006917e0a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95cb57df6ae54958b83c8469858feade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-67ffd764-cc5c-4fe5-aa9d-e89a5e2115c3 tempest-ServicesAdminNegativeTestJSON-1948728112 tempest-ServicesAdminNegativeTestJSON-1948728112-project] Request method failure captured: Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iOK3XGYQ3NjOLC8l1NOHZzxwA_69WfVF8rRlaqdfpfBcATbE0mVScM3X0IOOv1I4zOP69vVWH0vRSv4Lux_RFfTBSPqmf0MGdBnLrTZ7tPcVfJE8hYEE1xqcQXAt8ojapuuUV3JJ8EvyLKFNXvKeShT4XqjF4zwWD1IW5mbGgajC0 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 95cb57df6ae54958b83c8469858feade Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1948728112 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95cb57df6ae54958b83c8469858feade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/95cb57df6ae54958b83c8469858feade"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_95cb57df6ae54958b83c8469858feade", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/95cb57df6ae54958b83c8469858feade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1948728112 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 95cb57df6ae54958b83c8469858feade Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1948728112 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServicesAdminNegativeTestJSON-1948728112-project Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 5700841568d3469db0214006917e0a57 Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1948728112-project Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: action_args: {} Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 13:26:40.962664 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-67ffd764-cc5c-4fe5-aa9d-e89a5e2115c3 tempest-ServicesAdminNegativeTestJSON-1948728112 tempest-ServicesAdminNegativeTestJSON-1948728112-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-67ffd764-cc5c-4fe5-aa9d-e89a5e2115c3 tempest-ServicesAdminNegativeTestJSON-1948728112 tempest-ServicesAdminNegativeTestJSON-1948728112-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.234783 Oct 28 13:26:40.967762 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2322/4745] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:26:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:26:41.104345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:41.105268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:41.115279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:41.116520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:41.117149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:41.118048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:41.119000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:41.119446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:41.121458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:41.132383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:41.138450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:41.138775 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-117ec473-182a-4674-b17c-204ddf5ae3ed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1847 microversion: 2.42 time: 0.286250 Oct 28 13:26:41.142278 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2424/4746] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:40 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1847 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:26:41.517040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:41.540522 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ebc5b30-a406-4fd2-9de5-b4d3a47e9ab5 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1315 microversion: 2.1 time: 0.442834 Oct 28 13:26:41.541140 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2323/4747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:41 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:26:42.168527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:42.169144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:42.183544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:42.184412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:42.189032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:42.190037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:42.190730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:42.192166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:42.192589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1b550cc8-c5a4-4ee0-bedb-17521101576e req-3f102e4f-c680-4578-8f94-a447a8362b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "585cc549-1b07-4522-85cf-a1914cce9d33"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:42.212225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1b550cc8-c5a4-4ee0-bedb-17521101576e req-3f102e4f-c680-4578-8f94-a447a8362b8a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:42.212823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1b550cc8-c5a4-4ee0-bedb-17521101576e req-3f102e4f-c680-4578-8f94-a447a8362b8a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:42.213700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1b550cc8-c5a4-4ee0-bedb-17521101576e req-3f102e4f-c680-4578-8f94-a447a8362b8a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:42.248862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1b550cc8-c5a4-4ee0-bedb-17521101576e req-3f102e4f-c680-4578-8f94-a447a8362b8a service nova] Creating event network-changed:585cc549-1b07-4522-85cf-a1914cce9d33 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:26:42.255391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1b550cc8-c5a4-4ee0-bedb-17521101576e req-3f102e4f-c680-4578-8f94-a447a8362b8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067439 Oct 28 13:26:42.258163 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2324/4748] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:42.567791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:42.568647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:42.589452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:42.592722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:42.593497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:42.594429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:42.595541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:42.598288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:42.599398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:42.617491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:42.627008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:42.633593 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ca06452-8981-4b4b-a0fa-be2ad7776d88 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1868 microversion: 2.42 time: 0.470155 Oct 28 13:26:42.639575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2425/4749] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:42 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1868 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:43.125789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:43.134405 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-389bf933-7f4c-4680-9d82-28925889812e tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1502 microversion: 2.1 time: 0.572514 Oct 28 13:26:43.138127 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2325/4750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:42 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1502 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:43.169656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:43.170145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:43.194302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.197085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.197930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.198895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.205031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.209754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.557108 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e4898604-7711-4a39-83ff-d3daa8df342c tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.394518 Oct 28 13:26:43.562844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2426/4751] 10.222.0.25 () {58 vars in 1296 bytes} [Fri Oct 28 13:26:43 2022] DELETE /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d/os-server-password => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:26:43.572592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:43.573865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:43.598688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.600303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.600832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.601854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.602469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.604549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.655106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41535ee8-5753-4b09-9b92-35eea8f74bd3 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.090900 Oct 28 13:26:43.659012 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2326/4752] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Oct 28 13:26:43 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d/os-server-password => generated 16 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:26:43.665285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:43.669452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:43.669786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:43.669786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:43.679527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.680388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.681382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.683165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.684602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.685364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.686103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.688211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.688670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.689406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:43.696293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:43.700558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:43.728598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:26:44.087241 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ea1686f-8c0e-4bd4-9398-af84157dbff1 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 204 len: 0 microversion: 2.1 time: 0.422619 Oct 28 13:26:44.091535 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2327/4753] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:26:43 2022] DELETE /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:26:44.099062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:44.100514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:44.119168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:44.119922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:44.121869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:44.122674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:44.123256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:44.125616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:44.252183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:44.264302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:44.269450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:44.272245 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-04c150a7-ab55-4f51-929f-7b6f8cab102d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 0.612155 Oct 28 13:26:44.277118 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2427/4754] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:43 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:26:44.325586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-97d8f4c7-13a0-4d77-8ac4-f834662483f0 req-1140997c-94fe-41cb-a598-75345b5f4492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "34ff3a2e-4c23-4038-b121-e08b82372578"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:44.348913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-97d8f4c7-13a0-4d77-8ac4-f834662483f0 req-1140997c-94fe-41cb-a598-75345b5f4492 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:44.348913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-97d8f4c7-13a0-4d77-8ac4-f834662483f0 req-1140997c-94fe-41cb-a598-75345b5f4492 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:44.348913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-97d8f4c7-13a0-4d77-8ac4-f834662483f0 req-1140997c-94fe-41cb-a598-75345b5f4492 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:44.373371 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-97d8f4c7-13a0-4d77-8ac4-f834662483f0 req-1140997c-94fe-41cb-a598-75345b5f4492 service nova] Creating event network-changed:34ff3a2e-4c23-4038-b121-e08b82372578 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:26:44.389168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-97d8f4c7-13a0-4d77-8ac4-f834662483f0 req-1140997c-94fe-41cb-a598-75345b5f4492 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068723 Oct 28 13:26:44.393452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2428/4755] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:44.534173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:44.553760 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-20177f9d-e33f-4d4c-b92e-36c998660945 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1508 microversion: 2.1 time: 0.459572 Oct 28 13:26:44.559555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2328/4756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:44 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:45.316442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:45.320156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:45.342280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:45.348164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:45.349551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:45.354432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:45.356987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:45.358306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:45.587163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:45.587802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:45.596702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:45.600295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:45.600962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:45.601866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:45.602543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:45.604049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:45.820967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:45.825275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:45.845351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:45.847367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:45.848587 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8b71748-9540-4669-8422-87047948cee3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 0.543784 Oct 28 13:26:45.849543 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2429/4757] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:45 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:45.927080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:45.927080 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9723b1f1-9b58-41de-8013-28e385641f61 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1508 microversion: 2.1 time: 0.336631 Oct 28 13:26:45.927080 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2329/4758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:45 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:46.844561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d3a438d5-ef2a-487f-a846-9755ed9ac494 req-366841c9-57eb-44d3-9e86-7eacefb6a775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e81ec9-aef3-4739-a8b0-3b21ec3ee56d", "name": "network-vif-deleted", "tag": "0a8d53df-eec3-4cad-9045-1b55ca3133af"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:46.879500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:46.879500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:46.891824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:46.894597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:46.896541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:46.897440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:46.897906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:46.898336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:46.900886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d3a438d5-ef2a-487f-a846-9755ed9ac494 req-366841c9-57eb-44d3-9e86-7eacefb6a775 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:46.901398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d3a438d5-ef2a-487f-a846-9755ed9ac494 req-366841c9-57eb-44d3-9e86-7eacefb6a775 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:46.901827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d3a438d5-ef2a-487f-a846-9755ed9ac494 req-366841c9-57eb-44d3-9e86-7eacefb6a775 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:46.940221 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d3a438d5-ef2a-487f-a846-9755ed9ac494 req-366841c9-57eb-44d3-9e86-7eacefb6a775 service nova] Creating event network-vif-deleted:0a8d53df-eec3-4cad-9045-1b55ca3133af for instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d on n-h1-862876-2 Oct 28 13:26:46.956822 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d3a438d5-ef2a-487f-a846-9755ed9ac494 req-366841c9-57eb-44d3-9e86-7eacefb6a775 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117818 Oct 28 13:26:46.963673 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2430/4759] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:46.976724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:46.980993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:46.991815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:46.993944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:46.994615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:46.995420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:46.996331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:46.996944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:46.997580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:47.103706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:47.117418 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0abcf68d-0898-4276-b4f0-a44f34a023de tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1466 microversion: 2.1 time: 0.149626 Oct 28 13:26:47.131899 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2431/4760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:46 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1466 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:47.426926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:47.438608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:47.446117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:47.451197 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6873dd7-81f8-4fad-978d-32948d401ec4 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 0.573700 Oct 28 13:26:47.453027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2330/4761] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:46 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:26:48.147251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:48.147711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:48.165639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:48.166146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:48.166591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:48.167982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:48.168353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:48.168779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:48.262721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:48.263257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:48.263761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:48.270973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lazy-loading 'fault' on Instance uuid 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:26:48.338633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7010fb8619d4425e81d44cd6cdc41f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508f0e1757154dcc96b003a1b4a88c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:48.348520 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ba8646cf-85a3-4370-9ea6-86202ff3970f tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 200 len: 1305 microversion: 2.1 time: 0.206115 Oct 28 13:26:48.348982 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2432/4762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:48 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 1305 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:48.442286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b773df08-97dd-4b9e-81f2-3dba612b72df req-d889b130-4770-4044-9b5b-b4014be92f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "c6bceb41-c854-430c-8667-7fd5d959eee4"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:48.466707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b773df08-97dd-4b9e-81f2-3dba612b72df req-d889b130-4770-4044-9b5b-b4014be92f2d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:48.478599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:48.480138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:48.489161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:48.489985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b773df08-97dd-4b9e-81f2-3dba612b72df req-d889b130-4770-4044-9b5b-b4014be92f2d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:48.493511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:48.494132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b773df08-97dd-4b9e-81f2-3dba612b72df req-d889b130-4770-4044-9b5b-b4014be92f2d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:48.494695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:48.498441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:48.500654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:48.501225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:48.520402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:48.523500 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b773df08-97dd-4b9e-81f2-3dba612b72df req-d889b130-4770-4044-9b5b-b4014be92f2d service nova] Creating event network-changed:c6bceb41-c854-430c-8667-7fd5d959eee4 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:26:48.530026 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b773df08-97dd-4b9e-81f2-3dba612b72df req-d889b130-4770-4044-9b5b-b4014be92f2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091367 Oct 28 13:26:48.531369 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2331/4763] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:49.356211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:49.379795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:49.380561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] [instance: 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:49.391931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:49.393608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:49.398980 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f38453de-f6fb-4c4e-bb02-641e25fa87c3 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 0.920270 Oct 28 13:26:49.410137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:49.422309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:49.422791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:49.428421 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2433/4764] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:48 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:26:49.428984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:49.429635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:49.433435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:49.466954 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] HTTP exception thrown: Instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d could not be found. Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Request method failure captured: Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d HTTP/1.1 Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9h6K0UaZRuKFlGxpqNewlgNqnCJykX46yN7h3shzR24hECZGVj64zesiI1-75GFPkrcil3nZ88mhJ9zvLqsWArzncwuP4m3BvPZmtztHixV39pBfoH5WoIo5OxVy5zqEPb7yGs73GrjkD3H0vwYGnI2nEywCM_GaMJHk7LMN3JKulE Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 508f0e1757154dcc96b003a1b4a88c2c Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerPasswordTestJSON-171106602 Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/508f0e1757154dcc96b003a1b4a88c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/508f0e1757154dcc96b003a1b4a88c2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_508f0e1757154dcc96b003a1b4a88c2c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/508f0e1757154dcc96b003a1b4a88c2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerPasswordTestJSON-171106602 Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 508f0e1757154dcc96b003a1b4a88c2c Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerPasswordTestJSON-171106602 Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerPasswordTestJSON-171106602-project Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7010fb8619d4425e81d44cd6cdc41f3d Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerPasswordTestJSON-171106602-project Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d could not be found. Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '04e81ec9-aef3-4739-a8b0-3b21ec3ee56d'} Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d could not be found. Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d could not be found. Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:26:49.470306 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d could not be found. Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] Returning 404 to user: Instance 04e81ec9-aef3-4739-a8b0-3b21ec3ee56d could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-edaafcf4-aa90-4964-9754-0086d8af36e2 tempest-ServerPasswordTestJSON-171106602 tempest-ServerPasswordTestJSON-171106602-project] 10.222.0.25 "GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d" status: 404 len: 111 microversion: 2.1 time: 0.098756 Oct 28 13:26:49.482231 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2332/4765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:49 2022] GET /compute/v2.1/servers/04e81ec9-aef3-4739-a8b0-3b21ec3ee56d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:26:50.428089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:50.429868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:50.447430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:50.448161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:50.453178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:50.454108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:50.454737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:50.455375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:50.644133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:50.891834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:50.909970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:50.913708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:50.915480 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4aadcb39-612e-4a2d-a63d-72c66cfe96f7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 0.494152 Oct 28 13:26:50.931848 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2434/4766] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:50 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:51.469440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c7a78b00-79bf-4d75-b4fd-40fd53986509 req-60a2722c-507b-462d-a6ff-a954b6f21d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "09ba8bae-1034-46b2-8b3c-7e6052ebbe90"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:51.485821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:26:51.507609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c7a78b00-79bf-4d75-b4fd-40fd53986509 req-60a2722c-507b-462d-a6ff-a954b6f21d40 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:51.508232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c7a78b00-79bf-4d75-b4fd-40fd53986509 req-60a2722c-507b-462d-a6ff-a954b6f21d40 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:51.508637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c7a78b00-79bf-4d75-b4fd-40fd53986509 req-60a2722c-507b-462d-a6ff-a954b6f21d40 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:51.553535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c7a78b00-79bf-4d75-b4fd-40fd53986509 req-60a2722c-507b-462d-a6ff-a954b6f21d40 service nova] Creating event network-changed:09ba8bae-1034-46b2-8b3c-7e6052ebbe90 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:26:51.559060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c7a78b00-79bf-4d75-b4fd-40fd53986509 req-60a2722c-507b-462d-a6ff-a954b6f21d40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093225 Oct 28 13:26:51.560307 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2333/4767] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:51.944382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:51.945998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:51.963864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:51.966368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:51.967438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:51.970916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:51.971683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:51.987523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:52.398174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:52.412013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:52.415589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:52.420900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4ac396d3-ab6c-4768-b3cc-fcbfa028413d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 0.480934 Oct 28 13:26:52.421796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2435/4768] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:51 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:53.455467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:53.457800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:53.487037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:53.488210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:53.488913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:53.489912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:53.490603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:53.495823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:54.734031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:54.754780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:54.761248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:54.763518 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b32ee4d3-8f90-476f-b552-22eb1c3ebc58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 1.314285 Oct 28 13:26:54.775004 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2334/4769] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:53 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:55.127770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2ef4241c-caaa-4f1d-9789-339831e7ac1b req-598616ac-6ddc-4afe-9662-7d7bdf24febb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "352a0edd-de4a-4fa0-bdeb-aba88b63a429"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:55.150093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ef4241c-caaa-4f1d-9789-339831e7ac1b req-598616ac-6ddc-4afe-9662-7d7bdf24febb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:55.154323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ef4241c-caaa-4f1d-9789-339831e7ac1b req-598616ac-6ddc-4afe-9662-7d7bdf24febb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:55.155214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ef4241c-caaa-4f1d-9789-339831e7ac1b req-598616ac-6ddc-4afe-9662-7d7bdf24febb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:55.183812 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2ef4241c-caaa-4f1d-9789-339831e7ac1b req-598616ac-6ddc-4afe-9662-7d7bdf24febb service nova] Creating event network-changed:352a0edd-de4a-4fa0-bdeb-aba88b63a429 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:26:55.193226 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2ef4241c-caaa-4f1d-9789-339831e7ac1b req-598616ac-6ddc-4afe-9662-7d7bdf24febb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068813 Oct 28 13:26:55.197380 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2436/4770] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:26:55.794106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:55.797017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:55.824996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:55.825566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:55.826020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:55.826971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:55.827438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:55.827864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:57.232512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10cf5a07-1262-4c85-8e5d-98f2c87e177c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:57.255868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cf5a07-1262-4c85-8e5d-98f2c87e177c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:57.255868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cf5a07-1262-4c85-8e5d-98f2c87e177c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:57.257787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cf5a07-1262-4c85-8e5d-98f2c87e177c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:57.272462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:57.294405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:57.300152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:57.319627 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad6a6192-3f5d-4d53-9970-3806116104b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 1.514665 Oct 28 13:26:57.319627 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2335/4771] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:55 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:26:57.366611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10cf5a07-1262-4c85-8e5d-98f2c87e177c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:26:57.728072 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10cf5a07-1262-4c85-8e5d-98f2c87e177c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action" status: 202 len: 0 microversion: 2.1 time: 0.499866 Oct 28 13:26:57.732633 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2437/4772] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:26:57 2022] POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:26:57.739690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:57.740824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:57.780448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:57.781291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:57.781975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:57.800529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:57.801105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:57.801563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:58.333988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:26:58.335584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:26:58.347673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:58.353095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:58.353807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:58.355401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:58.357107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:58.360010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:59.125912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:26:59.142952 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1524b8e-fae8-4a85-bdd2-964aedd1813a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 1.407320 Oct 28 13:26:59.143681 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2336/4773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:26:57 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:26:59.632136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-323318ab-f9db-42f9-9bfc-94e34b339aa5 req-1a5fae41-11b1-4793-bb75-877f19ea2ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "1297cfba-46fe-4a0e-b6a3-aa9ffcbca8f6"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:26:59.655793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-323318ab-f9db-42f9-9bfc-94e34b339aa5 req-1a5fae41-11b1-4793-bb75-877f19ea2ce9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:26:59.659188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-323318ab-f9db-42f9-9bfc-94e34b339aa5 req-1a5fae41-11b1-4793-bb75-877f19ea2ce9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:26:59.660820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-323318ab-f9db-42f9-9bfc-94e34b339aa5 req-1a5fae41-11b1-4793-bb75-877f19ea2ce9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:26:59.690486 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-323318ab-f9db-42f9-9bfc-94e34b339aa5 req-1a5fae41-11b1-4793-bb75-877f19ea2ce9 service nova] Creating event network-changed:1297cfba-46fe-4a0e-b6a3-aa9ffcbca8f6 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:26:59.698917 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-323318ab-f9db-42f9-9bfc-94e34b339aa5 req-1a5fae41-11b1-4793-bb75-877f19ea2ce9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071295 Oct 28 13:26:59.700298 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2337/4774] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:26:59.994124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:00.018341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:00.026808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:00.034395 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc338371-b807-4447-9ec4-ee4051bc90a5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1889 microversion: 2.42 time: 1.702642 Oct 28 13:27:00.036088 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2438/4775] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:26:58 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1889 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:00.172642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:00.174224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:00.183191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:00.184078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:00.184991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:00.186499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:00.187224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:00.187899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:00.723292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:00.738270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71bf0cb0-e285-4dee-8a1e-b28dd4e26ec5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.571224 Oct 28 13:27:00.744473 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2338/4776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:00 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:01.089774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:01.091327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:01.108156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:01.109384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:01.111704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:01.113567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:01.115717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:01.118598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:01.775214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:01.777088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:01.795454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:01.797979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:01.802929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:01.803920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:01.804565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:01.805191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:02.244030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:02.278248 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be766099-0093-4a57-bfde-1c5a66814963 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.507770 Oct 28 13:27:02.279163 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2339/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:01 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:02.738635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:02.754792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:02.757219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:02.759563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac3dbfcc-ce95-4d3c-98d9-ac15779361aa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 1.692530 Oct 28 13:27:02.762405 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2439/4778] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:01 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:03.282577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2865662-fba0-4e41-a936-739404737da6", "device": "/dev/sdb"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:03.287221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:03.295794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:03.296541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:03.297293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:03.298407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:03.299263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:03.299853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:03.308452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:03.309257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:03.341227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:03.341724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:03.345037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:03.346180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:03.349802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:03.350482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:03.895212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:03.905130 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-abce2d67-1c46-4063-af19-a7eb2b9e548c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.602583 Oct 28 13:27:03.905909 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2440/4779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:03 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:03.922294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:03.922294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:03.928380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:03.929057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:03.929664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:03.930711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:03.931197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:03.931624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:04.219426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:04.235287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:04.237315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:04.238886 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19a219e5-0c05-4fa3-8deb-45614f643784 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.331683 Oct 28 13:27:04.241175 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2441/4780] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:03 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:04.498989 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f2b788a0-a1f0-4cbd-bb3f-7270e0b9c2bf tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "POST /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.221138 Oct 28 13:27:04.515772 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2340/4781] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:27:03 2022] POST /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218/os-volume_attachments => generated 194 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:04.930241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:04.931467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:04.942831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:04.945982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:04.945982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:04.945982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:04.945982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:04.946876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:05.270067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:05.271637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:05.284295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:05.285114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:05.285779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:05.286833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:05.287520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:05.290239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:05.339540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:05.350819 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2fa1755d-1a6a-47ba-b1a6-3168614ff857 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.425936 Oct 28 13:27:05.352105 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2442/4782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:04 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:05.811328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:05.840907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:05.843759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:05.849885 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f7b1b82-f9af-4947-abea-517862addcf5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.583609 Oct 28 13:27:05.867941 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2341/4783] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:05 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:06.378124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:06.378731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:06.395349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:06.396081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:06.396703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:06.397590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:06.398223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:06.398896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:06.723647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-626561038", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "727caa2f-1923-4abe-bb0d-e565fc619d13"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:06.728075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:06.739933 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ba85e5e-e96e-4ace-be30-c4cb0c2bc9c7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.365610 Oct 28 13:27:06.740833 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2443/4784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:06 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:06.809291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] validate_networks() for [('727caa2f-1923-4abe-bb0d-e565fc619d13', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:27:06.888045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:06.888775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:06.900275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:06.900900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:06.903254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:06.904047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:06.905959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:06.906611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:07.248287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:07.258625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:07.261165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:07.264955 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb8a7d46-33c5-45d8-bb04-07e65d435cca tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.379773 Oct 28 13:27:07.266635 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2444/4785] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:06 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:07.611032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:27:07.613454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:27:07.613977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:27:07.614372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:27:07.614815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:27:07.628948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:07.629742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:07.630384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:07.631364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:07.632644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:07.633313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:07.655122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for project 207bb29d0b79413097cfed319c0eae7a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:27:07.661579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for user 4141fc4731c24c00af71839c6594e659 and project 207bb29d0b79413097cfed319c0eae7a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:27:07.678537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:27:07.681515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:27:07.771440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:07.771440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:07.805583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:07.806103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:07.806599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:07.808077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:07.808760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:07.809395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:07.979345 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4386288b-c4ab-4080-95e1-af61b7162d3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520699 Oct 28 13:27:07.980492 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2342/4786] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:27:07.995385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e3943a4-3fdc-4e72-a2a8-61ca8be5589f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:07.996135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e3943a4-3fdc-4e72-a2a8-61ca8be5589f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:08.084401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e3943a4-3fdc-4e72-a2a8-61ca8be5589f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:08.092875 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e3943a4-3fdc-4e72-a2a8-61ca8be5589f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1224 microversion: 2.1 time: 0.104600 Oct 28 13:27:08.094064 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2343/4787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:07 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:08.293867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:08.294401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:08.306406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:08.306952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:08.307995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:08.308860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:08.309165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:08.309596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:08.608881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:08.622970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:08.627949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:08.629789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6050ccf4-afcd-4a39-aa45-8932f476c2a2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.340091 Oct 28 13:27:08.631017 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2344/4788] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:08 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:08.813215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:08.823731 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e712cd62-55d4-4ce4-ad93-903748fa24f4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 1.061378 Oct 28 13:27:08.824324 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2445/4789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:07 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:09.128537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07d369c1-ec0b-4228-bd15-85f1869f4abe tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:09.129525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07d369c1-ec0b-4228-bd15-85f1869f4abe tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:09.233211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-07d369c1-ec0b-4228-bd15-85f1869f4abe tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:09.250225 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07d369c1-ec0b-4228-bd15-85f1869f4abe tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1224 microversion: 2.1 time: 0.137317 Oct 28 13:27:09.251912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2345/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:09 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:09.661682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:09.662326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:09.669897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:09.670409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:09.670891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:09.671616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:09.672085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:09.672516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:09.734207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:09.849870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:09.850255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:09.873171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:09.874134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:09.874654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:09.880523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:09.880523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:09.880523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:10.087843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:10.120302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:10.124883 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2536d98-7b9b-48fb-97c8-1e9b8a0fc1e5 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.267142 Oct 28 13:27:10.127078 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2346/4791] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:09 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:10.137774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:10.149752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:10.160970 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b47ad84-e6a1-43c4-be7a-04a4238cb524 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.504491 Oct 28 13:27:10.186028 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2446/4792] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:09 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:10.279216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:10.279952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:10.305245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:10.306252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:10.307509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:10.308697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:10.309445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:10.310287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:10.467579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:10.533492 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59d56233-764e-452a-a510-b0293f2c112f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1276 microversion: 2.1 time: 0.257926 Oct 28 13:27:10.556856 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2347/4793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:10 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1276 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:11.159095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:11.159887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:11.184034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:11.184531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:11.190773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:11.191546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:11.192026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:11.192460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:11.201373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:11.202098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:11.208214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:11.236979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:11.239276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:11.241135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:11.242559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:11.244972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:11.247169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:11.779383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:11.795528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:11.797036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:11.798238 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c0a695a-a2c7-40bb-bab5-8ac794ed53fc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.602128 Oct 28 13:27:11.810883 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2348/4794] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:11 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:11.815880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:11.816486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:11.827375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:11.831506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:11.831506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:11.831506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:11.831506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:11.831506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:11.941715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:11.954411 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5ae0cc5-74a9-4d70-baa7-748db109f642 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1294 microversion: 2.1 time: 0.141517 Oct 28 13:27:11.955317 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2349/4795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:11 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:12.328908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:12.342106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5dcc676e-3657-4d66-919e-620b33cc9ce4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 1.189911 Oct 28 13:27:12.343277 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2447/4796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:11 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:12.831767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:12.836808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:12.849847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:12.851224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:12.852159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:12.853604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:12.854647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:12.855623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:12.983532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:12.984218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:13.000886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:13.001376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:13.002057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:13.003089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:13.003780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:13.004401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:13.200616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:13.219481 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-74833d86-9c93-405d-bf4f-2a8c7d35431a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1282 microversion: 2.1 time: 0.230661 Oct 28 13:27:13.235350 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2448/4797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:12 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1282 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:13.292848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:13.302665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:13.304194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:13.305364 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b2b67810-a01e-4e4f-8d98-f5bf351801b5 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.480509 Oct 28 13:27:13.305940 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2350/4798] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:12 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:13.367903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:13.369143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:13.378228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:13.378727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:13.379188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:13.379894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:13.380347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:13.380779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:13.944616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:13.954506 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81e5d5b2-a452-4018-a209-b0f03e14de3b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.590874 Oct 28 13:27:13.955301 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2449/4799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:13 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:14.253054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:14.254418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:14.268682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:14.270004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:14.270666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:14.271836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:14.272646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:14.273426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:14.335748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:14.336372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:14.350716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:14.351830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:14.352862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:14.355858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:14.356838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:14.357632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:14.561665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:14.566569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:14.573473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e4ea4222-a0c9-47d5-b209-f37b0cf28280 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.326285 Oct 28 13:27:14.581350 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2351/4800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:14 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:14.977461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:14.978323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:14.986637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:14.987984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:14.987984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:14.988937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:14.989586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:14.990206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:15.056458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:15.070090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:15.072086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:15.074461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c46a6eaf-5b6b-41a3-92d7-3a6b443bcd7e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.743096 Oct 28 13:27:15.075695 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2450/4801] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:14 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:15.256705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:15.267731 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eae4e66d-fc88-4d98-8126-04d62c41fa18 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.294059 Oct 28 13:27:15.269006 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2352/4802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:14 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:15.598481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:15.599171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:15.607973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:15.608312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:15.608750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:15.609474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:15.609910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:15.610369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:15.773648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-da362d2c-b771-4d96-be16-d4bf63b34d45 req-9bd07c5e-0476-459a-97f1-e93c327cf7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785451ce-363f-4121-a2bf-4fb67bd138c8", "tag": "23de660d-531a-4d76-a27b-050196639a13"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:15.820206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-da362d2c-b771-4d96-be16-d4bf63b34d45 req-9bd07c5e-0476-459a-97f1-e93c327cf7ff service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:15.822530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-da362d2c-b771-4d96-be16-d4bf63b34d45 req-9bd07c5e-0476-459a-97f1-e93c327cf7ff service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:15.824345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-da362d2c-b771-4d96-be16-d4bf63b34d45 req-9bd07c5e-0476-459a-97f1-e93c327cf7ff service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:15.842026 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-da362d2c-b771-4d96-be16-d4bf63b34d45 req-9bd07c5e-0476-459a-97f1-e93c327cf7ff service nova] Creating event network-changed:23de660d-531a-4d76-a27b-050196639a13 for instance 785451ce-363f-4121-a2bf-4fb67bd138c8 on n-h2-862876-2 Oct 28 13:27:15.847694 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-da362d2c-b771-4d96-be16-d4bf63b34d45 req-9bd07c5e-0476-459a-97f1-e93c327cf7ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078559 Oct 28 13:27:15.849147 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2353/4803] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:15.938137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:15.953432 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8031b44d-ee7b-4c40-8089-1e28c45a3af8 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.358816 Oct 28 13:27:15.955496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2451/4804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:15 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:16.102224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:16.103288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:16.112236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:16.113154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:16.113844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:16.114846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:16.115569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:16.116245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:16.294910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:16.296354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:16.311588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:16.312520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:16.313770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:16.318573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:16.320639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:16.322152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:16.410509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:16.426660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:16.433010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:16.434862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca8b04b1-5877-46bb-b543-121954e0d17a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.336993 Oct 28 13:27:16.444226 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2354/4805] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:16 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:16.759165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:16.797625 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e526c529-9fbb-4a64-87bc-c3e015c6748e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.506151 Oct 28 13:27:16.801334 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2452/4806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:16 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:16.980100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:16.980731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:17.006605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:17.007149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:17.007900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:17.008875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:17.009533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:17.010191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:17.331911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:17.343088 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-461e77e0-59c6-4624-be83-4879933f01e2 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.369497 Oct 28 13:27:17.343715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2355/4807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:16 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:17.481048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:17.481818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:17.495731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:17.496255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:17.497196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:17.501649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:17.503125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:17.505250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:17.827153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:17.827763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:17.829972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:17.843303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:17.844068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:17.844892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:17.845803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:17.846817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:17.847438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:18.025269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:18.036387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:18.038150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:18.040435 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-03474e0f-e165-492b-a343-8cb7bfa4dffc tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.575092 Oct 28 13:27:18.056181 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2453/4808] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:17 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:18.089300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:18.099586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-264696a4-c424-4ebe-b7a8-1722e8ef7adb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1725 microversion: 2.1 time: 0.276078 Oct 28 13:27:18.102164 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2356/4809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:17 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:18.369756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:18.370375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:18.377321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:18.377834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:18.378262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:18.383187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:18.383874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:18.384371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:18.577811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:18.586567 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d85d74f-fa79-4f99-860b-3e807f6f5983 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.220570 Oct 28 13:27:18.587469 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2454/4810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:18 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:19.069602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:19.070919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:19.080566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:19.081922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:19.082584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:19.083483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:19.084130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:19.084759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:19.130279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:19.133390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:19.145250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=50 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:19.152112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:19.156297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:19.156297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:19.156297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:19.156297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:19.169678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:19.250833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:19.346430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:19.357450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:19.359839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:19.362320 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4e5aa7d-defc-4411-b6b3-ab0aaeb69202 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.297423 Oct 28 13:27:19.363251 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2357/4811] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:19 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:19.406196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:19.429738 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f01e60f-7a06-4b14-9fdf-d4e7c663919f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1702 microversion: 2.1 time: 0.308829 Oct 28 13:27:19.446472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2455/4812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:19 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1702 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:19.463139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8da71ccb-ef18-462b-8cf4-5a3f441c882a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:19.481664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8da71ccb-ef18-462b-8cf4-5a3f441c882a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:19.482182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8da71ccb-ef18-462b-8cf4-5a3f441c882a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:19.482632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8da71ccb-ef18-462b-8cf4-5a3f441c882a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:19.523749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8da71ccb-ef18-462b-8cf4-5a3f441c882a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Going to try to start instance {{(pid=127793) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 13:27:19.593949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1626994812", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:19.680795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] validate_networks() for [('0bc54d61-9bd5-4664-8083-b5c3c2dc6d64', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:27:19.814129 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8da71ccb-ef18-462b-8cf4-5a3f441c882a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action" status: 202 len: 0 microversion: 2.1 time: 0.358392 Oct 28 13:27:19.820099 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2456/4813] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:27:19 2022] POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:27:19.827860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:19.828812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:19.836007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:19.837001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:19.837912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:19.839003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:19.839776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:19.840431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:20.163711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:20.177743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cacfe7e6-666e-4e06-b23c-7e2820e873b5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.352501 Oct 28 13:27:20.206842 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2457/4814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:19 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:20.226168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:20.228888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:20.245729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:20.248639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:20.249227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:20.251420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:20.254139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:20.256056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:20.515263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:20.527408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0698cbae-8df3-4ed7-8233-df201d561180 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1711 microversion: 2.1 time: 0.319194 Oct 28 13:27:20.528619 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2458/4815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:20 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1711 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:20.538693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:20.538693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:20.540825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:20.542040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:20.542650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:20.543558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:20.544172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:20.544885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:20.734916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:27:20.735908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:27:20.736661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:27:20.737258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:27:20.737841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:27:20.748605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:20.749362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:20.750000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:20.751040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:20.751966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:20.752577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:20.774348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Getting quotas for project 8733a0175cf84af98014b171e14f5d19. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:27:20.781851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Getting quotas for user d5b5dc7dd91a4c16b7ebdd22957a28eb and project 8733a0175cf84af98014b171e14f5d19. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:27:20.826499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:27:20.829116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:27:21.066668 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b40d589d-7be8-4363-a7b7-ab094553b08f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.701684 Oct 28 13:27:21.067997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2358/4816] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:27:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:27:21.079920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41326326-6a9c-44a5-b7fe-794b0944c03d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:21.083749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41326326-6a9c-44a5-b7fe-794b0944c03d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:21.264722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41326326-6a9c-44a5-b7fe-794b0944c03d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:21.278923 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41326326-6a9c-44a5-b7fe-794b0944c03d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1214 microversion: 2.1 time: 0.203045 Oct 28 13:27:21.280095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2359/4817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:21 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:21.298929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:21.300298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:21.306468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:21.310230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:21.311203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:21.312112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:21.315008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:21.315623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:21.559994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:21.574926 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f7c94cf-59f2-4f39-a5f3-e50302063248 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.288491 Oct 28 13:27:21.578582 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2360/4818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:21 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:21.592904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:21.595196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:21.613590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:21.616122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:21.616583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:21.617229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:21.617694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:21.617803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:21.618194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:21.629941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:21.636777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:21.638022 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5aefff4-917f-4337-aeab-362f41dbf97e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 1.108226 Oct 28 13:27:21.638595 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2459/4819] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:20 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:21.901296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:21.913419 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4655dfe-4413-42d2-ac2b-af8ff915533c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1711 microversion: 2.1 time: 0.333419 Oct 28 13:27:21.914854 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2361/4820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:21 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1711 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:22.301659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e1bc5bf3-46db-4df1-bd22-058761f0640a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:22.302284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e1bc5bf3-46db-4df1-bd22-058761f0640a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:22.436921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e1bc5bf3-46db-4df1-bd22-058761f0640a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:22.450569 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e1bc5bf3-46db-4df1-bd22-058761f0640a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1214 microversion: 2.1 time: 0.152565 Oct 28 13:27:22.451608 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2460/4821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:22 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:22.605024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:22.606952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:22.621509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:22.623168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:22.624336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:22.625273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:22.625875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:22.626403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:22.671198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:22.672370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:22.691325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:22.692024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:22.692676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:22.693636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:22.694304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:22.694969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:22.902767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:22.918988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9da335e-e9ad-409a-9889-cc7d2d7ddbcf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.319898 Oct 28 13:27:22.922131 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2362/4822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:22 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:22.948791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:22.949749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:22.955965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:22.956741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:22.957403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:22.958315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:22.959076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:22.959706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:23.316307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:23.328337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:23.329784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:23.345753 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e4662b0-01eb-4b61-8f21-4de162485e94 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.678255 Oct 28 13:27:23.355980 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2461/4823] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:22 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:23.376050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:23.411625 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f359a733-4c63-4690-8782-158e08bc93ad tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1715 microversion: 2.1 time: 0.477059 Oct 28 13:27:23.414306 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2363/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:22 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1715 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:23.479344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:23.480824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:23.490051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:23.491049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:23.492290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:23.493282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:23.493974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:23.495286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:23.753856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:23.768254 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f0d0313-4318-44d5-875c-6abcbbfde82d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1218 microversion: 2.1 time: 0.294535 Oct 28 13:27:23.769445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2462/4825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:23 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:23.946154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:23.946823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:23.960304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:23.964162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:23.964162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:23.964162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:23.964162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:23.964162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:24.251235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:24.263525 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2287c778-0ece-4600-84a1-2cfb37699e0d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.321824 Oct 28 13:27:24.279320 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2364/4826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:23 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:24.384647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:24.387368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:24.401718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:24.402219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:24.402662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:24.407471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:24.409784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:24.410326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:24.449656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:24.793116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:24.795883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:24.804557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:24.807977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:24.808709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:24.809675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:24.813624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:24.814323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:24.988620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:25.019653 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd2825e0-a4ca-47a9-ba9b-7a51e67dec45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1274 microversion: 2.1 time: 0.227663 Oct 28 13:27:25.026411 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2365/4827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:24 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:25.063381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:25.083276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:25.086518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:25.092284 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37cf26b1-8dcf-43e5-8de2-440287ec1c99 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.711476 Oct 28 13:27:25.095314 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2463/4828] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:24 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:25.287679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:25.288561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:25.296357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:25.297038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:25.297614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:25.298567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:25.299158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:25.300062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:25.830711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:25.853154 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d225754f-0f36-4cdb-8d1e-9ae8a9cfce9c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.569267 Oct 28 13:27:25.855111 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2366/4829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:25 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:26.050316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:26.051112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:26.075504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:26.076194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:26.082623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:26.083547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:26.084113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:26.084654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:26.124971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:26.125718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:26.141692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:26.142189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:26.145670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:26.147017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:26.147868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:26.148357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:26.334023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:26.351414 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e86da5b-b84e-47e0-8c3c-1d47ce76a3e1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1272 microversion: 2.1 time: 0.307581 Oct 28 13:27:26.365063 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2464/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:26 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:26.507918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:26.549704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:26.558879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:26.561514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dbfcea69-3dd7-42f7-94e2-27bd77fbc52d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.443580 Oct 28 13:27:26.566796 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2367/4831] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:26 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:26.879756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:26.882509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:26.904279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:26.904802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:26.905786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:26.906866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:26.907312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:26.907747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:27.240555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:27.250206 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99f13e71-f111-48c5-893f-41939534225c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.375308 Oct 28 13:27:27.250715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2465/4832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:26 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:27.378686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:27.379387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:27.397583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:27.397583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:27.397583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:27.397583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:27.397583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:27.397583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:27.593012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:27.593966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:27.601260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:27.602103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:27.602806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:27.604376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:27.605194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:27.605922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:28.227872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:28.252763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:28.257595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:28.261769 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-523805ef-7011-40d7-9779-5a2de7e361b8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.671691 Oct 28 13:27:28.271239 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2466/4833] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:27 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:28.273466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:28.292567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-eb97098e-0dc3-43d9-8f06-06cd2f5504a4 req-e8f48ce6-0f56-41b0-9d34-951709a95cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785451ce-363f-4121-a2bf-4fb67bd138c8", "name": "network-vif-plugged", "status": "completed", "tag": "23de660d-531a-4d76-a27b-050196639a13"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:28.293804 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6a5d049-bbe4-4913-a7da-08f03bd1f523 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.918513 Oct 28 13:27:28.295063 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2368/4834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:27 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:28.304540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:28.305476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:28.318439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:28.321621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:28.323335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:28.324370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:28.331490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:28.332316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:28.351093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-eb97098e-0dc3-43d9-8f06-06cd2f5504a4 req-e8f48ce6-0f56-41b0-9d34-951709a95cc2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:28.351613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-eb97098e-0dc3-43d9-8f06-06cd2f5504a4 req-e8f48ce6-0f56-41b0-9d34-951709a95cc2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:28.352063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-eb97098e-0dc3-43d9-8f06-06cd2f5504a4 req-e8f48ce6-0f56-41b0-9d34-951709a95cc2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:28.399900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-eb97098e-0dc3-43d9-8f06-06cd2f5504a4 req-e8f48ce6-0f56-41b0-9d34-951709a95cc2 service nova] Creating event network-vif-plugged:23de660d-531a-4d76-a27b-050196639a13 for instance 785451ce-363f-4121-a2bf-4fb67bd138c8 on n-h2-862876-2 Oct 28 13:27:28.420739 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-eb97098e-0dc3-43d9-8f06-06cd2f5504a4 req-e8f48ce6-0f56-41b0-9d34-951709a95cc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147701 Oct 28 13:27:28.421314 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2467/4835] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:28.903105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:28.913599 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2829e221-6f34-45ce-b2e3-c5fd4c01300b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.617140 Oct 28 13:27:28.918189 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2369/4836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:28 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:29.296917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:29.297708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:29.311524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:29.312031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:29.312480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:29.314661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:29.323667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:29.324381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:29.337553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:29.341599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:29.348498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:29.352159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:29.352622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:29.354104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:29.356342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:29.362101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:29.748561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:29.768648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:29.772943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:29.774208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bd0b3b05-e927-4a70-a1f3-3fb5d9e16208 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.484377 Oct 28 13:27:29.782518 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2468/4837] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:29 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:29.795712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-85ff0669-7f7c-4146-a04d-23eaac1c37de req-c8001332-d0d2-43b5-ab21-dfc781196f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1987d8-50db-46f9-88dc-3c53ccf6e3d3", "tag": "b01f65de-e1ae-4476-9a93-7b75bc15fa54"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:29.821006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85ff0669-7f7c-4146-a04d-23eaac1c37de req-c8001332-d0d2-43b5-ab21-dfc781196f00 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:29.821546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85ff0669-7f7c-4146-a04d-23eaac1c37de req-c8001332-d0d2-43b5-ab21-dfc781196f00 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:29.821986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85ff0669-7f7c-4146-a04d-23eaac1c37de req-c8001332-d0d2-43b5-ab21-dfc781196f00 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:29.824197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:29.826428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:29.834476 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a917dba8-43d2-4285-bd66-3c8cda23db77 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.516886 Oct 28 13:27:29.838662 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2370/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:29 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:29.849545 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-85ff0669-7f7c-4146-a04d-23eaac1c37de req-c8001332-d0d2-43b5-ab21-dfc781196f00 service nova] Creating event network-changed:b01f65de-e1ae-4476-9a93-7b75bc15fa54 for instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 on n-h1-862876-2 Oct 28 13:27:29.859239 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-85ff0669-7f7c-4146-a04d-23eaac1c37de req-c8001332-d0d2-43b5-ab21-dfc781196f00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077353 Oct 28 13:27:29.860541 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2469/4839] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:29.949508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:29.950153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:29.970147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:29.970673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:29.971151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:29.971876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:29.972334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:29.972762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:30.392099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:30.409417 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab0080de-c4e6-43d4-9a61-684455b8f2b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1324 microversion: 2.1 time: 0.467301 Oct 28 13:27:30.410604 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2371/4840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:29 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:30.804900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:30.805703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:30.813711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:30.814288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:30.814819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:30.815829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:30.816318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:30.816815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:30.870572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:30.871380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:30.873878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:30.889298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:30.895041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:30.895041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:30.896541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:30.899600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:30.900389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:31.063845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:31.075924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:31.077586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:31.078943 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-adc129d7-3499-4869-8aa1-fa4846b9cd34 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.279167 Oct 28 13:27:31.088995 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2470/4841] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:30 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:31.238630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:31.255674 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c41e7c5f-6eaa-44bb-8019-06a84cf1b9d8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.394192 Oct 28 13:27:31.283362 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2372/4842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:30 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:31.434035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:31.434650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:31.444891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:31.445651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:31.446293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:31.447436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:31.448068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:31.448664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:31.644657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:31.656205 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dae370e7-df75-47c6-a593-912f2de8e542 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.226974 Oct 28 13:27:31.657632 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2471/4843] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:31 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:31.681082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:31.682583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:31.684860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:31.691193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:31.691950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:31.692802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:31.693818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:31.699318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:31.699318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.111971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:32.114243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:32.129698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.130397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.130936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.131856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.132385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.133008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.417822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:32.426278 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4956ded0-1a8c-4ec4-b6b6-64afb97449bc tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.748991 Oct 28 13:27:32.446151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2373/4844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:31 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:32.447299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:32.451737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:32.452401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:32.458972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.459517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.460225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.461311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.462099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.462812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.463627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:32.481974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:32.483598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:32.485596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce258858-b66c-4584-98fb-b0283c2c9526 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.383265 Oct 28 13:27:32.486509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2472/4845] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:32 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:32.516745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d35865ec-787f-4f14-a16f-03b9641610a3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-627228366", "metadata": {"": ""}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d35865ec-787f-4f14-a16f-03b9641610a3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action HTTP/1.1 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 106 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-627228366", "metadata": {"": ""}}} Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '785451ce-363f-4121-a2bf-4fb67bd138c8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-627228366', 'metadata': {'': ''}}}} Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'': ''} Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:27:32.567471 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:32.574048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d35865ec-787f-4f14-a16f-03b9641610a3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:27:32.581495 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d35865ec-787f-4f14-a16f-03b9641610a3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action" status: 400 len: 170 microversion: 2.1 time: 0.072975 Oct 28 13:27:32.581495 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2473/4846] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Oct 28 13:27:32 2022] POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action => generated 170 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:27:32.589716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:32.590330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:32.604122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.604780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.605224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.608416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.608416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.608416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.919893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:32.928556 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a959b5cd-28a8-4e8f-8b8f-45fd116b8212 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.343220 Oct 28 13:27:32.931156 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2474/4847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:32 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:32.960767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:32.962120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:32.969864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.970681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.971361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:32.973609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:32.974435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:32.975140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.178050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:33.188342 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ecc6e616-fa4d-45a1-bc39-54e7c3155fe2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.740961 Oct 28 13:27:33.191372 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2374/4848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:32 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:33.218178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:33.227239 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5045a3fa-0d6d-4245-a96f-c2fd21de40b7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.271057 Oct 28 13:27:33.228422 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2475/4849] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:32 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:33.250630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f3ba836-11f6-460b-9e6b-7146996a83b1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-141850545", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f3ba836-11f6-460b-9e6b-7146996a83b1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action HTTP/1.1 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 618 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-141850545", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '785451ce-363f-4121-a2bf-4fb67bd138c8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-141850545', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:27:33.255660 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 13:27:33.266186 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.273360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f3ba836-11f6-460b-9e6b-7146996a83b1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:27:33.273360 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f3ba836-11f6-460b-9e6b-7146996a83b1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action" status: 400 len: 938 microversion: 2.1 time: 0.011125 Oct 28 13:27:33.273360 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2375/4850] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Oct 28 13:27:33 2022] POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action => generated 938 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:27:33.276299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:33.277921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:33.291043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.296907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.296907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.296907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.306945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.307608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.503540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:33.515273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b2daa91-8e20-46ca-8c44-81ddbf0ba9ed tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.251109 Oct 28 13:27:33.515419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:33.516654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:33.516805 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2476/4851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:33 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:33.524165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.524656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.525092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.525840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.526447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.526739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.548566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:33.549217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:33.555556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.556034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.556993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.557694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.558275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.558889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.749583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:33.757912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:33.761338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:33.763266 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-987c329d-1a2c-4d03-9d98-9e0dc9ff59f9 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.251929 Oct 28 13:27:33.764297 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2376/4852] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:33 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:33.796932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:33.804754 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-384b6e1b-5807-4bfb-9d6a-30df294eb370 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.260121 Oct 28 13:27:33.805530 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2477/4853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:33 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:33.828793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17c0c6cc-bd24-46d6-bbce-525993fa8982 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17c0c6cc-bd24-46d6-bbce-525993fa8982 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action HTTP/1.1 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 285 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '785451ce-363f-4121-a2bf-4fb67bd138c8', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.832611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17c0c6cc-bd24-46d6-bbce-525993fa8982 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17c0c6cc-bd24-46d6-bbce-525993fa8982 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action" status: 400 len: 619 microversion: 2.1 time: 0.009205 Oct 28 13:27:33.842979 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2377/4854] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Oct 28 13:27:33 2022] POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:27:33.845457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:33.845457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:33.849055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.849535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.850070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:33.850782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:33.851242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:33.851670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.066676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:34.082585 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00019edc-bfcf-42f8-8bd3-d75f18a2c4ce tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.243848 Oct 28 13:27:34.083247 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2478/4855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:33 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:34.115529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:34.115529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:34.116177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.116675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.117308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.118210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.118920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.120101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.215117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:34.216161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:34.224427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.225465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.225972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.226762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.227332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.227864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.364379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:34.374111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8cb291aa-41a1-44f2-a9a4-4d5fa92ab3ae tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.271025 Oct 28 13:27:34.374528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:34.386770 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2378/4856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:34 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:34.386998 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4a91f6a-0451-4630-9fe5-ce91aefd9e09 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.173027 Oct 28 13:27:34.386998 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2479/4857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:34 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:34.398127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1294105579"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:34.400976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:34.407473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.408077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.408584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.409354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.409879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.410629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.790370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:34.791718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:34.802874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.802874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.802874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.802874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.802874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.802874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.938171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c98bbe4-c38b-4059-ac63-f445f6bb848a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action" status: 202 len: 0 microversion: 2.1 time: 0.543104 Oct 28 13:27:34.939830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2379/4858] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:27:34 2022] POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:27:34.958060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-414897981"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:34.962038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:34.971252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.971936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.972634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:34.973507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:34.974253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:34.975187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:35.030177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:35.031590 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Cannot 'createImage' instance 785451ce-363f-4121-a2bf-4fb67bd138c8 while it is in task_state image_snapshot_pending Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action HTTP/1.1 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 84 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-414897981"}} Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'createImage' instance 785451ce-363f-4121-a2bf-4fb67bd138c8 while it is in task_state image_snapshot_pending Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '785451ce-363f-4121-a2bf-4fb67bd138c8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-414897981'}}} Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:27:35.033473 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 785451ce-363f-4121-a2bf-4fb67bd138c8 while it is in task_state image_snapshot_pending Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 785451ce-363f-4121-a2bf-4fb67bd138c8 while it is in task_state image_snapshot_pending Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 409 to user: Cannot 'createImage' instance 785451ce-363f-4121-a2bf-4fb67bd138c8 while it is in task_state image_snapshot_pending {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06cf7d88-13c3-46a2-b489-bccbcb4f6aec tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action" status: 409 len: 167 microversion: 2.1 time: 0.087686 Oct 28 13:27:35.037896 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2380/4859] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:27:34 2022] POST /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8/action => generated 167 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:27:35.042507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:35.043492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5589ca8-142c-4cf4-8c69-44cbd9502f08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '.version_select at 0x7f27b85e6af0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:35.043989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:35.045172 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b969a377-0fa0-4f99-bdf1-2a8ba1b05a6b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.259296 Oct 28 13:27:35.046022 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2480/4860] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:34 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:35.402484 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d5589ca8-142c-4cf4-8c69-44cbd9502f08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/images/d4e89b33-e8d0-4726-8702-ad511a7109a7" status: 204 len: 0 microversion: 2.1 time: 0.363002 Oct 28 13:27:35.403441 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2381/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:35 2022] DELETE /compute/v2.1/images/d4e89b33-e8d0-4726-8702-ad511a7109a7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:27:35.412584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:35.413061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:35.413528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:35.413676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:35.419880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:35.420427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:35.420860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:35.424385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:35.424515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:35.424634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:35.424746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:35.424851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:35.424953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:35.426292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:35.427012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:35.427682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:35.625131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:35.636695 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4288d643-f1af-4ca1-9d41-b7bd0823e97d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1533 microversion: 2.1 time: 0.227687 Oct 28 13:27:35.637382 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2481/4862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:35 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1533 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:35.683007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:35.703443 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6e72e7d-c349-4903-9805-d5b3db6513cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.293866 Oct 28 13:27:35.714003 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2382/4863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:35 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:36.074205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:36.080442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:36.081275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:36.081869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:36.082309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:36.083103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:36.083580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:36.084009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:36.088169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:36.286267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:36.305727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:36.308442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:36.318471 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58dfd1bc-b646-47c8-9fc9-a066c25e7d0a tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.249803 Oct 28 13:27:36.319304 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2482/4864] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:36 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:36.661525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:36.662322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:36.669376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:36.674535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:36.674535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:36.674535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:36.674535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:36.674535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:36.726674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:36.729420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:36.740940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:36.741436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:36.746057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:36.747089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:36.747567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:36.751299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:36.936603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:36.945905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:36.948064 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ecbb510c-6a16-4567-a9e2-b740e352db08 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1539 microversion: 2.1 time: 0.290605 Oct 28 13:27:36.950902 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2383/4865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:36 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1539 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:36.960496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13df5517-fe69-4f26-8e27-42ac10b898e4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.237494 Oct 28 13:27:36.961845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2483/4866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:36 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:37.168329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-919ea2cf-03b8-42c8-a107-9cd93572ea8e req-77251ee3-4e1d-45b1-b78c-f4f5f92b4316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-plugged", "status": "completed", "tag": "585cc549-1b07-4522-85cf-a1914cce9d33"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:37.179502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-919ea2cf-03b8-42c8-a107-9cd93572ea8e req-77251ee3-4e1d-45b1-b78c-f4f5f92b4316 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:37.180386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-919ea2cf-03b8-42c8-a107-9cd93572ea8e req-77251ee3-4e1d-45b1-b78c-f4f5f92b4316 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:37.180913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-919ea2cf-03b8-42c8-a107-9cd93572ea8e req-77251ee3-4e1d-45b1-b78c-f4f5f92b4316 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:37.214268 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-919ea2cf-03b8-42c8-a107-9cd93572ea8e req-77251ee3-4e1d-45b1-b78c-f4f5f92b4316 service nova] Creating event network-vif-plugged:585cc549-1b07-4522-85cf-a1914cce9d33 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:37.231808 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-919ea2cf-03b8-42c8-a107-9cd93572ea8e req-77251ee3-4e1d-45b1-b78c-f4f5f92b4316 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068246 Oct 28 13:27:37.235863 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2384/4867] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:37.373386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:37.374208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:37.381595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:37.382515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:37.383393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:37.384366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:37.385479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:37.394296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:37.675120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:37.691315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:37.694161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:37.695399 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b912c06-03cd-44b0-9a12-e39b9bee0ffa tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.348176 Oct 28 13:27:37.696409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2484/4868] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:37 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:37.994001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:37.995916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:37.996629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:37.997057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:38.012524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:38.014081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:38.014531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:38.017433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:38.017705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:38.018143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:38.018503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:38.019001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:38.019412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:38.020099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:38.020564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:38.020991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:38.291504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:38.299193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:38.305537 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3d6e95c-ebe1-4e1a-a283-92d4fc049692 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.321658 Oct 28 13:27:38.307270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-56724e5a-32c5-4df5-8eaf-e2f433c65561 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1534 microversion: 2.1 time: 0.325017 Oct 28 13:27:38.310889 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2485/4869] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:37 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:38.323788 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2385/4870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:37 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1534 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:38.723261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:38.724353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:38.732720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:38.733399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:38.734151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:38.734972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:38.735628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:38.736083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.118412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:39.132249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:39.136489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:39.136489 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-83ec3813-5f12-4fe9-9525-537eb7be5da0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.417686 Oct 28 13:27:39.148130 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2486/4871] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:38 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:39.253521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-plugged", "status": "completed", "tag": "c6bceb41-c854-430c-8667-7fd5d959eee4"}, {"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-plugged", "status": "completed", "tag": "09ba8bae-1034-46b2-8b3c-7e6052ebbe90"}, {"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-plugged", "status": "completed", "tag": "08737e4b-2e2f-4bce-8fe2-9864e3a719de"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:39.265709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:39.266302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:39.267149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.280111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] Creating event network-vif-plugged:c6bceb41-c854-430c-8667-7fd5d959eee4 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:39.280895 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] Creating event network-vif-plugged:09ba8bae-1034-46b2-8b3c-7e6052ebbe90 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:39.281397 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] Creating event network-vif-plugged:08737e4b-2e2f-4bce-8fe2-9864e3a719de for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:39.287170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-fb5fba6a-1326-4bd7-8625-200778556999 req-e4106083-841e-4b8c-8b33-5ec8cb0fc10e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037261 Oct 28 13:27:39.288022 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2386/4872] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:39.335841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:39.336787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:39.339189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:39.346109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:39.354860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:39.355613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:39.356234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.357124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:39.358032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:39.358642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.362348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:39.363037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:39.363528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.365048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:39.365808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:39.366403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.562464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:39.570940 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47d6722d-a734-4d06-ba7f-ed6b3c7bd186 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1521 microversion: 2.1 time: 0.238878 Oct 28 13:27:39.571536 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2487/4873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:39 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:39.596876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:39.598273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:39.605445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:39.606202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:39.606854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.607963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:39.608595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:39.609188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:39.639112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:27:39.747982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:39.757959 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-501f0d21-441e-4fe5-9f9a-5dc255ae0a27 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.424505 Oct 28 13:27:39.757959 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2387/4874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:39 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:40.003004 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07cd4b9a-7413-45a6-92d3-a7f9648ec961 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 204 len: 0 microversion: 2.1 time: 0.411616 Oct 28 13:27:40.010039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2488/4875] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:27:39 2022] DELETE /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:27:40.017988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:40.019002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:40.025124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.025699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.026331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:40.027315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.027878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.028371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:40.164130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:40.165046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:40.178529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.179206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.179780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:40.180656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.181249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.182346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:40.258593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:40.275562 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e94a8b4d-2f64-40d0-aa8d-b42508cda1eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1527 microversion: 2.1 time: 0.262375 Oct 28 13:27:40.276335 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2388/4876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:40 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1527 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:40.424534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:40.434453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:40.435985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:40.437154 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-12153068-ec67-4fb0-b7a1-d6363005f812 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.279274 Oct 28 13:27:40.439992 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2489/4877] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:40 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:40.473128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:40.473649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:40.480556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.481046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.481533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:40.482172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.482653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.483106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:40.600907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lazy-loading 'services' on Instance uuid 19002f60-5a25-4476-a548-8a979af98a72 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:27:40.784817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:40.785741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:40.817670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:40.818720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.821027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.821527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:40.824282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:40.825428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:40.826416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:41.013203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:41.021879 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f4d7c01-0f1b-49a5-9179-82442fe4a374 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.245253 Oct 28 13:27:41.049416 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6c9d0aa4-efdc-4708-9770-ad863041f54d tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72/os-volume_attachments/80eb6338-5b0f-4a34-8150-f8524f3a76c0" status: 202 len: 0 microversion: 2.1 time: 0.580187 Oct 28 13:27:41.050024 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2389/4878] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:27:40 2022] DELETE /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72/os-volume_attachments/80eb6338-5b0f-4a34-8150-f8524f3a76c0 => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:27:41.050507 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2490/4879] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:40 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:41.302009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:41.303428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:41.308966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-plugged", "status": "completed", "tag": "34ff3a2e-4c23-4038-b121-e08b82372578"}, {"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-plugged", "status": "completed", "tag": "352a0edd-de4a-4fa0-bdeb-aba88b63a429"}, {"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-plugged", "status": "completed", "tag": "1297cfba-46fe-4a0e-b6a3-aa9ffcbca8f6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:41.311623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:41.312398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:41.313112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:41.314056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:41.314769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:41.315435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:41.326266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:41.327113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:41.327789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:41.345160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] Creating event network-vif-plugged:34ff3a2e-4c23-4038-b121-e08b82372578 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:41.345760 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] Creating event network-vif-plugged:352a0edd-de4a-4fa0-bdeb-aba88b63a429 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:41.346404 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] Creating event network-vif-plugged:1297cfba-46fe-4a0e-b6a3-aa9ffcbca8f6 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:41.353036 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-310962b5-6f3e-4a6a-9085-93e0ef416fe1 req-4f6728f2-7d86-4b3c-ba96-ff083d9b0f41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051733 Oct 28 13:27:41.354936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2491/4880] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:41.473896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:41.474714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:41.487405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:41.489753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:41.490339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:41.491171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:41.497610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:41.501629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:41.519759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:41.553112 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4643fe55-8a36-438e-ab3e-56e09db9a9ea tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1527 microversion: 2.1 time: 0.256316 Oct 28 13:27:41.573638 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2390/4881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:41 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1527 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:42.056065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:42.057344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:42.065556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:42.066201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:42.066785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:42.068043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:42.068871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:42.069547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:42.255394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:42.271271 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d2377585-382a-4ec1-b76a-1dc848d23611 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.222383 Oct 28 13:27:42.272375 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2391/4882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:42 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:42.287103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:42.306172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:42.307549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:42.309016 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5783fa1-f988-45d2-bc00-76cd6335b09e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1877 microversion: 2.42 time: 0.841174 Oct 28 13:27:42.323782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2492/4883] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:41 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1877 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:27:42.591716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:42.593306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:42.602861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:42.604152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:42.604896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:42.606249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:42.606997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:42.607334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:42.756666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:42.764976 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11cb9afa-7283-480d-807f-6a4ffd962a0a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1527 microversion: 2.1 time: 0.180556 Oct 28 13:27:42.765890 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2392/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:42 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:43.146415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b87f57f8-05b6-4ede-8604-0f9be90e646c req-6fd37000-1cc8-42a7-bd15-3fcbcad5a9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785451ce-363f-4121-a2bf-4fb67bd138c8", "name": "network-vif-deleted", "tag": "23de660d-531a-4d76-a27b-050196639a13"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:43.168842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b87f57f8-05b6-4ede-8604-0f9be90e646c req-6fd37000-1cc8-42a7-bd15-3fcbcad5a9de service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.169409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b87f57f8-05b6-4ede-8604-0f9be90e646c req-6fd37000-1cc8-42a7-bd15-3fcbcad5a9de service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.169866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b87f57f8-05b6-4ede-8604-0f9be90e646c req-6fd37000-1cc8-42a7-bd15-3fcbcad5a9de service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.186498 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b87f57f8-05b6-4ede-8604-0f9be90e646c req-6fd37000-1cc8-42a7-bd15-3fcbcad5a9de service nova] Creating event network-vif-deleted:23de660d-531a-4d76-a27b-050196639a13 for instance 785451ce-363f-4121-a2bf-4fb67bd138c8 on n-h2-862876-2 Oct 28 13:27:43.192417 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b87f57f8-05b6-4ede-8604-0f9be90e646c req-6fd37000-1cc8-42a7-bd15-3fcbcad5a9de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049516 Oct 28 13:27:43.193014 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2493/4885] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:43.309139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:43.309775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:43.312020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:43.317407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.317904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.318343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.319082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.319526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.319951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.337353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:43.343696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:43.389991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.390600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.391786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.392994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.393535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.394035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.520818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:43.533890 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49a226b9-3591-4390-9de7-f1b911cda814 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.243122 Oct 28 13:27:43.534688 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2393/4886] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:43 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:43.540107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1716e221-1892-467d-9761-98e0c2d28256 req-46a806a2-250a-450d-84c8-551d1b6eee92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1987d8-50db-46f9-88dc-3c53ccf6e3d3", "name": "network-vif-plugged", "status": "completed", "tag": "b01f65de-e1ae-4476-9a93-7b75bc15fa54"}, {"server_uuid": "785451ce-363f-4121-a2bf-4fb67bd138c8", "name": "network-vif-plugged", "status": "completed", "tag": "23de660d-531a-4d76-a27b-050196639a13"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:43.553693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1716e221-1892-467d-9761-98e0c2d28256 req-46a806a2-250a-450d-84c8-551d1b6eee92 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.555114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1716e221-1892-467d-9761-98e0c2d28256 req-46a806a2-250a-450d-84c8-551d1b6eee92 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.556107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1716e221-1892-467d-9761-98e0c2d28256 req-46a806a2-250a-450d-84c8-551d1b6eee92 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.589275 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1716e221-1892-467d-9761-98e0c2d28256 req-46a806a2-250a-450d-84c8-551d1b6eee92 service nova] Creating event network-vif-plugged:b01f65de-e1ae-4476-9a93-7b75bc15fa54 for instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 on n-h1-862876-2 Oct 28 13:27:43.594015 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1716e221-1892-467d-9761-98e0c2d28256 req-46a806a2-250a-450d-84c8-551d1b6eee92 service nova] Creating event network-vif-plugged:23de660d-531a-4d76-a27b-050196639a13 for instance 785451ce-363f-4121-a2bf-4fb67bd138c8 on n-h2-862876-2 Oct 28 13:27:43.605826 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1716e221-1892-467d-9761-98e0c2d28256 req-46a806a2-250a-450d-84c8-551d1b6eee92 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068787 Oct 28 13:27:43.607260 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2394/4887] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:43.652899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:43.666290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:43.675942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:43.683114 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d38b831-68d5-4699-9e9a-d4cfc909dd33 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2835 microversion: 2.42 time: 0.349925 Oct 28 13:27:43.684702 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2494/4888] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:27:43 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2835 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:43.697078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:43.707889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:43.707889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.707889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.707889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.707889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.707889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.707889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.713944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:43.714571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:43.724740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.725987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.727974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.729797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.730488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.732786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.855909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lazy-loading 'services' on Instance uuid 49aaf8ce-7f94-4845-adb9-c2157aa98218 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:27:43.922823 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9aa95c97-64a1-4da5-b60b-04336d26ea0c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.212926 Oct 28 13:27:43.923723 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2495/4889] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Oct 28 13:27:43 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87/os-interface => generated 1831 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:27:43.928710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:43.930391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:43.945796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.948687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.949245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.950073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.951240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.952512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.992037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:43.992800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:43.993412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:43.994155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lazy-loading 'fault' on Instance uuid 785451ce-363f-4121-a2bf-4fb67bd138c8 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:27:44.045202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:44.062458 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e0a339a-bd75-427a-8536-7c18a7726d97 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 200 len: 1314 microversion: 2.1 time: 0.137313 Oct 28 13:27:44.064221 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2496/4890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:43 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:44.146861 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e9b8842b-c808-4ab9-80d2-053492b9c63d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218/os-volume_attachments/d2865662-fba0-4e41-a936-739404737da6" status: 202 len: 0 microversion: 2.1 time: 0.454384 Oct 28 13:27:44.169357 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2395/4891] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:27:43 2022] DELETE /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218/os-volume_attachments/d2865662-fba0-4e41-a936-739404737da6 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:27:44.564507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:44.564507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:44.573009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:44.573864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:44.574485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:44.575420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:44.576847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:44.577845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:44.755232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:44.767059 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f27c0c28-c60c-41a5-b934-9d2057e12366 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1314 microversion: 2.1 time: 0.210224 Oct 28 13:27:44.769148 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2497/4892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:44 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:45.094197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:45.094197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:45.099244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:45.100108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:45.100707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:45.101718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:45.102295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:45.102871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:45.143787 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 HTTP/1.1 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '785451ce-363f-4121-a2bf-4fb67bd138c8'} Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:45.146916 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:27:45.153392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:27:45.156150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:27:45.157539 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5cf66e7a-5078-4f0d-8455-3ecf288a48c3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 404 len: 111 microversion: 2.1 time: 0.073400 Oct 28 13:27:45.158703 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2396/4893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:45 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:27:45.173435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5be7141d-6c9b-4e9b-9bb9-6d4525f15215 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'create', calling method: .version_select at 0x7f27b9c360d0>, body: {"keypair": {"name": "tempest-keypair-1307562389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdfl4/ES2zgPWtvttf5Va+MNcgiDKvnVxPX1FlVPWf3570yvThuT3FtaJt+VYLklKC1SZ8w5RPOifNzblvQPFQzkrSnOU3sloIYi5gogddDH7LgMKudmmTizixiCE4Yvg=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:45.195264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5be7141d-6c9b-4e9b-9bb9-6d4525f15215 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for project 207bb29d0b79413097cfed319c0eae7a. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:27:45.206169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5be7141d-6c9b-4e9b-9bb9-6d4525f15215 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for user 4141fc4731c24c00af71839c6594e659 and project 207bb29d0b79413097cfed319c0eae7a. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:27:45.207622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:45.308860 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5be7141d-6c9b-4e9b-9bb9-6d4525f15215 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141713 Oct 28 13:27:45.309809 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2498/4894] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:27:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:45.793982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:45.795709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:45.808269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:45.810862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:45.810862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:45.810862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:45.810862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:45.812041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:46.205212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:46.225585 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-967a907b-2b70-4a2e-9833-9a5da5d08492 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1500 microversion: 2.1 time: 0.437001 Oct 28 13:27:46.226566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2397/4895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:45 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1500 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:46.253201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:46.256498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:46.265912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:46.267091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:46.267824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:46.268813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:46.269603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:46.270292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:46.305811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:46.317363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lazy-loading 'flavor' on Instance uuid dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:27:46.427043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f24200e1-808a-4f8a-8010-a63a1b3a0b69 req-647b3bcc-d8f3-4474-931b-c80ea380724c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "tag": "08737e4b-2e2f-4bce-8fe2-9864e3a719de"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:46.445002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f24200e1-808a-4f8a-8010-a63a1b3a0b69 req-647b3bcc-d8f3-4474-931b-c80ea380724c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:46.445495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f24200e1-808a-4f8a-8010-a63a1b3a0b69 req-647b3bcc-d8f3-4474-931b-c80ea380724c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:46.445933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f24200e1-808a-4f8a-8010-a63a1b3a0b69 req-647b3bcc-d8f3-4474-931b-c80ea380724c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:46.475511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f24200e1-808a-4f8a-8010-a63a1b3a0b69 req-647b3bcc-d8f3-4474-931b-c80ea380724c service nova] Creating event network-changed:08737e4b-2e2f-4bce-8fe2-9864e3a719de for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:27:46.506199 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f24200e1-808a-4f8a-8010-a63a1b3a0b69 req-647b3bcc-d8f3-4474-931b-c80ea380724c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080603 Oct 28 13:27:46.519398 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2398/4896] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:27:46.780860 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ab5831d9-8d2c-44c0-9959-f81400fbb87c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "POST /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3/action" status: 200 len: 32 microversion: 2.1 time: 0.532428 Oct 28 13:27:46.790246 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2499/4897] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:27:46 2022] POST /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3/action => generated 32 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:27:46.800740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:46.801556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:46.826969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:46.830300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:46.830989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:46.832093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:46.835522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:46.836496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:47.486202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:47.497288 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-70752af4-3f6f-43da-850c-7b9fe13746a4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.708287 Oct 28 13:27:47.497880 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2399/4898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:46 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:48.070381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:48.071005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:48.078859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:48.079721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:48.081020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:48.081856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:48.082333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:48.082792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:48.120848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:27:48.498195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19f56787-0fe8-4b5a-aa7b-f5366d1e077e tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 204 len: 0 microversion: 2.1 time: 0.432859 Oct 28 13:27:48.498961 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2500/4899] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:27:48 2022] DELETE /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:27:48.507825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:48.518056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:48.522166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:48.523062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:48.544831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:48.545863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:48.548522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:48.552408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:48.553129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:48.553997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:48.555129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:48.558150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:48.560136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:48.561039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:48.561553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:48.561999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:48.781156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:48.782001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:48.801270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5648da2d-edf6-43b4-8c73-e4367d6f6501 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1470 microversion: 2.1 time: 0.297607 Oct 28 13:27:48.802920 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40b26638-a568-462b-b358-0771be049823 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.282032 Oct 28 13:27:48.805907 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2501/4900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:48 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:48.824126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2400/4901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:48 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:49.422511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-552190260", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:49.496022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] validate_networks() for [('727caa2f-1923-4abe-bb0d-e565fc619d13', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:27:49.831784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:49.833208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:49.841267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:49.842057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:49.842821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:49.844018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:49.844647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:49.845069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:49.995329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:50.010330 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-848d7aba-43c7-42c4-ace4-ee442eb11d57 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.182815 Oct 28 13:27:50.011070 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2401/4902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:49 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:50.017547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:50.018588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:50.025949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:50.026667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:50.027135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:50.028144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:50.028628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:50.029052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:50.192165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:50.201520 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f74a46a-1fd6-4680-bd4a-567a2ec8facf tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1470 microversion: 2.1 time: 0.189172 Oct 28 13:27:50.205527 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2402/4903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:50 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1470 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:50.360577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:27:50.361504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:27:50.362222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:27:50.362897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:27:50.364023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:27:50.376962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:50.377847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:50.378524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:50.379522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:50.380211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:50.380871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:50.400000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for project 207bb29d0b79413097cfed319c0eae7a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:27:50.407634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for user 4141fc4731c24c00af71839c6594e659 and project 207bb29d0b79413097cfed319c0eae7a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:27:50.425769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:27:50.428979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:27:50.566446 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2259754-04fa-442f-9a12-f9559ca25867 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.147998 Oct 28 13:27:50.567482 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2502/4904] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:27:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:27:50.580133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4cd20a1-56fd-4ece-9b34-251220e58462 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:50.580133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4cd20a1-56fd-4ece-9b34-251220e58462 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:50.670695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4cd20a1-56fd-4ece-9b34-251220e58462 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:50.679108 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4cd20a1-56fd-4ece-9b34-251220e58462 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1224 microversion: 2.1 time: 0.103934 Oct 28 13:27:50.679701 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2403/4905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:50 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:51.037654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:51.039500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-565cd5e6-d432-4f99-9460-461592637798 req-547f901b-f2b2-4ce6-bc69-ec173cbd0f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19002f60-5a25-4476-a548-8a979af98a72", "name": "network-vif-deleted", "tag": "88de4033-93a4-4a6a-95bb-da9633860e24"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:51.040792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:51.055914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:51.060432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:51.060986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:51.061808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:51.064143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-565cd5e6-d432-4f99-9460-461592637798 req-547f901b-f2b2-4ce6-bc69-ec173cbd0f52 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:51.064743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:51.065254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:51.071090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-565cd5e6-d432-4f99-9460-461592637798 req-547f901b-f2b2-4ce6-bc69-ec173cbd0f52 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:51.072492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-565cd5e6-d432-4f99-9460-461592637798 req-547f901b-f2b2-4ce6-bc69-ec173cbd0f52 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:51.094093 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-565cd5e6-d432-4f99-9460-461592637798 req-547f901b-f2b2-4ce6-bc69-ec173cbd0f52 service nova] Creating event network-vif-deleted:88de4033-93a4-4a6a-95bb-da9633860e24 for instance 19002f60-5a25-4476-a548-8a979af98a72 on n-h2-862876-2 Oct 28 13:27:51.099591 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-565cd5e6-d432-4f99-9460-461592637798 req-547f901b-f2b2-4ce6-bc69-ec173cbd0f52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068254 Oct 28 13:27:51.100803 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2404/4906] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:51.229007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:51.229716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:51.242285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:51.243065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:51.244237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:51.255785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:51.256281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:51.256724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:51.323384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:51.341397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-75d55aef-f638-4838-b731-ad7f680ce904 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.311690 Oct 28 13:27:51.363833 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2503/4907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:51 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:51.409372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1f11a4e6a32473dac2afea955f8fae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ba03bae2274b809dce51c3de85426f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:51.435921 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3ad52dc-6ad8-48af-bf12-c243ec7c4144 tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 200 len: 1299 microversion: 2.1 time: 0.211496 Oct 28 13:27:51.453308 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2405/4908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:51 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:51.703902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5c5ef88-9aef-4917-a378-404f481f3427 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:51.704708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5c5ef88-9aef-4917-a378-404f481f3427 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:51.765355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5c5ef88-9aef-4917-a378-404f481f3427 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:51.773201 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5c5ef88-9aef-4917-a378-404f481f3427 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1224 microversion: 2.1 time: 0.073407 Oct 28 13:27:51.777929 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2504/4909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:51 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1224 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:52.386554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:52.387335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:52.396755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:52.397925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:52.398548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:52.399608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:52.401155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:52.401946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:52.462223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:52.463738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] [instance: 19002f60-5a25-4476-a548-8a979af98a72] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:52.471813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:52.472576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:52.473011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:52.473714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:52.475516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:52.475955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] HTTP exception thrown: Instance 19002f60-5a25-4476-a548-8a979af98a72 could not be found. Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Request method failure captured: Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 HTTP/1.1 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9gdUNuL_WNK9oU3i0pyd42sNodEf-7Qj5bsuqRcoGHkk4wT748Efoo0LXDVahC7yvyvr6zW2QOKCqmgvKEW_epzQnVgIR5tXr3WcGKHYYIkVLhvP_5TlIyxHSUgSLx_S1Td4X2k7MgftuElm6mEWU0Qu8TSJtwYN0lHzrjK0v0bJfQ Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d2ba03bae2274b809dce51c3de85426f Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesBackupsTest-1481550607 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2ba03bae2274b809dce51c3de85426f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d2ba03bae2274b809dce51c3de85426f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d2ba03bae2274b809dce51c3de85426f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d2ba03bae2274b809dce51c3de85426f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesBackupsTest-1481550607 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d2ba03bae2274b809dce51c3de85426f Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesBackupsTest-1481550607 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesBackupsTest-1481550607-project Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: c1f11a4e6a32473dac2afea955f8fae8 Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesBackupsTest-1481550607-project Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 19002f60-5a25-4476-a548-8a979af98a72 could not be found. Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '19002f60-5a25-4476-a548-8a979af98a72'} Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19002f60-5a25-4476-a548-8a979af98a72 could not be found. Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:27:52.496156 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19002f60-5a25-4476-a548-8a979af98a72 could not be found. Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19002f60-5a25-4476-a548-8a979af98a72 could not be found. Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] Returning 404 to user: Instance 19002f60-5a25-4476-a548-8a979af98a72 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87af23b9-908f-4a72-ae08-7ba6ff8acb0b tempest-VolumesBackupsTest-1481550607 tempest-VolumesBackupsTest-1481550607-project] 10.222.0.25 "GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72" status: 404 len: 111 microversion: 2.1 time: 0.037825 Oct 28 13:27:52.501629 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2505/4910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:52 2022] GET /compute/v2.1/servers/19002f60-5a25-4476-a548-8a979af98a72 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:27:52.647401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:52.656205 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1bc0093-767e-4dc1-9d22-8b96ca4684c8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.274483 Oct 28 13:27:52.657455 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2406/4911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:52 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:52.797220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:52.797842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:52.804444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:52.804929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:52.805370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:52.806129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:52.806591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:52.807105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:52.869350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:52.877061 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f0a848e-a165-451b-9d02-ba260362d476 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1276 microversion: 2.1 time: 0.083859 Oct 28 13:27:52.877629 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2506/4912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:52 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:53.462585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:53.463187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:53.470087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:53.473879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:53.474379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:53.475149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:53.475621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:53.476052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:53.503531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:27:53.681754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:53.682623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:53.689912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:53.690652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:53.691310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:53.692029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:53.692487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:53.692918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:53.754314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:27:53.983968 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-db9ef19a-2644-402b-8552-66e642327a67 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 204 len: 0 microversion: 2.1 time: 0.524923 Oct 28 13:27:53.984948 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2407/4913] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:27:53 2022] DELETE /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:27:53.990789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:53.992438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:54.003107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:54.003606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:54.004048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:54.004823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:54.005203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:54.005631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:54.113447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:54.131151 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-55e19ec3-5c3d-43a6-837f-6e22182851a5 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1294 microversion: 2.1 time: 0.144545 Oct 28 13:27:54.131907 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2408/4914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:53 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1294 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:54.136639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:54.159743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c2b99f3-b4c0-44cd-982d-11f76d663ab9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.481557 Oct 28 13:27:54.161297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2507/4915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:53 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:54.164226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:54.165174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:54.172288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:54.173192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:54.173884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:54.174817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:54.175449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:54.176044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:54.429636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:54.439605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca03d2f9-b82e-4ebd-aa21-b39337210a9d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1513 microversion: 2.1 time: 0.291770 Oct 28 13:27:54.450188 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2409/4916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:54 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:55.160254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:55.163970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:55.178735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.179249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.179806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:55.181763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.182514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.183701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:55.190122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:55.191450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:55.206059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.209770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.210393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:55.211338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.211826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.212326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:55.472563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:55.485203 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63aa39e1-67a4-4f30-a7a7-61c4507e1998 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.299506 Oct 28 13:27:55.485997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2410/4917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:55 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:55.491017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:55.491712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:55.498733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.503894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.503894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:55.503894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.503894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.503894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:55.664588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:55.683696 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-069a0b78-40c0-4d65-b5e2-1c7e3c0cf8f4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.528019 Oct 28 13:27:55.687108 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2508/4918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:55 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:55.704258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:55.714656 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4098eb6-c1bb-4bc2-a984-4851b26a89f0 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1513 microversion: 2.1 time: 0.227501 Oct 28 13:27:55.715788 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2411/4919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:55 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:55.869753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:55.877442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:55.897788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.900083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.900745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:55.904759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:55.906345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:55.907801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:56.073183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lazy-loading 'services' on Instance uuid 4f35a4c2-2658-4948-873b-c44e0e7ad80f {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:27:56.356325 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0dd537e0-f4c4-43a9-a38d-18062ecac4de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-volume_attachments/c5042b5e-bc7e-4e18-be21-b73f4d008330" status: 202 len: 0 microversion: 2.1 time: 0.513566 Oct 28 13:27:56.360307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2509/4920] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:27:55 2022] DELETE /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-volume_attachments/c5042b5e-bc7e-4e18-be21-b73f4d008330 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:27:56.513016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:56.513629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:56.526655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:56.531521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:56.532296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:56.533699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:56.535155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:56.536464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:56.711616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:56.712611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:56.729285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:56.734409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:56.737912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:56.738965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:56.739544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:56.741398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:56.841914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:56.862007 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-78e147b7-9914-452c-9b32-3f07d21e867f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.352293 Oct 28 13:27:56.873835 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2412/4921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:56 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:56.879113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:56.883410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:56.893160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:56.894941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:56.895710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:56.896682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:56.897370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:56.898080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:57.080366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:57.106523 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31499211-771d-45b4-ae17-fd889fc669a7 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1513 microversion: 2.1 time: 0.223953 Oct 28 13:27:57.106523 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2413/4922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:56 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:57.196829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:57.206444 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b9cda9c-1216-4c45-b9b0-83444b8ebcfb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.499217 Oct 28 13:27:57.232065 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2510/4923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:56 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:27:57.589838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-252fe75b-69c4-4c2c-8dbe-8d8f1a3c2f47 req-e6dd0b61-1574-44fc-872e-57a3cfbc5fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49aaf8ce-7f94-4845-adb9-c2157aa98218", "name": "network-vif-deleted", "tag": "ab3ae769-a5fe-454f-bd9c-3dbe23411c79"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:57.610287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-252fe75b-69c4-4c2c-8dbe-8d8f1a3c2f47 req-e6dd0b61-1574-44fc-872e-57a3cfbc5fa3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:57.617963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-252fe75b-69c4-4c2c-8dbe-8d8f1a3c2f47 req-e6dd0b61-1574-44fc-872e-57a3cfbc5fa3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:57.617963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-252fe75b-69c4-4c2c-8dbe-8d8f1a3c2f47 req-e6dd0b61-1574-44fc-872e-57a3cfbc5fa3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:57.641455 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-252fe75b-69c4-4c2c-8dbe-8d8f1a3c2f47 req-e6dd0b61-1574-44fc-872e-57a3cfbc5fa3 service nova] Creating event network-vif-deleted:ab3ae769-a5fe-454f-bd9c-3dbe23411c79 for instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 on n-h2-862876-2 Oct 28 13:27:57.647894 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-252fe75b-69c4-4c2c-8dbe-8d8f1a3c2f47 req-e6dd0b61-1574-44fc-872e-57a3cfbc5fa3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062853 Oct 28 13:27:57.649346 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2414/4924] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:57.889427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:57.890367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:57.903742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:57.908774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:57.908774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:57.908774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:57.908774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:57.908774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:58.130233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:58.131309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:58.145355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:58.146461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:58.148267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:58.155266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:58.155266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:58.155266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:58.224584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:58.225391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:58.226723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:58.227400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lazy-loading 'fault' on Instance uuid 49aaf8ce-7f94-4845-adb9-c2157aa98218 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:27:58.304026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:58.314248 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d5ce2de4-e338-4ac1-8909-83ca1396b0ec tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 200 len: 1308 microversion: 2.1 time: 0.188094 Oct 28 13:27:58.317922 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2415/4925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:58 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:58.339510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:58.340440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:58.352831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:58.357933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:58.358435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:58.358896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:58.359604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:58.360930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:58.361938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:58.362086 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c7b3d40a-3072-492a-863d-f841e3f8cb21 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.476199 Oct 28 13:27:58.375747 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2511/4926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:57 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:58.524432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:58.541527 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f05c4cf4-8fc3-4db5-a752-cad313bb4f81 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.219328 Oct 28 13:27:58.549961 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2416/4927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:58 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:59.343918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:59.345315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 49aaf8ce-7f94-4845-adb9-c2157aa98218] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:59.356607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:59.357341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:59.357982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:59.359070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:59.359865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:59.360554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:59.378882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] HTTP exception thrown: Instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 could not be found. Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Request method failure captured: Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 HTTP/1.1 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ffYAXIJZPBdWuu_ZqD4ldh3gXNKZ3DJcuCKTu2272FtIJmgUMedQi7GJDciD-hiwI3z4tq6vkH_zxLqX1dxa0dp2rPhZcz4TpK24H2qC0olAPxWyukZhlSx86VtORjsx3pYxLO-MLhbOC-VGFF1pImeT-E0Z5cuDFtsRGJc49A4w4 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: e30bb4edd8cc4eff88444ca688c4e862 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesSnapshotTestJSON-36614554 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e30bb4edd8cc4eff88444ca688c4e862"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e30bb4edd8cc4eff88444ca688c4e862"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e30bb4edd8cc4eff88444ca688c4e862", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e30bb4edd8cc4eff88444ca688c4e862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesSnapshotTestJSON-36614554 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: e30bb4edd8cc4eff88444ca688c4e862 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-36614554 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesSnapshotTestJSON-36614554-project Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 361c7be5f66a48e9b3b283d063b89ff3 Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesSnapshotTestJSON-36614554-project Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 could not be found. Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '49aaf8ce-7f94-4845-adb9-c2157aa98218'} Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 could not be found. Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 could not be found. Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:27:59.384763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:59.392509 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:27:59.392509 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:27:59.392509 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:27:59.392509 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:27:59.392509 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:27:59.392509 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 could not be found. Oct 28 13:27:59.392509 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:27:59.393145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:59.393145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:59.395759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Returning 404 to user: Instance 49aaf8ce-7f94-4845-adb9-c2157aa98218 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:27:59.397133 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25da5081-8755-4399-a23a-275692af75fd tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218" status: 404 len: 111 microversion: 2.1 time: 0.058469 Oct 28 13:27:59.398509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2512/4928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:59 2022] GET /compute/v2.1/servers/49aaf8ce-7f94-4845-adb9-c2157aa98218 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:27:59.400022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:59.412520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:59.412520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:59.412520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:59.412520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:59.412520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:59.567469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:27:59.568283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:27:59.581048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:59.581877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:59.582556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:59.583554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:59.584416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:59.585082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:59.675456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:59.692816 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa61055f-5cc8-4436-9a8d-bb09ce6d701c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.309596 Oct 28 13:27:59.694152 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2417/4929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:59 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:27:59.700051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c41a6d60-a15c-41d3-a363-586475b97ac0 req-76b48c8d-eb64-4b2d-aedc-6adae59de35a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cca2a5-5f69-420d-ba91-b69c4d3377bc", "tag": "c8409ddf-099c-49f3-8499-d429adfac2a0"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:27:59.730649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c41a6d60-a15c-41d3-a363-586475b97ac0 req-76b48c8d-eb64-4b2d-aedc-6adae59de35a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:27:59.736504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c41a6d60-a15c-41d3-a363-586475b97ac0 req-76b48c8d-eb64-4b2d-aedc-6adae59de35a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:27:59.744843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c41a6d60-a15c-41d3-a363-586475b97ac0 req-76b48c8d-eb64-4b2d-aedc-6adae59de35a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:27:59.778462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c41a6d60-a15c-41d3-a363-586475b97ac0 req-76b48c8d-eb64-4b2d-aedc-6adae59de35a service nova] Creating event network-changed:c8409ddf-099c-49f3-8499-d429adfac2a0 for instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc on n-h2-862876-2 Oct 28 13:27:59.795896 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c41a6d60-a15c-41d3-a363-586475b97ac0 req-76b48c8d-eb64-4b2d-aedc-6adae59de35a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098519 Oct 28 13:27:59.796538 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2418/4930] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:27:59.835455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:27:59.845241 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4ff18b32-43d9-4cda-b7ea-290924ef5d57 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.284088 Oct 28 13:27:59.846033 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2513/4931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:27:59 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:00.722332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:00.723275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:00.726841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:00.745203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:00.746823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:00.747546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:00.748454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:00.749227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:00.750096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:00.870060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:00.872623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:00.877564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:00.883638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:00.885055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:00.886009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:00.886935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:00.887939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:00.888571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:01.288906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:01.298572 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97e8e40f-bb58-4cac-8141-1e6f5226e5f2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.581289 Oct 28 13:28:01.301365 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2419/4932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:00 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:01.317653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:01.321703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:01.327361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c16379f-ad1e-43b9-8d49-7e2579aeaa06 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.462492 Oct 28 13:28:01.346835 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2514/4933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:00 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:02.322380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:02.323902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:02.339107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:02.339925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:02.341036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:02.344408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:02.345130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:02.348552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:02.351800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:02.352420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:02.365250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:02.371144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:02.371745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:02.372199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:02.372932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:02.373398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:02.378653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:02.643762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:02.656280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0afc0a63-412b-480c-85ac-eec9e7088c20 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.308180 Oct 28 13:28:02.656800 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2515/4934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:02 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:02.876112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:02.917644 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2567e859-8da3-4a43-a082-bf512fe91bd8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.599468 Oct 28 13:28:02.923451 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2420/4935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:02 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:03.683257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:03.689223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:03.693541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-350353d1-d695-45cc-8d10-cec1f8f68d53 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:03.703115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:03.705005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350353d1-d695-45cc-8d10-cec1f8f68d53 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:03.705752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:03.706203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350353d1-d695-45cc-8d10-cec1f8f68d53 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:03.706328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:03.706977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-350353d1-d695-45cc-8d10-cec1f8f68d53 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:03.708276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:03.710169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:03.713261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:03.739515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-350353d1-d695-45cc-8d10-cec1f8f68d53 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Going to try to stop instance {{(pid=127794) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:28:03.937164 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-350353d1-d695-45cc-8d10-cec1f8f68d53 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action" status: 202 len: 0 microversion: 2.1 time: 0.249790 Oct 28 13:28:03.937883 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2421/4936] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:28:03 2022] POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:28:03.949952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:03.950652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:03.966493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:03.967295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:03.967899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:03.968759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:03.969381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:03.969991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:03.974182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:03.987993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3dc65276-f0ac-48ba-b65e-a5fd7a7e6acf tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.309198 Oct 28 13:28:03.996400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2516/4937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:03 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:04.014696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:04.015867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:04.023019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:04.023780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:04.024395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:04.025930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:04.026625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:04.027258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:04.226417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:04.235034 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-104aedf2-36c9-4057-acbf-d21e7738712b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.291903 Oct 28 13:28:04.254065 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2422/4938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:03 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:04.389346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:04.399233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f1e514d-366a-4133-a9ba-a3acbd9df752 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.401467 Oct 28 13:28:04.401212 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2517/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:03 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:05.024333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:05.025150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:05.037367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:05.038189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:05.038963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:05.039963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:05.041123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:05.041854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:05.216210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:05.228463 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0a0bf739-6624-460d-8a25-9b539ec89ed1 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.208755 Oct 28 13:28:05.229471 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2423/4940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:05 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:05.263297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:05.267519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:05.287449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:05.288210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:05.288718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:05.289780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:05.290380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:05.291175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:05.424013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:05.424954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:05.438001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:05.438495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:05.438967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:05.439707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:05.440162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:05.440616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:05.468227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:05.606789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:05.612798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:05.615755 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e1294d5f-5609-4b7e-8ddf-f4d57496bc8c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.358617 Oct 28 13:28:05.620691 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2518/4941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:05 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:05.621973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-34b31b73-8943-4d1f-a210-2a0c6e804ee4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.202074 Oct 28 13:28:05.622546 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2424/4942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:05 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:06.256400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:06.257013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:06.263986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:06.264635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:06.266008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:06.267876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:06.268346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:06.268827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:06.288752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6cab3d98-11dd-4b88-aadd-d94e1874d821 req-0df54c1f-2740-4863-93d7-711ce43ed1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cca2a5-5f69-420d-ba91-b69c4d3377bc", "name": "network-vif-plugged", "status": "completed", "tag": "c8409ddf-099c-49f3-8499-d429adfac2a0"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:06.302925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6cab3d98-11dd-4b88-aadd-d94e1874d821 req-0df54c1f-2740-4863-93d7-711ce43ed1a0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:06.303786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6cab3d98-11dd-4b88-aadd-d94e1874d821 req-0df54c1f-2740-4863-93d7-711ce43ed1a0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:06.304438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6cab3d98-11dd-4b88-aadd-d94e1874d821 req-0df54c1f-2740-4863-93d7-711ce43ed1a0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:06.319436 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6cab3d98-11dd-4b88-aadd-d94e1874d821 req-0df54c1f-2740-4863-93d7-711ce43ed1a0 service nova] Creating event network-vif-plugged:c8409ddf-099c-49f3-8499-d429adfac2a0 for instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc on n-h2-862876-2 Oct 28 13:28:06.325871 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6cab3d98-11dd-4b88-aadd-d94e1874d821 req-0df54c1f-2740-4863-93d7-711ce43ed1a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043675 Oct 28 13:28:06.327290 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2425/4943] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:06.528348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:06.548641 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4fdc240b-357b-46fb-b172-a93b72166602 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.295756 Oct 28 13:28:06.550534 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2519/4944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:06 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:06.641259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:06.642246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:06.645571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:06.646495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:06.655001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:06.655850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:06.656535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:06.657343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:06.657850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:06.658271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:06.658399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:06.658831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:06.659242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:06.660112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:06.660580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:06.662989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:06.831436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:06.834444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:06.844729 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-571b3136-5c6b-4026-a9a8-641726661741 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.203558 Oct 28 13:28:06.861148 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ce3906a-53b3-4fcc-8931-06c373a27de6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.209844 Oct 28 13:28:06.861148 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2426/4945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:06 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:06.865766 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2520/4946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:06 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:07.573771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:07.575089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:07.583210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:07.583944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:07.584549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:07.585586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:07.586583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:07.589664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:07.773150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:07.786400 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c02e3699-b0e2-4940-8add-372a22149030 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1324 microversion: 2.1 time: 0.216960 Oct 28 13:28:07.787664 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2427/4947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:07 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1324 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:07.870064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:07.870888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:07.882728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:07.883865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:07.895364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:07.896293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:07.897295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:07.897665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:07.898366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:07.899418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:07.900037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:07.900673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:07.901534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:07.902080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:07.902701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:07.905502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:08.184662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:08.195133 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-399e92e4-1c8f-4d06-8b73-fb546c360f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.329236 Oct 28 13:28:08.197598 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2521/4948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:07 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:08.247456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:08.255655 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a0c3374e-1786-4f5d-ac03-95a791c65e8f tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.377567 Oct 28 13:28:08.256932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2428/4949] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:07 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:08.815640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:08.816275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:08.834967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:08.835080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:08.835457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:08.836425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:08.837609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:08.838262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.071205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:09.079616 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cba48a3e-b40d-49b0-9d0e-e1cfc451294d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1521 microversion: 2.1 time: 0.268160 Oct 28 13:28:09.096210 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2522/4950] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:08 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:09.112291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:09.113058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:09.121327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.121826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.122361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.123137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.123629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.124058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.229705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:09.230713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:09.244515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.245324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.246119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.247093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.247753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.248372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.468409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:09.485499 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2fa36399-2ecb-482d-921e-e2c165198eab tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1521 microversion: 2.1 time: 0.377153 Oct 28 13:28:09.486187 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2429/4951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:09 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:09.508248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:09.515944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:09.516588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:09.534730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.537077 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b535d5b1-fea1-4307-8625-a1ed4cdb5c3e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.316934 Oct 28 13:28:09.540240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.542371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.543442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.548868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.551325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.567077 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2523/4952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:09 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:09.582123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-285949289"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:09.586057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:09.596131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.596893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.597681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.598688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:09.599203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:09.599804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:09.788275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:09.796224 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d3ae282-3b54-44c3-8a0b-a6444232613d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.284265 Oct 28 13:28:09.796795 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2430/4953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:09 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:10.067142 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cd78e029-c334-4b2a-a98a-527a44d36255 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc/action" status: 202 len: 0 microversion: 2.1 time: 0.498552 Oct 28 13:28:10.073598 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2524/4954] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:28:09 2022] POST /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:28:10.078865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75e6671a-2bdc-4764-bf29-b214f8153424 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '.version_select at 0x7f27b854d550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:10.444775 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75e6671a-2bdc-4764-bf29-b214f8153424 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6" status: 204 len: 0 microversion: 2.1 time: 0.369880 Oct 28 13:28:10.446237 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2431/4955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:10 2022] DELETE /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:10.456370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4bb85aeb-cdf6-49b3-a569-4202f1275f9f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '.version_select at 0x7f27b8dc59d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:10.481988 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-4bb85aeb-cdf6-49b3-a569-4202f1275f9f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Image not found. Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4bb85aeb-cdf6-49b3-a569-4202f1275f9f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6 HTTP/1.1 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1552520a-a68a-4302-aa94-8be520c58be6'} Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1552520a-a68a-4302-aa94-8be520c58be6 Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 13:28:10.486923 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1552520a-a68a-4302-aa94-8be520c58be6 could not be found. Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4bb85aeb-cdf6-49b3-a569-4202f1275f9f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4bb85aeb-cdf6-49b3-a569-4202f1275f9f tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6" status: 404 len: 62 microversion: 2.1 time: 0.033816 Oct 28 13:28:10.491715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2525/4956] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Oct 28 13:28:10 2022] GET /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:28:10.497100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:10.497100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:10.512222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:10.512849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:10.513163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:10.513897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:10.514352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:10.514808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:10.568616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:10.570969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:10.580852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:10.581739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:10.582408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:10.583758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:10.584660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:10.585466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:10.812959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:10.822635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e6adf38d-1d81-46ce-b73d-76c4d82e7a60 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.260863 Oct 28 13:28:10.823122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:10.830208 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2526/4957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:10 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:10.830208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1284628952", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "b8809e1a-7408-486a-8fe6-467899e363d2"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:10.832612 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-308af77d-3553-4396-9bcf-9c5bf7c1507e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1533 microversion: 2.1 time: 0.341763 Oct 28 13:28:10.833606 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2432/4958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:10 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1533 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:10.840686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:10.842534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:10.849083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:10.849788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:10.851032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:10.851740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:10.852196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:10.852657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:10.916288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] validate_networks() for [('b8809e1a-7408-486a-8fe6-467899e363d2', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:28:11.028113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:11.042053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-090ffc8b-a966-4aef-a94d-f7701d389ee8 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.207039 Oct 28 13:28:11.044293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2433/4959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:10 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:11.875403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:11.875403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:11.878517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:11.879452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:11.880117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:11.881322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:11.882203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:11.882998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:11.953581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:28:11.954805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:28:11.955307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:28:11.955776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:28:11.956793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:28:11.979147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:11.979683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:11.980423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:11.981608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:11.982572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:11.983243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:12.013280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Getting quotas for project e30bb4edd8cc4eff88444ca688c4e862. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:12.020864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Getting quotas for user 361c7be5f66a48e9b3b283d063b89ff3 and project e30bb4edd8cc4eff88444ca688c4e862. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:12.036872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:28:12.054948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:28:12.055292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:12.072268 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88246c55-0110-4c32-ad4a-d35b0441186f tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.210303 Oct 28 13:28:12.072866 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2434/4960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:11 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:12.079167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:12.080101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:12.087427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:12.087927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:12.088502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:12.089216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:12.089671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:12.090095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:12.228532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:12.236266 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1ac840e-a923-47d5-93c6-532741f0a48a tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1539 microversion: 2.1 time: 0.161610 Oct 28 13:28:12.236836 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2435/4961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:12 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1539 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:12.250183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:12.250919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:12.257208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:12.257731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:12.258167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:12.258877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:12.259328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:12.259747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:12.397862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:12.406060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a8e0fd5-a393-4292-9835-5c92d968a347 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.161739 Oct 28 13:28:12.409862 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2436/4962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:12 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:12.481866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-30113e1e-a7d5-475c-8e76-df7c2811f9de tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657055 Oct 28 13:28:12.483015 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2527/4963] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:28:12.496227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c86f2574-1c85-49e1-bb18-715ca5d657aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:12.497019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c86f2574-1c85-49e1-bb18-715ca5d657aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:12.620251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c86f2574-1c85-49e1-bb18-715ca5d657aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:12.629647 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c86f2574-1c85-49e1-bb18-715ca5d657aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1219 microversion: 2.1 time: 0.138946 Oct 28 13:28:12.648260 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2437/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:12 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:13.097381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:13.097977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:13.105860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.106346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.106795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.107482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.107936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.108645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.265596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:13.266708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:13.275184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:13.277303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:13.285569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.286181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.286635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.288414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.288703 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e840961-7656-4b09-9d91-6d7af131d457 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.196208 Oct 28 13:28:13.289316 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2528/4965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:13 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:13.291268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.292233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.441168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:13.443091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:13.459916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:13.463319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:13.468197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.470554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.475359 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5213e25-669b-470e-83f5-5e90be2e6624 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1539 microversion: 2.1 time: 0.215430 Oct 28 13:28:13.475359 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2438/4966] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:13 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1539 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:13.477672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.483108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.484195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.484900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.671595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:13.672218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:13.678565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.679434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.680303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.681799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:13.682736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:13.683363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:13.705203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:13.714001 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-929b30a3-0ed0-4bcf-9a6b-45c08b9b63ec tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.284355 Oct 28 13:28:13.725038 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2529/4967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:13 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:13.768662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:13.778265 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8639592-37f0-4dc8-93bc-ce015e7c85c4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1223 microversion: 2.1 time: 0.117018 Oct 28 13:28:13.783560 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2439/4968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:13 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1223 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:14.315404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:14.316310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:14.333510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.334705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.338684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.339946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.342290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.344291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.511467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:14.513013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:14.536508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.542450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.545615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.548031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.553233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.553233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.658899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:14.672684 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3a129d03-1654-4ec5-b1b8-f6a4f0627682 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1679 microversion: 2.1 time: 0.362272 Oct 28 13:28:14.673522 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2530/4969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:14 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1679 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:14.737806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:14.743382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:14.766649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.766649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.769752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.770629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.773953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.775197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.836542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:14.854682 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a445bff-57b4-4b4e-8b55-413e1231815e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1521 microversion: 2.1 time: 0.353018 Oct 28 13:28:14.858970 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2440/4970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:14 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:14.866409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:14.867102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:14.876312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.877496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.878150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.879259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:14.879882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:14.880480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:14.972835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:14.988991 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-70a26ebe-64ed-4e9f-bd7b-523721a45128 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1271 microversion: 2.1 time: 0.128680 Oct 28 13:28:14.989916 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2441/4971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:14 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:14.997419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:14.998205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:15.005946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:15.011552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:15.013009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:15.015008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:15.016132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:15.022417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:15.097884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:15.109600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:15.114186 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-21d6fcfc-a8eb-41d0-b3c0-40302ef6b8b4 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1506 microversion: 2.1 time: 0.380522 Oct 28 13:28:15.115487 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2531/4972] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:14 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:15.435571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:28:15.483425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:15.698015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:15.701127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:15.711119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:15.712077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:15.712839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:15.713894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:15.714632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:15.715400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:16.180141 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d035dfad-2990-4ea3-addc-ac1d821970dd tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 204 len: 0 microversion: 2.1 time: 1.188678 Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2442/4973] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:28:14 2022] DELETE /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 0 bytes in 1191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca5c0459-e8fe-46fb-b18f-454617c8e25d tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1277 microversion: 2.1 time: 0.095041 Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2443/4974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:16 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:16.388925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:16.389989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:16.389989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:16.389989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:16.389989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:16.389989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:16.389989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:16.389989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:16.879979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:16.897502 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dfeb1b0b-6a80-4ed7-a553-e7a22737ef85 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1486 microversion: 2.1 time: 0.616827 Oct 28 13:28:16.901317 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2444/4975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:16 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1486 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:16.909548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:16.910439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:16.927284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:16.927284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:16.927284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:16.927284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:16.927284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:16.927284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:16.991993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:17.001815 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf9e5b44-2090-4048-817e-fab908039f54 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1656 microversion: 2.1 time: 1.309232 Oct 28 13:28:17.018934 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2532/4976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:15 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1656 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:17.031713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-766263666", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:17.120814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] validate_networks() for [('0bc54d61-9bd5-4664-8083-b5c3c2dc6d64', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:28:17.153713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:17.166102 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83ba813e-f21c-4303-b791-09d62987c23b tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1527 microversion: 2.1 time: 0.263218 Oct 28 13:28:17.167008 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2445/4977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:16 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1527 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:17.172381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4dc28bc9-b70b-42b2-8fa3-71194ea0ddb7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:17.203078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc28bc9-b70b-42b2-8fa3-71194ea0ddb7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:17.203776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc28bc9-b70b-42b2-8fa3-71194ea0ddb7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:17.204489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc28bc9-b70b-42b2-8fa3-71194ea0ddb7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:17.241677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4dc28bc9-b70b-42b2-8fa3-71194ea0ddb7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Going to try to start instance {{(pid=127794) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 13:28:17.724350 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4dc28bc9-b70b-42b2-8fa3-71194ea0ddb7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action" status: 202 len: 0 microversion: 2.1 time: 0.555895 Oct 28 13:28:17.725690 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2446/4978] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:28:17 2022] POST /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:28:17.738815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:17.739807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:17.747314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:17.748391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:17.749154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:17.750421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:17.751106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:17.752112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:17.849809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:17.862087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6b553358-e2a7-4f6c-84cd-c5862442571e tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1277 microversion: 2.1 time: 0.134739 Oct 28 13:28:17.870578 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2447/4979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:17 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:17.995997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d6aaec46-3a3d-40c0-a733-346a5e522ffc req-7142bfe3-2bca-4708-94ff-7bd7f2b9a455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cca2a5-5f69-420d-ba91-b69c4d3377bc", "name": "network-vif-plugged", "status": "completed", "tag": "c8409ddf-099c-49f3-8499-d429adfac2a0"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:18.007581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d6aaec46-3a3d-40c0-a733-346a5e522ffc req-7142bfe3-2bca-4708-94ff-7bd7f2b9a455 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.008304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d6aaec46-3a3d-40c0-a733-346a5e522ffc req-7142bfe3-2bca-4708-94ff-7bd7f2b9a455 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.008932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d6aaec46-3a3d-40c0-a733-346a5e522ffc req-7142bfe3-2bca-4708-94ff-7bd7f2b9a455 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.026005 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d6aaec46-3a3d-40c0-a733-346a5e522ffc req-7142bfe3-2bca-4708-94ff-7bd7f2b9a455 service nova] Creating event network-vif-plugged:c8409ddf-099c-49f3-8499-d429adfac2a0 for instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc on n-h2-862876-2 Oct 28 13:28:18.032673 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d6aaec46-3a3d-40c0-a733-346a5e522ffc req-7142bfe3-2bca-4708-94ff-7bd7f2b9a455 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167545 Oct 28 13:28:18.043331 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2448/4980] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:18.064175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:18.074526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:18.088218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.088724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.090770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.095766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.095766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.095766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.132369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:28:18.133012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:28:18.133500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:28:18.134670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:28:18.135325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:28:18.162711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.166003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.166893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.168083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.171043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.172909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.230734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Getting quotas for project 8733a0175cf84af98014b171e14f5d19. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:18.241769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Getting quotas for user d5b5dc7dd91a4c16b7ebdd22957a28eb and project 8733a0175cf84af98014b171e14f5d19. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:18.263745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:28:18.266211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:28:18.425271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:18.441234 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8a1f18d-1b27-4f0a-8440-6df8c484a8df tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1665 microversion: 2.1 time: 0.389880 Oct 28 13:28:18.446789 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2449/4981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:18 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1665 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:18.450368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:18.451019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:18.469509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.470027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.470498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.471262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.471729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.472349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.565857 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82564049-3436-4635-896b-4552eea8a786 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.545149 Oct 28 13:28:18.574773 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2533/4982] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:28:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:28:18.609211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-308f654a-cd11-408e-9356-a4d81816882e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:18.609839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-308f654a-cd11-408e-9356-a4d81816882e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:18.731920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-308f654a-cd11-408e-9356-a4d81816882e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:18.740336 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-308f654a-cd11-408e-9356-a4d81816882e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1213 microversion: 2.1 time: 0.140988 Oct 28 13:28:18.744010 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2534/4983] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:18 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:18.890402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:18.891153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:18.900774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.910436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.910436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.910436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:18.910436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:18.910436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:18.944522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:18.955988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc77b0fe-963d-403b-bbed-4033d4d899a4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1527 microversion: 2.1 time: 0.512141 Oct 28 13:28:18.960955 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2450/4984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:18 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1527 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:19.467135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:19.467794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:19.480785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:19.485863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:19.485863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:19.485863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:19.485863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:19.485863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:19.485863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:19.495167 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eae35205-3759-4690-89f2-eba04ad82468 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.609406 Oct 28 13:28:19.502944 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2535/4985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:18 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:19.766774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b3d8763e-67cf-4a1f-bcd9-535409c1eaf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:19.768152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b3d8763e-67cf-4a1f-bcd9-535409c1eaf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:19.905382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b3d8763e-67cf-4a1f-bcd9-535409c1eaf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:19.922753 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b3d8763e-67cf-4a1f-bcd9-535409c1eaf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1213 microversion: 2.1 time: 0.160480 Oct 28 13:28:19.923496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2536/4986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:19 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:19.948517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-af8ae336-ad43-47a2-aa80-9e1c30f6134e req-b980a781-baa5-4d7f-b8a4-aee773962738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cca2a5-5f69-420d-ba91-b69c4d3377bc", "name": "network-vif-deleted", "tag": "c8409ddf-099c-49f3-8499-d429adfac2a0"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:19.963780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af8ae336-ad43-47a2-aa80-9e1c30f6134e req-b980a781-baa5-4d7f-b8a4-aee773962738 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:19.964663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af8ae336-ad43-47a2-aa80-9e1c30f6134e req-b980a781-baa5-4d7f-b8a4-aee773962738 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:19.965455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af8ae336-ad43-47a2-aa80-9e1c30f6134e req-b980a781-baa5-4d7f-b8a4-aee773962738 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:19.990877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-af8ae336-ad43-47a2-aa80-9e1c30f6134e req-b980a781-baa5-4d7f-b8a4-aee773962738 service nova] Creating event network-vif-deleted:c8409ddf-099c-49f3-8499-d429adfac2a0 for instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc on n-h2-862876-2 Oct 28 13:28:19.999094 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-af8ae336-ad43-47a2-aa80-9e1c30f6134e req-b980a781-baa5-4d7f-b8a4-aee773962738 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057343 Oct 28 13:28:20.000182 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2537/4987] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:20.007639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:20.009250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:20.020119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:20.021033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:20.021714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:20.022679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:20.023437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:20.024272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:20.143885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:20.154519 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c5ace383-1448-4a91-ba68-8adc2118235b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1665 microversion: 2.1 time: 0.691323 Oct 28 13:28:20.178501 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2451/4988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:19 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1665 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:20.212477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bbd42fe6-1f67-42a0-9ad1-90105e635f9a req-9df646d1-0ed2-4b65-b526-13b1c19ca533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cca2a5-5f69-420d-ba91-b69c4d3377bc", "name": "network-vif-unplugged", "status": "completed", "tag": "c8409ddf-099c-49f3-8499-d429adfac2a0"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:20.240558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbd42fe6-1f67-42a0-9ad1-90105e635f9a req-9df646d1-0ed2-4b65-b526-13b1c19ca533 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:20.242255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbd42fe6-1f67-42a0-9ad1-90105e635f9a req-9df646d1-0ed2-4b65-b526-13b1c19ca533 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:20.244052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbd42fe6-1f67-42a0-9ad1-90105e635f9a req-9df646d1-0ed2-4b65-b526-13b1c19ca533 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:20.272579 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bbd42fe6-1f67-42a0-9ad1-90105e635f9a req-9df646d1-0ed2-4b65-b526-13b1c19ca533 service nova] Creating event network-vif-unplugged:c8409ddf-099c-49f3-8499-d429adfac2a0 for instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc on n-h2-862876-2 Oct 28 13:28:20.285477 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bbd42fe6-1f67-42a0-9ad1-90105e635f9a req-9df646d1-0ed2-4b65-b526-13b1c19ca533 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082708 Oct 28 13:28:20.287083 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2452/4989] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:20.518407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:20.519190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:20.528937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:20.528937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:20.528937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:20.528937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:20.528937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:20.528937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:20.674848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:20.684310 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e3bddcdc-34dc-4ea3-b402-32aab39cffe4 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 200 len: 1485 microversion: 2.1 time: 0.682271 Oct 28 13:28:20.686797 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2538/4990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:20 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 1485 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:20.886000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:20.898737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0456c17c-c4e4-4f83-b00c-bf32f55e863f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.384780 Oct 28 13:28:20.900202 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2453/4991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:20 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:20.952713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:20.958677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:20.960941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:20.962239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:20.962946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:20.963877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:20.964544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:20.965198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:21.037980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:21.046589 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1dd6a364-0355-4928-981a-f2f85de8c9cd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1209 microversion: 2.1 time: 0.097725 Oct 28 13:28:21.047292 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2539/4992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:20 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:21.182035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:21.185735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:21.189380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:21.189876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:21.190311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:21.191036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:21.191792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:21.192463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:21.376551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:21.387324 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4d76a385-4727-411f-abbb-fc7fdcbd78cb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1669 microversion: 2.1 time: 0.209179 Oct 28 13:28:21.388156 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2454/4993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:21 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:21.710449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:21.720956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:21.735054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:21.735601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:21.736198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:21.736907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:21.737366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:21.737795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:21.756458 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc HTTP/1.1 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '62cca2a5-5f69-420d-ba91-b69c4d3377bc'} Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:21.758216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:21.767584 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ee4ff53-9875-4038-a124-7c9e5f465785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 404 len: 111 microversion: 2.1 time: 0.054718 Oct 28 13:28:21.770322 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2540/4994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:21 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:28:21.817706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2003004384", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:21.881168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] validate_networks() for [('727caa2f-1923-4abe-bb0d-e565fc619d13', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:28:21.926031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:21.927039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:21.942975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:21.943750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:21.944724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:21.947737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:21.958255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:21.958903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:22.342145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:22.351279 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce3ddd06-f176-468e-8b0e-3480edda6a34 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.430213 Oct 28 13:28:22.360103 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2541/4995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:21 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:22.366289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d37934f7-6a68-466e-b56d-95ba6be1ae6b req-23e54495-2ff9-45b1-a91e-b0a646cca014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce6f3ae-73cd-4bdd-a049-388d4fbaf081", "tag": "6e3635df-3e4c-49cf-9b14-e4f038148ba2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:22.385330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d37934f7-6a68-466e-b56d-95ba6be1ae6b req-23e54495-2ff9-45b1-a91e-b0a646cca014 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:22.387067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d37934f7-6a68-466e-b56d-95ba6be1ae6b req-23e54495-2ff9-45b1-a91e-b0a646cca014 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:22.395004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d37934f7-6a68-466e-b56d-95ba6be1ae6b req-23e54495-2ff9-45b1-a91e-b0a646cca014 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:22.412938 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d37934f7-6a68-466e-b56d-95ba6be1ae6b req-23e54495-2ff9-45b1-a91e-b0a646cca014 service nova] Creating event network-changed:6e3635df-3e4c-49cf-9b14-e4f038148ba2 for instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 on n-h2-862876-2 Oct 28 13:28:22.419113 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d37934f7-6a68-466e-b56d-95ba6be1ae6b req-23e54495-2ff9-45b1-a91e-b0a646cca014 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057369 Oct 28 13:28:22.420376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2542/4996] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:22.427662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:22.428706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:22.436263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:22.436862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:22.437407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:22.438260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:22.439706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:22.440962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:22.562792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:22.583376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-baac9857-d307-442f-a318-81ea594d24fb tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1273 microversion: 2.1 time: 0.160811 Oct 28 13:28:22.584187 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2543/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:22 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:22.605559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:28:22.605559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:28:22.605559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:28:22.606214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:28:22.606729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:28:22.616929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:22.618985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:22.619538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:22.620378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:22.621094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:22.621622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:22.639442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for project 207bb29d0b79413097cfed319c0eae7a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:22.645487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Getting quotas for user 4141fc4731c24c00af71839c6594e659 and project 207bb29d0b79413097cfed319c0eae7a. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:22.659306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:28:22.663504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:28:22.851295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60890e15-c437-4b4e-bb86-e22e8b0c5d40 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.037596 Oct 28 13:28:22.857359 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2455/4998] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:28:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:28:22.863621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88254092-ec1f-4482-abb8-abae5d2669e3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:22.864234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88254092-ec1f-4482-abb8-abae5d2669e3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:22.952618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88254092-ec1f-4482-abb8-abae5d2669e3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:22.963169 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88254092-ec1f-4482-abb8-abae5d2669e3 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1225 microversion: 2.1 time: 0.103384 Oct 28 13:28:22.965099 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2544/4999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:22 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:23.380857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:23.381392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:23.388667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:23.392330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:23.392330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:23.392330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:23.392330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:23.392330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:23.613552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:23.616455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:23.629025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:23.629526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:23.631990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:23.632911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:23.636039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:23.636664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:23.799385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:23.809665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dc95d75c-5098-49ba-8e26-aba2c659cfb4 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.432925 Oct 28 13:28:23.819933 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2456/5000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:23 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:23.918310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:23.934541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f89cc32-a249-4499-b7a2-45f8a2528014 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1325 microversion: 2.1 time: 0.325093 Oct 28 13:28:23.945039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2545/5001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:23 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:23.988900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6e567fc-b061-426c-97e6-d1daaab7707c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:23.989727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a6e567fc-b061-426c-97e6-d1daaab7707c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:24.047873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6e567fc-b061-426c-97e6-d1daaab7707c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:24.055461 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6e567fc-b061-426c-97e6-d1daaab7707c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1225 microversion: 2.1 time: 0.070780 Oct 28 13:28:24.056042 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2457/5002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:23 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1225 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:24.838817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:24.839980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:24.851653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:24.852949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:24.854207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:24.855173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:24.856245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:24.857037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:24.959297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:24.960311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:24.971477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:24.972519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:24.973223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:24.974009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:24.974716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:24.975291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:25.078581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:25.090128 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-155ea7fd-ba3c-4d5f-945a-763f80e980e2 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.259348 Oct 28 13:28:25.110885 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2546/5003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:24 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:25.116801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:25.117670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:25.126257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:25.127129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:25.139099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:25.140253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:25.146969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:25.149833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:25.218128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:25.229177 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d1f8cb80-b7d7-4c0f-b21a-854d78539dc0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1313 microversion: 2.1 time: 0.274869 Oct 28 13:28:25.246014 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2458/5004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:24 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:25.271988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:25.275288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-843bc317-f1f3-4b66-a2bb-eb9386ac4ce0 req-6e880a1e-3ac5-4360-916a-5f791bcbd04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2456e54-3c35-4ef1-b4cf-5b9440bb06a4", "tag": "1ab80ad2-d338-4da0-ba7c-e2ae6f9906fb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:25.292444 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d9a6fca-45ce-44ae-a5cd-67d2de213785 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1221 microversion: 2.1 time: 0.180344 Oct 28 13:28:25.293345 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2547/5005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:25 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:25.296803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-843bc317-f1f3-4b66-a2bb-eb9386ac4ce0 req-6e880a1e-3ac5-4360-916a-5f791bcbd04d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:25.297619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-843bc317-f1f3-4b66-a2bb-eb9386ac4ce0 req-6e880a1e-3ac5-4360-916a-5f791bcbd04d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:25.298297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-843bc317-f1f3-4b66-a2bb-eb9386ac4ce0 req-6e880a1e-3ac5-4360-916a-5f791bcbd04d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:25.312871 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-843bc317-f1f3-4b66-a2bb-eb9386ac4ce0 req-6e880a1e-3ac5-4360-916a-5f791bcbd04d service nova] Creating event network-changed:1ab80ad2-d338-4da0-ba7c-e2ae6f9906fb for instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 on n-h2-862876-2 Oct 28 13:28:25.320568 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-843bc317-f1f3-4b66-a2bb-eb9386ac4ce0 req-6e880a1e-3ac5-4360-916a-5f791bcbd04d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050774 Oct 28 13:28:25.335216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2459/5006] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:28:26.119722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:26.120346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:26.127900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:26.128396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:26.128831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:26.129526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:26.130164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:26.130590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:26.264161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:26.265096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:26.273144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:26.274049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:26.274847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:26.275884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:26.276397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:26.277058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:26.387284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:26.405016 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d127ebf4-2e0b-43d6-95bd-3ef1a5d62276 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.288348 Oct 28 13:28:26.409886 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2548/5007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:26 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:26.427260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:26.429963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:26.457683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:26.458244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:26.458986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:26.460290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:26.460759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:26.461190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:26.499338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:26.507969 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf9f48ff-2fa1-4cc2-a081-d99223f22dd7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1313 microversion: 2.1 time: 0.256342 Oct 28 13:28:26.509459 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2460/5008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:26 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:26.560476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:26.570188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-730915fa-77b7-4f75-9a00-2d66bcca2deb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1285 microversion: 2.1 time: 0.158870 Oct 28 13:28:26.574912 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2549/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:26 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:27.432287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:27.433118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:27.440088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:27.440580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:27.441013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:27.441719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:27.442172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:27.442594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:27.458212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:27.566111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:27.576051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:27.588349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:27.594035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:27.597000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:27.597705 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a2de7c58-1e0f-42b5-813f-1c421cb6b587 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.169301 Oct 28 13:28:27.598325 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2461/5010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:27 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:27.603702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:27.604435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:27.607229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:27.608248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:27.611097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:27.611823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:27.612443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:27.613431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:27.613779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:27.614225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:27.614442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:27.615069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:27.773853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:27.783583 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26d8dbf1-b24d-4d99-b493-90773e993ad9 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1337 microversion: 2.1 time: 0.184117 Oct 28 13:28:27.787195 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2462/5011] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:27 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1337 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:28.016493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:28.037744 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-90aae707-9c52-457d-937d-470b45056937 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1313 microversion: 2.1 time: 0.494131 Oct 28 13:28:28.038987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2550/5012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:27 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:28.340755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-48c9c77d-727d-4340-8eff-c052d1e5e5a4 req-c65372d5-8b56-4db9-86e8-cb23d6cbfd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce6f3ae-73cd-4bdd-a049-388d4fbaf081", "name": "network-vif-plugged", "status": "completed", "tag": "6e3635df-3e4c-49cf-9b14-e4f038148ba2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:28.357078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-48c9c77d-727d-4340-8eff-c052d1e5e5a4 req-c65372d5-8b56-4db9-86e8-cb23d6cbfd2a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:28.357565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-48c9c77d-727d-4340-8eff-c052d1e5e5a4 req-c65372d5-8b56-4db9-86e8-cb23d6cbfd2a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:28.360119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-48c9c77d-727d-4340-8eff-c052d1e5e5a4 req-c65372d5-8b56-4db9-86e8-cb23d6cbfd2a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:28.379069 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-48c9c77d-727d-4340-8eff-c052d1e5e5a4 req-c65372d5-8b56-4db9-86e8-cb23d6cbfd2a service nova] Creating event network-vif-plugged:6e3635df-3e4c-49cf-9b14-e4f038148ba2 for instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 on n-h2-862876-2 Oct 28 13:28:28.385460 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-48c9c77d-727d-4340-8eff-c052d1e5e5a4 req-c65372d5-8b56-4db9-86e8-cb23d6cbfd2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049660 Oct 28 13:28:28.386388 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2463/5013] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:28.625310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:28.626232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:28.628716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:28.635346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:28.636222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:28.636776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:28.637603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:28.638137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:28.638570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:28.813525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:28.818831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:28.820949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:28.829811 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ce0b80b-cedd-40c2-8eed-edea1c930351 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.205059 Oct 28 13:28:28.833357 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2551/5014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:28 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:28.843883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:28.844383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:28.844823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:28.846066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:28.846539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:28.847007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:29.062150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:29.063423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:29.072183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:29.072778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:29.080229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:29.080229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:29.080229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:29.080229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:29.130386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:29.144481 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-506bc501-0e56-4d82-b54b-e048b8fffdc6 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.339736 Oct 28 13:28:29.155626 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2464/5015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:28 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:29.314013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:29.333433 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9e9d61b1-2049-498a-94fa-39c6ba0ea27e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1313 microversion: 2.1 time: 0.275540 Oct 28 13:28:29.335272 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2552/5016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:29 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:29.437958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3ee23af2-a1be-435e-9780-56b2afd721ed req-ea4ca920-9341-43c5-94cc-63ff1a5f2065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be0b5b62-e492-44c7-be5a-676e2b65106e", "tag": "a0037e38-e43c-477c-bf20-17cd8cbf4917"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:29.451183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3ee23af2-a1be-435e-9780-56b2afd721ed req-ea4ca920-9341-43c5-94cc-63ff1a5f2065 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:29.451974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3ee23af2-a1be-435e-9780-56b2afd721ed req-ea4ca920-9341-43c5-94cc-63ff1a5f2065 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:29.452584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3ee23af2-a1be-435e-9780-56b2afd721ed req-ea4ca920-9341-43c5-94cc-63ff1a5f2065 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:29.466458 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3ee23af2-a1be-435e-9780-56b2afd721ed req-ea4ca920-9341-43c5-94cc-63ff1a5f2065 service nova] Creating event network-changed:a0037e38-e43c-477c-bf20-17cd8cbf4917 for instance be0b5b62-e492-44c7-be5a-676e2b65106e on n-h2-862876-2 Oct 28 13:28:29.475615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3ee23af2-a1be-435e-9780-56b2afd721ed req-ea4ca920-9341-43c5-94cc-63ff1a5f2065 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041591 Oct 28 13:28:29.477342 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2465/5017] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:29.861121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:29.862384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:29.871627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:29.874216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:29.875060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:29.876515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:29.877084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:29.877743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:30.143053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:30.154481 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe9a0fde-ea91-490e-84c8-002c57db74d5 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1319 microversion: 2.1 time: 0.298443 Oct 28 13:28:30.169732 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2553/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:29 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:30.178391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:30.179197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:30.187293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:30.197784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:30.197784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:30.197784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:30.197784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:30.197784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:30.358130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:30.362367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:30.365908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:30.366406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:30.367020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:30.368547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:30.369188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:30.369617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:30.374320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:30.462823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:30.478346 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d9929b9-b1f7-42ae-bb5c-f82f85ed8ca7 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.307272 Oct 28 13:28:30.480139 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2466/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:30 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:30.598719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:30.607543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06403019-dc40-48cd-9f62-d07dd4c9a195 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1313 microversion: 2.1 time: 0.253656 Oct 28 13:28:30.608435 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2554/5020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:30 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:31.177139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:31.177759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:31.184760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.185336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.185745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:31.186604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.187139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.187564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:31.324616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:31.333304 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f11ca12e-7807-44a3-b093-e84eb6d9cc6f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1508 microversion: 2.1 time: 0.160083 Oct 28 13:28:31.333872 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2467/5021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:31 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:31.370767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05408daf-648e-450a-9989-abdf8497ccc9", "device": "/dev/sdb"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:31.370767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:31.370767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.370767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.370767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:31.371874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.371874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.371874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:31.503754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:31.504740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:31.510991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.511488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.512196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:31.512956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.513387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.513810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:31.923311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:31.934790 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f7fa628d-35e6-4d1d-b99f-2f10a6eca677 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.434924 Oct 28 13:28:31.935387 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2468/5022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:31 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:31.939870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:31.940473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:31.946231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.946693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.947162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:31.947853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:31.948308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:31.948723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:32.115016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:32.132825 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b1115f50-bcc5-4883-8e89-6dd638ec563b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1313 microversion: 2.1 time: 0.188410 Oct 28 13:28:32.132825 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2469/5023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:31 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:32.369844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-11dae972-b1d5-4a7c-8f9b-da12ea49808d req-e758fa02-5598-4810-ab6a-808754743202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2456e54-3c35-4ef1-b4cf-5b9440bb06a4", "name": "network-vif-plugged", "status": "completed", "tag": "1ab80ad2-d338-4da0-ba7c-e2ae6f9906fb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:32.380861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-11dae972-b1d5-4a7c-8f9b-da12ea49808d req-e758fa02-5598-4810-ab6a-808754743202 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:32.381341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-11dae972-b1d5-4a7c-8f9b-da12ea49808d req-e758fa02-5598-4810-ab6a-808754743202 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:32.381771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-11dae972-b1d5-4a7c-8f9b-da12ea49808d req-e758fa02-5598-4810-ab6a-808754743202 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:32.396452 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-11dae972-b1d5-4a7c-8f9b-da12ea49808d req-e758fa02-5598-4810-ab6a-808754743202 service nova] Creating event network-vif-plugged:1ab80ad2-d338-4da0-ba7c-e2ae6f9906fb for instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 on n-h2-862876-2 Oct 28 13:28:32.399978 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-11dae972-b1d5-4a7c-8f9b-da12ea49808d req-e758fa02-5598-4810-ab6a-808754743202 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033801 Oct 28 13:28:32.400717 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2470/5024] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:28:32.770800 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6e492e0-562a-4575-bc58-d1734bc8fc4b tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "POST /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.414811 Oct 28 13:28:32.772796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2555/5025] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:28:31 2022] POST /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081/os-volume_attachments => generated 194 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:32.954867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:32.959391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:32.960143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:32.966357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:32.966924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:32.967370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:32.968069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:32.968527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:32.969040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:33.110565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:33.118514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dd328f80-b932-4583-adaa-bb5ddedecb4d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.164644 Oct 28 13:28:33.119101 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2471/5026] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:32 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:33.152210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:33.152997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:33.154979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=18 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:33.160614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:33.161109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:33.164144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:33.164144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:33.164144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:33.164144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:33.313380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:33.322540 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dfeb5f5b-c0d4-4b09-99ee-541476624229 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1313 microversion: 2.1 time: 0.175643 Oct 28 13:28:33.323149 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2556/5027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:33 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:34.144035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:34.144633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:34.158012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:34.171813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:34.171813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:34.171813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:34.171813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:34.171813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:34.171813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:34.346197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:34.352991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:34.360028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:34.360848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:34.361290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:34.362854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:34.363507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:34.363936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:34.454554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:34.464815 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f7b4cd8d-727e-4bc4-a57f-1cbe9ce54734 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.325942 Oct 28 13:28:34.470293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2472/5028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:34 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:34.569502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:34.578941 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ebf734b8-ef68-41aa-89fd-ae1e65da1b2d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1500 microversion: 2.1 time: 0.237374 Oct 28 13:28:34.579649 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2557/5029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:34 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1500 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:34.602931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:34.605209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:34.614419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:34.616161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:34.616161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:34.617010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:34.619083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:34.620266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:34.649816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lazy-loading 'flavor' on Instance uuid b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:28:35.055615 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0ed5d7a6-60c9-47de-a4ab-5806123cb9c9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "POST /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4/action" status: 200 len: 32 microversion: 2.1 time: 0.456041 Oct 28 13:28:35.056514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2473/5030] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:28:34 2022] POST /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4/action => generated 32 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:28:35.066088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:35.067007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:35.074079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:35.074578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:35.075087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:35.076003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:35.076463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:35.076891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:35.232971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:35.243996 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4ae36014-4bef-4382-a4d3-8206d7f7cb8d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.181823 Oct 28 13:28:35.246081 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2558/5031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:35 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:35.494183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:35.495535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:35.506476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:35.508637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:35.510411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:35.511671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:35.513978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:35.515406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:35.689571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:35.698828 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-818f17a4-47b2-4c88-b8d3-8cf787c21a13 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.208844 Oct 28 13:28:35.711047 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2474/5032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:35 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:36.270166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:36.271575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:36.279352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:36.280176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:36.280791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:36.282219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:36.283021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:36.283626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:36.465128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:36.481650 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40fe66ab-b0fb-4a22-a9fe-585cc9cc5bc1 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.216107 Oct 28 13:28:36.495426 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2559/5033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:36 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:36.608899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e633ba6d-0f71-4957-90aa-187219add581 req-9ecc8b28-a4c0-4a6d-b1b8-672d2ca89f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0b5b62-e492-44c7-be5a-676e2b65106e", "name": "network-vif-plugged", "status": "completed", "tag": "a0037e38-e43c-477c-bf20-17cd8cbf4917"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:36.630990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e633ba6d-0f71-4957-90aa-187219add581 req-9ecc8b28-a4c0-4a6d-b1b8-672d2ca89f7a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:36.631850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e633ba6d-0f71-4957-90aa-187219add581 req-9ecc8b28-a4c0-4a6d-b1b8-672d2ca89f7a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:36.633169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e633ba6d-0f71-4957-90aa-187219add581 req-9ecc8b28-a4c0-4a6d-b1b8-672d2ca89f7a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:36.651882 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e633ba6d-0f71-4957-90aa-187219add581 req-9ecc8b28-a4c0-4a6d-b1b8-672d2ca89f7a service nova] Creating event network-vif-plugged:a0037e38-e43c-477c-bf20-17cd8cbf4917 for instance be0b5b62-e492-44c7-be5a-676e2b65106e on n-h2-862876-2 Oct 28 13:28:36.657195 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e633ba6d-0f71-4957-90aa-187219add581 req-9ecc8b28-a4c0-4a6d-b1b8-672d2ca89f7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057329 Oct 28 13:28:36.658305 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2475/5034] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:36.724205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:36.724986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:36.735434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:36.735434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:36.735434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:36.735434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:36.736117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:36.736266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:36.972637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:36.985569 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d203db4c-e586-4cf0-837c-95b3d6f4c716 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.264977 Oct 28 13:28:36.985569 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2560/5035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:36 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:37.509760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:37.510852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:37.518929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:37.519731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:37.520401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:37.521191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:37.521723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:37.522225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:37.884884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:37.898456 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a8d67ae-8ac7-42e1-8c4f-0c9a566c6244 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.394067 Oct 28 13:28:37.903494 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2476/5036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:37 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:38.010556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:38.011142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:38.021401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:38.022194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:38.022837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:38.023816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:38.026337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:38.027051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:38.274213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:38.285411 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52342bfa-c758-4a14-8b3f-c24bd792d758 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1325 microversion: 2.1 time: 0.279850 Oct 28 13:28:38.286730 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2561/5037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:38 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1325 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:38.926126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:38.927154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:38.937928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:38.939718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:38.940216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:38.945084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:38.953689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:38.953689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:38.953689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:39.317566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:39.320304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:39.337910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:39.338685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:39.342378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:39.342378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:39.342378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:39.342378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:39.409990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:39.419794 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec471b9e-0045-42fa-8d34-d446eca82554 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.497400 Oct 28 13:28:39.427056 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2477/5038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:38 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:39.641858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:39.661422 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20e1fc67-344a-4c18-8791-912391297739 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1522 microversion: 2.1 time: 0.346311 Oct 28 13:28:39.661422 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2562/5039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:39 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:39.691026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:39.692512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:39.706249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:39.708043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:39.708806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:39.713348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:39.715430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:39.715958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:39.759115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:28:39.763881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:40.197356 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1974e2f5-5647-4601-a04c-61d1b0ae991e tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 204 len: 0 microversion: 2.1 time: 0.513630 Oct 28 13:28:40.202472 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2478/5040] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:28:39 2022] DELETE /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:40.209005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:40.209985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:40.217620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:40.218432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:40.219088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:40.220063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:40.220845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:40.221444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:40.421033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:40.430541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-05dc9e96-c3fa-455d-a0a8-b392f3be20eb tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1528 microversion: 2.1 time: 0.226419 Oct 28 13:28:40.431812 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2563/5041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:40 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1528 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:40.453013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:40.454038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:40.473501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:40.474313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:40.474958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:40.475871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:40.476505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:40.477724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:40.991324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:40.996569 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fe36d279-cc54-447a-b20d-0be1c5d47403 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.547735 Oct 28 13:28:40.997409 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2479/5042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:40 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:41.461753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:41.463731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:41.472469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:41.473197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:41.473816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:41.474699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:41.475893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:41.476504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:41.701548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:41.709572 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99b717bc-ce94-4bb9-9716-300006e24b96 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1528 microversion: 2.1 time: 0.253653 Oct 28 13:28:41.710172 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2564/5043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:41 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1528 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:42.022159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:42.022719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:42.043210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:42.044227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:42.044947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:42.046814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:42.047808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:42.048442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:42.338320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:42.349054 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a5a93f8-0d43-4a55-a321-52805872d6c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.331090 Oct 28 13:28:42.351913 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2480/5044] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:42 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:42.431573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f60fec42-223c-4cc6-ab79-95616a5f282f req-6d646baa-86b6-446c-89d2-f4282c35c4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0b5b62-e492-44c7-be5a-676e2b65106e", "name": "network-vif-deleted", "tag": "a0037e38-e43c-477c-bf20-17cd8cbf4917"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:42.441529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f60fec42-223c-4cc6-ab79-95616a5f282f req-6d646baa-86b6-446c-89d2-f4282c35c4ad service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:42.441960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f60fec42-223c-4cc6-ab79-95616a5f282f req-6d646baa-86b6-446c-89d2-f4282c35c4ad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:42.442600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f60fec42-223c-4cc6-ab79-95616a5f282f req-6d646baa-86b6-446c-89d2-f4282c35c4ad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:42.454724 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f60fec42-223c-4cc6-ab79-95616a5f282f req-6d646baa-86b6-446c-89d2-f4282c35c4ad service nova] Creating event network-vif-deleted:a0037e38-e43c-477c-bf20-17cd8cbf4917 for instance be0b5b62-e492-44c7-be5a-676e2b65106e on n-h2-862876-2 Oct 28 13:28:42.459524 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f60fec42-223c-4cc6-ab79-95616a5f282f req-6d646baa-86b6-446c-89d2-f4282c35c4ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201108 Oct 28 13:28:42.460120 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2565/5045] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:28:42.739394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:42.740273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:42.755193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:42.757542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:42.758861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:42.759904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:42.760602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:42.762068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:42.870543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4141fc4731c24c00af71839c6594e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207bb29d0b79413097cfed319c0eae7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:42.901721 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7ead6d95-38a1-4249-947c-666617d6a128 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 200 len: 1310 microversion: 2.1 time: 0.168009 Oct 28 13:28:42.911667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2481/5046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:42 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 1310 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:43.386392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:43.388325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:43.397121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:43.397644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:43.398080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:43.398862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:43.399316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:43.399743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:43.580748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:43.597882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2106cf63-1365-47ca-88b3-25e2e26e25f0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.219320 Oct 28 13:28:43.599093 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2566/5047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:43 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:43.937362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:43.938617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: be0b5b62-e492-44c7-be5a-676e2b65106e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:43.948013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:43.948748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:43.949375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:43.950276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:43.951605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:43.952419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:43.973264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Instance be0b5b62-e492-44c7-be5a-676e2b65106e could not be found. Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e HTTP/1.1 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance be0b5b62-e492-44c7-be5a-676e2b65106e could not be found. Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'be0b5b62-e492-44c7-be5a-676e2b65106e'} Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0b5b62-e492-44c7-be5a-676e2b65106e could not be found. Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0b5b62-e492-44c7-be5a-676e2b65106e could not be found. Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:43.975766 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0b5b62-e492-44c7-be5a-676e2b65106e could not be found. Oct 28 13:28:43.981907 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:43.983421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Instance be0b5b62-e492-44c7-be5a-676e2b65106e could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:43.984611 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bab675ed-20d9-4fe0-9d45-e61b4948d626 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e" status: 404 len: 111 microversion: 2.1 time: 0.055949 Oct 28 13:28:43.989183 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2482/5048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:43 2022] GET /compute/v2.1/servers/be0b5b62-e492-44c7-be5a-676e2b65106e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:28:43.995901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1efae171-0a0d-465e-9f9a-f51a15cadc2d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '.version_select at 0x7f27bd9e2af0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:44.025129 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1efae171-0a0d-465e-9f9a-f51a15cadc2d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Image not found. Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1efae171-0a0d-465e-9f9a-f51a15cadc2d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6 HTTP/1.1 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: exception: Image not found. Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1552520a-a68a-4302-aa94-8be520c58be6'} Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1552520a-a68a-4302-aa94-8be520c58be6 to delete Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1552520a-a68a-4302-aa94-8be520c58be6 could not be found. Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:44.027441 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:28:44.033807 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.038162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1efae171-0a0d-465e-9f9a-f51a15cadc2d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Image not found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:44.038162 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1efae171-0a0d-465e-9f9a-f51a15cadc2d tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6" status: 404 len: 62 microversion: 2.1 time: 0.047244 Oct 28 13:28:44.038764 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2567/5049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:43 2022] DELETE /compute/v2.1/images/1552520a-a68a-4302-aa94-8be520c58be6 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:28:44.046665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:44.047307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:44.053710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:44.054377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:44.055479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:44.056688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:44.057474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:44.058171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:44.074320 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc HTTP/1.1 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '62cca2a5-5f69-420d-ba91-b69c4d3377bc'} Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:28:44.076224 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.081583 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.083998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:44.085095 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6b2a377a-0aac-4b66-881e-9743ba86af19 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 404 len: 111 microversion: 2.1 time: 0.042912 Oct 28 13:28:44.089176 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2483/5050] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:28:44 2022] DELETE /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:28:44.097265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:44.097265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 62cca2a5-5f69-420d-ba91-b69c4d3377bc] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:44.102297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:44.102844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:44.103410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:44.104120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:44.104577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:44.105005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:44.120146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc HTTP/1.1 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '62cca2a5-5f69-420d-ba91-b69c4d3377bc'} Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.121789 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Instance 62cca2a5-5f69-420d-ba91-b69c4d3377bc could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fda42c9-0df6-44d6-ac02-da6742fb9c3c tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc" status: 404 len: 111 microversion: 2.1 time: 0.033175 Oct 28 13:28:44.128948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2568/5051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:44 2022] GET /compute/v2.1/servers/62cca2a5-5f69-420d-ba91-b69c4d3377bc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:28:44.134707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a12f832-77fe-49d3-872a-05d287bd8f48 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '.version_select at 0x7f27b85a83a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:44.203445 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a12f832-77fe-49d3-872a-05d287bd8f48 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307562389" status: 202 len: 0 microversion: 2.1 time: 0.074503 Oct 28 13:28:44.204045 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2484/5052] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:28:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307562389 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:28:44.623497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:44.624155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:44.632404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:44.632922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:44.633411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:44.634118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:44.634572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:44.635032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:44.927307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:44.939078 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8008c067-781d-4aef-bba3-8ce75152b260 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.320457 Oct 28 13:28:44.942112 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2569/5053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:44 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:45.329989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d889cf6-a170-437d-a13b-2bb7a417fbca tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '.version_select at 0x7f27b8af6040>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:45.355462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8d889cf6-a170-437d-a13b-2bb7a417fbca tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Image not found. Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d889cf6-a170-437d-a13b-2bb7a417fbca tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/images/d4e89b33-e8d0-4726-8702-ad511a7109a7 HTTP/1.1 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: exception: Image not found. Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'd4e89b33-e8d0-4726-8702-ad511a7109a7'} Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d4e89b33-e8d0-4726-8702-ad511a7109a7 to delete Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d4e89b33-e8d0-4726-8702-ad511a7109a7 could not be found. Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:45.358361 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d889cf6-a170-437d-a13b-2bb7a417fbca tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Image not found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8d889cf6-a170-437d-a13b-2bb7a417fbca tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/images/d4e89b33-e8d0-4726-8702-ad511a7109a7" status: 404 len: 62 microversion: 2.1 time: 0.035092 Oct 28 13:28:45.366413 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2485/5054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:45 2022] DELETE /compute/v2.1/images/d4e89b33-e8d0-4726-8702-ad511a7109a7 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:45.384191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:45.405634 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 HTTP/1.1 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '785451ce-363f-4121-a2bf-4fb67bd138c8'} Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:28:45.407216 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5966e2f-f570-49c6-bc33-5ef9f64777ac tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 404 len: 111 microversion: 2.1 time: 0.042596 Oct 28 13:28:45.412315 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2570/5055] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:28:45 2022] DELETE /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:28:45.417444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:45.418071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] [instance: 785451ce-363f-4121-a2bf-4fb67bd138c8] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:45.424727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:45.425226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:45.427813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:45.427813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:45.427813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:45.427813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:45.452542 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] HTTP exception thrown: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Request method failure captured: Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 HTTP/1.1 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9iq7D9WhMUsxYi_JSyPXksNKJrtnHQ83-tLx5MP0kRD7-vciudLFFkvoc3ac0TmPPwWha8jSnXZIpqtEib1fYMxUTpB97n0k4g0zNBO38z5e0XXoAY_R4LsSsyyCBXmKHpRdFr2ugKOfWJGPc6VBY_FqEPzkt07nU6y5u5K2o3wHjE Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_207bb29d0b79413097cfed319c0eae7a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/207bb29d0b79413097cfed319c0eae7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 207bb29d0b79413097cfed319c0eae7a Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-616711690 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4141fc4731c24c00af71839c6594e659 Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-616711690-project Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '785451ce-363f-4121-a2bf-4fb67bd138c8'} Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.454229 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. Oct 28 13:28:45.459581 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:28:45.461530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] Returning 404 to user: Instance 785451ce-363f-4121-a2bf-4fb67bd138c8 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:28:45.464504 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-032e8b94-d4cc-4ea7-a999-77359d48ad63 tempest-ImagesOneServerNegativeTestJSON-616711690 tempest-ImagesOneServerNegativeTestJSON-616711690-project] 10.222.0.25 "GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8" status: 404 len: 111 microversion: 2.1 time: 0.050969 Oct 28 13:28:45.468998 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2486/5056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:45 2022] GET /compute/v2.1/servers/785451ce-363f-4121-a2bf-4fb67bd138c8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:28:45.970117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:45.970860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:45.980133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:45.981060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:45.981509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:45.982296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:45.982781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:45.983231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:46.684855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:46.703878 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-df77dd8b-a674-4442-8491-5d6fd4d366c7 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.738171 Oct 28 13:28:46.707209 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2571/5057] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:45 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:47.734686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:47.734686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:47.743481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:47.743983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:47.744430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:47.745144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:47.745624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:47.746036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:48.062467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:48.072553 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-152d3507-d89f-453d-8ab8-5e57e78990dd tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.345001 Oct 28 13:28:48.073886 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2487/5058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:47 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:49.096606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:49.097303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:49.108554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:49.115597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:49.115597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:49.115597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:49.120282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:49.121313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:49.166521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:49.641591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:49.641591 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-143ee5a9-d04c-4c03-83bb-55ae9d77a94e tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.377874 Oct 28 13:28:49.641591 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2572/5059] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:49 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:50.494997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:50.497073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:50.507017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:50.507844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:50.508477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:50.510048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:50.510805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:50.511423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:50.753188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:50.789409 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dc9f7605-e58a-45dc-8e31-c86579ef0623 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.299089 Oct 28 13:28:50.794901 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2488/5060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:50 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:51.818166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:51.818935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:51.827317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:51.827808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:51.828240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:51.828930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:51.829380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:51.829901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:52.005227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:52.017888 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c1dcfc0-051d-4b82-8e98-a5aaeb2fd855 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.204186 Oct 28 13:28:52.018666 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2573/5061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:51 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:53.042998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:53.043634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:53.054827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:53.055673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:53.055760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:53.070870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:53.071707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:53.072345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:53.325939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:53.341209 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8d350940-95ff-4d36-b9de-812c83dcca07 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.301117 Oct 28 13:28:53.342098 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2489/5062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:53 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:53.936515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:53.939267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:53.956571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:53.957368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:53.958038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:53.958882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:53.959461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:53.959997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:53.999904 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b019739a-0dbf-4f1e-946b-a8a3a73a1923 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067337 Oct 28 13:28:54.000582 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2574/5063] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:28:53 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 13:28:54.070731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:54.071272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:54.078278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:54.079495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:54.079495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:54.080042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:54.080493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:54.080921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:54.113981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:28:54.551733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f6486029-b771-44c7-9606-2fe4168ba867 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 204 len: 0 microversion: 2.1 time: 0.484919 Oct 28 13:28:54.552497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2490/5064] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:28:54 2022] DELETE /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:54.558664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:54.559633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:54.582773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:54.583440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:54.583888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:54.584605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:54.588768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:54.590194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:54.592655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a42a1626-2e86-4818-99e5-d172c1de9539 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b93ce160>, body: {"keypair": {"name": "tempest-keypair-1532548061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp4fZlk0JQ8NwG2D2LAsG7NuifHk5IzTUzdB1PghoD/sikzxpvfsN5+nwKLmWEufR3lIIveiwspOYZUazHNS1Y0rip75JvY+au5H+F9K2NOrLRBxp1M7J40kmkIy/RBwg=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:54.629695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a42a1626-2e86-4818-99e5-d172c1de9539 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:54.641812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a42a1626-2e86-4818-99e5-d172c1de9539 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:54.783977 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a42a1626-2e86-4818-99e5-d172c1de9539 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.465060 Oct 28 13:28:54.785165 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2575/5065] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Oct 28 13:28:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 467 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 28 13:28:54.795349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:54.795973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:54.810956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:54.812195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:54.812896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:54.814174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:54.817096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:54.817590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:54.819486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:54.820753 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a8b41b36-cf39-45a5-a67a-b55c94ec5d18 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.266443 Oct 28 13:28:54.821355 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2491/5066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:54 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:54.826574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5dfec5da-9520-4e6d-a392-9330e819c7cd tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b8521550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:54.835960 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5dfec5da-9520-4e6d-a392-9330e819c7cd tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1532548061" status: 200 len: 513 microversion: 2.2 time: 0.013019 Oct 28 13:28:54.837489 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2492/5067] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Oct 28 13:28:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1532548061 => generated 513 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:54.852931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41efd1a0-aff1-4805-8df3-649d33c52cab tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b9454310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:54.943325 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41efd1a0-aff1-4805-8df3-649d33c52cab tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532548061" status: 204 len: 0 microversion: 2.2 time: 0.097958 Oct 28 13:28:54.944217 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2493/5068] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Oct 28 13:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532548061 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:54.965183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e8ec88a0-b4e1-4bce-9268-add84544ef54 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b8baff70>, body: {"keypair": {"name": "tempest-keypair-2112169237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBpZF2M07L/HZGSKF1LDIE1xZNNi9+falIEdmUlB9hJkCvBDC1XJaeePcwLE2yuX46eFlKgnVWcxCLklN7QoXYM3SZks1Q++WJNIc1PpioT8pUE5lq9sy8E0SsqkBDr1A=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:55.003944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e8ec88a0-b4e1-4bce-9268-add84544ef54 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:55.014075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e8ec88a0-b4e1-4bce-9268-add84544ef54 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:55.130387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:55.145387 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a6274a2b-8a12-4395-825e-367f08673288 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1675 microversion: 2.1 time: 0.359050 Oct 28 13:28:55.156682 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2576/5069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:54 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1675 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:55.163834 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e8ec88a0-b4e1-4bce-9268-add84544ef54 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.210421 Oct 28 13:28:55.165216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2494/5070] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Oct 28 13:28:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:28:55.183157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1210e42a-c00f-4ee5-8de0-af50950ffe66 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b881b3a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:55.292303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1210e42a-c00f-4ee5-8de0-af50950ffe66 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112169237" status: 204 len: 0 microversion: 2.2 time: 0.119476 Oct 28 13:28:55.293486 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2577/5071] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Oct 28 13:28:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112169237 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:55.304025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92a9cc33-a866-42e3-bfb5-d819ee95e4b5 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b8bafee0>, body: {"keypair": {"name": "tempest-keypair-1032760198", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:55.337534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-92a9cc33-a866-42e3-bfb5-d819ee95e4b5 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:55.347017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-92a9cc33-a866-42e3-bfb5-d819ee95e4b5 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:55.498321 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92a9cc33-a866-42e3-bfb5-d819ee95e4b5 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.198514 Oct 28 13:28:55.500278 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2495/5072] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Oct 28 13:28:55 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:28:55.510587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2b98d61-af95-4245-b305-16be8554a962 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b85a2820>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:55.607408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2b98d61-af95-4245-b305-16be8554a962 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032760198" status: 204 len: 0 microversion: 2.2 time: 0.100380 Oct 28 13:28:55.608209 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2578/5073] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Oct 28 13:28:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032760198 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:55.620032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3dd80a20-87f1-4064-a080-0e6fa81b4572 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b94545e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1855299244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADQAJ4brQ1VweuBVPvq406+Hu9dO4so6vztTUycpWRkRnKqIZChW9S/PEkMMrAH0pq29rFUELDphRTgtctkJTvYXp16mJyPoZl69xmfzi3vRhveLEMD++B8i6wbijShOg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:55.646239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3dd80a20-87f1-4064-a080-0e6fa81b4572 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:55.655322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3dd80a20-87f1-4064-a080-0e6fa81b4572 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:55.750546 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3dd80a20-87f1-4064-a080-0e6fa81b4572 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.133444 Oct 28 13:28:55.761250 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2496/5074] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Oct 28 13:28:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:28:55.766179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bea71bba-ec6a-4458-bdb6-3594040c1fb7 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b882f430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2098576273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1yZFUEIuqYApeOso3YV5seI852S3Ybe4BVrVKS6hxYy1XGX4HHXq5mSh97nEG6c7OGa7YszBW9D7dOLQ9/kDokb7wzbNMD1SRdmqbUOdP+iZ6FtPnz0ur7ANxdCbf+LQ=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:55.785612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bea71bba-ec6a-4458-bdb6-3594040c1fb7 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:55.792904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bea71bba-ec6a-4458-bdb6-3594040c1fb7 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:55.851029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:55.852712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:55.869857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:55.870626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:55.871456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:55.872350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:55.876797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:55.879221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:55.906543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bea71bba-ec6a-4458-bdb6-3594040c1fb7 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.144401 Oct 28 13:28:55.907314 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2579/5075] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Oct 28 13:28:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:28:55.921761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-30d747c2-8931-4265-9b38-8223c1cea481 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b881b4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1349657098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJffXj2Bs9NkxtkLZwxfvJo+DhXjWP50DfJa2QxdDmRiUkNKzbJ0/FApUh8UMczBb79882BSnTFt7pqGk+/mWShtMT5FEK5qQglkTcfypGectLapYYzTLeW5kV977xHBMg=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:56.002619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-30d747c2-8931-4265-9b38-8223c1cea481 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:56.057218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-30d747c2-8931-4265-9b38-8223c1cea481 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:56.203846 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-30d747c2-8931-4265-9b38-8223c1cea481 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.286432 Oct 28 13:28:56.204858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2580/5076] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Oct 28 13:28:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 13:28:56.210498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:56.213180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:56.239962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:56.240836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:56.241660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:56.245023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:56.247415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:56.248096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:56.323542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:56.335037 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e46f5f76-4622-4091-bc4d-a202a8ae95f9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.485613 Oct 28 13:28:56.337657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2497/5077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:55 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:56.359466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c5569593-f765-4e33-8733-044c21889723 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b8818790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:56.363979 n-d-862876-2 devstack@n-api.service[127794]: WARNING oslo_db.sqlalchemy.utils [None req-c5569593-f765-4e33-8733-044c21889723 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 13:28:56.374408 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c5569593-f765-4e33-8733-044c21889723 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.029353 Oct 28 13:28:56.375141 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2498/5078] 10.222.0.25 () {60 vars in 1177 bytes} [Fri Oct 28 13:28:56 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:56.387044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e921190b-a016-46cc-aa0d-1b6bb239d1c5 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b9454d30>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:56.478387 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e921190b-a016-46cc-aa0d-1b6bb239d1c5 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1349657098" status: 204 len: 0 microversion: 2.2 time: 0.095448 Oct 28 13:28:56.479027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2499/5079] 10.222.0.25 () {60 vars in 1321 bytes} [Fri Oct 28 13:28:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1349657098 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:28:56.492731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-491bc413-d74a-4f46-a149-f988fbb0c27d tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b8874f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:56.652187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-491bc413-d74a-4f46-a149-f988fbb0c27d tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2098576273" status: 204 len: 0 microversion: 2.2 time: 0.164093 Oct 28 13:28:56.653015 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2500/5080] 10.222.0.25 () {60 vars in 1321 bytes} [Fri Oct 28 13:28:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2098576273 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:56.661798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f01581b7-b4c7-4198-8656-b3437fc3e3b3 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b85eb8b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:56.871986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f01581b7-b4c7-4198-8656-b3437fc3e3b3 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1855299244" status: 204 len: 0 microversion: 2.2 time: 0.214556 Oct 28 13:28:56.872719 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2501/5081] 10.222.0.25 () {60 vars in 1321 bytes} [Fri Oct 28 13:28:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1855299244 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:56.888400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6bd74498-e6c5-48f4-ba3e-40219cd0dd86 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b8521dc0>, body: {"keypair": {"name": "tempest-keypair-1775850045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmX2MKVBMT8mbOuGneBw2qAuAOp+DfApaBbLUF9j97jbIyAQB2aIV8ru3rI7qgtfYQoImOtSZmGeLa+EqVxDBQibrKR2R/jEzaWhiJrIXFT0sknA5ot+qzw86+L7p6yAA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:56.895888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:28:56.908700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6bd74498-e6c5-48f4-ba3e-40219cd0dd86 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:56.922719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6bd74498-e6c5-48f4-ba3e-40219cd0dd86 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:56.941992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:56.952306 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-57c6e992-ef9b-48fa-a75b-f9dbb8ec5f27 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1675 microversion: 2.1 time: 0.745899 Oct 28 13:28:56.952902 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2581/5082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:56 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1675 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:57.078451 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6bd74498-e6c5-48f4-ba3e-40219cd0dd86 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.194066 Oct 28 13:28:57.085437 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2502/5083] 10.222.0.25 () {62 vars in 1199 bytes} [Fri Oct 28 13:28:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 28 13:28:57.090357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d728ff8-5926-4c16-bebb-3c11c22307ef tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b882fb80>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.105717 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d728ff8-5926-4c16-bebb-3c11c22307ef tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1775850045" status: 200 len: 513 microversion: 2.2 time: 0.019435 Oct 28 13:28:57.109219 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2582/5084] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Oct 28 13:28:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1775850045 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:28:57.119645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-38f4c542-0fc4-48c8-aeea-124a4ad4490a tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b8af6550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.123828 n-d-862876-2 devstack@n-api.service[127794]: WARNING oslo_db.sqlalchemy.utils [None req-38f4c542-0fc4-48c8-aeea-124a4ad4490a tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 13:28:57.130908 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-38f4c542-0fc4-48c8-aeea-124a4ad4490a tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.016666 Oct 28 13:28:57.135400 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2503/5085] 10.222.0.25 () {60 vars in 1177 bytes} [Fri Oct 28 13:28:57 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:57.142640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e1cfc6e-11d6-4b95-908a-7c3649bb0ba9 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b85a2820>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.247406 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e1cfc6e-11d6-4b95-908a-7c3649bb0ba9 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775850045" status: 204 len: 0 microversion: 2.2 time: 0.108868 Oct 28 13:28:57.248311 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2583/5086] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Oct 28 13:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775850045 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:57.257743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Action: 'create', calling method: .version_select at 0x7f27b85ebc10>, body: {"keypair": {"name": "tempest-keypair-1865603631", "type": "x509"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:57.281640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:57.295149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:57.321723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.processutils [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp0onenkin/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0onenkin/temp.key -subj /CN=a9ae3a30798e47009fa70afded94608c -extensions v3_req_client {{(pid=127794) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 13:28:57.364781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.365390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:57.379768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:57.380476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:57.381051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:57.381887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:57.382480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:57.383128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:57.542342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.processutils [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp0onenkin/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0onenkin/temp.key -subj /CN=a9ae3a30798e47009fa70afded94608c -extensions v3_req_client" returned: 0 in 0.221s {{(pid=127794) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 13:28:57.544199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.processutils [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp0onenkin/temp.key -password pass: {{(pid=127794) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 13:28:57.584907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.processutils [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp0onenkin/temp.key -password pass:" returned: 0 in 0.040s {{(pid=127794) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 13:28:57.767983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:57.776813 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4df0ca37-deec-4692-b9c2-83d17c58e71b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.415786 Oct 28 13:28:57.778065 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2584/5087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:57 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:57.810432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:28:57.816695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Getting quotas for user a9ae3a30798e47009fa70afded94608c and project 5f3d258ffadb4633928e382023379eb1. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:28:57.835788 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30a485d1-be08-480a-9ecf-ddbd4639a92b tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.581970 Oct 28 13:28:57.837453 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2504/5088] 10.222.0.25 () {62 vars in 1198 bytes} [Fri Oct 28 13:28:57 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 585 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:57.848484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4238a242-6807-4027-93bf-06b73bf5a4d0 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27bb020820>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.858319 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4238a242-6807-4027-93bf-06b73bf5a4d0 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1865603631" status: 200 len: 1534 microversion: 2.2 time: 0.013730 Oct 28 13:28:57.859705 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2585/5089] 10.222.0.25 () {60 vars in 1258 bytes} [Fri Oct 28 13:28:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1865603631 => generated 1534 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:57.874389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77479bf7-e716-4bb0-b1f1-28062c624aab tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b8aee8b0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.879234 n-d-862876-2 devstack@n-api.service[127794]: WARNING oslo_db.sqlalchemy.utils [None req-77479bf7-e716-4bb0-b1f1-28062c624aab tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 13:28:57.886226 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77479bf7-e716-4bb0-b1f1-28062c624aab tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.017063 Oct 28 13:28:57.886912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2505/5090] 10.222.0.25 () {60 vars in 1177 bytes} [Fri Oct 28 13:28:57 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:57.904268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5779c029-ba28-475f-8a09-b4b280a42109 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] Calling method '.version_select at 0x7f27b85a2b80>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.986178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:57.986178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:57.990106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:57.990721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:57.991275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:57.992690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:57.993292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:57.993868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:58.038094 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5779c029-ba28-475f-8a09-b4b280a42109 tempest-KeyPairsV22TestJSON-1909312346 tempest-KeyPairsV22TestJSON-1909312346-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865603631" status: 204 len: 0 microversion: 2.2 time: 0.143626 Oct 28 13:28:58.040132 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2586/5091] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Oct 28 13:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865603631 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:28:58.251321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:58.270679 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4170ae5c-1fd3-4ded-a14d-a6c131f776f3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1675 microversion: 2.1 time: 0.297180 Oct 28 13:28:58.285474 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2506/5092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:57 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1675 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:28:58.721395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fb4d23d6-4b3b-4cdf-a1a2-e52c889b08e9 req-752e4623-d48c-47b7-85f3-6af813352349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f35a4c2-2658-4948-873b-c44e0e7ad80f", "name": "network-vif-deleted", "tag": "d49d8d00-ce40-4925-b7b6-07f94ab7209e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:28:58.752181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb4d23d6-4b3b-4cdf-a1a2-e52c889b08e9 req-752e4623-d48c-47b7-85f3-6af813352349 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:58.752904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb4d23d6-4b3b-4cdf-a1a2-e52c889b08e9 req-752e4623-d48c-47b7-85f3-6af813352349 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:58.753514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fb4d23d6-4b3b-4cdf-a1a2-e52c889b08e9 req-752e4623-d48c-47b7-85f3-6af813352349 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:58.770446 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fb4d23d6-4b3b-4cdf-a1a2-e52c889b08e9 req-752e4623-d48c-47b7-85f3-6af813352349 service nova] Creating event network-vif-deleted:d49d8d00-ce40-4925-b7b6-07f94ab7209e for instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f on n-h1-862876-2 Oct 28 13:28:58.786496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fb4d23d6-4b3b-4cdf-a1a2-e52c889b08e9 req-752e4623-d48c-47b7-85f3-6af813352349 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070405 Oct 28 13:28:58.787441 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2587/5093] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:28:58.801959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:58.802516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:58.809260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:58.809759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:58.810213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:58.811008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:58.811474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:58.811902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:59.200068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:59.209613 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd12fe0a-a565-41d5-beaa-628a17d722ed tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.410575 Oct 28 13:28:59.222622 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2507/5094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:58 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:28:59.307161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:28:59.308229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:28:59.318624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:59.319481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:59.320188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:59.321616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:59.322347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:59.323022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:59.397189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:28:59.399478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:28:59.403236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:28:59.404067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lazy-loading 'fault' on Instance uuid 4f35a4c2-2658-4948-873b-c44e0e7ad80f {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:28:59.652582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:28:59.666956 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e43b42b4-39cc-459a-a071-177ecbb808b7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 200 len: 1328 microversion: 2.1 time: 0.374739 Oct 28 13:28:59.668187 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2588/5095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:28:59 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 1328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:00.234861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:00.236038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:00.244368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:00.245109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:00.245709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:00.246408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:00.247038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:00.247615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:00.498100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:00.509234 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f373fcf6-8a90-473d-94d9-68b26674ea67 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.278183 Oct 28 13:29:00.525128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2508/5096] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:00 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:00.692234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:00.692857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:00.700257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:00.701113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:00.701782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:00.702635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:00.703275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:00.703853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:00.720908 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] HTTP exception thrown: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Request method failure captured: Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f HTTP/1.1 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9hE2-t_H3m-VbRUW8xCsunHYUpUlER8ksGmflVi3TZzmSkJ0ILaRGW0tCq71bnuqblsOblpWMNwCs5lCXvxNNCrAbgbV-3FhdMIn0ZAP_Ibk5i_gDQYtxEwBV38FJDmOSPUNHr6rd517QrMioqy2XwRqpCpFpcoZu4wrpAzaXaX-nU Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7dec96587614543843d0c86c3e4adb6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3cf94118fc4e458e9e1163a03be85c50 Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4f35a4c2-2658-4948-873b-c44e0e7ad80f'} Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:00.723522 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:00.727576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:00.727576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:00.727576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:00.727576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:29:00.727576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:29:00.727576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:29:00.727576 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:00.729009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Returning 404 to user: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:29:00.730048 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-970d7563-8744-4362-aed8-c28ee5af7a2a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 404 len: 111 microversion: 2.1 time: 0.041975 Oct 28 13:29:00.732328 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2589/5097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:00 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:29:00.741372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3131bb12-7c22-4b78-894d-521f7b6378c6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '.version_select at 0x7f27b8874700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:00.952701 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3131bb12-7c22-4b78-894d-521f7b6378c6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980747019" status: 202 len: 0 microversion: 2.1 time: 0.215523 Oct 28 13:29:00.956794 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2509/5098] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980747019 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:01.534282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:01.534282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:01.542342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:01.545770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:01.546399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:01.550165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:01.551975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:01.557602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:01.768965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] Calling method '.version_select at 0x7f27b856d160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:01.783980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:01.784489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:01.785001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:01.785736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:01.786203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:01.786636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:01.796989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:01.824772 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb2e5dfe-49f2-420b-a002-6808c82a3301 tempest-AbsoluteLimitsTestJSON-1728551611 tempest-AbsoluteLimitsTestJSON-1728551611-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.252357 Oct 28 13:29:01.825975 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2510/5099] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Oct 28 13:29:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:29:02.059099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:02.072147 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8d9ce1c-5ce0-4a67-a9ed-5a3121c0cc45 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.542485 Oct 28 13:29:02.075830 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2590/5100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:01 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:02.610101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0fad59e4-42a8-4689-b7b3-236b23cfb4bf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'create', calling method: .version_select at 0x7f27b9474430>, body: {"keypair": {"name": "tempest-keypair-172061007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSAnP6+OLuXZk9eGb+pYM6NMosAcSzaKFPPT3K59LfHoDxc9gwcGqO6A3p5lSCE+7+9MuwHbdxxOL+iahs2t1WZrGPHDf3LCjJiuF575yUg2hI5zYQBwWrnv1xnZ7zeeQ=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:02.673291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0fad59e4-42a8-4689-b7b3-236b23cfb4bf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for project c7dec96587614543843d0c86c3e4adb6. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:29:02.687297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0fad59e4-42a8-4689-b7b3-236b23cfb4bf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for user 3cf94118fc4e458e9e1163a03be85c50 and project c7dec96587614543843d0c86c3e4adb6. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:29:02.809630 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0fad59e4-42a8-4689-b7b3-236b23cfb4bf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.204186 Oct 28 13:29:02.810376 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2511/5101] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:29:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:03.099500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:03.100711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:03.112113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:03.112898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:03.113577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:03.114902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:03.116348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:03.117098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:03.351247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:03.359782 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c8fcc31-5b81-4f88-8d77-7a8cbefa49b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.264561 Oct 28 13:29:03.378799 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2591/5102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:03 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:04.281250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:04.281810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:04.294147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:04.294641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:04.297059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:04.302261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:04.302983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:04.303576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:04.387077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:04.387834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:04.397103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:04.397642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:04.399646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:04.400962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:04.401814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:04.402552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:04.449884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lazy-loading 'services' on Instance uuid 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:29:04.858638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:04.871464 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-49aef73b-137e-406e-b04f-53efeef2dc6a tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081/os-volume_attachments/05408daf-648e-450a-9989-abdf8497ccc9" status: 202 len: 0 microversion: 2.1 time: 0.593396 Oct 28 13:29:04.873364 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2512/5103] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:29:04 2022] DELETE /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081/os-volume_attachments/05408daf-648e-450a-9989-abdf8497ccc9 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:04.891162 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a306113-12a3-46ef-b717-ed0c4674ddac tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1486 microversion: 2.1 time: 0.509511 Oct 28 13:29:04.893386 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2592/5104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:04 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1486 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:29:04.920267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:04.921128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:04.930964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:04.931679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:04.932262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:04.933108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:04.935382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:04.935971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:05.366321 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-816efe82-1e5a-4c47-b78c-b650e294e5b5 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "POST /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4/action" status: 202 len: 0 microversion: 2.1 time: 0.450425 Oct 28 13:29:05.368737 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2513/5105] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:29:04 2022] POST /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:05.377127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:05.377965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:05.385325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:05.389612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:05.389612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:05.389612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:05.389612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:05.389612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:05.691000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:05.704148 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-028af381-9baf-4424-a357-918bad0016d2 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1494 microversion: 2.1 time: 0.331033 Oct 28 13:29:05.705888 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2593/5106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:05 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1494 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:06.730234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:06.731101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:06.733777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:06.745353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1845424285", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac494844-a111-46b7-ba85-59a91ca923b5"}], "security_groups": [{"name": "tempest-securitygroup--171361957"}], "key_name": "tempest-keypair-172061007", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:06.747938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:06.748572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:06.751155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:06.751898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:06.752369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:06.755281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:07.293957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:07.302529 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-53343438-e5ef-45ba-8ae4-abb89983ae4d tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1494 microversion: 2.1 time: 0.577481 Oct 28 13:29:07.315968 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2594/5107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:06 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1494 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:07.660079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] validate_networks() for [('ac494844-a111-46b7-ba85-59a91ca923b5', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:29:08.198292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:29:08.199906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:29:08.201540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:29:08.202163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:29:08.202817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:29:08.222388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:08.223298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:08.224041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:08.225225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:08.225950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:08.226789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:08.248677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for project c7dec96587614543843d0c86c3e4adb6. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:29:08.255103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Getting quotas for user 3cf94118fc4e458e9e1163a03be85c50 and project c7dec96587614543843d0c86c3e4adb6. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:29:08.272978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:29:08.277393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:29:08.337679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:08.338291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:08.353682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:08.354176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:08.354612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:08.355373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:08.355826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:08.356246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:08.471484 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a74a91c-ed2b-4c33-9a22-b6ff0b39d765 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.732756 Oct 28 13:29:08.475468 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2514/5108] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:29:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:29:08.492515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-01f29bcb-6d8f-4b1d-b2ea-ed0bc75e31f8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:08.496785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-01f29bcb-6d8f-4b1d-b2ea-ed0bc75e31f8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:08.644471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-01f29bcb-6d8f-4b1d-b2ea-ed0bc75e31f8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:08.648229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:08.654073 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-01f29bcb-6d8f-4b1d-b2ea-ed0bc75e31f8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1237 microversion: 2.1 time: 0.170428 Oct 28 13:29:08.656480 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2515/5109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:08 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1237 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:08.659773 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3f370936-e9af-4310-9b6d-9fe4ea8bcd37 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1494 microversion: 2.1 time: 0.326115 Oct 28 13:29:08.683957 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2595/5110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:08 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1494 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:29:09.682361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3812e962-165b-4310-8d00-b8aae9d1aac3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:09.683634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3812e962-165b-4310-8d00-b8aae9d1aac3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:09.712336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:09.713826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:09.727471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:09.729518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:09.731140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:09.741606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:09.741606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:09.741606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:09.781910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3812e962-165b-4310-8d00-b8aae9d1aac3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:09.792581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3812e962-165b-4310-8d00-b8aae9d1aac3 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1237 microversion: 2.1 time: 0.112614 Oct 28 13:29:09.797395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2516/5111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:09 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:10.372453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:10.381192 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1abb9ed8-880b-4932-a5af-831c3b6fc23b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1500 microversion: 2.1 time: 0.673562 Oct 28 13:29:10.384248 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2596/5112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:09 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1500 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:29:10.419077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:10.419606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:10.443117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:10.446014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:10.447554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:10.457666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:10.459124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:10.460426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:10.548068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:29:10.830630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:10.831927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:10.859334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:10.863208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:10.865841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:10.868419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:10.869078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:10.869654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:11.075380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:11.085331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:11.093299 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73ea9bf4-0eb1-41dc-aee3-4357797ec61b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1241 microversion: 2.1 time: 0.272965 Oct 28 13:29:11.096720 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2597/5113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:10 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1241 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:11.255061 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1fb24104-82e5-48ad-b23b-b2e8a43d57fe tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 204 len: 0 microversion: 2.1 time: 0.841867 Oct 28 13:29:11.255991 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2517/5114] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:29:10 2022] DELETE /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:29:11.265038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:11.266003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:11.276265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:11.278464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:11.279130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:11.280778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:11.282306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:11.284349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:11.671185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:11.689345 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b034d7b-bc38-412e-ad43-ad85873d0287 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.418124 Oct 28 13:29:11.699829 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2598/5115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:11 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:12.127340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:12.128715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:12.153790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:12.154576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:12.157669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:12.158656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:12.159485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:12.160066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:12.318337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:12.331730 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48bf4e7e-bcf5-479a-92ad-3aa34c813baa tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1289 microversion: 2.1 time: 0.208670 Oct 28 13:29:12.332514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2518/5116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:12 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1289 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:12.731674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:12.732447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:12.749783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:12.752513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:12.753770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:12.754930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:12.756370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:12.758711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:12.771828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:12.861484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:12.863173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:12.887487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:12.888023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:12.891662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:12.897531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:12.898795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:12.899249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:12.984025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:29:13.296084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:13.317656 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70929b62-4a08-43d8-b66e-950de43236d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.590196 Oct 28 13:29:13.323715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2599/5117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:12 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:13.357163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:13.357738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:13.361130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:13.383059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:13.383059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:13.383059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:13.385489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:13.387920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:13.388282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:13.510544 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7842e9b6-1d99-46a6-a269-db1c028cd8cb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 204 len: 0 microversion: 2.1 time: 0.653954 Oct 28 13:29:13.513096 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2519/5118] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:29:12 2022] DELETE /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:29:13.524944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:13.527036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:13.545164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:13.546008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:13.548900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:13.550661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:13.558994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:13.559740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:13.879791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:13.907684 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be369b9d-a75f-4398-b509-81b8829431de tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1295 microversion: 2.1 time: 0.555331 Oct 28 13:29:13.913049 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2600/5119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:13 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1295 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:29:14.288163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:14.301657 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-678280b4-5e47-4903-9b73-0556a8bfe4aa tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1514 microversion: 2.1 time: 0.784042 Oct 28 13:29:14.302507 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2520/5120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:13 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1514 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:14.348506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:14.349139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:14.362847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:14.363649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:14.363812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:14.368681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:14.369208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:14.371567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:14.797779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:14.808410 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23193d8e-4bf5-4c36-8bf4-1b15f292010c tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.464402 Oct 28 13:29:14.809505 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2601/5121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:14 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:14.936221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:14.937012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:14.949489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:14.952856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:14.953325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:14.954063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:14.957374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:14.958010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:15.335012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:15.335736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:15.350362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:15.350362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:15.350362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:15.351764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:15.353814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:15.354316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:15.367283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:15.377643 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c39f94bc-b14e-439f-a8fc-98bb36f81427 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1362 microversion: 2.1 time: 0.446257 Oct 28 13:29:15.379776 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2521/5122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:14 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:15.831315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:15.832163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:15.839634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:15.840122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:15.840715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:15.841569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:15.842208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:15.842864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:15.914373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:15.925225 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e26910df-f298-4b9b-9836-f4696ccc5559 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1514 microversion: 2.1 time: 0.592877 Oct 28 13:29:15.939176 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2602/5123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:15 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1514 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:16.407306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:16.408694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:16.418779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:16.419485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:16.420749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:16.421703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:16.422381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:16.423111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:16.452655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:16.461329 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1daf4c2-a027-40f1-b717-59cc2e727719 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1506 microversion: 2.1 time: 0.633910 Oct 28 13:29:16.461932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2522/5124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:15 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:29:16.954848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:16.957790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:16.962844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:16.967991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:16.968742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:16.971038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:16.974419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:16.975410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:16.976055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:16.978047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84541e89-1823-4560-b4e1-2c7f0ce45fb2 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1362 microversion: 2.1 time: 0.580077 Oct 28 13:29:16.978652 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2603/5125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:16 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1362 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:17.408664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d9989ac6-b9a1-4060-850e-d1ea3db9bd62 req-7b43b0b2-7212-4337-9c39-54195fd4bb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2456e54-3c35-4ef1-b4cf-5b9440bb06a4", "name": "network-vif-deleted", "tag": "1ab80ad2-d338-4da0-ba7c-e2ae6f9906fb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:17.452185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d9989ac6-b9a1-4060-850e-d1ea3db9bd62 req-7b43b0b2-7212-4337-9c39-54195fd4bb37 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:17.452988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d9989ac6-b9a1-4060-850e-d1ea3db9bd62 req-7b43b0b2-7212-4337-9c39-54195fd4bb37 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:17.453448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d9989ac6-b9a1-4060-850e-d1ea3db9bd62 req-7b43b0b2-7212-4337-9c39-54195fd4bb37 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:17.493935 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d9989ac6-b9a1-4060-850e-d1ea3db9bd62 req-7b43b0b2-7212-4337-9c39-54195fd4bb37 service nova] Creating event network-vif-deleted:1ab80ad2-d338-4da0-ba7c-e2ae6f9906fb for instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 on n-h2-862876-2 Oct 28 13:29:17.503626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d9989ac6-b9a1-4060-850e-d1ea3db9bd62 req-7b43b0b2-7212-4337-9c39-54195fd4bb37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100833 Oct 28 13:29:17.514071 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2604/5126] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:29:17.528504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:17.556827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:17.574204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:17.574724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:17.577508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:17.580217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:17.581881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:17.582337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:17.806914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:17.827601 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81a30e28-76ea-48c6-b4b0-2329a23ebd7b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1464 microversion: 2.1 time: 0.309474 Oct 28 13:29:17.838786 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2605/5127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:17 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1464 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:17.859210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:17.874476 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-899b95a0-e040-4261-a064-8c3cebc3deeb tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1472 microversion: 2.1 time: 0.918232 Oct 28 13:29:17.875227 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2523/5128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:16 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1472 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:18.008046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:18.008782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:18.028727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:18.029348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:18.030885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:18.032586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:18.033168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:18.033703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:18.528878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:18.666056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:18.681303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d0b2287-284b-4582-a2c2-62ca38b4fabd tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1362 microversion: 2.1 time: 0.679558 Oct 28 13:29:18.688076 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2606/5129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:18 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1362 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:18.723795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3782e397-2222-4dff-a38c-6c62e75d53ec tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b85ebe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-612864664", "description": "tempest-description-348023898"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:18.858072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:18.859036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:18.867948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:18.869197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:18.869792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:18.871330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:18.871963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:18.872552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:18.965707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:18.966485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:18.968345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:18.969677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lazy-loading 'fault' on Instance uuid b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:29:19.044276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:19.052478 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79aa5fde-cf85-4d8f-812a-8525ff511a62 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 200 len: 1303 microversion: 2.1 time: 0.199550 Oct 28 13:29:19.053099 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2607/5130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:18 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:29:19.063950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:19.064944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:19.082597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:19.082597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:19.082597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:19.082597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:19.082597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:19.082597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:19.140303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:19.140879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:19.141390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:19.141972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lazy-loading 'fault' on Instance uuid 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:29:19.240967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361c7be5f66a48e9b3b283d063b89ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30bb4edd8cc4eff88444ca688c4e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:19.251340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-faeb837e-24f1-434e-b76b-000cd565fb15 tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 200 len: 1309 microversion: 2.1 time: 0.191624 Oct 28 13:29:19.252137 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2608/5131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:19 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:19.293204 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3782e397-2222-4dff-a38c-6c62e75d53ec tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.772828 Oct 28 13:29:19.294638 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2524/5132] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:29:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:19.310767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-74e5a62f-cdaa-4c80-853d-8de41207b21c tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b86ade50>, body: {"security_group_rule": {"parent_group_id": "ee9bd315-c347-47d1-8f46-be01dc60b5ae", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:19.687368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-08e2fa15-a11e-4c5c-9514-e38b190add81 req-f853f0e6-cfad-4d86-90ad-8c2a37dcf9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce6f3ae-73cd-4bdd-a049-388d4fbaf081", "name": "network-vif-deleted", "tag": "6e3635df-3e4c-49cf-9b14-e4f038148ba2"}, {"name": "network-changed", "server_uuid": "7da71137-52cf-4db7-884b-d421c3057b0c", "tag": "de173011-edd0-4b4a-b30f-765c6648da62"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:19.757865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-08e2fa15-a11e-4c5c-9514-e38b190add81 req-f853f0e6-cfad-4d86-90ad-8c2a37dcf9c4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:19.758841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-08e2fa15-a11e-4c5c-9514-e38b190add81 req-f853f0e6-cfad-4d86-90ad-8c2a37dcf9c4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:19.760327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-08e2fa15-a11e-4c5c-9514-e38b190add81 req-f853f0e6-cfad-4d86-90ad-8c2a37dcf9c4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:19.779451 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-08e2fa15-a11e-4c5c-9514-e38b190add81 req-f853f0e6-cfad-4d86-90ad-8c2a37dcf9c4 service nova] Creating event network-vif-deleted:6e3635df-3e4c-49cf-9b14-e4f038148ba2 for instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 on n-h2-862876-2 Oct 28 13:29:19.780233 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-08e2fa15-a11e-4c5c-9514-e38b190add81 req-f853f0e6-cfad-4d86-90ad-8c2a37dcf9c4 service nova] Creating event network-changed:de173011-edd0-4b4a-b30f-765c6648da62 for instance 7da71137-52cf-4db7-884b-d421c3057b0c on n-h1-862876-2 Oct 28 13:29:19.811471 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-08e2fa15-a11e-4c5c-9514-e38b190add81 req-f853f0e6-cfad-4d86-90ad-8c2a37dcf9c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.137398 Oct 28 13:29:19.814630 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2525/5133] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:19.819311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=40 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:19.825602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:19.826589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:19.858580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:19.860329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:19.860791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:19.863624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:19.864794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:19.865938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:20.002103 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-74e5a62f-cdaa-4c80-853d-8de41207b21c tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.697430 Oct 28 13:29:20.015590 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2609/5134] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:29:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:20.030869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ebca92a-7420-4849-9862-697710200412 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b8528700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1821928490", "description": "tempest-description-1524952500"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:20.241680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:20.253041 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ffd490a5-41e4-46e9-92cf-081eeb034042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1362 microversion: 2.1 time: 0.435118 Oct 28 13:29:20.254241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2526/5135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:19 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:20.259494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:20.260397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: b2456e54-3c35-4ef1-b4cf-5b9440bb06a4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:20.266882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:20.268157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:20.268828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:20.271609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:20.272549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:20.273774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:20.306774 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] HTTP exception thrown: Instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 could not be found. Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Request method failure captured: Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 HTTP/1.1 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9i3G_hPxV-MEvBmunc9_eI9wvemLJjqr1uunPko2FEil_eKPlAxzqVcxEDfySxc_e5sdAhkzYpuE0L-G-U4X8B5Fos153UZncBe0ajiE07Abd8vtAptDeLjcKaofb8Sda-sANoo6t3RUkSacJJJ2wYES91xJCd1jQ6hEavJb6N344A Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 8733a0175cf84af98014b171e14f5d19 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerRescueTestJSON-1055379269 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8733a0175cf84af98014b171e14f5d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8733a0175cf84af98014b171e14f5d19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8733a0175cf84af98014b171e14f5d19", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8733a0175cf84af98014b171e14f5d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerRescueTestJSON-1055379269 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 8733a0175cf84af98014b171e14f5d19 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerRescueTestJSON-1055379269 Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerRescueTestJSON-1055379269-project Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d5b5dc7dd91a4c16b7ebdd22957a28eb Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerRescueTestJSON-1055379269-project Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 could not be found. Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b2456e54-3c35-4ef1-b4cf-5b9440bb06a4'} Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 could not be found. Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 could not be found. Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:20.309639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 could not be found. Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Returning 404 to user: Instance b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:29:20.312923 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f5080c0-87d3-4c54-bab7-443b454f5757 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4" status: 404 len: 111 microversion: 2.1 time: 0.056438 Oct 28 13:29:20.315119 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2527/5136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:20 2022] GET /compute/v2.1/servers/b2456e54-3c35-4ef1-b4cf-5b9440bb06a4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:29:20.323220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:20.323832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] [instance: 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:20.340197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:20.340851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:20.341148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:20.341864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:20.349411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:20.349967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:20.375274 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] HTTP exception thrown: Instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 could not be found. Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Request method failure captured: Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 HTTP/1.1 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ffYAXIJZPBdWuu_ZqD4ldh3gXNKZ3DJcuCKTu2272FtIJmgUMedQi7GJDciD-hiwI3z4tq6vkH_zxLqX1dxa0dp2rPhZcz4TpK24H2qC0olAPxWyukZhlSx86VtORjsx3pYxLO-MLhbOC-VGFF1pImeT-E0Z5cuDFtsRGJc49A4w4 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e30bb4edd8cc4eff88444ca688c4e862 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesSnapshotTestJSON-36614554 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e30bb4edd8cc4eff88444ca688c4e862"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e30bb4edd8cc4eff88444ca688c4e862"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e30bb4edd8cc4eff88444ca688c4e862", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e30bb4edd8cc4eff88444ca688c4e862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesSnapshotTestJSON-36614554 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e30bb4edd8cc4eff88444ca688c4e862 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-36614554 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesSnapshotTestJSON-36614554-project Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 361c7be5f66a48e9b3b283d063b89ff3 Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesSnapshotTestJSON-36614554-project Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 could not be found. Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '0ce6f3ae-73cd-4bdd-a049-388d4fbaf081'} Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 could not be found. Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 could not be found. Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:20.380824 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 could not be found. Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] Returning 404 to user: Instance 0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:29:20.387470 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-df2c9a05-c740-4dd7-bdfa-ec01b41d654f tempest-VolumesSnapshotTestJSON-36614554 tempest-VolumesSnapshotTestJSON-36614554-project] 10.222.0.25 "GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081" status: 404 len: 111 microversion: 2.1 time: 0.063415 Oct 28 13:29:20.389564 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2528/5137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:20 2022] GET /compute/v2.1/servers/0ce6f3ae-73cd-4bdd-a049-388d4fbaf081 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:29:20.405683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:20.405683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:20.414308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:20.418873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:20.419413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:20.420494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:20.420971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:20.421411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:20.425964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:20.497078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:29:21.002954 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-78c94fa0-3697-4b60-a27d-558165d003d0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 204 len: 0 microversion: 2.1 time: 0.611037 Oct 28 13:29:21.007822 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2529/5138] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:29:20 2022] DELETE /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:29:21.032813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:21.035252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:21.052091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:21.053283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:21.055256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:21.056316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:21.057149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:21.057996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:21.185473 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ebca92a-7420-4849-9862-697710200412 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.162385 Oct 28 13:29:21.187151 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2610/5139] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:29:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:21.201170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2fcea3e3-331e-49aa-bb5b-a1941c6750c6 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27bda2eb80>, body: {"security_group_rule": {"parent_group_id": "560bd93b-1d51-4c22-9d42-14132006dbbe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:21.368319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:21.379978 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9298ab62-4af4-4443-9075-596cac6cf39b tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1492 microversion: 2.1 time: 0.367237 Oct 28 13:29:21.382615 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2530/5140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:21 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1492 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:21.396504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:21.399366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:21.411311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:21.417995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:21.417995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:21.418201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:21.418628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:21.419099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:21.669176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:21.678246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d757264-a07b-4284-8555-d0e50b31e3e6 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1362 microversion: 2.1 time: 0.294351 Oct 28 13:29:21.679224 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2531/5141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:21 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:22.087417 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2fcea3e3-331e-49aa-bb5b-a1941c6750c6 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.891808 Oct 28 13:29:22.091501 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2611/5142] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:29:21 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:29:22.105223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2735817-b511-4013-88f9-fb2a145982f4 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b8baf8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1973918568", "description": "tempest-description-563804231"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:22.411587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:22.412863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:22.420300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:22.421087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:22.421737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:22.422670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:22.427517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:22.428474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:22.597922 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a2735817-b511-4013-88f9-fb2a145982f4 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.495857 Oct 28 13:29:22.599717 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2532/5143] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:29:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:22.611549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d073fd5e-5082-4acf-90f9-070aa8d6bb02 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b9474a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-364818660", "description": "tempest-description-1858400299"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:22.761652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:22.774949 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b62deced-3ee5-4a53-bd1d-6a7268d6dcf9 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1492 microversion: 2.1 time: 0.372809 Oct 28 13:29:22.790243 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2612/5144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:22 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1492 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:22.790243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:22.790243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:22.790868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:22.805566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:22.806251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:22.810231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:22.811270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:22.812469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:23.164909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:23.175882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ff3af6a-1eaf-4e97-a138-27c35d1abc21 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1362 microversion: 2.1 time: 0.396810 Oct 28 13:29:23.178230 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2613/5145] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:22 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:23.337263 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d073fd5e-5082-4acf-90f9-070aa8d6bb02 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.729855 Oct 28 13:29:23.338149 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2533/5146] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:29:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:23.353054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40597b2d-6331-4a1c-94df-84b18b0925cf tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b86ad790>, body: {"security_group_rule": {"parent_group_id": "4665be80-7d10-4428-a6e6-575b479ebd60", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "20cb6ce2-2cf5-4bf6-a668-a52831267736"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:23.573211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-da82e7ad-6846-4401-9ac1-08b2c649b0eb req-ae7dfd89-f8bd-4817-9267-2fad99d3ef79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da71137-52cf-4db7-884b-d421c3057b0c", "name": "network-vif-plugged", "status": "completed", "tag": "de173011-edd0-4b4a-b30f-765c6648da62"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:23.589153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-da82e7ad-6846-4401-9ac1-08b2c649b0eb req-ae7dfd89-f8bd-4817-9267-2fad99d3ef79 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:23.590094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-da82e7ad-6846-4401-9ac1-08b2c649b0eb req-ae7dfd89-f8bd-4817-9267-2fad99d3ef79 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:23.590543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-da82e7ad-6846-4401-9ac1-08b2c649b0eb req-ae7dfd89-f8bd-4817-9267-2fad99d3ef79 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:23.606300 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-da82e7ad-6846-4401-9ac1-08b2c649b0eb req-ae7dfd89-f8bd-4817-9267-2fad99d3ef79 service nova] Creating event network-vif-plugged:de173011-edd0-4b4a-b30f-765c6648da62 for instance 7da71137-52cf-4db7-884b-d421c3057b0c on n-h1-862876-2 Oct 28 13:29:23.619582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-da82e7ad-6846-4401-9ac1-08b2c649b0eb req-ae7dfd89-f8bd-4817-9267-2fad99d3ef79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047390 Oct 28 13:29:23.619582 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2534/5147] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:29:23.806369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:23.807191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:23.814346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:23.814879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:23.815370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:23.816092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:23.816538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:23.817143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:24.084140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:24.092706 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec276e7e-60e1-4508-9cc0-713c124b2247 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1492 microversion: 2.1 time: 0.291198 Oct 28 13:29:24.093486 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2535/5148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:23 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1492 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:24.169119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-eda56de3-e46d-4da4-a9d7-488b2acc2875 req-18e144b0-66ad-49fc-8814-790378fa1ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1987d8-50db-46f9-88dc-3c53ccf6e3d3", "name": "network-vif-deleted", "tag": "b01f65de-e1ae-4476-9a93-7b75bc15fa54"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:24.179575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eda56de3-e46d-4da4-a9d7-488b2acc2875 req-18e144b0-66ad-49fc-8814-790378fa1ba9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:24.180281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eda56de3-e46d-4da4-a9d7-488b2acc2875 req-18e144b0-66ad-49fc-8814-790378fa1ba9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:24.180722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eda56de3-e46d-4da4-a9d7-488b2acc2875 req-18e144b0-66ad-49fc-8814-790378fa1ba9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:24.193916 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-eda56de3-e46d-4da4-a9d7-488b2acc2875 req-18e144b0-66ad-49fc-8814-790378fa1ba9 service nova] Creating event network-vif-deleted:b01f65de-e1ae-4476-9a93-7b75bc15fa54 for instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 on n-h1-862876-2 Oct 28 13:29:24.200135 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-eda56de3-e46d-4da4-a9d7-488b2acc2875 req-18e144b0-66ad-49fc-8814-790378fa1ba9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105217 Oct 28 13:29:24.211349 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2536/5149] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:24.217760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:24.218556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:24.225228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:24.226334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:24.227059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:24.227906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:24.228446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:24.228939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:24.391995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:24.403097 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea205a92-fffd-4667-971b-2cfe53e2159e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1362 microversion: 2.1 time: 0.189973 Oct 28 13:29:24.404249 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2537/5150] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:24 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:25.079045 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40597b2d-6331-4a1c-94df-84b18b0925cf tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.731182 Oct 28 13:29:25.092749 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2614/5151] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:29:23 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:25.094310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f868026-b6bc-4143-9618-27d98cdd7141 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b8ad8af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1234597457", "description": "tempest-description-1367270213"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:25.123194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:25.124937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:25.143549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:25.144692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:25.145302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:25.146322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:25.146969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:25.147599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:25.194639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:25.195207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:25.195725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:25.197720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lazy-loading 'fault' on Instance uuid dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:29:25.253783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5b5dc7dd91a4c16b7ebdd22957a28eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8733a0175cf84af98014b171e14f5d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:25.339435 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-643ce003-fd2d-400d-b907-6cd903edfd1a tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 200 len: 1304 microversion: 2.1 time: 0.225533 Oct 28 13:29:25.341991 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2615/5152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:25 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 1304 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:25.428630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:25.430538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:25.440891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:25.442903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:25.444007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:25.444881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:25.448586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:25.449106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:25.636133 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f868026-b6bc-4143-9618-27d98cdd7141 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.545909 Oct 28 13:29:25.645728 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2538/5153] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:29:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:25.654136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-377df0c3-1fa4-4468-8d11-cc48dd11c316 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b8af63a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1342369671", "description": "tempest-description-1305955019"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:25.809895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:25.832030 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-98bf0364-2d06-4491-a51a-2b3ab9bfc155 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1549 microversion: 2.1 time: 0.408509 Oct 28 13:29:25.832647 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2616/5154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:25 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1549 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:29:25.863955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:25.867094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:25.891040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:25.894718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:25.896127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:25.907144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:25.907949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:25.909545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:26.205817 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-22cde539-8f75-4220-8923-81f829e58066 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.345885 Oct 28 13:29:26.207469 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2617/5155] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:29:25 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-interface => generated 285 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:29:26.366883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:26.368007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] [instance: dd1987d8-50db-46f9-88dc-3c53ccf6e3d3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:26.383096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:26.386931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:26.386931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:26.386931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:26.386931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:26.387713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:26.414388 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] HTTP exception thrown: Instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 could not be found. Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Request method failure captured: Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 HTTP/1.1 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9i3G_hPxV-MEvBmunc9_eI9wvemLJjqr1uunPko2FEil_eKPlAxzqVcxEDfySxc_e5sdAhkzYpuE0L-G-U4X8B5Fos153UZncBe0ajiE07Abd8vtAptDeLjcKaofb8Sda-sANoo6t3RUkSacJJJ2wYES91xJCd1jQ6hEavJb6N344A Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 8733a0175cf84af98014b171e14f5d19 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerRescueTestJSON-1055379269 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8733a0175cf84af98014b171e14f5d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8733a0175cf84af98014b171e14f5d19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8733a0175cf84af98014b171e14f5d19", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8733a0175cf84af98014b171e14f5d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerRescueTestJSON-1055379269 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 8733a0175cf84af98014b171e14f5d19 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerRescueTestJSON-1055379269 Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerRescueTestJSON-1055379269-project Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d5b5dc7dd91a4c16b7ebdd22957a28eb Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerRescueTestJSON-1055379269-project Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 could not be found. Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'dd1987d8-50db-46f9-88dc-3c53ccf6e3d3'} Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 could not be found. Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 could not be found. Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:26.417667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 could not be found. Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:26.421121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] Returning 404 to user: Instance dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:29:26.423173 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13d2c6d0-8d35-4e12-8e00-67e1154b71e0 tempest-ServerRescueTestJSON-1055379269 tempest-ServerRescueTestJSON-1055379269-project] 10.222.0.25 "GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3" status: 404 len: 111 microversion: 2.1 time: 0.061207 Oct 28 13:29:26.426100 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2618/5156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:26 2022] GET /compute/v2.1/servers/dd1987d8-50db-46f9-88dc-3c53ccf6e3d3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:29:26.501454 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-377df0c3-1fa4-4468-8d11-cc48dd11c316 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.854185 Oct 28 13:29:26.502833 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2539/5157] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:29:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:26.522642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99c2c3d0-745b-4a28-b557-33ce7fffe62e tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27bd978310>, body: {"security_group_rule": {"parent_group_id": "868e7a47-04f2-4106-9b6e-fa2fa013c906", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d4f27106-2055-4b4b-af1d-c3a386e69ecf"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:28.362926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:28.364898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:28.373990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:28.374817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:28.375432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:28.376447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:28.377067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:28.377784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:28.509420 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99c2c3d0-745b-4a28-b557-33ce7fffe62e tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.995172 Oct 28 13:29:28.512593 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2619/5158] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:29:26 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:28.525711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e6aaf264-4976-42ca-a2d8-de546ed82ae8 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b9479700>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:28.816086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:28.836242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:28.838198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:28.840364 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1183adef-f8bf-4e0f-a6e7-06aa3b6407a8 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2954 microversion: 2.42 time: 0.483245 Oct 28 13:29:28.868417 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2540/5159] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:29:28 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2954 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:29:28.876847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:28.878180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:28.896748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:28.900616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:28.900616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:28.900616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:28.900616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:28.901380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:29.229524 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c56de725-fb86-41e0-ba17-66ef259a07f0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.359473 Oct 28 13:29:29.230214 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2541/5160] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Oct 28 13:29:28 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87/os-interface => generated 1831 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:29:29.829650 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e6aaf264-4976-42ca-a2d8-de546ed82ae8 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d4f27106-2055-4b4b-af1d-c3a386e69ecf" status: 202 len: 0 microversion: 2.1 time: 1.308237 Oct 28 13:29:29.831182 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2620/5161] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:28 2022] DELETE /compute/v2.1/os-security-groups/d4f27106-2055-4b4b-af1d-c3a386e69ecf => generated 0 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:29.841345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b7c145a-4fd4-4819-9d89-dacebb3e5e8e tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b856d5e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:29.900655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a7704895-58e3-4a73-82a9-0fa2beb31e80 req-f03acd9e-4a12-4029-a92e-a8da6b5b695c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da71137-52cf-4db7-884b-d421c3057b0c", "tag": "de173011-edd0-4b4a-b30f-765c6648da62"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:29.923608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7704895-58e3-4a73-82a9-0fa2beb31e80 req-f03acd9e-4a12-4029-a92e-a8da6b5b695c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:29.924450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7704895-58e3-4a73-82a9-0fa2beb31e80 req-f03acd9e-4a12-4029-a92e-a8da6b5b695c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:29.930035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7704895-58e3-4a73-82a9-0fa2beb31e80 req-f03acd9e-4a12-4029-a92e-a8da6b5b695c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:29.970952 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a7704895-58e3-4a73-82a9-0fa2beb31e80 req-f03acd9e-4a12-4029-a92e-a8da6b5b695c service nova] Creating event network-changed:de173011-edd0-4b4a-b30f-765c6648da62 for instance 7da71137-52cf-4db7-884b-d421c3057b0c on n-h1-862876-2 Oct 28 13:29:29.981578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a7704895-58e3-4a73-82a9-0fa2beb31e80 req-f03acd9e-4a12-4029-a92e-a8da6b5b695c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085056 Oct 28 13:29:29.982447 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2621/5162] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:29:30.249914 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b7c145a-4fd4-4819-9d89-dacebb3e5e8e tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/868e7a47-04f2-4106-9b6e-fa2fa013c906" status: 200 len: 248 microversion: 2.1 time: 0.414469 Oct 28 13:29:30.260135 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2542/5163] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:29:29 2022] GET /compute/v2.1/os-security-groups/868e7a47-04f2-4106-9b6e-fa2fa013c906 => generated 248 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:30.269429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c812e65-ac8d-4cda-9907-e17e88366ae0 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b882f0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-386201371", "description": "tempest-description-733222983"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:31.555464 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c812e65-ac8d-4cda-9907-e17e88366ae0 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.290797 Oct 28 13:29:31.557241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2622/5164] 10.222.0.25 () {60 vars in 1180 bytes} [Fri Oct 28 13:29:30 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:31.572886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6126c817-21f5-4034-8dd2-cf632c29aa08 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b8b6f1f0>, body: {"security_group_rule": {"parent_group_id": "e897e785-b00c-4029-bc04-219c6cb84c8c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:32.569584 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6126c817-21f5-4034-8dd2-cf632c29aa08 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.002934 Oct 28 13:29:32.570524 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2543/5165] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:29:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:32.594363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1fb082d1-475c-4709-9b60-8a649c1af7f6 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Action: 'create', calling method: .version_select at 0x7f27b9490820>, body: {"security_group_rule": {"parent_group_id": "e897e785-b00c-4029-bc04-219c6cb84c8c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:33.963256 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1fb082d1-475c-4709-9b60-8a649c1af7f6 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.384738 Oct 28 13:29:33.964639 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2623/5166] 10.222.0.25 () {60 vars in 1195 bytes} [Fri Oct 28 13:29:32 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:33.977890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dadb3c53-2af0-40df-bfcd-61d68bd16c34 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b8740e50>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:34.233039 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dadb3c53-2af0-40df-bfcd-61d68bd16c34 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/e897e785-b00c-4029-bc04-219c6cb84c8c" status: 200 len: 663 microversion: 2.1 time: 0.259726 Oct 28 13:29:34.234647 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2544/5167] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:29:33 2022] GET /compute/v2.1/os-security-groups/e897e785-b00c-4029-bc04-219c6cb84c8c => generated 663 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:29:34.249444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a8197ca-cc61-4284-a8e3-a78fd2387558 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b983c670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:34.655511 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a8197ca-cc61-4284-a8e3-a78fd2387558 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/d45476b6-dcf7-4315-8267-000964e2c34e" status: 202 len: 0 microversion: 2.1 time: 0.410118 Oct 28 13:29:34.656111 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2624/5168] 10.222.0.25 () {58 vars in 1287 bytes} [Fri Oct 28 13:29:34 2022] DELETE /compute/v2.1/os-security-group-rules/d45476b6-dcf7-4315-8267-000964e2c34e => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:34.680944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a6aa850-f41e-4d5f-b22e-81fd7b13b85e tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b8af69d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:35.220037 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a6aa850-f41e-4d5f-b22e-81fd7b13b85e tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e897e785-b00c-4029-bc04-219c6cb84c8c" status: 202 len: 0 microversion: 2.1 time: 0.556688 Oct 28 13:29:35.221157 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2545/5169] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:34 2022] DELETE /compute/v2.1/os-security-groups/e897e785-b00c-4029-bc04-219c6cb84c8c => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:35.245090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a7311d5-5c7c-4159-89a4-dc890fea4851 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b882f700>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:35.282624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG neutronclient.v2_0.client [None req-6a7311d5-5c7c-4159-89a4-dc890fea4851 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist", "detail": ""}} {{(pid=127793) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 13:29:35.283521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.security_group_api [None req-6a7311d5-5c7c-4159-89a4-dc890fea4851 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Neutron security group d4f27106-2055-4b4b-af1d-c3a386e69ecf not found {{(pid=127793) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 13:29:35.284174 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6a7311d5-5c7c-4159-89a4-dc890fea4851 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] HTTP exception thrown: Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist Oct 28 13:29:35.284174 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-ac3bb6bb-d1b8-4287-bfb8-1ed64b113479'] Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a7311d5-5c7c-4159-89a4-dc890fea4851 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Request method failure captured: Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-security-groups/d4f27106-2055-4b4b-af1d-c3a386e69ecf HTTP/1.1 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9kutGDiDNo7VKvzz03VGOVZsasV4CdQbDpTKZg2hJ3SQopqUj6M2WVv-6-aR8zn7rqbr83Pdt8Gy4-v-35_nZJnct57mx21dF89aLUGjSD62KnH-Ff75Y5yGMX3C8-StcV6JXnvmbBCG-B8i5jBhD3Wt04o2CW6bKD3NvhW9b02gak Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 1b63f3493a8040d1bd89bd5d4876093d Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1284651542 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b63f3493a8040d1bd89bd5d4876093d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1b63f3493a8040d1bd89bd5d4876093d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1b63f3493a8040d1bd89bd5d4876093d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1b63f3493a8040d1bd89bd5d4876093d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1284651542 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 1b63f3493a8040d1bd89bd5d4876093d Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1284651542 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-SecurityGroupRulesTestJSON-1284651542-project Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0a863259f2734546b6dc94e6c8114842 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1284651542-project Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: exception: Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-ac3bb6bb-d1b8-4287-bfb8-1ed64b113479'] Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'd4f27106-2055-4b4b-af1d-c3a386e69ecf'} Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 13:29:35.287289 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac3bb6bb-d1b8-4287-bfb8-1ed64b113479'] Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac3bb6bb-d1b8-4287-bfb8-1ed64b113479'] Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac3bb6bb-d1b8-4287-bfb8-1ed64b113479'] Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac3bb6bb-d1b8-4287-bfb8-1ed64b113479'] Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a7311d5-5c7c-4159-89a4-dc890fea4851 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Returning 404 to user: Security group d4f27106-2055-4b4b-af1d-c3a386e69ecf does not exist Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: Neutron server returns request_ids: ['req-ac3bb6bb-d1b8-4287-bfb8-1ed64b113479'] {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:29:35.294519 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a7311d5-5c7c-4159-89a4-dc890fea4851 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d4f27106-2055-4b4b-af1d-c3a386e69ecf" status: 404 len: 194 microversion: 2.1 time: 0.064469 Oct 28 13:29:35.301811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d9710db0-a461-40e6-b6aa-478d2f27eb54 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27baf3c3a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:35.303984 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2625/5170] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:35 2022] DELETE /compute/v2.1/os-security-groups/d4f27106-2055-4b4b-af1d-c3a386e69ecf => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:29:36.130887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d9710db0-a461-40e6-b6aa-478d2f27eb54 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/868e7a47-04f2-4106-9b6e-fa2fa013c906" status: 202 len: 0 microversion: 2.1 time: 0.836082 Oct 28 13:29:36.131848 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2546/5171] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:35 2022] DELETE /compute/v2.1/os-security-groups/868e7a47-04f2-4106-9b6e-fa2fa013c906 => generated 0 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:36.142899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4bd07bdd-eb16-4df0-973b-f4317b5a1ce0 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b9bc9e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:36.619634 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4bd07bdd-eb16-4df0-973b-f4317b5a1ce0 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/20cb6ce2-2cf5-4bf6-a668-a52831267736" status: 202 len: 0 microversion: 2.1 time: 0.483499 Oct 28 13:29:36.620758 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2626/5172] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:36 2022] DELETE /compute/v2.1/os-security-groups/20cb6ce2-2cf5-4bf6-a668-a52831267736 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:36.629457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07490df5-7314-4a70-b145-6dcfa9a163cb tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b85a89d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:37.055429 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07490df5-7314-4a70-b145-6dcfa9a163cb tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4665be80-7d10-4428-a6e6-575b479ebd60" status: 202 len: 0 microversion: 2.1 time: 0.429420 Oct 28 13:29:37.057130 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2547/5173] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:36 2022] DELETE /compute/v2.1/os-security-groups/4665be80-7d10-4428-a6e6-575b479ebd60 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:37.065208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9ac830a-246a-41a8-8554-2b1d30f8967f tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b9490dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:37.644385 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9ac830a-246a-41a8-8554-2b1d30f8967f tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/560bd93b-1d51-4c22-9d42-14132006dbbe" status: 202 len: 0 microversion: 2.1 time: 0.583001 Oct 28 13:29:37.646186 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2627/5174] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:37 2022] DELETE /compute/v2.1/os-security-groups/560bd93b-1d51-4c22-9d42-14132006dbbe => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:37.654272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-972e61cb-80fb-4429-a563-641865fc4547 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] Calling method '.version_select at 0x7f27b856d160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:38.268963 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-972e61cb-80fb-4429-a563-641865fc4547 tempest-SecurityGroupRulesTestJSON-1284651542 tempest-SecurityGroupRulesTestJSON-1284651542-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ee9bd315-c347-47d1-8f46-be01dc60b5ae" status: 202 len: 0 microversion: 2.1 time: 0.618706 Oct 28 13:29:38.269765 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2548/5175] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 13:29:37 2022] DELETE /compute/v2.1/os-security-groups/ee9bd315-c347-47d1-8f46-be01dc60b5ae => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:29:48.300071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=37 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:48.309968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=92 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:48.646805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-520545811", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:48.798922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] validate_networks() for [('b2c627c7-7dac-4912-88cf-802713af8af7', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:29:50.103038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:29:50.104224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:29:50.104886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:29:50.105620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:29:50.106236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:29:50.122277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:50.123110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:50.123725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:50.128962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:50.128962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:50.128962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:50.150469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:29:50.157661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for user 65484989d170478c88a1ff8a1f378b2a and project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:29:50.176878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:29:50.180601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:29:50.360058 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b0d5510-e334-4b0f-a935-8033d624e0df tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.071959 Oct 28 13:29:50.367411 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2628/5176] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:29:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:29:50.369910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:50.370829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:29:50.382494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91831a1b-2945-417d-8a3c-bc6cf715ce03 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:50.383340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-91831a1b-2945-417d-8a3c-bc6cf715ce03 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:50.472569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-91831a1b-2945-417d-8a3c-bc6cf715ce03 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:50.483062 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91831a1b-2945-417d-8a3c-bc6cf715ce03 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1221 microversion: 2.1 time: 0.112445 Oct 28 13:29:50.483995 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2549/5177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:50 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:50.634681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1763154919", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:29:50.734240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] validate_networks() for [('b2c627c7-7dac-4912-88cf-802713af8af7', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:29:51.716309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:29:51.716876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:29:51.717219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:29:51.717624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:29:51.718036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:29:51.746924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:51.747435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:51.747860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:51.748595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:51.749052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:51.749477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:51.808704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:29:51.827707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for user 65484989d170478c88a1ff8a1f378b2a and project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:29:51.894433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:29:51.896769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:29:52.150461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e85bee0e-5094-4890-b208-573d911b0621 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.521322 Oct 28 13:29:52.163185 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2629/5178] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:29:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:29:52.172963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-044eaf99-6f5b-4e0c-a649-f2f0ae9a7958 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:52.173598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-044eaf99-6f5b-4e0c-a649-f2f0ae9a7958 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:52.331193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-044eaf99-6f5b-4e0c-a649-f2f0ae9a7958 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:52.347410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-044eaf99-6f5b-4e0c-a649-f2f0ae9a7958 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1222 microversion: 2.1 time: 0.184537 Oct 28 13:29:52.348537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2550/5179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:52 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:53.376465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2359c622-4748-454c-b2da-aa3d7aaf51ab tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:53.381643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2359c622-4748-454c-b2da-aa3d7aaf51ab tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:53.547518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2359c622-4748-454c-b2da-aa3d7aaf51ab tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:53.557746 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2359c622-4748-454c-b2da-aa3d7aaf51ab tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1222 microversion: 2.1 time: 0.192206 Oct 28 13:29:53.568266 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2630/5180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:53 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:54.592637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:54.593260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:54.608095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:54.608600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:54.609044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:54.611589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:54.614112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:54.637307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:54.720600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:54.730696 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-342df405-8796-48b8-a69e-0ef4adac78c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1218 microversion: 2.1 time: 0.141881 Oct 28 13:29:54.734726 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2551/5181] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:54 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:55.765161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:55.765864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:55.780676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:55.784816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:55.784816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:55.784816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:55.785080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:55.785418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:56.032444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:56.042273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c4438c6-98cc-4be3-8363-398d5cb8e788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1282 microversion: 2.1 time: 0.284809 Oct 28 13:29:56.047740 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2631/5182] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:55 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1282 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:57.075792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:57.076343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:57.093653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:57.094179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:57.094624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:57.098367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:57.098895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:57.099335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:57.283736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:57.295843 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81ecc19f-4d2b-464a-a40e-1f1a45c1bfa7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1280 microversion: 2.1 time: 0.221967 Oct 28 13:29:57.295843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2552/5183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:57 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:58.319380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:58.320645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:58.335277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:58.339158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:58.340184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:58.342715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:58.344401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:58.351816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:58.712293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:29:58.727263 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9336a3b-afc1-47e9-aafc-e9c7f6440be3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1280 microversion: 2.1 time: 0.411571 Oct 28 13:29:58.727926 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2632/5184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:58 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1280 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:29:59.753952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:29:59.754666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:29:59.777233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:59.777811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:59.779572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:29:59.780391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:29:59.781890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:29:59.784601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:00.396376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:00.411002 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aeeb6b5f-35ce-4eda-89ff-64c8045b328e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.661322 Oct 28 13:30:00.412336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2553/5185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:29:59 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:01.437356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:01.438402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:01.456137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:01.456748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:01.457011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:01.457723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:01.458196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:01.458606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:01.783955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:01.895332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:01.898612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:01.927471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:01.929809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:01.930369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:01.931875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:01.933784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:01.935311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:01.998492 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-356564de-2a71-4c74-9df7-1bef6ac4ce03 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/ips" status: 200 len: 146 microversion: 2.1 time: 0.119363 Oct 28 13:30:02.000093 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2554/5186] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:30:01 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/ips => generated 146 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:02.187257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:02.202124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f0c38c8-678b-44a7-ba64-a2bff03a333d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.765779 Oct 28 13:30:02.203484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2633/5187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:01 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:02.353969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-28115458-419d-4cf2-9f3c-e6752a10f050 req-13c3cc66-86e2-4cb0-a4fb-0de0a8c5f905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc0c05a-ae51-4799-bfa7-8321c75a7bb1", "tag": "98989e25-0295-479a-b6db-9849c0cf340f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:02.373632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:02.376362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-28115458-419d-4cf2-9f3c-e6752a10f050 req-13c3cc66-86e2-4cb0-a4fb-0de0a8c5f905 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:02.377701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-28115458-419d-4cf2-9f3c-e6752a10f050 req-13c3cc66-86e2-4cb0-a4fb-0de0a8c5f905 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:02.395333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-28115458-419d-4cf2-9f3c-e6752a10f050 req-13c3cc66-86e2-4cb0-a4fb-0de0a8c5f905 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:02.434014 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-28115458-419d-4cf2-9f3c-e6752a10f050 req-13c3cc66-86e2-4cb0-a4fb-0de0a8c5f905 service nova] Creating event network-changed:98989e25-0295-479a-b6db-9849c0cf340f for instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 on n-h2-862876-2 Oct 28 13:30:02.451087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-28115458-419d-4cf2-9f3c-e6752a10f050 req-13c3cc66-86e2-4cb0-a4fb-0de0a8c5f905 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100979 Oct 28 13:30:02.452360 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2555/5188] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:03.227302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:03.228596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:03.260389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:03.261531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:03.263709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:03.266269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:03.272611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:03.272611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:03.553314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=14 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:04.539055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-58351871-d62f-477f-9127-81e70ac3d253 req-2ce66fbc-09c6-4e95-877a-2d1ec4d55cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84d5e6a-5429-4e85-8595-b17f9dcf17b5", "tag": "885c4a89-eec4-4bff-9787-c06c44e55466"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:04.557303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:04.571541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef212f26-1e6d-4f89-b532-02a9f187df39 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 1.349448 Oct 28 13:30:04.572399 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2634/5189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:03 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:04.576098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-58351871-d62f-477f-9127-81e70ac3d253 req-2ce66fbc-09c6-4e95-877a-2d1ec4d55cbc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:04.587577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-58351871-d62f-477f-9127-81e70ac3d253 req-2ce66fbc-09c6-4e95-877a-2d1ec4d55cbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:04.588038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-58351871-d62f-477f-9127-81e70ac3d253 req-2ce66fbc-09c6-4e95-877a-2d1ec4d55cbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:04.621891 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-58351871-d62f-477f-9127-81e70ac3d253 req-2ce66fbc-09c6-4e95-877a-2d1ec4d55cbc service nova] Creating event network-changed:885c4a89-eec4-4bff-9787-c06c44e55466 for instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 on n-h2-862876-2 Oct 28 13:30:04.644957 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-58351871-d62f-477f-9127-81e70ac3d253 req-2ce66fbc-09c6-4e95-877a-2d1ec4d55cbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109832 Oct 28 13:30:04.645891 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2556/5190] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:30:05.599439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:05.600564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:05.618192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:05.618692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:05.619163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:05.620090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:05.620556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:05.620984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:05.781122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa23d992-928e-496c-a8fb-3c360974bed8 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Action: 'create', calling method: .version_select at 0x7f27b9a45700>, body: {"keypair": {"name": "tempest-keypair-1221394670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ5ZWgrmLgbENbS0zmw2AX3Euy/f1Fi9OGB5eV0jwTAw0q8yZB2j7Lt8TTrQoA232MULGZC7h3cmqjRjkRNNGo0+AYjn4MzhUWUzbEwmXZSxZ72qklzsf6IuqcXKtqDEw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:05.831863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-aa23d992-928e-496c-a8fb-3c360974bed8 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Getting quotas for project 530d2cb6a5aa4795a74034a0c3c0cf4b. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:30:05.856348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-aa23d992-928e-496c-a8fb-3c360974bed8 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Getting quotas for user e8d879c0c98b47cda7509ac2392e889d and project 530d2cb6a5aa4795a74034a0c3c0cf4b. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:30:05.991360 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa23d992-928e-496c-a8fb-3c360974bed8 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.422416 Oct 28 13:30:05.992292 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2635/5191] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:30:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:06.229889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:06.242306 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b8b7da2-3bb2-4e2e-a882-12767230fb73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.644208 Oct 28 13:30:06.244744 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2557/5192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:05 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:06.592410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b499a90-ea76-4353-a8bf-36f250a78c92"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:06.595040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:06.605263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:06.606083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:06.606720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:06.607679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:06.608348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:06.608943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:07.268692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:07.269313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:07.288123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:07.288999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:07.304897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:07.308087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:07.320116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:07.320785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:07.731272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:07.743049 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28d5f74d-d67f-4206-9991-a9e6927d7c73 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.475551 Oct 28 13:30:07.744306 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2558/5193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:07 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:07.854667 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61b6d5d3-3289-41e3-bb60-6740fd4d6f12 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.267422 Oct 28 13:30:07.862054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2636/5194] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:30:06 2022] POST /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments => generated 194 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:08.770000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:08.770633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:08.819802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:08.820441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:08.820902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:08.821657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:08.822123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:08.822543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:09.605098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:09.615197 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87cdd478-5a6f-4a7b-ab09-9b54cd1155d3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.850822 Oct 28 13:30:09.616252 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2559/5195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:08 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:10.648041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:10.649931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:10.672977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:10.674342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:10.676460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:10.680275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:10.683110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:10.683886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:11.102656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:11.114256 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b6f1960-4aa5-4718-811e-8142d2d5c982 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.472708 Oct 28 13:30:11.117186 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2637/5196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:10 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:12.105333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-103376735", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a551847c-a716-449d-9774-90c67df219d6"}], "security_groups": [{"name": "tempest-securitygroup--1352513860"}], "key_name": "tempest-keypair-1221394670", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:12.144778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:12.146543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:12.165398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:12.165398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:12.188252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:12.191128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:12.191801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:12.192400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:12.564637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:12.589565 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-168f3d7d-6674-46bb-92d1-6f446679b253 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.455120 Oct 28 13:30:12.612030 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2638/5197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:12 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:12.898104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] validate_networks() for [('a551847c-a716-449d-9774-90c67df219d6', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:30:13.621303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:13.622651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:13.644370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:13.649978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:13.654008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:13.654996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:13.671459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:13.671459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:13.976254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:14.002980 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bc06f11c-7485-49be-8f97-0bbd386330f7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.368402 Oct 28 13:30:14.004161 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2639/5198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:13 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:14.029821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Getting quotas for project 530d2cb6a5aa4795a74034a0c3c0cf4b. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:30:14.036604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Getting quotas for user e8d879c0c98b47cda7509ac2392e889d and project 530d2cb6a5aa4795a74034a0c3c0cf4b. Resources: dict_keys(['metadata_items']) {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:30:14.052958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:30:14.053649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:30:14.054292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:30:14.054899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:30:14.055457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:30:14.067005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:14.067779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:14.068431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:14.069498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:14.070118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:14.070692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:14.096428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Getting quotas for project 530d2cb6a5aa4795a74034a0c3c0cf4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:30:14.099284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Getting quotas for user e8d879c0c98b47cda7509ac2392e889d and project 530d2cb6a5aa4795a74034a0c3c0cf4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:30:14.113204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:30:14.115792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:30:14.284024 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8bff25f-7c63-47bb-8021-0b623bf8e165 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.184899 Oct 28 13:30:14.294210 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2560/5199] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:30:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:30:14.303367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01d91800-26e5-454d-88a1-f646689a209b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:14.305345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-01d91800-26e5-454d-88a1-f646689a209b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:14.478024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01d91800-26e5-454d-88a1-f646689a209b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:14.494916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01d91800-26e5-454d-88a1-f646689a209b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1269 microversion: 2.1 time: 0.200637 Oct 28 13:30:14.509602 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2640/5200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:14 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:14.770872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9c5a4f97-24ce-4ea0-8b94-baf2a14e5cd0 req-c35cfb34-f4c4-42f3-8228-3a02aaf18d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc0c05a-ae51-4799-bfa7-8321c75a7bb1", "name": "network-vif-plugged", "status": "completed", "tag": "98989e25-0295-479a-b6db-9849c0cf340f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:14.794674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c5a4f97-24ce-4ea0-8b94-baf2a14e5cd0 req-c35cfb34-f4c4-42f3-8228-3a02aaf18d9d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:14.794674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c5a4f97-24ce-4ea0-8b94-baf2a14e5cd0 req-c35cfb34-f4c4-42f3-8228-3a02aaf18d9d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:14.794674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c5a4f97-24ce-4ea0-8b94-baf2a14e5cd0 req-c35cfb34-f4c4-42f3-8228-3a02aaf18d9d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:14.808623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9c5a4f97-24ce-4ea0-8b94-baf2a14e5cd0 req-c35cfb34-f4c4-42f3-8228-3a02aaf18d9d service nova] Creating event network-vif-plugged:98989e25-0295-479a-b6db-9849c0cf340f for instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 on n-h2-862876-2 Oct 28 13:30:14.831751 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9c5a4f97-24ce-4ea0-8b94-baf2a14e5cd0 req-c35cfb34-f4c4-42f3-8228-3a02aaf18d9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066553 Oct 28 13:30:14.833122 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2561/5201] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:30:15.033206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:15.036558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:15.060767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:15.073403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:15.082495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:15.084109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:15.092595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:15.092595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:15.362150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:15.378509 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0c7faf39-e9ba-4aee-85b3-1d5f3f92c8f2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.352613 Oct 28 13:30:15.379844 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2641/5202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:15 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:15.524505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29f22acc-c569-43e8-9916-12583ac7c57b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:15.525313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-29f22acc-c569-43e8-9916-12583ac7c57b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:15.703327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29f22acc-c569-43e8-9916-12583ac7c57b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:15.715645 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-29f22acc-c569-43e8-9916-12583ac7c57b tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1269 microversion: 2.1 time: 0.192706 Oct 28 13:30:15.723493 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2562/5203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:15 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1269 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:16.401503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:16.402124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:16.416071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:16.416592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:16.422494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:16.423832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:16.424666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:16.425277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:16.745232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:16.745856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:16.758266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:16.772224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:16.772224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:16.772682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:16.773158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:16.773579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:16.784481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:16.794057 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-31bc936c-5c49-4590-b6d0-43eada40527f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.396357 Oct 28 13:30:16.807941 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2642/5204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:16 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:16.983841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:16.990655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-25d98052-ed85-4cd6-97cb-0d2f12ec25ee req-edb9b117-b167-4db0-ba7e-f9d8bcc53340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84d5e6a-5429-4e85-8595-b17f9dcf17b5", "name": "network-vif-plugged", "status": "completed", "tag": "885c4a89-eec4-4bff-9787-c06c44e55466"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:16.998240 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b59b62b1-0ff6-4a8a-a321-940e5319bc28 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1273 microversion: 2.1 time: 0.257640 Oct 28 13:30:17.011541 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2563/5205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:16 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:17.026845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-25d98052-ed85-4cd6-97cb-0d2f12ec25ee req-edb9b117-b167-4db0-ba7e-f9d8bcc53340 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:17.033180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-25d98052-ed85-4cd6-97cb-0d2f12ec25ee req-edb9b117-b167-4db0-ba7e-f9d8bcc53340 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:17.033688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-25d98052-ed85-4cd6-97cb-0d2f12ec25ee req-edb9b117-b167-4db0-ba7e-f9d8bcc53340 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:17.075314 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-25d98052-ed85-4cd6-97cb-0d2f12ec25ee req-edb9b117-b167-4db0-ba7e-f9d8bcc53340 service nova] Creating event network-vif-plugged:885c4a89-eec4-4bff-9787-c06c44e55466 for instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 on n-h2-862876-2 Oct 28 13:30:17.091504 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-25d98052-ed85-4cd6-97cb-0d2f12ec25ee req-edb9b117-b167-4db0-ba7e-f9d8bcc53340 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106116 Oct 28 13:30:17.095068 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2643/5206] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:30:17.821778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:17.823762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:17.842451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:17.842981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:17.843421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:17.844117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:17.847727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:17.848437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:18.027371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:18.028082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:18.053562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:18.054056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:18.054497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:18.061897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:18.062429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:18.063062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:18.253311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:18.263677 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d3a3c2a4-20e2-4b89-b80b-ba525beb91e6 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1265 microversion: 2.1 time: 0.241020 Oct 28 13:30:18.270687 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2644/5207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:18 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:18.372634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:18.381171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ddc302f9-7fd4-4f1a-9057-b78b0ae5255d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1322 microversion: 2.1 time: 0.563369 Oct 28 13:30:18.385544 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2564/5208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:17 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:19.307810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:19.318002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:19.353948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:19.357797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:19.360882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:19.362336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:19.364480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:19.368524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:19.370436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:19.412765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:19.413566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:19.435058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:19.440952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:19.449640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:19.456076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:19.456869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:19.458121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:19.570272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:19.974237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:19.987910 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26cbc44c-fcb0-4cfe-be04-7de63e564b9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1516 microversion: 2.1 time: 0.579422 Oct 28 13:30:19.999403 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2565/5209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:19 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1516 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:20.034284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:20.042533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:20.072977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:20.073740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:20.074768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:20.075322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:20.075939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:20.089503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:20.210131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'flavor' on Instance uuid f84d5e6a-5429-4e85-8595-b17f9dcf17b5 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:30:20.392641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:20.401407 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aabd11fe-4773-4fa1-884b-da5294d347f5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1329 microversion: 2.1 time: 1.105692 Oct 28 13:30:20.419553 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2645/5210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:19 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1329 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:20.750166 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8faee86-d7ce-4dda-95f0-5b3e21c40f0d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action" status: 200 len: 32 microversion: 2.1 time: 0.723991 Oct 28 13:30:20.750782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2566/5211] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:30:20 2022] POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action => generated 32 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:30:20.761175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:20.762071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:20.769149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:20.769984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:20.770577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:20.772012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:20.772740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:20.773230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:21.047213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:21.056971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-350d60c1-e474-4a12-af64-453786070788 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.298959 Oct 28 13:30:21.058073 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2646/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:20 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:21.445129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:21.473695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:21.482787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:21.483420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:21.484046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:21.484984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:21.489224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:21.489833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:21.672549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:21.681819 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63685270-b1f4-42d2-a1fd-c843a9658f93 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1327 microversion: 2.1 time: 0.253778 Oct 28 13:30:21.682398 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2567/5213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:21 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1327 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:22.091461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:22.093274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:22.129657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:22.130736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:22.138351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:22.142217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:22.144550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:22.146572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:22.431341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:22.443567 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9746e75b-cfd9-4aa9-a619-144c6c16c748 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.361049 Oct 28 13:30:22.444449 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2647/5214] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:22 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:22.708091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:22.708913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:22.722655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:22.723394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:22.723943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:22.725670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:22.726166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:22.726704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:23.068436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:23.078082 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-68995032-1005-416c-a94f-4be2952d5d45 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1395 microversion: 2.1 time: 0.376078 Oct 28 13:30:23.079305 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2568/5215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:22 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1395 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:23.471418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:23.472034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:23.478605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:23.491343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:23.492950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:23.492950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:23.496522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:23.496522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:23.639664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5e50dd33-6557-4412-9a0d-a7b2ddbcdec7 req-d372ee8d-d769-406e-8c95-6b800f252918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b54026-c9c9-4f1a-b2ba-bd088dead277", "tag": "509952ff-014a-495f-b995-8a8f7add21a3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:23.661917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e50dd33-6557-4412-9a0d-a7b2ddbcdec7 req-d372ee8d-d769-406e-8c95-6b800f252918 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:23.662411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e50dd33-6557-4412-9a0d-a7b2ddbcdec7 req-d372ee8d-d769-406e-8c95-6b800f252918 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:23.662872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e50dd33-6557-4412-9a0d-a7b2ddbcdec7 req-d372ee8d-d769-406e-8c95-6b800f252918 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:23.675859 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5e50dd33-6557-4412-9a0d-a7b2ddbcdec7 req-d372ee8d-d769-406e-8c95-6b800f252918 service nova] Creating event network-changed:509952ff-014a-495f-b995-8a8f7add21a3 for instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 on n-h1-862876-2 Oct 28 13:30:23.682097 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5e50dd33-6557-4412-9a0d-a7b2ddbcdec7 req-d372ee8d-d769-406e-8c95-6b800f252918 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047143 Oct 28 13:30:23.683457 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2569/5216] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:30:24.057961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:24.073397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2bc81640-fbce-4c50-bf0b-5d70fdfe2457 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.605353 Oct 28 13:30:24.077927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2648/5217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:23 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:24.102061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:24.107140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:24.110801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:24.123310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:24.124094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:24.127508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:24.128548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:24.132865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:24.133719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:24.141381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:24.633448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:24.645054 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bc80e76b-b04b-4782-96ce-068e386c55ca tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1395 microversion: 2.1 time: 0.545182 Oct 28 13:30:24.648318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2570/5218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:24 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1395 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:25.105249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:25.105942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:25.118286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:25.124122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:25.134637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:25.135355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:25.136113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:25.136593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:25.137021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:25.672538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:25.676058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:25.682410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:25.690735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:25.692037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:25.692865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:25.695196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:25.696652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:25.697724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:25.726404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=12 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:25.769549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:25.789072 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4eb6bb6-e9f8-436a-816a-4728881835d7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.687769 Oct 28 13:30:25.789726 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2649/5219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:25 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:25.974784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:26.008466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a28783a9-0802-49ff-93ca-549668d8bf47 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1395 microversion: 2.1 time: 0.340711 Oct 28 13:30:26.022771 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2571/5220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:25 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1395 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:26.292060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:26.294398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:26.310115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:26.310607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:26.312531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:26.314765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:26.315347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:26.315914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:26.352939 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe62ae67-6ed5-4f85-9825-11c4fa84165e tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065574 Oct 28 13:30:26.360398 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2650/5221] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:30:26 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:26.366592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:26.367454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:26.378663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:26.379371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:26.380009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:26.380876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:26.381544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:26.382170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:26.422824 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-45729325-16d2-4ff9-a1d5-c4fa3ef4c36b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/1b499a90-ea76-4353-a8bf-36f250a78c92" status: 200 len: 194 microversion: 2.1 time: 0.061779 Oct 28 13:30:26.424020 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2572/5222] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Oct 28 13:30:26 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/1b499a90-ea76-4353-a8bf-36f250a78c92 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:26.816448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:26.817072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:26.823426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:26.828206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:26.828206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:26.828206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:26.828206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:26.828206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:27.002708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:27.011161 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86f3c329-fae1-42d8-9d0b-e7a9305a3409 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.198642 Oct 28 13:30:27.015034 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2651/5223] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:26 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:27.033997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:27.034784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:27.047930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:27.049464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:27.049464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:27.050069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:27.050598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:27.051113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:27.341030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:27.348885 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-65d872bb-383a-4ff8-9e4a-ad41e0f60077 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1395 microversion: 2.1 time: 0.318736 Oct 28 13:30:27.350038 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2573/5224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:27 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1395 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:28.045652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:28.046443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:28.060213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:28.060714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:28.062181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:28.063104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:28.063595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:28.064029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:28.315936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:28.330230 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35456a41-bf77-4b30-b95c-3e3b52d7d375 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.287621 Oct 28 13:30:28.334622 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2652/5225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:28 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:28.382428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:28.384301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:28.393019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:28.394025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:28.394581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:28.395425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:28.396785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:28.397281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:28.717019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:28.740009 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2494229e-9cd7-4815-9f2a-800f49760f14 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1395 microversion: 2.1 time: 0.362901 Oct 28 13:30:28.742236 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2574/5226] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:28 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1395 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:29.361994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:29.369221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:29.393533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:29.393950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:29.401529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:29.401529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:29.401529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:29.401529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:29.637796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:29.655552 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2590e845-606b-42f6-af01-9c6ad754706a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.292681 Oct 28 13:30:29.656872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2653/5227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:29 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:29.767388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:29.768000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:29.785972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:29.786484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:29.787542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:29.790349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:29.791113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:29.792627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:29.947562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3523fdd6-5d80-4768-871d-87ed4777e931"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:29.950816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:29.972402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:29.973560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:29.977552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:29.984639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:29.984639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:29.984639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:30.069146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:30.096709 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eaf04814-5759-40bd-a485-0d6409a918cf tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1395 microversion: 2.1 time: 0.319009 Oct 28 13:30:30.120061 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2575/5228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:29 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1395 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:30.485017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f6a1f3bf-4ebc-4bfc-a103-481cd7012be9 req-b7a1e868-600f-4c19-990d-f11663f80c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b54026-c9c9-4f1a-b2ba-bd088dead277", "name": "network-vif-plugged", "status": "completed", "tag": "509952ff-014a-495f-b995-8a8f7add21a3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:30.503305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6a1f3bf-4ebc-4bfc-a103-481cd7012be9 req-b7a1e868-600f-4c19-990d-f11663f80c45 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:30.504060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6a1f3bf-4ebc-4bfc-a103-481cd7012be9 req-b7a1e868-600f-4c19-990d-f11663f80c45 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:30.504643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6a1f3bf-4ebc-4bfc-a103-481cd7012be9 req-b7a1e868-600f-4c19-990d-f11663f80c45 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:30.533287 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f6a1f3bf-4ebc-4bfc-a103-481cd7012be9 req-b7a1e868-600f-4c19-990d-f11663f80c45 service nova] Creating event network-vif-plugged:509952ff-014a-495f-b995-8a8f7add21a3 for instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 on n-h1-862876-2 Oct 28 13:30:30.545079 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f6a1f3bf-4ebc-4bfc-a103-481cd7012be9 req-b7a1e868-600f-4c19-990d-f11663f80c45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066718 Oct 28 13:30:30.550783 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2576/5229] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:30:30.686485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:30.686485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:30.699484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:30.700120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:30.704262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:30.705419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:30.706032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:30.706760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:30.963391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:30.973263 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-178b172f-08cb-4e9c-94fb-1f8d0a4d1593 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.293211 Oct 28 13:30:30.974978 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2577/5230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:30 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:31.127670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:31.128382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:31.134925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:31.135499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:31.136072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:31.136835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:31.137353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:31.137993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:31.270931 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-100bce7e-7682-42ee-ab9b-917c774a8ea4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "POST /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.327550 Oct 28 13:30:31.277642 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2654/5231] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:30:29 2022] POST /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments => generated 194 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:31.392918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:31.439899 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0901d0a3-2079-4968-b13e-f3ec14771b16 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1395 microversion: 2.1 time: 0.316049 Oct 28 13:30:31.440497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2578/5232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:31 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1395 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:31.998994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:31.999993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:32.012637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:32.017828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:32.018798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:32.022869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:32.023603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:32.025302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:32.466512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:32.468784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:32.498443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:32.499012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:32.499457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:32.500188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:32.500650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:32.501067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:32.925241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:32.936157 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7a7bdc9f-55d1-4b46-925d-c259ec89966e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.941679 Oct 28 13:30:32.947597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2655/5233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:31 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:33.001136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:33.012698 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad6611d8-b126-4788-8024-a12835e847e5 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1576 microversion: 2.1 time: 0.550027 Oct 28 13:30:33.016145 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2579/5234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:32 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1576 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:33.045903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:33.046563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:33.060751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:33.061411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:33.063398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:33.065402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:33.066020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:33.069099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:33.230799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-817ecfa0-a88a-4d71-b8d2-0b949bf27a2f tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188261 Oct 28 13:30:33.230799 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2656/5235] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:30:33 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:33.970167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:33.971133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:33.993338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:33.993853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:33.994297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:33.995044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:34.000209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:34.009247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:34.378889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:34.390723 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f72ae374-9d03-41e9-871f-f267e973b8ef tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.433318 Oct 28 13:30:34.391961 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2580/5236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:33 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:35.415899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:35.416983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:35.436386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:35.441603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:35.442346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:35.443395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:35.444027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:35.445472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:36.040674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:36.053057 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f99ce36c-4b95-4efe-893e-a4f61b1facc0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.641501 Oct 28 13:30:36.073169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2657/5237] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:35 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:36.414227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:36.414869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:36.426108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:36.426910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:36.428114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:36.428968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:36.429668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:36.430249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:36.430771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0f869185-542a-40fe-bf16-923afdf0aa90 req-2483a68f-90af-49da-860c-357222a9c00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b54026-c9c9-4f1a-b2ba-bd088dead277", "tag": "509952ff-014a-495f-b995-8a8f7add21a3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:36.447968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0f869185-542a-40fe-bf16-923afdf0aa90 req-2483a68f-90af-49da-860c-357222a9c00b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:36.452971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0f869185-542a-40fe-bf16-923afdf0aa90 req-2483a68f-90af-49da-860c-357222a9c00b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:36.453553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0f869185-542a-40fe-bf16-923afdf0aa90 req-2483a68f-90af-49da-860c-357222a9c00b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:36.472518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0f869185-542a-40fe-bf16-923afdf0aa90 req-2483a68f-90af-49da-860c-357222a9c00b service nova] Creating event network-changed:509952ff-014a-495f-b995-8a8f7add21a3 for instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 on n-h1-862876-2 Oct 28 13:30:36.483372 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0f869185-542a-40fe-bf16-923afdf0aa90 req-2483a68f-90af-49da-860c-357222a9c00b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054550 Oct 28 13:30:36.486858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2658/5238] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:30:36.703114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:36.713392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-186553ae-24dd-44f2-b5dc-eaa81263ba06 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1576 microversion: 2.1 time: 0.303498 Oct 28 13:30:36.717040 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2581/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:36 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1576 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:37.079501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:37.080683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:37.093863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:37.097774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:37.099245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:37.100438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:37.102124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:37.104549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:37.752454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:37.760971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-112030c0-4273-42af-8b96-15ec215f581e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.686344 Oct 28 13:30:37.761646 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2659/5240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:37 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:38.790535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:38.791837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:38.805559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:38.806466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:38.808104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:38.812750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:38.813304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:38.814326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:39.178548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:39.190946 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-875508f0-6a9d-483d-9797-a1e895c2e112 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.405234 Oct 28 13:30:39.191470 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2582/5241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:38 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:40.217916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:40.218946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:40.226800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:40.227285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:40.227727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:40.230115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:40.230790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:40.231232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:40.609473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:40.619902 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19281fa7-0a6e-4d69-a58a-e19d9533cd44 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.405868 Oct 28 13:30:40.624114 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2660/5242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:40 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:41.652538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:41.653837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:41.665148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:41.667200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:41.668588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:41.670334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:41.672453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:41.677737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:41.963634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:41.987040 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b041be8e-b820-4427-b234-86b5385e3993 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.337844 Oct 28 13:30:41.991447 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2583/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:41 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:43.018016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:43.022400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:43.029794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:43.030564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:43.031194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:43.032319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:43.033063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:43.033758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:43.053596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:43.257997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:43.272008 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4ebaf3cf-e411-4e62-b5c7-b2a5d67a3805 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.258365 Oct 28 13:30:43.272779 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2661/5244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:43 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:44.296417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:44.297679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:44.305281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:44.306019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:44.306646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:44.307548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:44.308151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:44.308755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:44.495447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:44.504038 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bde8e7ce-403c-4fcf-91a9-dbda50c7e1a0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.211563 Oct 28 13:30:44.506793 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2584/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:44 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:45.531595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:45.532421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:45.557885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:45.558378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:45.558857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:45.560690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:45.561195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:45.561631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:45.732019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:45.741986 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1cadf9b9-7f7e-4329-bea9-860c8627b7d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.214440 Oct 28 13:30:45.743263 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2662/5246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:45 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:46.767834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:46.769317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:46.779919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:46.780659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:46.782194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:46.783312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:46.784039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:46.784742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:46.983685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:46.996260 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb4627d3-49ed-4388-863b-53bd86324d21 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.234594 Oct 28 13:30:46.996867 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2585/5247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:46 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:48.021805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:48.022425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:48.042908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:48.043296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:48.044016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:48.045165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:48.045866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:48.046496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:48.374261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:48.386877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-358e12c6-61e1-4e52-836c-35eb0f69cafe tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1522 microversion: 2.1 time: 0.371039 Oct 28 13:30:48.387697 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2663/5248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:48 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:49.215854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:49.218206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:49.226615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.227235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.227683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.228418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.228876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.229303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.267312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3d96733-e014-4b91-971d-70c8d3e5de82 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055861 Oct 28 13:30:49.268965 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2586/5249] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:30:49 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:49.410668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:49.411205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:49.412281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:49.413146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:49.420010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.420871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.422246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.423494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.423883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.424264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.424670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.425029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.425348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.426485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.427673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.428280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.450954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:49.470415 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09d92a0f-f2bf-4775-8fae-cf59b2e65e28 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/1b499a90-ea76-4353-a8bf-36f250a78c92" status: 200 len: 194 microversion: 2.1 time: 0.064272 Oct 28 13:30:49.471968 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2664/5250] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Oct 28 13:30:49 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/1b499a90-ea76-4353-a8bf-36f250a78c92 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:49.483253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:49.484014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:49.491984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.495432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.495432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.495432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.495432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.495432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.618481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:49.630478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-66921a5c-4159-4e9c-ac57-063f64776d4f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1502 microversion: 2.1 time: 0.223129 Oct 28 13:30:49.644887 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2587/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:49 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:49.657759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:49.659796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:49.675875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lazy-loading 'services' on Instance uuid 7da71137-52cf-4db7-884b-d421c3057b0c {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:30:49.676024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.676024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.676024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.676024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.676024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.676024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.842141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:49.853236 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c66b7b9-1490-4b3d-afc4-c772b7cac714 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1516 microversion: 2.1 time: 0.202284 Oct 28 13:30:49.853841 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2588/5252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:49 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:49.877640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2be6d2f7-2cb7-42cf-8ee9-85070bdcdf9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:49.881312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2be6d2f7-2cb7-42cf-8ee9-85070bdcdf9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 8fb59ddc-4ea0-4670-b0a3-e51336ef4f38] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:49.887893 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2be6d2f7-2cb7-42cf-8ee9-85070bdcdf9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Instance 8fb59ddc-4ea0-4670-b0a3-e51336ef4f38 could not be found. Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2be6d2f7-2cb7-42cf-8ee9-85070bdcdf9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/8fb59ddc-4ea0-4670-b0a3-e51336ef4f38/action HTTP/1.1 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 14 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: {"rescue": {}} Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 8fb59ddc-4ea0-4670-b0a3-e51336ef4f38 could not be found. Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '8fb59ddc-4ea0-4670-b0a3-e51336ef4f38', 'body': {'rescue': {}}} Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb59ddc-4ea0-4670-b0a3-e51336ef4f38 could not be found. Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb59ddc-4ea0-4670-b0a3-e51336ef4f38 could not be found. Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:30:49.894840 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb59ddc-4ea0-4670-b0a3-e51336ef4f38 could not be found. Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2be6d2f7-2cb7-42cf-8ee9-85070bdcdf9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 404 to user: Instance 8fb59ddc-4ea0-4670-b0a3-e51336ef4f38 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2be6d2f7-2cb7-42cf-8ee9-85070bdcdf9f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/8fb59ddc-4ea0-4670-b0a3-e51336ef4f38/action" status: 404 len: 111 microversion: 2.1 time: 0.024037 Oct 28 13:30:49.906863 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2589/5253] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:30:49 2022] POST /compute/v2.1/servers/8fb59ddc-4ea0-4670-b0a3-e51336ef4f38/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:30:49.907380 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ca0f28f-395a-419a-ba9a-d7aa2c9271e8 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/1b499a90-ea76-4353-a8bf-36f250a78c92" status: 202 len: 0 microversion: 2.1 time: 0.425548 Oct 28 13:30:49.907380 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2665/5254] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:30:49 2022] DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/1b499a90-ea76-4353-a8bf-36f250a78c92 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:30:49.931435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:49.933955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:49.944725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.945222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.945666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:49.946370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:49.946920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:49.947355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:50.284884 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23c02bff-4033-4e90-a2a7-b916ed7be006 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.379259 Oct 28 13:30:50.285595 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2590/5255] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:30:49 2022] POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:30:50.295028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:50.296651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:50.308173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=42 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:50.310005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:50.311037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:50.312388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:50.315956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:50.316802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:50.317343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:50.497397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:50.510928 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fdba6d5f-f62d-4d81-a87d-76c8590ba8bf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1521 microversion: 2.1 time: 0.220601 Oct 28 13:30:50.524028 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2666/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:50 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:51.538824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:51.540098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:51.548020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:51.548739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:51.549584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:51.550280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:51.550932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:51.551512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:51.729641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:51.738279 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-45bc07e0-45f6-4d24-8cea-07a87b10258e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1501 microversion: 2.1 time: 0.204370 Oct 28 13:30:51.739109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2591/5257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:51 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:51.766875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:51.770589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:51.777727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:51.778396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:51.779071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:51.779932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:51.780564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:51.781146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:51.807161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'flavor' on Instance uuid 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:30:51.820991 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Cannot 'rescue' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state paused Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action HTTP/1.1 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 14 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: {"rescue": {}} Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: exception: Cannot 'rescue' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state paused Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '5dc0c05a-ae51-4799-bfa7-8321c75a7bb1', 'body': {'rescue': {}}} Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 in vm_state paused. Cannot rescue while the instance is in this state. Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state paused Oct 28 13:30:51.823372 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state paused Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 409 to user: Cannot 'rescue' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state paused {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:30:51.827575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87b3007a-1eea-411c-8f74-45d933c69eed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action" status: 409 len: 144 microversion: 2.1 time: 0.062921 Oct 28 13:30:51.830628 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2667/5258] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:30:51 2022] POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action => generated 144 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:30:51.835423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:51.836292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:51.843445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:51.844165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:51.845493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:51.846588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:51.847257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:51.848562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:52.137137 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b63da91-386f-4c0c-9d73-247585749fb4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.305436 Oct 28 13:30:52.137808 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2592/5259] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:30:51 2022] POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:30:52.152059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:52.154607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:52.168028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:52.168778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:52.169329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:52.170234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:52.171359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:52.172100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:52.433764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:52.444276 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40b8fba5-e6a0-474a-92f7-81f5be06bbca tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1508 microversion: 2.1 time: 0.300254 Oct 28 13:30:52.444884 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2668/5260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:52 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:30:53.471211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:53.471928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:53.494675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:53.495696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:53.496443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:53.497190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:53.499261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:53.500247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:53.739908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:53.749096 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eeca8511-8371-400b-b8ad-37791de8e2d6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1516 microversion: 2.1 time: 0.283243 Oct 28 13:30:53.755690 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2593/5261] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:53 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:56.623822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:30:56.626119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:56.641068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:56.641571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:56.642026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:56.645212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:56.645716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:56.646153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:56.702607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'flavor' on Instance uuid 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:30:57.046355 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ad3c39c-a223-4512-81d2-29e3e85f50e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action" status: 200 len: 32 microversion: 2.1 time: 0.427023 Oct 28 13:30:57.062639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:57.063461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:57.066283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=46 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:30:57.070010 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2669/5262] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:30:56 2022] POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action => generated 32 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:30:57.077169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:57.080101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:57.080101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:57.080101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:57.080101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:57.080101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:57.309279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:57.325232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-749102dc-fe9d-4a3c-b25f-31950a2c3a20 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.263765 Oct 28 13:30:57.326059 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2594/5263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:57 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:57.798769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:57.806585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:57.806585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:57.806951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:57.807464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:57.808166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:57.808616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:57.809039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:57.842308 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3791d078-23aa-477c-850a-44fea4d1d0bb tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/3523fdd6-5d80-4768-871d-87ed4777e931" status: 200 len: 194 microversion: 2.1 time: 0.048781 Oct 28 13:30:57.842983 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2670/5264] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Oct 28 13:30:57 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/3523fdd6-5d80-4768-871d-87ed4777e931 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:30:57.864901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:57.864901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:57.871450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:57.871987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:57.872470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:57.873183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:57.873642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:57.874067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:57.974464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lazy-loading 'services' on Instance uuid 7da71137-52cf-4db7-884b-d421c3057b0c {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:30:58.195616 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1422c42-13fb-47a7-a063-779ce170e39c tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/3523fdd6-5d80-4768-871d-87ed4777e931" status: 202 len: 0 microversion: 2.1 time: 0.345058 Oct 28 13:30:58.196968 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2595/5265] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:30:57 2022] DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments/3523fdd6-5d80-4768-871d-87ed4777e931 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:30:58.348857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:58.349717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:58.360772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:58.361518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:58.361953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:58.362650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:58.363132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:58.363579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:58.521772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:58.530351 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8896da28-345e-4edf-8da2-e29a31197383 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.185160 Oct 28 13:30:58.531509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2671/5266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:58 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:30:59.563837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:30:59.577239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:30:59.577239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:59.577239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:59.577239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:59.577239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:30:59.577239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:30:59.577239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:30:59.749947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:30:59.758080 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f966a17-102c-4aeb-b314-dd9b0328a7c2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.200860 Oct 28 13:30:59.758650 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2596/5267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:30:59 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:00.781715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:00.783154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:00.791277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:00.792136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:00.792832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:00.793864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:00.794563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:00.795242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:01.041983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:01.050736 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c29361e3-2b2a-441f-a8bc-452d4402a2d1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.272964 Oct 28 13:31:01.063465 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2672/5268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:00 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:02.075099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:02.075826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:02.084872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:02.085450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:02.086122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:02.087396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:02.088239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:02.088790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:02.359008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:02.368198 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-326d51f1-bf42-44a7-9a64-11990693d790 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.297186 Oct 28 13:31:02.374331 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2597/5269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:02 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:03.393855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:03.395396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:03.411062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:03.411974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:03.415529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:03.416476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:03.417122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:03.417730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:03.610380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:03.629702 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8918b5ec-5b41-42e9-9882-cd5463d92017 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.240048 Oct 28 13:31:03.644528 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2673/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:03 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:04.656835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:04.657473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:04.673518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:04.674025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:04.674476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:04.675229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:04.675692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:04.676522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:04.855277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:04.863081 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54663acb-e168-47a7-866a-a90c2f58dead tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.211071 Oct 28 13:31:04.863649 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2598/5271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:04 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:05.890597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:05.890597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:05.899961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:05.900661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:05.901283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:05.902155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:05.902765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:05.903356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:06.059700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:06.068955 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9f2cbe09-27a2-41ac-8b49-37cba72a505b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.184599 Oct 28 13:31:06.069846 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2674/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:05 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:06.485185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:06.488715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:06.501056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:06.501557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:06.502165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:06.502913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:06.503373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:06.503801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:06.551361 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2fec2bb9-f0f6-45ed-a2bf-47af2b2b8e34 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071659 Oct 28 13:31:06.552164 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2599/5273] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:31:06 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:31:06.710896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:06.713537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:06.720961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:06.721629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:06.722244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:06.723133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:06.725078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:06.725698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:06.742294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:06.762109 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d418e3b3-fee1-4e0e-a33c-724a01974bdf tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056189 Oct 28 13:31:06.762686 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2675/5274] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:31:06 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:31:06.837310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:06.837676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:06.852942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:06.853703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:06.854152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:06.854924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:06.855394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:06.855831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:06.884934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:31:07.086340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:07.091687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:07.092297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:07.100501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:07.101006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:07.101433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:07.102140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:07.102620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:07.103126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:07.262353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:07.274962 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fcc39827-32da-42d6-b50e-a1847eac45c6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.184926 Oct 28 13:31:07.274962 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2676/5275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:07 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:07.361549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-986cc08b-2701-48b6-ae97-b898c18cde62 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 204 len: 0 microversion: 2.1 time: 0.528037 Oct 28 13:31:07.363798 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2600/5276] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:31:06 2022] DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:31:07.370676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:07.371504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:07.378056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:07.378572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:07.379286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:07.379748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:07.380208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:07.380638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:07.560107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:07.569998 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ce1f8da-7bde-4319-a1a5-6394bbc6f17a tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1673 microversion: 2.1 time: 0.203367 Oct 28 13:31:07.578898 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2677/5277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:07 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:07.793998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d07d9a81-a519-49cc-9949-427b00c5000a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: .version_select at 0x7f27b93a4700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1137896014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfUdxw6//XJq2LkGghWzwQG6x+n37Oyf5YvN1t+JAYtmxHH47+5VGkqDhV1CbswaRfOUS2OhHeyN4PR/x19+MZ8VVqTmKMHZM8ctBbSpFd3Z5Dyp0Q6Ccxgye4LkmyRTw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:07.812164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d07d9a81-a519-49cc-9949-427b00c5000a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:31:07.818403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d07d9a81-a519-49cc-9949-427b00c5000a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:31:07.922867 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d07d9a81-a519-49cc-9949-427b00c5000a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.333206 Oct 28 13:31:07.923709 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2601/5278] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:31:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:08.296641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:08.297075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:08.304751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:08.305447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:08.305889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:08.306599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:08.307086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:08.307522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:08.487868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:08.506768 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2393fc9a-2d04-4366-9c3f-b63c87313c95 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.214401 Oct 28 13:31:08.507490 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2678/5279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:08 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:08.593619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:08.594366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:08.603792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:08.604301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:08.604748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:08.605469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:08.605940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:08.606374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:08.762106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:08.770764 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abea2d37-c265-4d13-84a2-307b5ad87f49 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1673 microversion: 2.1 time: 0.181091 Oct 28 13:31:08.775306 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2602/5280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:08 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:09.536874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:09.539889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:09.553183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:09.553755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:09.554209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:09.554966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:09.555433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:09.555868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:09.798886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:09.800747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:09.811495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:09.812357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:09.817661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:09.817661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:09.817661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:09.817661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:09.833263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:09.847880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef95e2e4-3149-41ad-ab35-f1cc78b4fa36 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.315629 Oct 28 13:31:09.849600 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2679/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:09 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:10.047494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:10.057160 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6bbc6c96-6c25-4644-9c51-63ab3b5e7311 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1673 microversion: 2.1 time: 0.267030 Oct 28 13:31:10.064552 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2603/5282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:09 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1673 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:10.111248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:10.134464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:10.135244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Searching by: {'deleted': False, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:31:10.165453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.166090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.166529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.167279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.167726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.168181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.196441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:31:10.226883 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d7acdee9-ab62-4e6b-8a0f-d7886eda06d4 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.136351 Oct 28 13:31:10.227472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2680/5283] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 13:31:10 2022] GET /compute/v2.1/servers => generated 333 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:10.243201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:10.248439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:10.249468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Searching by: {'deleted': False, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 13:31:10.257938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.258647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.259082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.259928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.260476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.260979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.292182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 13:31:10.334621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:10.340078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.340587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.341050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.489993 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eff15c93-1628-413c-aff7-693d188f73d7 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.251186 Oct 28 13:31:10.490782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2604/5284] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:31:10 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:10.519933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98a29ad3-3e03-463f-a845-562d58686e2d tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:10.529233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-98a29ad3-3e03-463f-a845-562d58686e2d tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014060 Oct 28 13:31:10.537507 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2681/5285] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:31:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:10.705769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bbb5a598-d551-4213-a739-5208e7ee829b req-adf1d810-e43c-4113-9de5-b7e1234da507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da71137-52cf-4db7-884b-d421c3057b0c", "name": "network-vif-deleted", "tag": "de173011-edd0-4b4a-b30f-765c6648da62"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:10.716028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbb5a598-d551-4213-a739-5208e7ee829b req-adf1d810-e43c-4113-9de5-b7e1234da507 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.716828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbb5a598-d551-4213-a739-5208e7ee829b req-adf1d810-e43c-4113-9de5-b7e1234da507 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.717339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bbb5a598-d551-4213-a739-5208e7ee829b req-adf1d810-e43c-4113-9de5-b7e1234da507 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.731641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bbb5a598-d551-4213-a739-5208e7ee829b req-adf1d810-e43c-4113-9de5-b7e1234da507 service nova] Creating event network-vif-deleted:de173011-edd0-4b4a-b30f-765c6648da62 for instance 7da71137-52cf-4db7-884b-d421c3057b0c on n-h1-862876-2 Oct 28 13:31:10.737453 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bbb5a598-d551-4213-a739-5208e7ee829b req-adf1d810-e43c-4113-9de5-b7e1234da507 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035590 Oct 28 13:31:10.738278 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2605/5286] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:31:10.884299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:10.885036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:10.886960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:10.887759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:10.902554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.903315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.904091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.904801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.905432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.906070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.907047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.907977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:10.908643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.909456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:10.910094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.911346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:10.960352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:31:11.155787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:11.164409 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bda1e125-39c6-4948-803b-f8b148252dcd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.288171 Oct 28 13:31:11.168307 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2606/5287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:10 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:11.169439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:11.170053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:11.176213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:11.176825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:11.177263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:11.178169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:11.178635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:11.179095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:11.216143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:11.216143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:11.216505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:11.216853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lazy-loading 'fault' on Instance uuid 7da71137-52cf-4db7-884b-d421c3057b0c {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:31:11.295669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:11.313363 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4caa87a-c01a-42c9-aa1f-6affbd114db4 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1327 microversion: 2.1 time: 0.147330 Oct 28 13:31:11.318956 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2607/5288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:11 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:11.368625 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe34b5f4-41f1-42d9-8750-b8bad1ec2953 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 204 len: 0 microversion: 2.1 time: 0.496477 Oct 28 13:31:11.372676 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2682/5289] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:31:10 2022] DELETE /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:31:11.378787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:11.380892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:11.387494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:11.388000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:11.388440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:11.389160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:11.389622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:11.390050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:11.597667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:11.606196 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-72249fe6-e45f-4669-bc3d-6143f72757c3 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1701 microversion: 2.1 time: 0.232210 Oct 28 13:31:11.606912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2608/5290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:11 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1701 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:12.189694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:12.191262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:12.199528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:12.200294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:12.201061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:12.201979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:12.202434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:12.203110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:12.343754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:12.345025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:12.353285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:12.354154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:12.354604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:12.355386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:12.355849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:12.356502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:12.362228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:12.370859 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8731eb87-6896-48ef-898f-fad3d5351a34 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.187915 Oct 28 13:31:12.374281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2683/5291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:12 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:12.392070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:12.392704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:12.393267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:12.394060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lazy-loading 'fault' on Instance uuid 7da71137-52cf-4db7-884b-d421c3057b0c {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:31:12.471041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf94118fc4e458e9e1163a03be85c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dec96587614543843d0c86c3e4adb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:12.480473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7fb6c474-4119-4625-8bd8-b9308e96f178 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 200 len: 1327 microversion: 2.1 time: 0.141499 Oct 28 13:31:12.482580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2609/5292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:12 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:12.630866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:12.631504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:12.639506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:12.640007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:12.640469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:12.641154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:12.641610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:12.642039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:12.787084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:12.795306 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f8fcd82-06e6-449f-a28e-f802514ab895 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1701 microversion: 2.1 time: 0.169806 Oct 28 13:31:12.795893 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2684/5293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:12 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:13.393503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:13.394304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:13.401534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:13.402027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:13.402475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:13.409924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:13.410401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:13.411739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:13.513550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:13.514940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:13.543695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:13.546034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:13.546787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:13.550617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:13.551156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:13.552162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:13.582625 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] HTTP exception thrown: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Request method failure captured: Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c HTTP/1.1 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9hE2-t_H3m-VbRUW8xCsunHYUpUlER8ksGmflVi3TZzmSkJ0ILaRGW0tCq71bnuqblsOblpWMNwCs5lCXvxNNCrAbgbV-3FhdMIn0ZAP_Ibk5i_gDQYtxEwBV38FJDmOSPUNHr6rd517QrMioqy2XwRqpCpFpcoZu4wrpAzaXaX-nU Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7dec96587614543843d0c86c3e4adb6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3cf94118fc4e458e9e1163a03be85c50 Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7da71137-52cf-4db7-884b-d421c3057b0c'} Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:13.591991 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Returning 404 to user: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:31:13.597633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-983015e9-1065-4f73-9d01-2a2db8db6f9b tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 404 len: 111 microversion: 2.1 time: 0.092276 Oct 28 13:31:13.599653 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2685/5294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:13 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:31:13.605276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9bbde52-c0f0-4fbb-bc90-fe6850788bb9 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '.version_select at 0x7f27b9490820>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:13.674187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:13.692390 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c4c857aa-880f-494b-a74a-cb7bf4857985 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.302774 Oct 28 13:31:13.696516 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2610/5295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:13 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:13.774504 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9bbde52-c0f0-4fbb-bc90-fe6850788bb9 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172061007" status: 202 len: 0 microversion: 2.1 time: 0.173640 Oct 28 13:31:13.775439 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2686/5296] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172061007 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:31:13.819762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:13.820679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:13.830992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:13.831893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:13.833164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:13.844145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:13.844856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:13.845261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:13.997062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:14.006595 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9e5a026f-1aab-4251-ba9c-6c4ac0dc0e31 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1633 microversion: 2.1 time: 0.190996 Oct 28 13:31:14.007753 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2611/5297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:13 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1633 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:14.205207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-047047d0-f7ae-4f6c-8884-594bf99391c6 req-690dfba7-7708-4c75-b415-68733e82c9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b54026-c9c9-4f1a-b2ba-bd088dead277", "name": "network-vif-deleted", "tag": "509952ff-014a-495f-b995-8a8f7add21a3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:14.218177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-047047d0-f7ae-4f6c-8884-594bf99391c6 req-690dfba7-7708-4c75-b415-68733e82c9c6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:14.218949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-047047d0-f7ae-4f6c-8884-594bf99391c6 req-690dfba7-7708-4c75-b415-68733e82c9c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:14.220345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-047047d0-f7ae-4f6c-8884-594bf99391c6 req-690dfba7-7708-4c75-b415-68733e82c9c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:14.233442 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-047047d0-f7ae-4f6c-8884-594bf99391c6 req-690dfba7-7708-4c75-b415-68733e82c9c6 service nova] Creating event network-vif-deleted:509952ff-014a-495f-b995-8a8f7add21a3 for instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 on n-h1-862876-2 Oct 28 13:31:14.240896 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-047047d0-f7ae-4f6c-8884-594bf99391c6 req-690dfba7-7708-4c75-b415-68733e82c9c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040597 Oct 28 13:31:14.242189 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2687/5298] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:14.720771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:14.721411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:14.728667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:14.729184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:14.729644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:14.730737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:14.731561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:14.732001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:14.999860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:15.008629 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a7f67e8-c368-4fb1-8e8b-081f7d05c408 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.295759 Oct 28 13:31:15.009219 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2612/5299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:14 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:15.034254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:15.035379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:15.047651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:15.048207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:15.056201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:15.056981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:15.057475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:15.057915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:15.094383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:15.095174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:15.095825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:15.096440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lazy-loading 'fault' on Instance uuid 04b54026-c9c9-4f1a-b2ba-bd088dead277 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:31:15.224610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d879c0c98b47cda7509ac2392e889d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '530d2cb6a5aa4795a74034a0c3c0cf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:15.235629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e978cf0-9504-44a1-956e-5b5b93ddcd5a tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 200 len: 1359 microversion: 2.1 time: 0.206486 Oct 28 13:31:15.236562 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2688/5300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:15 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:16.033306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:16.034606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:16.043077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.044190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.044930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.046363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.047003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.048412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.283077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:16.284604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] [instance: 04b54026-c9c9-4f1a-b2ba-bd088dead277] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:16.304609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:16.316909 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cce71ce8-b928-4319-9136-a6887a27e50c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1502 microversion: 2.1 time: 0.287961 Oct 28 13:31:16.321770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.322512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.323144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.324100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.333811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.334653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.354303 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2613/5301] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:16 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:16.361022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2619b9a-8ea9-4bda-8859-0ffa3195886a"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:16.364887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:16.375561 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] HTTP exception thrown: Instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 could not be found. Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Request method failure captured: Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 HTTP/1.1 Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9ld0UCdornbCjkLvj2qv_VUm9Nk4R6tEU0ezK0Wap1D-rkPmlrZUVohSHTJni2QUdBMS2dmg-Y2NcxjB2-yTFWHc34-PwQbWANLbl6wmymO-HPQMl14zNUmFrCOOBnA-TDJm19OkhBPWnhYvP3BYpxGQFxkyXAnPb7qxX5H4Vtr9qI Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 530d2cb6a5aa4795a74034a0c3c0cf4b Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersTestJSON-230631413 Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/530d2cb6a5aa4795a74034a0c3c0cf4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/530d2cb6a5aa4795a74034a0c3c0cf4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_530d2cb6a5aa4795a74034a0c3c0cf4b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/530d2cb6a5aa4795a74034a0c3c0cf4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersTestJSON-230631413 Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 530d2cb6a5aa4795a74034a0c3c0cf4b Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersTestJSON-230631413 Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersTestJSON-230631413-project Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e8d879c0c98b47cda7509ac2392e889d Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersTestJSON-230631413-project Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 could not be found. Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '04b54026-c9c9-4f1a-b2ba-bd088dead277'} Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 could not be found. Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 could not be found. Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.377297 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:16.383105 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:16.383105 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:16.383105 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:31:16.383105 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:31:16.383105 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 could not be found. Oct 28 13:31:16.383105 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.383105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Returning 404 to user: Instance 04b54026-c9c9-4f1a-b2ba-bd088dead277 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:31:16.383968 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11cbeb71-0bbb-4eab-b0c1-046af3e8395c tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277" status: 404 len: 111 microversion: 2.1 time: 0.108411 Oct 28 13:31:16.384913 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2689/5302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:16 2022] GET /compute/v2.1/servers/04b54026-c9c9-4f1a-b2ba-bd088dead277 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:31:16.399321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-076f3d06-d252-4d96-95ae-b9ce5cd62267 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] Calling method '.version_select at 0x7f27b882fc10>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:16.401783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.402725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.403370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.404281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.413926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.415548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.471503 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Cannot 'attach_volume' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state rescued Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/os-volume_attachments HTTP/1.1 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 74 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: {"volumeAttachment": {"volumeId": "b2619b9a-8ea9-4bda-8859-0ffa3195886a"}} Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'attach_volume' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state rescued Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '5dc0c05a-ae51-4799-bfa7-8321c75a7bb1', 'body': {'volumeAttachment': {'volumeId': 'b2619b9a-8ea9-4bda-8859-0ffa3195886a'}}} Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 13:31:16.474252 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state rescued Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state rescued Oct 28 13:31:16.478633 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:31:16.480641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 409 to user: Cannot 'attach_volume' instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 while it is in vm_state rescued {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:31:16.481679 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8d1bd882-2ca2-4c2b-b3d0-5fa7f67b89c9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.126040 Oct 28 13:31:16.487379 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2614/5303] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:31:16 2022] POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/os-volume_attachments => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:31:16.493390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:16.495855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:16.504367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.504877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.505324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.506040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.506500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.507510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.551119 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-076f3d06-d252-4d96-95ae-b9ce5cd62267 tempest-ServersTestJSON-230631413 tempest-ServersTestJSON-230631413-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221394670" status: 202 len: 0 microversion: 2.1 time: 0.161648 Oct 28 13:31:16.551754 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2690/5304] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221394670 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:31:16.859450 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f557515-153e-4262-a840-afd401e76566 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action" status: 202 len: 0 microversion: 2.1 time: 0.370395 Oct 28 13:31:16.860777 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2615/5305] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:31:16 2022] POST /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:31:16.870138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:16.871070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:16.884360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.885098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.885781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:16.886648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:16.892295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:16.892966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:17.346678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:17.359501 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c079e57a-ad15-4a90-ab60-bb3d0c510f3d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1510 microversion: 2.1 time: 0.493276 Oct 28 13:31:17.363928 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2691/5306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:16 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:18.424917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:18.427081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:18.440741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:18.444662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:18.445570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:18.449261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:18.450164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:18.450896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:18.710679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:18.740266 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d96b4343-cd4c-4222-9a5d-5aabd790458a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1510 microversion: 2.1 time: 0.315576 Oct 28 13:31:18.741225 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2616/5307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:18 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:19.778242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:19.779137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:19.791851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:19.795282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:19.797120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:19.798123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:19.801610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:19.802373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:20.174359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:20.596094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:20.614582 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-43fb95fd-e067-44d6-adf6-005830b74873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1516 microversion: 2.1 time: 0.836954 Oct 28 13:31:20.620716 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2692/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:19 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1516 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:24.286161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1652803334", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "0d20900f-dfa0-4dfe-9071-8ef9293eeb7e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1137896014", "security_groups": [{"name": "tempest-secgroup-smoke-806582652"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:24.381745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:24.382537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:24.850255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] validate_networks() for [('0d20900f-dfa0-4dfe-9071-8ef9293eeb7e', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:31:25.519448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78bbec5b-c725-4408-b0fd-7b544a72ec96 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'create', calling method: .version_select at 0x7f27b83925e0>, body: {"keypair": {"name": "tempest-keypair-1268261442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALWVMeqMQeJuV1a4AvSi+mDw35X02VcChjm9UZIR2WjRXaigV8zeW4ag/mtUhR6BXrTLIdrb42UgHRB4Ahz6QYR8FX1o8C9h60jG3+N0EHv61sVR4iopkM2uxh7UPH+7Q=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:25.529533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:25.585093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-78bbec5b-c725-4408-b0fd-7b544a72ec96 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:31:25.592203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-78bbec5b-c725-4408-b0fd-7b544a72ec96 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for user 65484989d170478c88a1ff8a1f378b2a and project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:31:25.733883 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78bbec5b-c725-4408-b0fd-7b544a72ec96 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209564 Oct 28 13:31:25.735237 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2693/5309] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:31:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:31:27.001376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:31:27.001376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:31:27.001376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:31:27.002048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:31:27.002254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:31:27.016528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:27.022041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:27.022041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:27.022041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:27.024268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:27.025119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:27.041377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:27.062599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:31:27.074161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:31:27.110174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:27.116748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:31:27.120850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:31:27.276022 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d5c09db-feeb-4578-b7b2-7b5d1267ac5b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.993559 Oct 28 13:31:27.279579 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2617/5310] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:31:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:31:27.292006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f89172f6-7413-4756-a6f0-18edddd4fd73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:27.292621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f89172f6-7413-4756-a6f0-18edddd4fd73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:27.758629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f89172f6-7413-4756-a6f0-18edddd4fd73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:27.758629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f89172f6-7413-4756-a6f0-18edddd4fd73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1267 microversion: 2.1 time: 0.439439 Oct 28 13:31:27.758629 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2694/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:27 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1267 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:28.778853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9e403fc9-25aa-4315-8ecc-d1d9fc187b3c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:28.779523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9e403fc9-25aa-4315-8ecc-d1d9fc187b3c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:28.843458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:28.844701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:28.856118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:28.860599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:28.861510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:28.865570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:28.866336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:28.870883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:28.901649 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] HTTP exception thrown: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Request method failure captured: Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c HTTP/1.1 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9hE2-t_H3m-VbRUW8xCsunHYUpUlER8ksGmflVi3TZzmSkJ0ILaRGW0tCq71bnuqblsOblpWMNwCs5lCXvxNNCrAbgbV-3FhdMIn0ZAP_Ibk5i_gDQYtxEwBV38FJDmOSPUNHr6rd517QrMioqy2XwRqpCpFpcoZu4wrpAzaXaX-nU Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7dec96587614543843d0c86c3e4adb6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3cf94118fc4e458e9e1163a03be85c50 Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7da71137-52cf-4db7-884b-d421c3057b0c'} Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:31:28.915943 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.920587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.921758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Returning 404 to user: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:31:28.923047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d834bb19-4a1c-4943-a116-edbf51d18e76 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 404 len: 111 microversion: 2.1 time: 0.083550 Oct 28 13:31:28.924294 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2695/5312] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:31:28 2022] DELETE /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:31:28.935749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:28.936727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 7da71137-52cf-4db7-884b-d421c3057b0c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:28.952129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:28.952993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:28.953668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:28.954621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:28.959009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:28.959682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:28.965509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9e403fc9-25aa-4315-8ecc-d1d9fc187b3c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:28.981999 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9e403fc9-25aa-4315-8ecc-d1d9fc187b3c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1267 microversion: 2.1 time: 0.204693 Oct 28 13:31:28.985423 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2618/5313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:28 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:28.993265 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] HTTP exception thrown: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Request method failure captured: Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c HTTP/1.1 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9hE2-t_H3m-VbRUW8xCsunHYUpUlER8ksGmflVi3TZzmSkJ0ILaRGW0tCq71bnuqblsOblpWMNwCs5lCXvxNNCrAbgbV-3FhdMIn0ZAP_Ibk5i_gDQYtxEwBV38FJDmOSPUNHr6rd517QrMioqy2XwRqpCpFpcoZu4wrpAzaXaX-nU Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7dec96587614543843d0c86c3e4adb6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3cf94118fc4e458e9e1163a03be85c50 Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7da71137-52cf-4db7-884b-d421c3057b0c'} Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:28.996465 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:29.000392 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:29.000392 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:29.000392 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:29.000392 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:31:29.000392 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:31:29.000392 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. Oct 28 13:31:29.000392 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:29.003656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Returning 404 to user: Instance 7da71137-52cf-4db7-884b-d421c3057b0c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:31:29.004594 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d29fd212-1529-4b68-ad24-3159ccdbd109 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c" status: 404 len: 111 microversion: 2.1 time: 0.075917 Oct 28 13:31:29.019610 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2696/5314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:28 2022] GET /compute/v2.1/servers/7da71137-52cf-4db7-884b-d421c3057b0c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:31:30.013158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:30.013813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:30.041990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:30.044303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:30.050260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:30.052314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:30.054783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:30.056179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:30.473606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:30.486194 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c68a2f9-35e4-4a74-ac37-38d85dde8cd8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1263 microversion: 2.1 time: 0.479375 Oct 28 13:31:30.489375 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2619/5315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:30 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1263 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:31.526247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:31.527622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:31.542972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:31.544468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:31.544468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:31.545231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:31.545852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:31.548667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:31.945225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:31.964584 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff7172d8-21c9-42f1-91b7-a2b9af101cca tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1337 microversion: 2.1 time: 0.447125 Oct 28 13:31:31.967466 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2697/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:31 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1337 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:32.526314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-26370371", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2c627c7-7dac-4912-88cf-802713af8af7"}], "security_groups": [{"name": "tempest-securitygroup--177402332"}], "key_name": "tempest-keypair-1268261442", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:32.733596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] validate_networks() for [('b2c627c7-7dac-4912-88cf-802713af8af7', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:31:32.994108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:32.997232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:33.007891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:33.023392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:33.023392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:33.023392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:33.023392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:33.023392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:33.023392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:33.372745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:33.383997 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea4a18e4-fd7c-490e-b61e-d1b98d65e8ae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.394258 Oct 28 13:31:33.385364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2698/5317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:32 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:33.618791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:31:33.622001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:31:33.622937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:31:33.623536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:31:33.624751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:31:33.636019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:33.636795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:33.649401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:33.652335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:33.652874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:33.653324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:33.681864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:31:33.700728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Getting quotas for user 65484989d170478c88a1ff8a1f378b2a and project 6c35af71a13b4eabbb2c5f021ee5c983. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:31:33.738127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:31:33.741150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:31:33.907728 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7df84f0d-17fc-4d32-bcae-ebd04e2ecc2d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.385756 Oct 28 13:31:33.909191 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2620/5318] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:31:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:31:33.921170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0c4ae2c-2e8f-4314-a164-eebbe9d6d3a8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:33.921880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0c4ae2c-2e8f-4314-a164-eebbe9d6d3a8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:34.090497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0c4ae2c-2e8f-4314-a164-eebbe9d6d3a8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:34.112316 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0c4ae2c-2e8f-4314-a164-eebbe9d6d3a8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1244 microversion: 2.1 time: 0.196080 Oct 28 13:31:34.130660 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2699/5319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:33 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1244 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:34.418189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:34.418843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:34.431648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:34.432146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:34.432778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:34.433686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:34.438030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:34.438491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:34.530160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:34.545282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:34.556970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:34.557741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:34.558387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:34.559603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:34.560916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:34.561431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:34.611513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:31:34.852459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:34.863078 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa15fb46-1118-4de6-9d64-c01a7340f1cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.448962 Oct 28 13:31:34.870807 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2700/5320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:34 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:34.938474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:34.939241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:34.948406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:34.950150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:34.950150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:34.950150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:34.954390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:34.955139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:34.980960 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] HTTP exception thrown: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Request method failure captured: Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f HTTP/1.1 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9hE2-t_H3m-VbRUW8xCsunHYUpUlER8ksGmflVi3TZzmSkJ0ILaRGW0tCq71bnuqblsOblpWMNwCs5lCXvxNNCrAbgbV-3FhdMIn0ZAP_Ibk5i_gDQYtxEwBV38FJDmOSPUNHr6rd517QrMioqy2XwRqpCpFpcoZu4wrpAzaXaX-nU Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7dec96587614543843d0c86c3e4adb6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3cf94118fc4e458e9e1163a03be85c50 Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4f35a4c2-2658-4948-873b-c44e0e7ad80f'} Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:31:34.985542 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:34.989746 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:34.994758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Returning 404 to user: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:31:34.995859 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28f6f70d-a1ba-4f86-8d88-a43704b3b042 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 404 len: 111 microversion: 2.1 time: 0.061932 Oct 28 13:31:35.000729 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2701/5321] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:31:34 2022] DELETE /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:31:35.008656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8ef48491-2762-493d-964d-2b14caabe3c8 req-aec3119b-134a-472b-aa0a-878b775bf520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:35.025173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8ef48491-2762-493d-964d-2b14caabe3c8 req-aec3119b-134a-472b-aa0a-878b775bf520 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:35.025669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8ef48491-2762-493d-964d-2b14caabe3c8 req-aec3119b-134a-472b-aa0a-878b775bf520 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:35.026112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8ef48491-2762-493d-964d-2b14caabe3c8 req-aec3119b-134a-472b-aa0a-878b775bf520 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:35.040597 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8ef48491-2762-493d-964d-2b14caabe3c8 req-aec3119b-134a-472b-aa0a-878b775bf520 service nova] Creating event network-changed:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h1-862876-2 Oct 28 13:31:35.050224 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8ef48491-2762-493d-964d-2b14caabe3c8 req-aec3119b-134a-472b-aa0a-878b775bf520 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042114 Oct 28 13:31:35.056475 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2702/5322] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:35.064719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:35.065602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] [instance: 4f35a4c2-2658-4948-873b-c44e0e7ad80f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:35.077130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:35.077640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:35.078088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:35.078826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:35.079300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:35.079724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:35.095362 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] HTTP exception thrown: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Request method failure captured: Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f HTTP/1.1 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9hE2-t_H3m-VbRUW8xCsunHYUpUlER8ksGmflVi3TZzmSkJ0ILaRGW0tCq71bnuqblsOblpWMNwCs5lCXvxNNCrAbgbV-3FhdMIn0ZAP_Ibk5i_gDQYtxEwBV38FJDmOSPUNHr6rd517QrMioqy2XwRqpCpFpcoZu4wrpAzaXaX-nU Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c7dec96587614543843d0c86c3e4adb6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c7dec96587614543843d0c86c3e4adb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c7dec96587614543843d0c86c3e4adb6 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-124628226 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3cf94118fc4e458e9e1163a03be85c50 Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeTestJSON-124628226-project Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '4f35a4c2-2658-4948-873b-c44e0e7ad80f'} Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:31:35.098251 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:35.102805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:31:35.102805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:31:35.102805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:31:35.102805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:31:35.102805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:31:35.102805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. Oct 28 13:31:35.102805 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:31:35.107778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] Returning 404 to user: Instance 4f35a4c2-2658-4948-873b-c44e0e7ad80f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:31:35.108221 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5d6d7232-af23-4b7f-9cb0-d3ff1d7c8b2e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 204 len: 0 microversion: 2.42 time: 0.939682 Oct 28 13:31:35.111516 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2621/5323] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:31:34 2022] DELETE /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:31:35.114734 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-361447b2-5d66-42e2-879e-f8f4bb3ec1f7 tempest-AttachVolumeTestJSON-124628226 tempest-AttachVolumeTestJSON-124628226-project] 10.222.0.25 "GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f" status: 404 len: 111 microversion: 2.1 time: 0.056748 Oct 28 13:31:35.121993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:35.122804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:35.133542 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2703/5324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:35 2022] GET /compute/v2.1/servers/4f35a4c2-2658-4948-873b-c44e0e7ad80f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:31:35.142071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2d4b427-e1d1-4e87-8ee1-05162ceb7d01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:35.146514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2d4b427-e1d1-4e87-8ee1-05162ceb7d01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:35.158798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:35.159323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:35.159773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:35.160874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:35.161519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:35.162173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:35.286408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2d4b427-e1d1-4e87-8ee1-05162ceb7d01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:35.296000 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2d4b427-e1d1-4e87-8ee1-05162ceb7d01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1244 microversion: 2.1 time: 0.161036 Oct 28 13:31:35.302924 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2704/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:35 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1244 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:35.593662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:35.613343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:35.616355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:35.617660 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c33854f9-b57d-42d0-bf7f-413b147d4191 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2960 microversion: 2.42 time: 0.501206 Oct 28 13:31:35.622885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2622/5326] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:35 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2960 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:35.887461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:35.888092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:35.901616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:35.902116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:35.902554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:35.903289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:35.915584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:35.916292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:36.325794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:36.326412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:36.334095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:36.334590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:36.335051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:36.335802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:36.336270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:36.336696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:36.392517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:36.415789 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5c05d85-710a-40f2-ba3f-a36de979302f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.530681 Oct 28 13:31:36.421347 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2705/5327] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:35 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:36.471275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:36.480762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9db3f475-df33-453a-9b49-fa0441a01333 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1248 microversion: 2.1 time: 0.158817 Oct 28 13:31:36.486711 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2623/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:36 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1248 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:36.650717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:36.651644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:36.661952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:36.663407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:36.664011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:36.665163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:36.665822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:36.666498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:36.994706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:37.054693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:37.060972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:37.064490 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5811eb4c-75d7-4387-8814-3e8fec7df6f2 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2960 microversion: 2.42 time: 0.419484 Oct 28 13:31:37.071172 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2706/5329] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:36 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2960 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:31:37.452176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:37.455791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:37.468938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:37.469773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:37.470928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:37.472089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:37.475673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:37.476471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:37.509027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:37.514104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:37.534483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:37.536107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:37.542585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:37.543685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:37.546222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:37.549613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:37.705028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:37.715568 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7c74a07-f622-40e1-a518-08677fd1dafb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1240 microversion: 2.1 time: 0.214587 Oct 28 13:31:37.733438 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2707/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:37 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1240 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:38.099273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:38.100431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:38.113980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:38.116681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:38.118647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:38.119587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:38.122922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:38.125995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:38.214259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:38.222489 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bfa37f0-b60a-47ca-9e9a-2d27b9547baa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.785292 Oct 28 13:31:38.223668 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2624/5331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:37 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:38.737273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:38.743515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:38.747095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:38.757760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:38.763057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:38.763840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:38.771958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:38.771958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:38.771958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:38.771958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:38.772431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:38.773908 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f20e695e-926f-4a75-97dd-7baa5de19144 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2960 microversion: 2.42 time: 0.680152 Oct 28 13:31:38.775048 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2708/5332] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:38 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2960 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:31:38.974462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:38.998592 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-835a2c1a-ccc8-4a0c-a8bf-07eaa2aa8cc7 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1304 microversion: 2.1 time: 0.258039 Oct 28 13:31:39.011986 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2625/5333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:38 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1304 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:39.248846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:39.249472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:39.259663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:39.260364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:39.261025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:39.261977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:39.262660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:39.263317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:39.813011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:39.814660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:39.841355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:39.842133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:39.843578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:39.844544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:39.845231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:39.846135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:39.859899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:39.876394 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3722b77-e9ff-4cea-8469-ae67b8dd932e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.631698 Oct 28 13:31:39.876798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2709/5334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:39 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:40.025494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:40.026382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:40.043887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:40.048094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:40.048786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:40.050832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:40.051457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:40.053567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:40.574000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:40.581880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8d3359b-d874-4bc2-965d-74e60f87a873 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.560812 Oct 28 13:31:40.587577 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2710/5335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:40 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:40.686026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ae571692-aba0-401e-bb33-99aa8936a5e3 req-ff635587-f23a-40a2-9ffd-27e209c15ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-unplugged", "status": "completed", "tag": "585cc549-1b07-4522-85cf-a1914cce9d33"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:40.729406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ae571692-aba0-401e-bb33-99aa8936a5e3 req-ff635587-f23a-40a2-9ffd-27e209c15ef1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:40.729898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ae571692-aba0-401e-bb33-99aa8936a5e3 req-ff635587-f23a-40a2-9ffd-27e209c15ef1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:40.730338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ae571692-aba0-401e-bb33-99aa8936a5e3 req-ff635587-f23a-40a2-9ffd-27e209c15ef1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:40.775027 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ae571692-aba0-401e-bb33-99aa8936a5e3 req-ff635587-f23a-40a2-9ffd-27e209c15ef1 service nova] Creating event network-vif-unplugged:585cc549-1b07-4522-85cf-a1914cce9d33 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:40.795081 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ae571692-aba0-401e-bb33-99aa8936a5e3 req-ff635587-f23a-40a2-9ffd-27e209c15ef1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114072 Oct 28 13:31:40.795604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:40.796635 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2711/5336] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:31:40.812950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:40.815512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:40.818292 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-367751ed-496f-4f9b-916b-4742a3fcaf66 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2960 microversion: 2.42 time: 1.012431 Oct 28 13:31:40.825775 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2626/5337] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:39 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2960 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:31:40.908079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:40.909567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:40.924652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:40.927170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:40.928647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:40.930768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:40.932008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:40.933454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:41.515925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:41.531316 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c046e4cf-1dba-4e1f-9b5c-11892792a307 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.626556 Oct 28 13:31:41.532229 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2712/5338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:40 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:41.617488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:41.618461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:41.631336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:41.633375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:41.635389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:41.636302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:41.638930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:41.639487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:41.854077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:41.855010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:41.865117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:41.868099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:41.876255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:41.878364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:41.879942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:41.882049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:41.887862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:41.905089 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-39c89789-ff88-4f7e-8ead-8afc6aa9926a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.291050 Oct 28 13:31:41.906552 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2627/5339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:41 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:42.517615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:42.553594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:42.557104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:42.557850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:42.560643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:42.565601 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78ab7a6c-0aca-4bbf-82f0-f4dfddf0ff39 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2939 microversion: 2.42 time: 0.716953 Oct 28 13:31:42.573205 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2713/5340] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:41 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2939 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:42.575883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:42.578806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:42.579558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:42.583122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:42.585057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:42.587220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:42.835690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9adbeab7-e831-4fca-a693-bb333e722ec1 req-8ab3429f-f3b3-41d2-912e-552ff6fe2465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-unplugged", "status": "completed", "tag": "c6bceb41-c854-430c-8667-7fd5d959eee4"}, {"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-unplugged", "status": "completed", "tag": "09ba8bae-1034-46b2-8b3c-7e6052ebbe90"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:42.850656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9adbeab7-e831-4fca-a693-bb333e722ec1 req-8ab3429f-f3b3-41d2-912e-552ff6fe2465 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:42.851390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9adbeab7-e831-4fca-a693-bb333e722ec1 req-8ab3429f-f3b3-41d2-912e-552ff6fe2465 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:42.852033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9adbeab7-e831-4fca-a693-bb333e722ec1 req-8ab3429f-f3b3-41d2-912e-552ff6fe2465 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:42.879718 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9adbeab7-e831-4fca-a693-bb333e722ec1 req-8ab3429f-f3b3-41d2-912e-552ff6fe2465 service nova] Creating event network-vif-unplugged:c6bceb41-c854-430c-8667-7fd5d959eee4 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:42.880241 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9adbeab7-e831-4fca-a693-bb333e722ec1 req-8ab3429f-f3b3-41d2-912e-552ff6fe2465 service nova] Creating event network-vif-unplugged:09ba8bae-1034-46b2-8b3c-7e6052ebbe90 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:42.895196 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9adbeab7-e831-4fca-a693-bb333e722ec1 req-8ab3429f-f3b3-41d2-912e-552ff6fe2465 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.068785 Oct 28 13:31:42.913501 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2714/5341] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:42.942212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:42.943207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:42.950071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:42.950834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:42.951463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:42.952333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:42.956167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:42.956167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:43.007411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:43.027594 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-04cf12ae-d156-4776-91af-e2c6abc22efe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.474806 Oct 28 13:31:43.029529 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2628/5342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:42 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:43.435742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0ace5897-8b16-4404-9cad-6f10316a2846 req-ca6c07e4-0240-4510-9798-38107c4a7a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd7fdfa-5067-4a02-82a4-87d4ee670caa", "tag": "eab335fd-c705-40e7-9d38-6f99af3c756a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:43.456531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0ace5897-8b16-4404-9cad-6f10316a2846 req-ca6c07e4-0240-4510-9798-38107c4a7a23 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:43.456531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0ace5897-8b16-4404-9cad-6f10316a2846 req-ca6c07e4-0240-4510-9798-38107c4a7a23 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:43.456531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0ace5897-8b16-4404-9cad-6f10316a2846 req-ca6c07e4-0240-4510-9798-38107c4a7a23 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:43.483948 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0ace5897-8b16-4404-9cad-6f10316a2846 req-ca6c07e4-0240-4510-9798-38107c4a7a23 service nova] Creating event network-changed:eab335fd-c705-40e7-9d38-6f99af3c756a for instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa on n-h1-862876-2 Oct 28 13:31:43.491968 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0ace5897-8b16-4404-9cad-6f10316a2846 req-ca6c07e4-0240-4510-9798-38107c4a7a23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059731 Oct 28 13:31:43.493590 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2629/5343] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:43.600511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:43.601250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:43.614619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:43.617121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:43.617783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:43.619626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:43.621139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:43.622237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:43.679333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:43.723588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:43.867167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:43.881909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d33816d-6820-4bed-a819-32357ede9fdb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.951976 Oct 28 13:31:43.884177 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2715/5344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:42 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:44.070156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:44.071732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:44.102146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:44.102905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:44.105670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:44.108937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:44.112515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:44.114431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:44.147840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:44.163309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:44.164791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:44.166083 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27690a83-f0b9-4ea4-86ac-f0aa3b6bbf31 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2918 microversion: 2.42 time: 0.572121 Oct 28 13:31:44.180679 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2630/5345] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:43 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2918 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:44.887698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:44.906837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:44.908512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:44.914115 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb0151ed-0d49-40fd-9942-07a4d1e915f7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.862923 Oct 28 13:31:44.917312 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2716/5346] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:44 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:44.953614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:44.953614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:44.953614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:44.953614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:44.953614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:44.953614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:45.202030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:45.204332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:45.217039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:45.217772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:45.223610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:45.227325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:45.228367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:45.229222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:45.295645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:45.600211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:45.610401 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77d108bb-7470-4b93-a670-8fe4417013e2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.708575 Oct 28 13:31:45.611019 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2631/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:44 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:45.642644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-73bde6b8-5c44-44b3-8b48-9a9a6042627a req-2bff1d00-6017-4bfa-a096-2ad55bbb375d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-unplugged", "status": "completed", "tag": "08737e4b-2e2f-4bce-8fe2-9864e3a719de"}, {"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-unplugged", "status": "completed", "tag": "352a0edd-de4a-4fa0-bdeb-aba88b63a429"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:45.656644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73bde6b8-5c44-44b3-8b48-9a9a6042627a req-2bff1d00-6017-4bfa-a096-2ad55bbb375d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:45.657407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73bde6b8-5c44-44b3-8b48-9a9a6042627a req-2bff1d00-6017-4bfa-a096-2ad55bbb375d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:45.658142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73bde6b8-5c44-44b3-8b48-9a9a6042627a req-2bff1d00-6017-4bfa-a096-2ad55bbb375d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:45.672092 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-73bde6b8-5c44-44b3-8b48-9a9a6042627a req-2bff1d00-6017-4bfa-a096-2ad55bbb375d service nova] Creating event network-vif-unplugged:08737e4b-2e2f-4bce-8fe2-9864e3a719de for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:45.672973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-73bde6b8-5c44-44b3-8b48-9a9a6042627a req-2bff1d00-6017-4bfa-a096-2ad55bbb375d service nova] Creating event network-vif-unplugged:352a0edd-de4a-4fa0-bdeb-aba88b63a429 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:45.693422 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-73bde6b8-5c44-44b3-8b48-9a9a6042627a req-2bff1d00-6017-4bfa-a096-2ad55bbb375d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.061010 Oct 28 13:31:45.694116 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2632/5348] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:45.760070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8a442b04-6d47-4784-9efb-ad97b82cd93e req-b7f3df3e-0fdc-4eb4-ae22-bcea5a85d41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-deleted", "tag": "1297cfba-46fe-4a0e-b6a3-aa9ffcbca8f6"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:45.786403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8a442b04-6d47-4784-9efb-ad97b82cd93e req-b7f3df3e-0fdc-4eb4-ae22-bcea5a85d41b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:45.786971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8a442b04-6d47-4784-9efb-ad97b82cd93e req-b7f3df3e-0fdc-4eb4-ae22-bcea5a85d41b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:45.787408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8a442b04-6d47-4784-9efb-ad97b82cd93e req-b7f3df3e-0fdc-4eb4-ae22-bcea5a85d41b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:45.815967 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8a442b04-6d47-4784-9efb-ad97b82cd93e req-b7f3df3e-0fdc-4eb4-ae22-bcea5a85d41b service nova] Creating event network-vif-deleted:1297cfba-46fe-4a0e-b6a3-aa9ffcbca8f6 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:45.824494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8a442b04-6d47-4784-9efb-ad97b82cd93e req-b7f3df3e-0fdc-4eb4-ae22-bcea5a85d41b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075871 Oct 28 13:31:45.825462 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2633/5349] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:31:45.946221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:45.951480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:45.958507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:45.959036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:45.959480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:45.960195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:45.966360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:45.966918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:46.032017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:46.068330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:46.073388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:46.074960 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8707a90b-b114-4185-b421-061a1efb645b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2871 microversion: 2.42 time: 0.877154 Oct 28 13:31:46.081633 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2717/5350] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:45 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2871 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:31:46.595762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:46.605107 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0d64346c-557e-4ea5-8b7d-ad1773766b09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.664721 Oct 28 13:31:46.605986 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2634/5351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:45 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:46.636057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:46.636927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:46.644573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:46.646376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:46.646851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:46.647751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:46.648360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:46.649096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:46.855422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:46.885421 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-55247573-0cbf-482b-857a-3d376a3d8d6d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.254831 Oct 28 13:31:46.888549 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2718/5352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:46 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:47.117538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:47.117726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:47.130274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:47.131751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:47.135567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:47.136485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:47.138041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:47.138693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:47.447402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:47.456790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:47.458258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:47.459579 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b64d0ddf-2ca9-4b50-a24c-529eebac2a58 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2710 microversion: 2.42 time: 0.347358 Oct 28 13:31:47.475165 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2635/5353] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:47 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2710 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:47.632956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:47.634280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:47.670054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:47.670563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:47.673666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:47.676440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:47.677500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:47.678421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:47.931366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:47.938474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:47.989906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:47.990408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:48.005555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:48.010233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:48.011128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:48.011961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:48.131683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:48.639889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:48.654590 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aad789e9-3a40-4b9e-ae70-48b1529251f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.741102 Oct 28 13:31:48.655389 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2636/5354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:47 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:48.708123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4fa459bf-70f8-488d-a162-2513946d968a req-ec83758e-e2fa-42ee-8e17-ab4598084ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-deleted", "tag": "08737e4b-2e2f-4bce-8fe2-9864e3a719de"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:48.726560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4fa459bf-70f8-488d-a162-2513946d968a req-ec83758e-e2fa-42ee-8e17-ab4598084ee9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:48.727398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4fa459bf-70f8-488d-a162-2513946d968a req-ec83758e-e2fa-42ee-8e17-ab4598084ee9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:48.728027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4fa459bf-70f8-488d-a162-2513946d968a req-ec83758e-e2fa-42ee-8e17-ab4598084ee9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:48.751883 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4fa459bf-70f8-488d-a162-2513946d968a req-ec83758e-e2fa-42ee-8e17-ab4598084ee9 service nova] Creating event network-vif-deleted:08737e4b-2e2f-4bce-8fe2-9864e3a719de for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:48.759630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:48.767582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4fa459bf-70f8-488d-a162-2513946d968a req-ec83758e-e2fa-42ee-8e17-ab4598084ee9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091781 Oct 28 13:31:48.772169 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2637/5355] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:48.783733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0b053a21-9e71-4ea3-b831-7c1bada7c2bd req-358a7a20-273e-4020-bcb7-b3058e52f675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "name": "network-vif-plugged", "status": "completed", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:48.785720 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4aef1513-e172-4390-ae6d-4f2b77fe4a4c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 1.159431 Oct 28 13:31:48.799648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2719/5356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:47 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:48.807238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:48.807855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:48.819225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:48.824978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:48.824978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:48.824978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:48.824978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:48.824978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:48.831542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:48.845664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b053a21-9e71-4ea3-b831-7c1bada7c2bd req-358a7a20-273e-4020-bcb7-b3058e52f675 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:48.847494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b053a21-9e71-4ea3-b831-7c1bada7c2bd req-358a7a20-273e-4020-bcb7-b3058e52f675 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:48.848337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0b053a21-9e71-4ea3-b831-7c1bada7c2bd req-358a7a20-273e-4020-bcb7-b3058e52f675 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:48.878182 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0b053a21-9e71-4ea3-b831-7c1bada7c2bd req-358a7a20-273e-4020-bcb7-b3058e52f675 service nova] Creating event network-vif-plugged:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h1-862876-2 Oct 28 13:31:48.888344 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0b053a21-9e71-4ea3-b831-7c1bada7c2bd req-358a7a20-273e-4020-bcb7-b3058e52f675 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114669 Oct 28 13:31:48.893623 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2638/5357] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:49.109472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:49.120970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:49.124029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:49.129203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c355f811-512e-4443-9fa6-6b761132563e tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2710 microversion: 2.42 time: 0.327880 Oct 28 13:31:49.134820 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2720/5358] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:48 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2710 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:49.684253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:49.685841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:49.697927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:49.699427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:49.700263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:49.701200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:49.701928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:49.702731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:49.818403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:49.819190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:49.853553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:49.854058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:49.859364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:49.859364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:49.859364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:49.859364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:50.199607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:50.210438 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c01dab17-1853-4054-8241-d8a2fe70734a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.532569 Oct 28 13:31:50.220580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2639/5359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:49 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:50.220580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:50.220580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:50.247508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:50.247508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:50.247508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:50.247508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:50.247508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:50.247508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:50.259030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:50.329006 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-05390ee1-a3a3-4980-8ee0-af9d24b291cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1392 microversion: 2.1 time: 0.518202 Oct 28 13:31:50.335358 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2721/5360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:49 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1392 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:50.825878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d5d01921-523b-47a1-be39-ebc6cf27c07c req-3498d9dd-9f0d-4e37-908d-b96fde3d7d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-deleted", "tag": "09ba8bae-1034-46b2-8b3c-7e6052ebbe90"}, {"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-deleted", "tag": "352a0edd-de4a-4fa0-bdeb-aba88b63a429"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:50.851155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d5d01921-523b-47a1-be39-ebc6cf27c07c req-3498d9dd-9f0d-4e37-908d-b96fde3d7d1e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:50.851641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d5d01921-523b-47a1-be39-ebc6cf27c07c req-3498d9dd-9f0d-4e37-908d-b96fde3d7d1e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:50.852071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d5d01921-523b-47a1-be39-ebc6cf27c07c req-3498d9dd-9f0d-4e37-908d-b96fde3d7d1e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:50.874055 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d5d01921-523b-47a1-be39-ebc6cf27c07c req-3498d9dd-9f0d-4e37-908d-b96fde3d7d1e service nova] Creating event network-vif-deleted:09ba8bae-1034-46b2-8b3c-7e6052ebbe90 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:50.875327 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d5d01921-523b-47a1-be39-ebc6cf27c07c req-3498d9dd-9f0d-4e37-908d-b96fde3d7d1e service nova] Creating event network-vif-deleted:352a0edd-de4a-4fa0-bdeb-aba88b63a429 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:50.883198 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d5d01921-523b-47a1-be39-ebc6cf27c07c req-3498d9dd-9f0d-4e37-908d-b96fde3d7d1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066026 Oct 28 13:31:50.884757 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2722/5361] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:31:51.139036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:51.153330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:51.154825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:51.156108 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0421c6ea-6997-4942-8871-654d63c84c49 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 2324 microversion: 2.42 time: 0.943862 Oct 28 13:31:51.169519 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2640/5362] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:50 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 2324 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:51.240703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:51.241849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:51.256591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:51.257190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:51.259225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:51.259225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:51.259225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:51.261316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:51.374879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:51.377235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:51.431987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:51.436474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:51.436953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:51.439180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:51.443489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:51.444181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:51.718433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:51.722365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:51.732412 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b3c224d5-dd89-4c85-8de3-b769f85b8a01 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.497275 Oct 28 13:31:51.733394 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2723/5363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:51 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:51.734125 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-38295c1d-d2be-4ca1-b39e-84f33090cf1c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1564 microversion: 2.1 time: 0.381879 Oct 28 13:31:51.736687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2641/5364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:51 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1564 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:51.741728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9c568008-0fe4-4ac1-a482-f466846ec78e req-72ed59ba-6788-47e2-837c-239861d2fb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd7fdfa-5067-4a02-82a4-87d4ee670caa", "name": "network-vif-plugged", "status": "completed", "tag": "eab335fd-c705-40e7-9d38-6f99af3c756a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:51.748946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9c568008-0fe4-4ac1-a482-f466846ec78e req-72ed59ba-6788-47e2-837c-239861d2fb38 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:51.749341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9c568008-0fe4-4ac1-a482-f466846ec78e req-72ed59ba-6788-47e2-837c-239861d2fb38 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:51.749926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9c568008-0fe4-4ac1-a482-f466846ec78e req-72ed59ba-6788-47e2-837c-239861d2fb38 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:51.773865 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9c568008-0fe4-4ac1-a482-f466846ec78e req-72ed59ba-6788-47e2-837c-239861d2fb38 service nova] Creating event network-vif-plugged:eab335fd-c705-40e7-9d38-6f99af3c756a for instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa on n-h1-862876-2 Oct 28 13:31:51.779283 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9c568008-0fe4-4ac1-a482-f466846ec78e req-72ed59ba-6788-47e2-837c-239861d2fb38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044450 Oct 28 13:31:51.780102 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2724/5365] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:51.787425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:51.794289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:51.797740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:51.799349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:51.799858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:51.800716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:51.801775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:51.802963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:52.282996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:52.293923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-120441234", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f6719c5f-6a3e-4187-8df7-d08ef3f7deb2"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:52.312020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9455f5c0-d014-4677-b910-1470a36c3be2 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1564 microversion: 2.1 time: 0.530022 Oct 28 13:31:52.312660 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2725/5366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:51 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1564 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:52.331207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:52.334824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:52.343927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:52.347190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:52.348380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:52.353933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:52.353933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:52.353933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:52.402479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] validate_networks() for [('f6719c5f-6a3e-4187-8df7-d08ef3f7deb2', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:31:52.464356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:52.481583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:52.495515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:52.495515 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ef75242-4afe-4409-b835-8b54cc3b4c32 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.169372 Oct 28 13:31:52.495515 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2726/5367] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:52 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:52.755270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:52.756076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:52.768537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:52.771823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:52.772696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:52.774848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:52.775605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:52.777952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:53.120991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:31:53.121658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:31:53.122378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:31:53.123050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:31:53.123926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:31:53.140351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:53.141614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:53.141614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:53.142677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:53.143408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:53.144902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:53.169034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:31:53.176240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for user ba2dd748101e4b3492c9bea6a26cea14 and project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:31:53.195484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:31:53.198971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:31:53.234458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:53.250072 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ffe2b65a-af6d-4995-80a6-7bc467b31e24 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1369 microversion: 2.1 time: 0.498903 Oct 28 13:31:53.251599 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2727/5368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:52 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1369 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:53.259096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5b61212a-5d3e-423a-9341-68d397dced38 req-17a0408b-3ab9-4370-889b-e185b3a5fe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c8429a-14ed-4329-b9c5-998dbc3bff87", "name": "network-vif-deleted", "tag": "c6bceb41-c854-430c-8667-7fd5d959eee4"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:53.299073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5b61212a-5d3e-423a-9341-68d397dced38 req-17a0408b-3ab9-4370-889b-e185b3a5fe5e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:53.299627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5b61212a-5d3e-423a-9341-68d397dced38 req-17a0408b-3ab9-4370-889b-e185b3a5fe5e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:53.299999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5b61212a-5d3e-423a-9341-68d397dced38 req-17a0408b-3ab9-4370-889b-e185b3a5fe5e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:53.356588 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5b61212a-5d3e-423a-9341-68d397dced38 req-17a0408b-3ab9-4370-889b-e185b3a5fe5e service nova] Creating event network-vif-deleted:c6bceb41-c854-430c-8667-7fd5d959eee4 for instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 on n-h1-862876-2 Oct 28 13:31:53.368803 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5b61212a-5d3e-423a-9341-68d397dced38 req-17a0408b-3ab9-4370-889b-e185b3a5fe5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115650 Oct 28 13:31:53.371438 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2728/5369] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:53.412457 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-afb9fc8e-bf06-476b-ab1e-56b2163846e7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669472 Oct 28 13:31:53.423958 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2642/5370] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:31:53.427504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d226146c-8c2c-4b4e-8662-fc46ef7e674d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:53.428326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d226146c-8c2c-4b4e-8662-fc46ef7e674d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:53.515109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:53.516118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:53.522027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d226146c-8c2c-4b4e-8662-fc46ef7e674d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:53.528895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:53.531954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:53.532776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:53.537458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:53.541482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:53.542046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:53.550098 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d226146c-8c2c-4b4e-8662-fc46ef7e674d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1214 microversion: 2.1 time: 0.128563 Oct 28 13:31:53.551292 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2729/5371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:53 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:31:53.722020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:53.732305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:53.733907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:53.735245 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2db19b6f-c1d2-482b-970c-7e4d2230df12 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.224964 Oct 28 13:31:53.735803 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2643/5372] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:53 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:31:54.279229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:54.280422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:54.306899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:54.307498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:54.307815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:54.308519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:54.308970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:54.309416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:54.574763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fec73340-eed4-412d-9d88-1ea7860e87c1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:54.576140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fec73340-eed4-412d-9d88-1ea7860e87c1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:54.706102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fec73340-eed4-412d-9d88-1ea7860e87c1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:54.720605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fec73340-eed4-412d-9d88-1ea7860e87c1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1214 microversion: 2.1 time: 0.150628 Oct 28 13:31:54.725247 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2644/5373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:54 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:54.761554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:54.762449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:54.771478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:54.775613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:54.777143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:54.779785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:54.781217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:54.781902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:54.782670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:54.893534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:54.921449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:54.929074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:54.933279 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2fa221a0-1cc9-4f48-9b3d-9bee34d42edb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.174493 Oct 28 13:31:54.957780 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2645/5374] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:54 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:31:55.315611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:55.328542 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9cbaec0-968a-420b-9f90-7aad4063005f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1564 microversion: 2.1 time: 1.054378 Oct 28 13:31:55.329425 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2730/5375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:54 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1564 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:55.358550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:55.359189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:55.367543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:55.369133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:55.369828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:55.371503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:55.375472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:55.376157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:55.484736 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eab3c0aa-cdf3-402e-afbf-5d963fbddfc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131198 Oct 28 13:31:55.494342 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2646/5376] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:31:55 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:31:55.746518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:55.751800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:55.757894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:55.783210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:55.783672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:55.784473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:55.787161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:55.790196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:55.963318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:55.964663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:55.972494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:55.976937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:55.977596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:55.978351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:55.978939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:55.979283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:56.010373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:56.044163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2106033-47dd-4e9e-9bee-f0a46790468b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1266 microversion: 2.1 time: 0.303774 Oct 28 13:31:56.045959 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2731/5377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:55 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:56.202345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:56.228100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:56.238307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:56.241829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa42bbe5-6c30-41ae-a746-614c263c6798 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.282422 Oct 28 13:31:56.243909 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2647/5378] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:55 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:57.072081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:57.072693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:57.080279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:57.080780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:57.081220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:57.082505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:57.082994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:57.084826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:57.249786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:57.261569 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4358378b-9eec-4511-87fa-c1ac38170a80 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1274 microversion: 2.1 time: 0.193283 Oct 28 13:31:57.262629 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2732/5379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:57 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:57.274704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:57.275939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:57.321195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:57.327314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:57.328267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:57.329487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:57.344989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:57.350267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:57.467703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:57.487844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:57.489907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:57.493420 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0f92ae1-8f41-4dfb-9a7b-03856c5f4e53 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.222764 Oct 28 13:31:57.493420 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2648/5380] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:57 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:58.086088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-027470b0-6377-432c-89c5-e42532f158e3 req-d5ace754-5cad-4f24-ad53-f0181194fe5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd7fdfa-5067-4a02-82a4-87d4ee670caa", "tag": "eab335fd-c705-40e7-9d38-6f99af3c756a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:58.092343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:31:58.099733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-027470b0-6377-432c-89c5-e42532f158e3 req-d5ace754-5cad-4f24-ad53-f0181194fe5c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.100381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-027470b0-6377-432c-89c5-e42532f158e3 req-d5ace754-5cad-4f24-ad53-f0181194fe5c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.103705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-027470b0-6377-432c-89c5-e42532f158e3 req-d5ace754-5cad-4f24-ad53-f0181194fe5c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.147182 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-027470b0-6377-432c-89c5-e42532f158e3 req-d5ace754-5cad-4f24-ad53-f0181194fe5c service nova] Creating event network-changed:eab335fd-c705-40e7-9d38-6f99af3c756a for instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa on n-h1-862876-2 Oct 28 13:31:58.159046 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-027470b0-6377-432c-89c5-e42532f158e3 req-d5ace754-5cad-4f24-ad53-f0181194fe5c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075520 Oct 28 13:31:58.163224 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2733/5381] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:58.289449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:58.290025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:58.297423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.302904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.302904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.302904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.302904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.302904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.465876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:58.480305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08ee2b48-7de6-4908-8c86-a23677e5313d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1272 microversion: 2.1 time: 0.196104 Oct 28 13:31:58.481308 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2649/5382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:58 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:58.515093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:58.516050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:58.519696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:58.520659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:58.532799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.533316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.533762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.534514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.539197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.539718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.540333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.540952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.541401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.542115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.542576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.551176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-18fcbfe6-a262-4a62-8c4b-032373795088 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.213758 Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2650/5383] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:58 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-60e22a32-1c2e-4d5b-bc10-09677ee5999f req-f00dc57a-7271-4023-abdb-e98d136c581b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-60e22a32-1c2e-4d5b-bc10-09677ee5999f req-f00dc57a-7271-4023-abdb-e98d136c581b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-60e22a32-1c2e-4d5b-bc10-09677ee5999f req-f00dc57a-7271-4023-abdb-e98d136c581b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:58.770713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-60e22a32-1c2e-4d5b-bc10-09677ee5999f req-f00dc57a-7271-4023-abdb-e98d136c581b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:58.782406 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-60e22a32-1c2e-4d5b-bc10-09677ee5999f req-f00dc57a-7271-4023-abdb-e98d136c581b service nova] Creating event network-changed:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h1-862876-2 Oct 28 13:31:58.788582 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-60e22a32-1c2e-4d5b-bc10-09677ee5999f req-f00dc57a-7271-4023-abdb-e98d136c581b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057558 Oct 28 13:31:59.042670 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2651/5384] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:31:59.171881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:59.181282 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a55578c7-df81-4b05-a813-618dc2b91796 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1564 microversion: 2.1 time: 0.671041 Oct 28 13:31:59.182536 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2734/5385] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:58 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1564 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:59.512135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:59.512863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:59.538439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:59.538699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:59.539558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:59.540547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:59.541184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:59.541781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:59.794077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:31:59.795938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:31:59.813106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:59.822556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:59.823356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:59.825826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:31:59.830836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:31:59.832228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:31:59.881060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:31:59.895104 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-342afbdd-46ae-4c74-9857-a311b3e6a257 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.385226 Oct 28 13:31:59.897213 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2652/5386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:31:59 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:31:59.991662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:00.002239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:00.005233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:00.006899 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2ada4c3-3083-4bfd-8de3-4c229d368fed tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.224053 Oct 28 13:32:00.007984 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2735/5387] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:31:59 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:00.924399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:00.925104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:00.937035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:00.938167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:00.938809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:00.939782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:00.940804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:00.941568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:01.036259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:01.037706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:01.058841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:01.063597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:01.064324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:01.065293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:01.066352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:01.067135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:01.204502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:01.232664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:01.235715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:01.239944 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-62064dad-8de1-4e11-9211-6633cb9b1afb tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.209951 Oct 28 13:32:01.243564 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2736/5388] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:01 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:32:01.259056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:01.261813 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e26c8a99-d293-4550-aad6-83684b63412f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.344436 Oct 28 13:32:01.266842 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2653/5389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:00 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:01.520955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1007004516", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "dbdfe71e-f609-4c8d-91c7-a1301475a522"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:01.616561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] validate_networks() for [('dbdfe71e-f609-4c8d-91c7-a1301475a522', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:32:02.154119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f87e1ff2-841a-4ea5-9454-9f1e7e87f06a req-2c406072-6975-4da4-8530-802a48f7efa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cdede3-4829-4349-802a-71246263aa3d", "tag": "c5509117-b193-4aa7-ae19-e66df002cac5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:02.172469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f87e1ff2-841a-4ea5-9454-9f1e7e87f06a req-2c406072-6975-4da4-8530-802a48f7efa5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:02.173272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f87e1ff2-841a-4ea5-9454-9f1e7e87f06a req-2c406072-6975-4da4-8530-802a48f7efa5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:02.174089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f87e1ff2-841a-4ea5-9454-9f1e7e87f06a req-2c406072-6975-4da4-8530-802a48f7efa5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:02.198778 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f87e1ff2-841a-4ea5-9454-9f1e7e87f06a req-2c406072-6975-4da4-8530-802a48f7efa5 service nova] Creating event network-changed:c5509117-b193-4aa7-ae19-e66df002cac5 for instance 24cdede3-4829-4349-802a-71246263aa3d on n-h2-862876-2 Oct 28 13:32:02.205877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f87e1ff2-841a-4ea5-9454-9f1e7e87f06a req-2c406072-6975-4da4-8530-802a48f7efa5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056735 Oct 28 13:32:02.208237 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2654/5390] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:02.278020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:02.279047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:02.287483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:02.288223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:02.290365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:02.291795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:02.292899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:02.294641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:02.400581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:02.418337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:02.419834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:02.421229 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6c954d43-8b71-4b1e-b54c-bbc0d969e284 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.150492 Oct 28 13:32:02.438870 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2655/5391] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:02 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:02.438870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:02.438870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:02.438870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:02.438870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:02.438870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:02.439542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:02.439542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:02.439894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:02.579669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:32:02.580118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:32:02.586562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:32:02.586562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:32:02.586562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:32:02.593402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:02.593894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:02.594329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:02.595120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:02.595783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:02.596264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:02.623174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Getting quotas for project e420eb66d9314e19a1ed5c71fe9da78f. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:32:02.630147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Getting quotas for user e03ca387af2b4da1b774f46d934ad8ff and project e420eb66d9314e19a1ed5c71fe9da78f. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:32:02.636071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:02.647672 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca4fa8e5-4770-40cb-ab90-2042d0081870 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.223144 Oct 28 13:32:02.649685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:32:02.649927 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2656/5392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:02 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:02.650952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:32:02.782097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dfa762bc-636e-4f1b-a961-7350f154a285 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.452359 Oct 28 13:32:02.791198 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2737/5393] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:32:02.796027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8695ad4-217f-4671-91cb-ccae88926ddd tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:02.796677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8695ad4-217f-4671-91cb-ccae88926ddd tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:02.896269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b8695ad4-217f-4671-91cb-ccae88926ddd tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:02.906378 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8695ad4-217f-4671-91cb-ccae88926ddd tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1214 microversion: 2.1 time: 0.114746 Oct 28 13:32:02.907473 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2657/5394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:02 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:03.450462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:03.451129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:03.476662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:03.477745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:03.478571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:03.479497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:03.480136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:03.480697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:03.595821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:03.617750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:03.620483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:03.621894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e97980f8-358b-4650-a336-5b1165f1cf83 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.176131 Oct 28 13:32:03.623851 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2738/5395] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:03 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:03.673755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:03.674581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:03.676659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:03.687477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:03.690656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:03.690656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:03.690656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:03.691284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:03.693215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:03.848865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:03.856666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:03.861921 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-290bf250-c258-4cd6-9a4d-e063db42d7de tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.192129 Oct 28 13:32:03.864461 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2658/5396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:03 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:03.931328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35b9bde1-f252-4d62-84af-6a6eac996a24 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:03.932333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35b9bde1-f252-4d62-84af-6a6eac996a24 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:04.006580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35b9bde1-f252-4d62-84af-6a6eac996a24 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:04.014062 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35b9bde1-f252-4d62-84af-6a6eac996a24 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1214 microversion: 2.1 time: 0.088286 Oct 28 13:32:04.014638 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2739/5397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:03 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:04.649489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:04.655036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:04.656916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:04.657625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:04.658143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:04.658943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:04.660014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:04.660713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:04.729739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:04.742697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:04.744263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:04.746070 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8265d3c0-07a3-413a-a13c-67cfabff9d7b tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.100424 Oct 28 13:32:04.764061 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2659/5398] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:04 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:04.896473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:04.897103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:04.906429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:04.908217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:04.908217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:04.908873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:04.910182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:04.910777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:05.039816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:05.040797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:05.052895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:05.053510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:05.054033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:05.054972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:05.056696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:05.057484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:05.073456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:05.083662 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-82537da8-c59d-426c-a355-603ffd49eaea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.194824 Oct 28 13:32:05.088618 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2740/5399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:04 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:05.135769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:05.145292 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dc528d37-a56f-41cd-ac49-64a89a072eae tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1266 microversion: 2.1 time: 0.111012 Oct 28 13:32:05.150253 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2660/5400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:05 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:32:05.773467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:05.774329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:05.781154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:05.781649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:05.782082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:05.782990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:05.783599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:05.784182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:05.855033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:05.872394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:05.874011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:05.875460 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d428655-f641-41da-bd29-a549635e8558 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.107405 Oct 28 13:32:05.876597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2741/5401] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:05 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:06.108445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:06.109760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:06.118223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:06.118731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:06.119203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:06.120391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:06.120865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:06.121300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:06.172572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:06.173211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:06.182349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:06.183062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:06.183682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:06.184611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:06.185218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:06.186072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:06.191650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:06.286186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:06.293633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:06.299605 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-118c30cc-51b0-4943-a596-9e58986035ff tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1272 microversion: 2.1 time: 0.131552 Oct 28 13:32:06.307316 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2742/5402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:06 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:06.308186 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1fd016fa-d012-429f-ae15-7f6f8cd7acb6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.203609 Oct 28 13:32:06.309082 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2661/5403] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:06 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:06.905116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:06.906159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:06.926739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:06.927482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:06.928083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:06.929155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:06.929815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:06.930394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:07.011538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:07.022455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:07.024206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:07.025899 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94afc422-2776-409d-a2ce-3cf92ad4599c tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.126600 Oct 28 13:32:07.026480 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2743/5404] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:06 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:07.330000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:07.330933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:07.333001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:07.333618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:07.340903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:07.341759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:07.342441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:07.343552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:07.344266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:07.345299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:07.346417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:07.347597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:07.347956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:07.348661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:07.349119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:07.349546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:07.577328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:07.586558 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b79639ac-1ca6-4ed8-aaff-048aa728b3f0 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1314 microversion: 2.1 time: 0.263083 Oct 28 13:32:07.588060 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2662/5405] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:07 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:07.631514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:07.640425 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ecb1a6c6-c926-4c73-8b8f-a4a563e62004 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.311766 Oct 28 13:32:07.641092 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2744/5406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:07 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:32:07.874245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8b9316d9-cdad-49e3-9983-0ce08c0bf218 req-08fffedf-4f68-466c-a9c1-f860d2641826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1b0850-f1e1-42d2-8df4-99b3a229241a", "tag": "5df95966-3fdb-46bf-943a-980570af080f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:07.883716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8b9316d9-cdad-49e3-9983-0ce08c0bf218 req-08fffedf-4f68-466c-a9c1-f860d2641826 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:07.884431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8b9316d9-cdad-49e3-9983-0ce08c0bf218 req-08fffedf-4f68-466c-a9c1-f860d2641826 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:07.885051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8b9316d9-cdad-49e3-9983-0ce08c0bf218 req-08fffedf-4f68-466c-a9c1-f860d2641826 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:07.897392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8b9316d9-cdad-49e3-9983-0ce08c0bf218 req-08fffedf-4f68-466c-a9c1-f860d2641826 service nova] Creating event network-changed:5df95966-3fdb-46bf-943a-980570af080f for instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a on n-h2-862876-2 Oct 28 13:32:07.903697 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8b9316d9-cdad-49e3-9983-0ce08c0bf218 req-08fffedf-4f68-466c-a9c1-f860d2641826 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033119 Oct 28 13:32:07.904872 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2663/5407] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:08.053735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:08.054470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:08.062775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:08.064729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:08.064729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:08.064729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:08.065193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:08.066418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:08.159996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:08.170774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:08.172466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:08.173826 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cfd5ee5e-8721-4c9b-a439-3683c510b979 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.125258 Oct 28 13:32:08.175729 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2745/5408] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:08 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:08.615763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:08.616454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:08.625295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:08.625783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:08.626386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:08.627309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:08.627764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:08.628355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:08.665289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:08.667084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:08.677303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:08.679066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:08.680761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:08.682774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:08.683581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:08.684393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:08.796270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:08.805410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b34809a4-a542-4e54-a2bf-98d238a25f51 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1314 microversion: 2.1 time: 0.194773 Oct 28 13:32:08.809545 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2664/5409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:08 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:08.859359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:08.868423 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5ff2d9e-5dab-4544-ab4f-18275433fe10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.206983 Oct 28 13:32:08.869240 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2746/5410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:08 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:09.203445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:09.205185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:09.212064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:09.212627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:09.213199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:09.214647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:09.214900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:09.215437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:09.324148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:09.341741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:09.343405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:09.344727 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48a8558c-595a-4e85-b31f-6f15b1c44617 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.145669 Oct 28 13:32:09.345625 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2665/5411] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:09 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:09.419878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-760f9fee-f3cb-4ece-8c8b-cea6ff86be84 req-4a1330b5-fe40-4e6b-a545-8d69d7dbdb68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cdede3-4829-4349-802a-71246263aa3d", "name": "network-vif-plugged", "status": "completed", "tag": "c5509117-b193-4aa7-ae19-e66df002cac5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:09.430479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-760f9fee-f3cb-4ece-8c8b-cea6ff86be84 req-4a1330b5-fe40-4e6b-a545-8d69d7dbdb68 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:09.431011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-760f9fee-f3cb-4ece-8c8b-cea6ff86be84 req-4a1330b5-fe40-4e6b-a545-8d69d7dbdb68 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:09.432993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-760f9fee-f3cb-4ece-8c8b-cea6ff86be84 req-4a1330b5-fe40-4e6b-a545-8d69d7dbdb68 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:09.443214 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-760f9fee-f3cb-4ece-8c8b-cea6ff86be84 req-4a1330b5-fe40-4e6b-a545-8d69d7dbdb68 service nova] Creating event network-vif-plugged:c5509117-b193-4aa7-ae19-e66df002cac5 for instance 24cdede3-4829-4349-802a-71246263aa3d on n-h2-862876-2 Oct 28 13:32:09.448218 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-760f9fee-f3cb-4ece-8c8b-cea6ff86be84 req-4a1330b5-fe40-4e6b-a545-8d69d7dbdb68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041210 Oct 28 13:32:09.448814 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2747/5412] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:09.832885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:09.834726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:09.845162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:09.846364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:09.847984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:09.848898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:09.849376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:09.849809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:09.892404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:09.893739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:09.902152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:09.902946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:09.903556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:09.904259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:09.904725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:09.905147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:10.028142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:10.037544 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d781c1ce-3b09-449c-8e25-4cd5215833f4 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1314 microversion: 2.1 time: 0.208994 Oct 28 13:32:10.038137 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2666/5413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:09 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:10.071030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:10.078957 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1e476a64-60c1-4767-beff-9593e77b17a0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1314 microversion: 2.1 time: 0.190953 Oct 28 13:32:10.079672 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2748/5414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:09 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:10.371148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:10.371866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:10.378216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:10.378808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:10.379249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:10.379946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:10.380402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:10.380828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:10.446406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:10.455763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:10.457801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:10.459049 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1afdffbd-f0c5-47d0-aac6-6aef778a1066 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.091946 Oct 28 13:32:10.459805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2667/5415] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:10 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:32:11.061111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:11.061719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:11.069059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.069540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.072004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.072004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.072004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.072004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.103003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:11.103877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:11.111246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.111820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.112990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.113776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.114457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.114993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.217429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:11.229185 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-869a760a-c039-4ac3-b42d-deac9d79cce6 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1314 microversion: 2.1 time: 0.171787 Oct 28 13:32:11.230256 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2749/5416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:11 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:11.317227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:11.325638 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ebcdc470-5689-4252-a554-90b33d6ca67e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1501 microversion: 2.1 time: 0.227136 Oct 28 13:32:11.326682 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2668/5417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:11 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1501 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:32:11.350064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:11.350842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:11.358347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.359101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.359708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.360622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.361457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.362048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.390474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:32:11.485568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:11.486310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:11.493655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.499357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.499357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.499357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.499357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.499357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.579747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:11.592809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:11.602965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:11.602965 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a327c4d-6f94-46af-a3ed-14f7e829f7b7 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1602 microversion: 2.42 time: 0.114128 Oct 28 13:32:11.602965 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2669/5418] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:11 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1602 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:32:11.714847 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c31a2f09-55fe-4598-85e8-a1df670f4d51 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 204 len: 0 microversion: 2.1 time: 0.368651 Oct 28 13:32:11.715477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2750/5419] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:32:11 2022] DELETE /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:32:11.724488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:11.725418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:11.732370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.733187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.733898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.734874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:11.735560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:11.736245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:11.901769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:11.909467 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ca31d27-6b59-4350-ad1a-873a0e65d39e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1507 microversion: 2.1 time: 0.189311 Oct 28 13:32:11.910043 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2670/5420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:11 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:12.255993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:12.258589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:12.263929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:12.264425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:12.264866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:12.265583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:12.266041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:12.266469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:12.422218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:12.431043 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-991ad9d9-8ff0-4be1-b5b8-4399b23035d9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1314 microversion: 2.1 time: 0.179339 Oct 28 13:32:12.431701 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2751/5421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:12 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:12.621564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:12.623105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:12.630151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:12.630876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:12.631440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:12.632771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:12.633342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:12.634020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:12.673575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:12.674400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:12.675203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:12.675846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lazy-loading 'fault' on Instance uuid 04c8429a-14ed-4329-b9c5-998dbc3bff87 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:32:12.725155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:12.736331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:12.738323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b9280d754a41c5949836f84f7bfa8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e39c3cdf0f4775a64d93ddcba5bbc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:12.739993 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08139a37-8f66-45d5-85a3-14925f9ad818 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 200 len: 1607 microversion: 2.42 time: 0.122405 Oct 28 13:32:12.746874 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2671/5422] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:12 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 1607 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:32:12.934737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:12.935683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:12.938050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:12.944020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:12.944523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:12.944965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:12.946119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:12.946974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:12.947487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:13.201036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:13.209291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2050735-c7f1-48b7-aba7-0a78ef3f93c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1507 microversion: 2.1 time: 0.279564 Oct 28 13:32:13.210447 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2752/5423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:12 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:13.454429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:13.455159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:13.457944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:13.466726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:13.466726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:13.466726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:13.467239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:13.467693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:13.468117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:13.528727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5ec43ee7-5242-459f-a38a-8f21e4842c6b req-1b42ce42-62cc-49a2-8adc-df5fb6194878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1b0850-f1e1-42d2-8df4-99b3a229241a", "name": "network-vif-plugged", "status": "completed", "tag": "5df95966-3fdb-46bf-943a-980570af080f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:13.556619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ec43ee7-5242-459f-a38a-8f21e4842c6b req-1b42ce42-62cc-49a2-8adc-df5fb6194878 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:13.557375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ec43ee7-5242-459f-a38a-8f21e4842c6b req-1b42ce42-62cc-49a2-8adc-df5fb6194878 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:13.557932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5ec43ee7-5242-459f-a38a-8f21e4842c6b req-1b42ce42-62cc-49a2-8adc-df5fb6194878 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:13.572011 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5ec43ee7-5242-459f-a38a-8f21e4842c6b req-1b42ce42-62cc-49a2-8adc-df5fb6194878 service nova] Creating event network-vif-plugged:5df95966-3fdb-46bf-943a-980570af080f for instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a on n-h2-862876-2 Oct 28 13:32:13.577455 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5ec43ee7-5242-459f-a38a-8f21e4842c6b req-1b42ce42-62cc-49a2-8adc-df5fb6194878 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058563 Oct 28 13:32:13.582077 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2753/5424] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:32:13.637385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:13.675858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-34eb9957-c297-4cd2-9f8f-623569e389e3 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1314 microversion: 2.1 time: 0.223632 Oct 28 13:32:13.676971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2672/5425] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:13 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:13.777158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:13.778189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:13.787624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:13.791009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:13.791009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:13.791009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:13.791009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:13.791508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:13.809820 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] HTTP exception thrown: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Request method failure captured: Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 HTTP/1.1 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9gaZw49qP9pTkM12F57JZswitebnZ0SuYPgq7ivxED_cNyVwujn3Zi8lphDf8S7cpTnP2DtE8fE3E2ys5ZY0aLg1JzdE0_l-jxx5K9--JblwsnR9dOkJqG5L1E9CZg278Dn5iTVBcYS3wxxu9zmkE4M49KPWsxdDV_ka5Iv3lCBKdU Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 65e39c3cdf0f4775a64d93ddcba5bbc5 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65e39c3cdf0f4775a64d93ddcba5bbc5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 65e39c3cdf0f4775a64d93ddcba5bbc5 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TaggedBootDevicesTest_v242-1893766026-project Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 81b9280d754a41c5949836f84f7bfa8b Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1893766026-project Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '04c8429a-14ed-4329-b9c5-998dbc3bff87'} Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:13.812130 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:13.817992 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:13.821217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Returning 404 to user: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:32:13.822422 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae6e4655-9c12-4148-b642-2d10b8a0ab7f tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 404 len: 111 microversion: 2.42 time: 0.058468 Oct 28 13:32:13.823589 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2754/5426] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:13 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:32:13.833879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25078c89-6e54-4b14-a05b-2213c08bbdde tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '.version_select at 0x7f27b93865e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:13.921486 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25078c89-6e54-4b14-a05b-2213c08bbdde tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62101537" status: 204 len: 0 microversion: 2.42 time: 0.093062 Oct 28 13:32:13.923341 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2673/5427] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 13:32:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62101537 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:32:14.096235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-411c8d5e-2523-4f75-96bb-4fd772fa8bdc req-cd56c4c1-1c0a-42e8-8585-bc5c39828f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cdede3-4829-4349-802a-71246263aa3d", "name": "network-vif-deleted", "tag": "c5509117-b193-4aa7-ae19-e66df002cac5"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:14.119441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:14.123651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-411c8d5e-2523-4f75-96bb-4fd772fa8bdc req-cd56c4c1-1c0a-42e8-8585-bc5c39828f9e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:14.124478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-411c8d5e-2523-4f75-96bb-4fd772fa8bdc req-cd56c4c1-1c0a-42e8-8585-bc5c39828f9e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:14.125131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-411c8d5e-2523-4f75-96bb-4fd772fa8bdc req-cd56c4c1-1c0a-42e8-8585-bc5c39828f9e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:14.151478 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-411c8d5e-2523-4f75-96bb-4fd772fa8bdc req-cd56c4c1-1c0a-42e8-8585-bc5c39828f9e service nova] Creating event network-vif-deleted:c5509117-b193-4aa7-ae19-e66df002cac5 for instance 24cdede3-4829-4349-802a-71246263aa3d on n-h2-862876-2 Oct 28 13:32:14.158354 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-411c8d5e-2523-4f75-96bb-4fd772fa8bdc req-cd56c4c1-1c0a-42e8-8585-bc5c39828f9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071991 Oct 28 13:32:14.159738 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2755/5428] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:14.233788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:14.234409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:14.247213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:14.247718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:14.248328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:14.249216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:14.249680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:14.250173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:14.334764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:14.361412 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e95d817-c778-434b-9ccf-96c602a87505 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1299 microversion: 2.1 time: 0.131519 Oct 28 13:32:14.362022 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2674/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:14 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:14.701549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:14.702385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:14.709299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:14.709860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:14.710410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:14.711207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:14.711741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:14.712230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:14.853760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:14.861728 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb9175dc-33d8-41fa-b57d-7eb3efd076ab tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1314 microversion: 2.1 time: 0.165381 Oct 28 13:32:14.862312 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2756/5430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:14 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:15.400110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:15.404085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:15.413481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:15.414036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:15.414482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:15.415312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:15.415775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:15.416201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:15.453741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:15.454238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:15.458531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:15.459185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lazy-loading 'fault' on Instance uuid 24cdede3-4829-4349-802a-71246263aa3d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:32:15.525119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:15.533203 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b602015-aac1-4727-b6bb-af78383b69e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 200 len: 1304 microversion: 2.1 time: 0.146882 Oct 28 13:32:15.546794 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2675/5431] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:15 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:15.798441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:15.856802 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-608a13e4-cda9-4431-9991-b422329c08e4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action" status: 200 len: 24573 microversion: 2.1 time: 0.088554 Oct 28 13:32:15.864661 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2757/5432] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:32:15 2022] POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action => generated 24573 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:32:15.887049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:15.888689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:15.913130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:15.914035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:15.914868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:15.917557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:15.918336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:15.919180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:15.962025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:16.173682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:16.184832 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f2e7483-5549-4868-b312-e31df6595385 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1497 microversion: 2.1 time: 0.303023 Oct 28 13:32:16.197690 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2676/5433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:15 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1497 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:16.585090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:16.585804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:16.621700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:16.622867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:16.627187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:16.628035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:16.628523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:16.628961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:16.667473 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d HTTP/1.1 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '24cdede3-4829-4349-802a-71246263aa3d'} Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:16.669173 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:32:16.673071 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d234975a-1aa0-4346-9f90-6b98d03300e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 404 len: 111 microversion: 2.1 time: 0.091154 Oct 28 13:32:16.693987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2758/5434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:16 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:32:16.844473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2122149095", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f6719c5f-6a3e-4187-8df7-d08ef3f7deb2"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:16.912255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] validate_networks() for [('f6719c5f-6a3e-4187-8df7-d08ef3f7deb2', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:32:17.410155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:32:17.410575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:32:17.411075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:32:17.411484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:32:17.411912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:32:17.426157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:17.426157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:17.426157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:17.426157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:17.426157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:17.426157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:17.472380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:32:17.478417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for user ba2dd748101e4b3492c9bea6a26cea14 and project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:32:17.494250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:32:17.501269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:32:17.692443 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4b4c58b4-c024-48d5-b90c-6c006f329a2a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851718 Oct 28 13:32:17.695274 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2677/5435] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:32:17.707926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32ee1e44-b173-45c2-b93e-597406dede6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:17.708621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32ee1e44-b173-45c2-b93e-597406dede6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:17.827412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32ee1e44-b173-45c2-b93e-597406dede6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:17.837363 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32ee1e44-b173-45c2-b93e-597406dede6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1215 microversion: 2.1 time: 0.132346 Oct 28 13:32:17.853746 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2759/5436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:17 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:18.862620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa6f053f-f118-4510-b9fa-8d26adff52b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:18.864257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa6f053f-f118-4510-b9fa-8d26adff52b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:18.937002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa6f053f-f118-4510-b9fa-8d26adff52b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:18.950988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa6f053f-f118-4510-b9fa-8d26adff52b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1215 microversion: 2.1 time: 0.093257 Oct 28 13:32:18.953548 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2678/5437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:18 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:19.205573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:19.211023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:19.218773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:19.219487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:19.220021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:19.220972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:19.222316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:19.222934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:19.239242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] HTTP exception thrown: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Request method failure captured: Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 HTTP/1.1 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9gaZw49qP9pTkM12F57JZswitebnZ0SuYPgq7ivxED_cNyVwujn3Zi8lphDf8S7cpTnP2DtE8fE3E2ys5ZY0aLg1JzdE0_l-jxx5K9--JblwsnR9dOkJqG5L1E9CZg278Dn5iTVBcYS3wxxu9zmkE4M49KPWsxdDV_ka5Iv3lCBKdU Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 65e39c3cdf0f4775a64d93ddcba5bbc5 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65e39c3cdf0f4775a64d93ddcba5bbc5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 65e39c3cdf0f4775a64d93ddcba5bbc5 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TaggedBootDevicesTest_v242-1893766026-project Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 81b9280d754a41c5949836f84f7bfa8b Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1893766026-project Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '04c8429a-14ed-4329-b9c5-998dbc3bff87'} Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:32:19.243037 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Returning 404 to user: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-031e08d5-93d1-4a73-a3d6-ea7221960ee0 tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 404 len: 111 microversion: 2.42 time: 0.052088 Oct 28 13:32:19.254405 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2760/5438] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:32:19 2022] DELETE /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:32:19.261194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:19.261926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] [instance: 04c8429a-14ed-4329-b9c5-998dbc3bff87] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:19.270346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:19.271034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:19.271580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:19.272394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:19.272950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:19.273635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:19.312925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] HTTP exception thrown: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Request method failure captured: Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 HTTP/1.1 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9gaZw49qP9pTkM12F57JZswitebnZ0SuYPgq7ivxED_cNyVwujn3Zi8lphDf8S7cpTnP2DtE8fE3E2ys5ZY0aLg1JzdE0_l-jxx5K9--JblwsnR9dOkJqG5L1E9CZg278Dn5iTVBcYS3wxxu9zmkE4M49KPWsxdDV_ka5Iv3lCBKdU Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 65e39c3cdf0f4775a64d93ddcba5bbc5 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65e39c3cdf0f4775a64d93ddcba5bbc5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65e39c3cdf0f4775a64d93ddcba5bbc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 65e39c3cdf0f4775a64d93ddcba5bbc5 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1893766026 Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TaggedBootDevicesTest_v242-1893766026-project Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 81b9280d754a41c5949836f84f7bfa8b Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1893766026-project Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '04c8429a-14ed-4329-b9c5-998dbc3bff87'} Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.316336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] Returning 404 to user: Instance 04c8429a-14ed-4329-b9c5-998dbc3bff87 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:32:19.321145 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c84c2cc-4bf1-41e0-ac76-55461e1c737d tempest-TaggedBootDevicesTest_v242-1893766026 tempest-TaggedBootDevicesTest_v242-1893766026-project] 10.222.0.25 "GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87" status: 404 len: 111 microversion: 2.42 time: 0.061420 Oct 28 13:32:19.322513 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2679/5439] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:32:19 2022] GET /compute/v2.1/servers/04c8429a-14ed-4329-b9c5-998dbc3bff87 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:32:19.981451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:19.982526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:19.990244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:19.991103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:20.000480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:20.001580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:20.003293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:20.005717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:20.097421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:20.129313 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-645012a9-452d-4f01-a2f7-55a446d95645 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1267 microversion: 2.1 time: 0.153214 Oct 28 13:32:20.131407 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2761/5440] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:19 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:21.156406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:21.157682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:21.203989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:21.206565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:21.207304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:21.208223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:21.208701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:21.212400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:21.271587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:21.271587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:21.283549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:21.284375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:21.284993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:21.285867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:21.286487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:21.287094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:21.304683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:21.316972 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a42fb0ed-069b-4ffa-9ea9-34fc0780d6c8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1285 microversion: 2.1 time: 0.164334 Oct 28 13:32:21.320885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2680/5441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:21 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:21.328182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:21.340838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:32:21.685873 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0ffc7d4-e7c7-4bb5-9288-d0283371cd6e tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 204 len: 0 microversion: 2.1 time: 0.419822 Oct 28 13:32:21.686857 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2762/5442] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:32:21 2022] DELETE /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:32:21.695787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:21.696499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:21.705456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:21.707856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:21.708814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:21.709690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:21.710276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:21.710848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:21.933444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:21.944292 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-57ff98f3-a175-400b-9a33-6d96d7f4d17c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1503 microversion: 2.1 time: 0.252690 Oct 28 13:32:21.945693 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2681/5443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:21 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:32:22.354425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:22.355369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:22.381674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:22.387063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:22.387669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:22.389313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:22.392792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:22.394867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:22.652487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:22.661506 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48a71f02-4aeb-4f79-96b7-9ffbe687ebf3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.319762 Oct 28 13:32:22.662283 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2763/5444] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:22 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:22.969496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:22.970528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:22.982543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:22.983077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:22.983517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:22.984225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:22.984682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:22.985104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:23.501496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:23.543332 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c29c3b7-f157-4ff8-b7f3-9078c05e3eb8 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1503 microversion: 2.1 time: 0.575912 Oct 28 13:32:23.546471 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2682/5445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:22 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1503 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:23.691752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:23.693153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:23.700084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:23.700579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:23.701021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:23.701726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:23.702181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:23.702608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:24.022611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4987407c-6bda-433d-9ee6-ef8b19061270 req-bbc5b76e-3a69-4b17-85bf-5492b7275998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1b0850-f1e1-42d2-8df4-99b3a229241a", "name": "network-vif-deleted", "tag": "5df95966-3fdb-46bf-943a-980570af080f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:24.034346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:24.039735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4987407c-6bda-433d-9ee6-ef8b19061270 req-bbc5b76e-3a69-4b17-85bf-5492b7275998 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:24.045194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4987407c-6bda-433d-9ee6-ef8b19061270 req-bbc5b76e-3a69-4b17-85bf-5492b7275998 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:24.045194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4987407c-6bda-433d-9ee6-ef8b19061270 req-bbc5b76e-3a69-4b17-85bf-5492b7275998 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:24.067222 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4987407c-6bda-433d-9ee6-ef8b19061270 req-bbc5b76e-3a69-4b17-85bf-5492b7275998 service nova] Creating event network-vif-deleted:5df95966-3fdb-46bf-943a-980570af080f for instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a on n-h2-862876-2 Oct 28 13:32:24.073235 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4987407c-6bda-433d-9ee6-ef8b19061270 req-bbc5b76e-3a69-4b17-85bf-5492b7275998 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059602 Oct 28 13:32:24.074349 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2683/5446] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:32:24.184890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:24.202971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7242a8a4-68b5-4aa9-b620-c2ac057a4a0e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.514962 Oct 28 13:32:24.215485 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2764/5447] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:23 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:24.576381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:24.577388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:24.599017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:24.599536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:24.603257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:24.604490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:24.605506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:24.619784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:24.690008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:24.691110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:24.691781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:24.692243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lazy-loading 'fault' on Instance uuid 7c1b0850-f1e1-42d2-8df4-99b3a229241a {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:32:24.749363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:24.762700 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7bc2de92-f41a-4803-8401-8f7044808141 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1304 microversion: 2.1 time: 0.193390 Oct 28 13:32:24.779311 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2684/5448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:24 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:25.228409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:25.229132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:25.242556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:25.243667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:25.247947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:25.247947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:25.247947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:25.249115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:25.427726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:25.450652 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-55e927e9-3cd3-440a-8fc4-5354ad9e5b70 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.226739 Oct 28 13:32:25.452402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2765/5449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:25 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:25.790971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:25.790971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:25.797964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:25.798779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:25.799415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:25.801048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:25.801857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:25.802456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:25.842241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:25.843141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:25.843730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:25.844407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lazy-loading 'fault' on Instance uuid 7c1b0850-f1e1-42d2-8df4-99b3a229241a {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:32:25.891175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e03ca387af2b4da1b774f46d934ad8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e420eb66d9314e19a1ed5c71fe9da78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:25.902434 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ed69d084-b528-4d3c-b24e-7cabe630a98c tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 200 len: 1304 microversion: 2.1 time: 0.119188 Oct 28 13:32:25.918462 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2685/5450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:25 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:26.103878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b58b7edf-ded4-47da-bc35-6abe318dba86 req-f3ff3bb3-5146-472b-9646-c8102bc6a565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7084c26d-2fae-4ddb-ace7-cd7783630182", "tag": "42f0ff0d-7e62-448c-8bff-760e6edf525e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:26.115477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b58b7edf-ded4-47da-bc35-6abe318dba86 req-f3ff3bb3-5146-472b-9646-c8102bc6a565 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:26.115956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b58b7edf-ded4-47da-bc35-6abe318dba86 req-f3ff3bb3-5146-472b-9646-c8102bc6a565 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:26.116408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b58b7edf-ded4-47da-bc35-6abe318dba86 req-f3ff3bb3-5146-472b-9646-c8102bc6a565 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:26.128180 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b58b7edf-ded4-47da-bc35-6abe318dba86 req-f3ff3bb3-5146-472b-9646-c8102bc6a565 service nova] Creating event network-changed:42f0ff0d-7e62-448c-8bff-760e6edf525e for instance 7084c26d-2fae-4ddb-ace7-cd7783630182 on n-h2-862876-2 Oct 28 13:32:26.133467 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b58b7edf-ded4-47da-bc35-6abe318dba86 req-f3ff3bb3-5146-472b-9646-c8102bc6a565 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036434 Oct 28 13:32:26.134268 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2766/5451] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:26.480821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:26.482974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:26.495145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:26.495946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:26.496732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:26.497759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:26.498491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:26.504452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:26.722638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:26.724031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:26.738101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:26.741491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:26.742121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:26.743020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:26.743627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:26.744229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:26.821502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:26.831370 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bfcf7765-145d-47be-8123-8957ce69974a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.355397 Oct 28 13:32:26.832183 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2686/5452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:26 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:26.927696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:26.928633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] [instance: 7c1b0850-f1e1-42d2-8df4-99b3a229241a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:26.936153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:26.937097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:26.937722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:26.938660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:26.939641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:26.940428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:26.960413 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] HTTP exception thrown: Instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a could not be found. Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Request method failure captured: Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a HTTP/1.1 Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nKkcP_WbqIPgauULoNq6E6kCLmmBLM5ytFhCMLyTSAdZodRROqMER2JCZwa1Ecuub_K0Fno-mkTk0qW6gzru6DixVmyz4NZwCJMlCD6_tT_eN9-8h827brU-5vmzDNe6H4jwrDSsAozCgyIePUCXuT-07V5hPvX8K-9ERMKeG3r0Q Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e420eb66d9314e19a1ed5c71fe9da78f Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesActionsTest-2089521281 Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e420eb66d9314e19a1ed5c71fe9da78f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e420eb66d9314e19a1ed5c71fe9da78f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e420eb66d9314e19a1ed5c71fe9da78f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e420eb66d9314e19a1ed5c71fe9da78f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesActionsTest-2089521281 Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e420eb66d9314e19a1ed5c71fe9da78f Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesActionsTest-2089521281 Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesActionsTest-2089521281-project Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: e03ca387af2b4da1b774f46d934ad8ff Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesActionsTest-2089521281-project Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a could not be found. Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7c1b0850-f1e1-42d2-8df4-99b3a229241a'} Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a could not be found. Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a could not be found. Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:32:26.963265 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:26.970109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:32:26.970109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:32:26.970109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:32:26.970109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:32:26.970109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:32:26.970109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a could not be found. Oct 28 13:32:26.970109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:32:26.983155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] Returning 404 to user: Instance 7c1b0850-f1e1-42d2-8df4-99b3a229241a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:32:26.984150 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37358385-ecf4-441d-afa5-e0b2e2dc8cb9 tempest-VolumesActionsTest-2089521281 tempest-VolumesActionsTest-2089521281-project] 10.222.0.25 "GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a" status: 404 len: 111 microversion: 2.1 time: 0.062456 Oct 28 13:32:26.986330 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2687/5453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:26 2022] GET /compute/v2.1/servers/7c1b0850-f1e1-42d2-8df4-99b3a229241a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:32:27.272495 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f45d6acc-1fb6-4240-96cf-2ded1e945885 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1833 microversion: 2.1 time: 0.554737 Oct 28 13:32:27.272495 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2767/5454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:26 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1833 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:27.300282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:27.307130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:27.320436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.321208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.322308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.324232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.324848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.328022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.446181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:27.519190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:27.545190 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14ed5d72-2651-4c73-a640-44c8f17a68df tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1682 microversion: 2.1 time: 0.254453 Oct 28 13:32:27.548773 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2688/5455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:27 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:27.701541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:27.704262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:27.710127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:27.723949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.725260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.726000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.726904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.727537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.728688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.794725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4160f9f4-ef62-457f-964d-228c61b887be tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action" status: 200 len: 32646 microversion: 2.1 time: 0.098742 Oct 28 13:32:27.796235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2768/5456] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:32:27 2022] POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action => generated 32646 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:32:27.864617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:27.865427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:27.879835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.881838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.883925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.884968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.887309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.888024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.918063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:27.919186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:27.922113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:27.929316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.930136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.930650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.931549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:27.932093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:27.932592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:27.978783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd3e41af9d3c4502ad7e0d95c62be43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de72f802cbe2440187ac424eb389eb51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:27.979395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] flavor_id is None. Assuming migration. {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 13:32:27.979840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 13:32:28.302960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:28.315326 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da3c04e5-4534-4f97-a719-dfe83a663d00 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.463605 Oct 28 13:32:28.327200 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2689/5457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:27 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:28.570438 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ced571e1-2525-429e-9a27-4e68194fea55 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.654843 Oct 28 13:32:28.571675 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2769/5458] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:32:27 2022] POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:32:28.581422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:28.582110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:28.600838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:28.601345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:28.601792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:28.602597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:28.603089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:28.603520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:28.795916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:28.811514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0507cae-e469-49d1-94e0-265588f1567e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1691 microversion: 2.1 time: 0.233688 Oct 28 13:32:28.813232 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2690/5459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:28 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1691 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:29.343268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:29.345159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:29.371408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:29.372762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:29.373849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:29.375276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:29.376295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:29.378176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:29.616042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:29.627222 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-458e1bcf-fc89-4793-a8a7-972bb0a997b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.288946 Oct 28 13:32:29.630471 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2770/5460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:29 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:29.842763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:29.843591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:29.846439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:29.851785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:29.852444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:29.852979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:29.853586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:29.854287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:29.854812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:30.149676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:30.149676 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60f98c5b-957d-4e3e-9f2f-2aa988f5ac93 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1691 microversion: 2.1 time: 0.173173 Oct 28 13:32:30.149676 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2691/5461] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:29 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:30.663881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:30.665765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:30.677919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:30.678661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:30.680910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:30.682189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:30.683204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:30.683918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:30.908546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:30.918150 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76209fa6-a90c-46db-a0d3-095273c2bc14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.266907 Oct 28 13:32:30.918150 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2771/5462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:30 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:31.072050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:31.072687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:31.086918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:31.088641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:31.088641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:31.088641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:31.089029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:31.089461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:31.391041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:31.400095 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d405235e-f6eb-4856-bc27-51b937de8e9d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1691 microversion: 2.1 time: 0.335209 Oct 28 13:32:31.403665 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2692/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:31 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1691 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:31.740687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8c6f763f-c52d-44c3-83f8-9b178e417c06 req-92d7857f-588c-49a5-8bf5-4275fd0737fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7084c26d-2fae-4ddb-ace7-cd7783630182", "name": "network-vif-plugged", "status": "completed", "tag": "42f0ff0d-7e62-448c-8bff-760e6edf525e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:31.763430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8c6f763f-c52d-44c3-83f8-9b178e417c06 req-92d7857f-588c-49a5-8bf5-4275fd0737fa service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:31.764191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8c6f763f-c52d-44c3-83f8-9b178e417c06 req-92d7857f-588c-49a5-8bf5-4275fd0737fa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:31.764776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8c6f763f-c52d-44c3-83f8-9b178e417c06 req-92d7857f-588c-49a5-8bf5-4275fd0737fa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:31.777536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aa24519-825d-4916-94f2-4b0113832875"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:31.780670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:31.787879 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8c6f763f-c52d-44c3-83f8-9b178e417c06 req-92d7857f-588c-49a5-8bf5-4275fd0737fa service nova] Creating event network-vif-plugged:42f0ff0d-7e62-448c-8bff-760e6edf525e for instance 7084c26d-2fae-4ddb-ace7-cd7783630182 on n-h2-862876-2 Oct 28 13:32:31.797627 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8c6f763f-c52d-44c3-83f8-9b178e417c06 req-92d7857f-588c-49a5-8bf5-4275fd0737fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061082 Oct 28 13:32:31.797929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:31.799130 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2772/5464] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:31.803613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:31.805371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:31.806402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:31.807524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:31.808224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:31.941574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:31.942437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:31.972062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:31.976525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:31.979419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:31.981174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:31.985561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:31.987031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:32.407062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:32.417309 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76795a73-dddf-4a25-a685-9fbe526439b3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.480351 Oct 28 13:32:32.421183 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2773/5465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:31 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:32:32.431494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:32.432436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:32.463489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:32.465097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:32.466322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:32.467875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:32.469319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:32.470670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:32.825582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:32.853106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4eee2f0b-8ac3-439d-84ca-27edbbabc841 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1691 microversion: 2.1 time: 0.430515 Oct 28 13:32:32.855109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2774/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:32 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1691 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:32.948284 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b1a4e05-5c62-464f-bd72-40308cf93551 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.175303 Oct 28 13:32:32.949780 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2693/5467] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:32:31 2022] POST /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 194 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:33.449232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:33.453701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:33.463805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:33.464526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:33.465824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:33.466849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:33.467457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:33.468697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:33.812237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:33.826010 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27f886ae-706e-47cf-a7be-1ad69701dd53 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1315 microversion: 2.1 time: 0.381481 Oct 28 13:32:33.828598 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2775/5468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:33 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:33.880278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:33.881399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:33.916705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:33.917649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:33.920317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:33.921361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:33.922677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:33.923651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:34.358601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:34.362701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:34.398305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dde0e536-e6d1-4046-b20a-e50f06db8961 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1691 microversion: 2.1 time: 0.513860 Oct 28 13:32:34.398305 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2694/5469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:33 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1691 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:34.852771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:34.854636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:34.870930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:34.871773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:34.872381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:34.873322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:34.877271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:34.883365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:35.413834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:35.414640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:35.436591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:35.437981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:35.442926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:35.444334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:35.444931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:35.446072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:35.487788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:35.496739 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c878b39-ece9-479d-8bc7-394fe0c03aec tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1502 microversion: 2.1 time: 0.648788 Oct 28 13:32:35.497331 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2776/5470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:34 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1502 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:35.935835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:35.959445 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-71bb388b-48a6-4de5-aa0c-335999962878 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 0.549701 Oct 28 13:32:35.969044 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2695/5471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:35 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:32:37.004041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:37.011976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:37.030489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:37.032395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:37.033023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:37.034463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:37.035105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:37.035745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:37.070730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:37.600127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:37.616359 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2ac9883e-88d3-4167-971c-a6cade4cf8c6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 0.625875 Oct 28 13:32:37.617710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2777/5472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:36 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:38.647185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:38.648425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:38.667925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:38.671374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:38.675490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:38.691738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:38.708960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:38.708960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:39.454101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc6b5129-46ed-4154-975d-decd24535ac8"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:39.462403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:39.480602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:39.481381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:39.481997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:39.482906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:39.483526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:39.484116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:39.644642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:39.663221 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1700dca3-42d8-4a4b-a4c7-06c2affb663a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 1.012302 Oct 28 13:32:39.664238 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2696/5473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:38 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:40.523356 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c6c8cf5-bbe0-4ea8-91b0-3b3bb3ea9ab6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.074765 Oct 28 13:32:40.531375 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2778/5474] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 13:32:39 2022] POST /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:40.694315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:40.694986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:40.717520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:40.717520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:40.717520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:40.717520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:40.717520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:40.717520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:40.998428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:41.006872 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7409ea3-4946-49ea-98de-a65f8577ca07 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 0.322792 Oct 28 13:32:41.007477 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2697/5475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:40 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:42.031796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:42.035881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:42.068732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:42.069469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:42.073987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:42.074979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:42.075756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:42.076353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:42.439373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:42.453039 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a6a316fb-56d9-4864-a5aa-c14970caf049 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 0.425400 Oct 28 13:32:42.468365 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2779/5476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:42 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:43.480753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:43.481379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:43.498192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:43.499701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:43.500348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:43.501256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:43.501873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:43.503380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:43.856016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:43.889560 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b177a60c-d23d-4b6d-8de8-0257227c9abf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 0.413289 Oct 28 13:32:43.890144 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2698/5477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:43 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:44.917934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:44.919773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:44.950287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:44.951215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:44.953888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:44.954721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:44.955307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:44.957027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:45.269136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:45.281572 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-72d6fa3e-6768-4212-9255-c8d557085d25 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 0.370234 Oct 28 13:32:45.290288 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2780/5478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:44 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:46.311530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:46.312152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:46.324073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:46.324571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:46.325012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:46.328458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:46.329010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:46.331793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:46.811355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:46.826490 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a1b331b-f75e-4d69-be35-e885ffb8987a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1696 microversion: 2.1 time: 0.518529 Oct 28 13:32:46.839819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2699/5479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:46 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1696 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:47.857269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:47.857839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:47.880148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:47.881087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:47.881836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:47.886316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:47.886979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:47.887525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:48.010899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d495d5f8-bc3a-47d1-8b64-88adfdab8dac req-2a87736f-a296-4237-b2d5-4bd53955ff58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "name": "network-vif-unplugged", "status": "completed", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:48.058027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d495d5f8-bc3a-47d1-8b64-88adfdab8dac req-2a87736f-a296-4237-b2d5-4bd53955ff58 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:48.058515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d495d5f8-bc3a-47d1-8b64-88adfdab8dac req-2a87736f-a296-4237-b2d5-4bd53955ff58 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:48.061035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d495d5f8-bc3a-47d1-8b64-88adfdab8dac req-2a87736f-a296-4237-b2d5-4bd53955ff58 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:48.129119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d495d5f8-bc3a-47d1-8b64-88adfdab8dac req-2a87736f-a296-4237-b2d5-4bd53955ff58 service nova] Creating event network-vif-unplugged:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h2-862876-2 Oct 28 13:32:48.138027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-d495d5f8-bc3a-47d1-8b64-88adfdab8dac req-2a87736f-a296-4237-b2d5-4bd53955ff58 service nova] Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:32:48.162428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d495d5f8-bc3a-47d1-8b64-88adfdab8dac req-2a87736f-a296-4237-b2d5-4bd53955ff58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155526 Oct 28 13:32:48.162994 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2700/5480] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:32:48.392180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:48.431192 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d4701d4-1fbd-42db-bbc9-65477decf0b0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1695 microversion: 2.1 time: 0.575082 Oct 28 13:32:48.449986 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2781/5481] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:47 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1695 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:49.469227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:49.474057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:49.483898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:49.484664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:49.485305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:49.486268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:49.487553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:49.488722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:49.753096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:49.762117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5229dae-1534-4a3f-a37a-99ba65340fd1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1695 microversion: 2.1 time: 0.299405 Oct 28 13:32:49.763588 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2701/5482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:49 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1695 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:32:50.240459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2ae17adf-cb12-4a50-bc51-592fa2fc030e req-50e31a6f-b27d-47ca-a4b6-b74943f35f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:50.264809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae17adf-cb12-4a50-bc51-592fa2fc030e req-50e31a6f-b27d-47ca-a4b6-b74943f35f7e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:50.265296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae17adf-cb12-4a50-bc51-592fa2fc030e req-50e31a6f-b27d-47ca-a4b6-b74943f35f7e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:50.293392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:50.296346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:50.305523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2ae17adf-cb12-4a50-bc51-592fa2fc030e req-50e31a6f-b27d-47ca-a4b6-b74943f35f7e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:50.321789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:50.322391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:50.326207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:50.327008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:50.327494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:50.327996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:50.358097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2ae17adf-cb12-4a50-bc51-592fa2fc030e req-50e31a6f-b27d-47ca-a4b6-b74943f35f7e service nova] Creating event network-changed:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h2-862876-2 Oct 28 13:32:50.376933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-2ae17adf-cb12-4a50-bc51-592fa2fc030e req-50e31a6f-b27d-47ca-a4b6-b74943f35f7e service nova] Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:32:50.398668 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2ae17adf-cb12-4a50-bc51-592fa2fc030e req-50e31a6f-b27d-47ca-a4b6-b74943f35f7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159663 Oct 28 13:32:50.399585 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2782/5483] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:32:50.434871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'flavor' on Instance uuid ffd7fdfa-5067-4a02-82a4-87d4ee670caa {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:32:50.795085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:50.795922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:50.827257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:50.834108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:50.834847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:50.839338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:50.839999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:50.845642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:50.986711 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-924932a6-ef0f-4ca4-bd40-ecca5a2d91cb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/action" status: 200 len: 32 microversion: 2.1 time: 0.698488 Oct 28 13:32:50.993849 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2702/5484] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:32:50 2022] POST /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/action => generated 32 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:32:51.005452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:51.006414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:51.016332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:51.016833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:51.017271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:51.018827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:51.019294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:51.020039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:51.547875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:51.563630 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-367c6b45-bf3d-40a7-b1a9-3c5d690bdc7a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.562747 Oct 28 13:32:51.569810 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2703/5485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:50 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:51.883073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Calling method '.version_select at 0x7f27bd9a1940>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:51.885997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:51.886495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:51.886965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:51.907244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:51.907780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:51.908217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:51.923214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:51.923703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:51.924740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:51.931578 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d2ccba3-a8ae-4700-990c-7d6fa7a94536 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713 tempest-PortsAdminExtendedAttrsIpV6TestJSON-461047713-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.360424 Oct 28 13:32:51.932443 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2704/5486] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:32:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:52.062967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:52.076069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10715a02-4b89-4324-99b8-7060c30d4d43 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1695 microversion: 2.1 time: 1.286795 Oct 28 13:32:52.076792 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2783/5487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:50 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1695 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:52.592226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:52.592895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:52.606552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:52.607222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:52.608853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:52.609684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:52.611475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:52.613006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:52.951619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:52.964908 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-679f4560-d10b-49c4-a8a1-30b8dbcd64ae tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.377494 Oct 28 13:32:52.980137 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2705/5488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:52 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:53.103345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:53.104731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:53.113413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:53.114277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:53.115017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:53.117102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:53.118231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:53.119142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:53.393534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:53.406346 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-71538b7f-364c-4342-84ca-e4b47f307201 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1693 microversion: 2.1 time: 0.308109 Oct 28 13:32:53.415737 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2784/5489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:53 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1693 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:53.996018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:54.000379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:54.018941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:54.019435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:54.020123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:54.020894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:54.021348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:54.021769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:54.340860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:54.349768 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ffb00e6c-afda-4f87-a4fa-3172da6bc326 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.362211 Oct 28 13:32:54.351478 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2706/5490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:53 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:54.433895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:54.440438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:54.448045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:54.448963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:54.449732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:54.450718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:54.451779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:54.452642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:54.825455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:54.837712 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-660b69ab-0abe-4655-aa60-f02f47e9e31e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1693 microversion: 2.1 time: 0.408440 Oct 28 13:32:54.838477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2785/5491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:54 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1693 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:55.378053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:55.380192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:55.391304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:55.392398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:55.393645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:55.395341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:55.395602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:55.396590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:55.704872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:55.716992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8b801f95-607b-4105-aa00-eb12315c61b9 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.343816 Oct 28 13:32:55.717783 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2707/5492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:55 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:55.863039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:55.864192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:55.874404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:55.883121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:55.883815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:55.884894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:55.885508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:55.886084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:56.148696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:56.159205 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c19fe7b-f6c1-423a-9190-e6e2c5f0baf5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1690 microversion: 2.1 time: 0.300670 Oct 28 13:32:56.159828 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2786/5493] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:55 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1690 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:56.185056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:56.187156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:56.195154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:56.198117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:56.198900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:56.200749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:56.200749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:56.201326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:56.386657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:56.490072 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee7d61b0-9f2d-41bd-9e44-ff5fbb44349c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action" status: 204 len: 0 microversion: 2.1 time: 0.309474 Oct 28 13:32:56.502944 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2708/5494] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:32:56 2022] POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:32:56.504107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:56.505046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:56.518803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:56.520968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:56.522098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:56.524738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:56.526949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:56.529830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:56.747933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:56.748708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:56.757632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=58 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:56.759989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:56.760701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:56.761148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:56.761926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:56.762414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:56.762854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:57.221653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:57.242455 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d26cac4-8a3e-4977-a949-e685e90a2ea7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1690 microversion: 2.1 time: 0.737928 Oct 28 13:32:57.243712 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2787/5495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:56 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1690 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:57.349682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:57.371841 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ebcbbfe3-bcbf-43d5-80cb-dd2dcbea00b6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.632045 Oct 28 13:32:57.382071 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2709/5496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:56 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:57.816966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5cc5ba01-0a45-459a-b2a5-718e4daf48aa req-b440bcfe-3cb6-42a5-8be4-9d9fed312ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "name": "network-vif-plugged", "status": "completed", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:32:57.847015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5cc5ba01-0a45-459a-b2a5-718e4daf48aa req-b440bcfe-3cb6-42a5-8be4-9d9fed312ee5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:57.847590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5cc5ba01-0a45-459a-b2a5-718e4daf48aa req-b440bcfe-3cb6-42a5-8be4-9d9fed312ee5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:57.849116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5cc5ba01-0a45-459a-b2a5-718e4daf48aa req-b440bcfe-3cb6-42a5-8be4-9d9fed312ee5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:57.867376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5cc5ba01-0a45-459a-b2a5-718e4daf48aa req-b440bcfe-3cb6-42a5-8be4-9d9fed312ee5 service nova] Creating event network-vif-plugged:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h2-862876-2 Oct 28 13:32:57.877473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-5cc5ba01-0a45-459a-b2a5-718e4daf48aa req-b440bcfe-3cb6-42a5-8be4-9d9fed312ee5 service nova] Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:32:57.896957 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5cc5ba01-0a45-459a-b2a5-718e4daf48aa req-b440bcfe-3cb6-42a5-8be4-9d9fed312ee5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086749 Oct 28 13:32:57.906119 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2788/5497] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:32:58.025158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:58.025664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:58.041762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.042268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.042709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.047624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.048171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.048614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.108687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:32:58.272056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:58.273360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:58.284039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.284541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.284995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.285813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.286277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.286736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.467752 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-362db3a4-ac01-40b7-883a-ffff9a717d47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 204 len: 0 microversion: 2.1 time: 0.452652 Oct 28 13:32:58.468608 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2710/5498] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:32:58 2022] DELETE /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:32:58.476856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:58.478057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:58.491611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.492407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.493015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.495785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.496443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.497037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.567561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:58.577461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c7ddefb3-820a-492b-94e9-e7370a01ebec tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1690 microversion: 2.1 time: 0.311547 Oct 28 13:32:58.578064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2789/5499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:58 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1690 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:58.594891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:58.600680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:58.603076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=46 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:32:58.619226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.619916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.620522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.621419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:58.621882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:58.622314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:58.790178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:58.808039 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ec4a2ce-637f-4200-830c-31e5681e0f1f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.338051 Oct 28 13:32:58.808889 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2711/5500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:58 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:58.943856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:58.952904 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6ee7f82-ee40-431d-92d7-c78b94030742 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1554 microversion: 2.1 time: 0.363031 Oct 28 13:32:58.971065 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2790/5501] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:58 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1554 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:59.608391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:59.609676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:59.624577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:59.625092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:59.627145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:59.629249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:59.629747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:59.632367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:59.837918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:59.841304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:59.850720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:59.854409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:59.855101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:59.856479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:59.857184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:59.857788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:32:59.893205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:32:59.903128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2a0ff38c-0253-48ff-ad24-8041bd7d0a28 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1682 microversion: 2.1 time: 0.302748 Oct 28 13:32:59.903768 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2712/5502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:59 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1682 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:32:59.986103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:32:59.987059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:32:59.998271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:32:59.999088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:32:59.999703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:00.002027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:00.003211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:00.005301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:00.458385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:00.470964 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6611982f-8466-422b-a871-031a35e99e7d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.636879 Oct 28 13:33:00.476811 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2791/5503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:59 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:01.192657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:01.192657 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-15a89970-ca33-4136-a957-5a7ef75f83ad tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1554 microversion: 2.1 time: 1.169090 Oct 28 13:33:01.192657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2713/5504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:32:59 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1554 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:01.231590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-cb0d768e-82b0-4da6-8637-c89a148b34e9 req-ed2210f8-6ab8-4f81-bb22-08acd82188c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7084c26d-2fae-4ddb-ace7-cd7783630182", "name": "network-vif-deleted", "tag": "42f0ff0d-7e62-448c-8bff-760e6edf525e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:01.250015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cb0d768e-82b0-4da6-8637-c89a148b34e9 req-ed2210f8-6ab8-4f81-bb22-08acd82188c9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:01.250511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cb0d768e-82b0-4da6-8637-c89a148b34e9 req-ed2210f8-6ab8-4f81-bb22-08acd82188c9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:01.250977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cb0d768e-82b0-4da6-8637-c89a148b34e9 req-ed2210f8-6ab8-4f81-bb22-08acd82188c9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:01.280569 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-cb0d768e-82b0-4da6-8637-c89a148b34e9 req-ed2210f8-6ab8-4f81-bb22-08acd82188c9 service nova] Creating event network-vif-deleted:42f0ff0d-7e62-448c-8bff-760e6edf525e for instance 7084c26d-2fae-4ddb-ace7-cd7783630182 on n-h2-862876-2 Oct 28 13:33:01.293430 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-cb0d768e-82b0-4da6-8637-c89a148b34e9 req-ed2210f8-6ab8-4f81-bb22-08acd82188c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067323 Oct 28 13:33:01.300948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2792/5505] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 28 13:33:01.505226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:01.506066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:01.513000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:01.513531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:01.513995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:01.514695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:01.515177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:01.515602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:02.157752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:02.183552 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d11f481f-3866-4183-bdfd-b457454e21d2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.685951 Oct 28 13:33:02.196689 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2714/5506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:01 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:02.208855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:02.211426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:02.276260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:02.276873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:02.292852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:02.293644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:02.303634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:02.304272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:02.430464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:02.442617 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46eebd52-8ea0-4ab9-a569-9a81a262fdc7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1346 microversion: 2.1 time: 0.240235 Oct 28 13:33:02.444231 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2793/5507] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:02 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:03.213799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:03.214509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:03.224698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:03.225507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:03.226176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:03.227230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:03.227914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:03.228693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:03.484311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:03.496230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:03.522658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:03.528268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:03.546638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:03.548511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:03.567777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:03.568846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:03.581685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:03.603190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:03.618136 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ae821038-0aff-487b-a243-938734429987 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.407894 Oct 28 13:33:03.666310 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2715/5508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:03 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:04.157367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:04.165896 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0dee8509-68c1-4b2e-b9bb-cd41bb8b67b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1346 microversion: 2.1 time: 0.698162 Oct 28 13:33:04.183131 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2794/5509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:03 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1346 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:04.663313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:04.664102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:04.677061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:04.677703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:04.682838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:04.682838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:04.682838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:04.684984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:05.113836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:05.122948 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb141369-ff09-49e4-83f7-b062a1063229 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.463497 Oct 28 13:33:05.129396 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2716/5510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:04 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:05.197501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:05.198105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:05.211177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:05.213846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:05.214463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:05.215665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:05.216126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:05.216553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:05.349196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:05.388009 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23ec3c4d-f42f-4090-ac36-c49015c25087 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1346 microversion: 2.1 time: 0.194392 Oct 28 13:33:05.393378 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2795/5511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:05 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1346 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:06.160383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:06.162178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:06.180108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:06.180859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:06.181648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:06.182557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:06.183213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:06.183821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:06.415344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:06.416517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:06.437907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:06.442451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:06.443259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:06.451177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:06.451696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:06.453399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:06.525095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:06.539970 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-05bee429-c59e-4f71-8f20-54a42387f311 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.383271 Oct 28 13:33:06.562821 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2717/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:06 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:06.731425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:06.763924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-686da2d4-2b58-468f-8aed-fbb5314826d1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1346 microversion: 2.1 time: 0.352499 Oct 28 13:33:06.783170 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2796/5513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:06 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1346 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:07.570087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:07.571243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:07.578822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:07.579719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:07.580461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:07.582559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:07.583730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:07.584403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:07.838341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1402207602", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "6c0217ae-b9e4-45f0-bb4f-52e4dae46746"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:07.852173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:07.861928 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2e039045-0904-4ee5-bd9f-71121fdb37b1 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.295168 Oct 28 13:33:07.867207 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2797/5514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:07 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:07.892029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:07.892958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:07.911047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:07.911790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:07.912391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:07.914893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:07.914893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:07.914893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:07.930624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] validate_networks() for [('6c0217ae-b9e4-45f0-bb4f-52e4dae46746', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:33:08.018732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:08.032596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07025b8f-e814-47a2-bb8e-1f17170338c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1346 microversion: 2.1 time: 0.148702 Oct 28 13:33:08.034129 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2798/5515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:07 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1346 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:08.560863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:33:08.561679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:33:08.563316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:33:08.564004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:33:08.564590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:33:08.576312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:08.577052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:08.577671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:08.578883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:08.580060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:08.580655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:08.615666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Getting quotas for project c43bbe69e12d4975bfbf88a6d30301e7. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:33:08.621462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Getting quotas for user 983e1719c2a245fca99f081b1fd7e800 and project c43bbe69e12d4975bfbf88a6d30301e7. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:33:08.636002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:33:08.638404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:33:08.849139 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ead0237-b3e3-405b-b086-d9aba112b6e5 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.312663 Oct 28 13:33:08.851226 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2718/5516] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:33:08.863661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-030b9652-5bcf-42c2-b6e0-afc63d6162da tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:08.864933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-030b9652-5bcf-42c2-b6e0-afc63d6162da tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:08.884621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:08.887140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:08.894411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:08.896738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:08.901051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:08.902091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:08.903208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:08.903878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:09.015825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-030b9652-5bcf-42c2-b6e0-afc63d6162da tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:09.024575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-030b9652-5bcf-42c2-b6e0-afc63d6162da tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:09.026026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-030b9652-5bcf-42c2-b6e0-afc63d6162da tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:09.028447 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-030b9652-5bcf-42c2-b6e0-afc63d6162da tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1259 microversion: 2.21 time: 0.170070 Oct 28 13:33:09.029508 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2799/5517] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:08 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:09.056431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:09.056987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:09.068756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:09.072723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:09.075987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:09.075987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:09.075987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:09.075987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:09.138508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:09.139266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:09.143144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:09.143144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lazy-loading 'fault' on Instance uuid 7084c26d-2fae-4ddb-ace7-cd7783630182 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:33:09.202453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:09.212535 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4eac61bf-2ba2-4f19-9bbe-25878d145615 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 200 len: 1351 microversion: 2.1 time: 0.159837 Oct 28 13:33:09.215516 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2800/5518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:09 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 1351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:09.231189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:09.239500 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-06db269d-c6a1-40f3-841c-21f934cee367 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.358982 Oct 28 13:33:09.240092 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2719/5519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:08 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:10.059764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6737502-e2c5-4374-8755-344119cca2c7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:10.061146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6737502-e2c5-4374-8755-344119cca2c7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:10.170655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6737502-e2c5-4374-8755-344119cca2c7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:10.183009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6737502-e2c5-4374-8755-344119cca2c7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:10.185066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6737502-e2c5-4374-8755-344119cca2c7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:10.186821 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6737502-e2c5-4374-8755-344119cca2c7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1259 microversion: 2.21 time: 0.131473 Oct 28 13:33:10.187978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2801/5520] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:10 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1259 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:10.252313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:10.252942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:10.265484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:10.266315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:10.275667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:10.276485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:10.277202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:10.278486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:10.279705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:10.280336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:10.291484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:10.291941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:10.292390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:10.295914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:10.296673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:10.301276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:10.347916 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 HTTP/1.1 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7084c26d-2fae-4ddb-ace7-cd7783630182'} Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:10.353162 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:10.357427 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12088668-158c-42fc-892d-b46dd0c65845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 404 len: 111 microversion: 2.1 time: 0.110392 Oct 28 13:33:10.377201 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2720/5521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:10 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:33:10.644424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:10.647095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:10.661009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:10.666455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:10.666455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:10.666455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:10.666455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:10.666455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:10.691642 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182/os-volume_attachments HTTP/1.1 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '7084c26d-2fae-4ddb-ace7-cd7783630182'} Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:10.694044 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-80fd49fb-7df6-4803-8dec-957dc26e7f39 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056233 Oct 28 13:33:10.705096 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2721/5522] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:33:10 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:33:10.725673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:10.737023 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-715db2ec-4d5a-4b8c-b823-be5232bad890 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.475291 Oct 28 13:33:10.738394 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2802/5523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:10 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:11.006297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1922542583", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f6719c5f-6a3e-4187-8df7-d08ef3f7deb2"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:11.076191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] validate_networks() for [('f6719c5f-6a3e-4187-8df7-d08ef3f7deb2', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:33:11.218358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:11.219723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:11.228602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:11.229091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:11.229556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:11.230260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:11.230713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:11.231174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:11.307365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:11.323609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:11.325256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:11.326583 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09f2fe30-48f6-4b53-ae8b-dc7b545d52f0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1255 microversion: 2.21 time: 0.112587 Oct 28 13:33:11.329657 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2803/5524] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:11 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1255 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:11.742358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:33:11.745740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:33:11.746860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:33:11.747390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:33:11.747942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:33:11.760072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:11.760869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:11.761540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:11.762883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:11.763890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:11.764518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:11.766557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:11.767240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:11.776049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:11.776549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:11.776990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:11.777699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:11.778158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:11.778586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:11.787618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:33:11.793478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for user ba2dd748101e4b3492c9bea6a26cea14 and project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:33:11.811384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:33:11.816248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 5e8aaf30-ff82-4601-a487-73de1780adb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:33:12.035968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:12.047351 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09aebcdd-b7fd-4f11-a17b-b46b3fd2f624 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.285436 Oct 28 13:33:12.051751 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2804/5525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:11 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:12.212879 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da4b114e-5757-433f-b1b9-d37509280adf tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210438 Oct 28 13:33:12.219659 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2722/5526] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:33:12.224909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99a95162-a9c3-48a6-9b5a-a3fe1582090f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:12.226074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99a95162-a9c3-48a6-9b5a-a3fe1582090f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 5e8aaf30-ff82-4601-a487-73de1780adb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:12.347387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99a95162-a9c3-48a6-9b5a-a3fe1582090f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:12.354852 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99a95162-a9c3-48a6-9b5a-a3fe1582090f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3" status: 200 len: 1215 microversion: 2.1 time: 0.133707 Oct 28 13:33:12.355067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:12.355541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:12.356342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2805/5527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:12 2022] GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:12.379961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:12.380314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c228616d-f0ee-4546-88ab-b3416f27a554 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:12.380471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:12.380804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c228616d-f0ee-4546-88ab-b3416f27a554 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 5e8aaf30-ff82-4601-a487-73de1780adb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:12.380917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:12.381640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:12.385067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:12.385913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:12.432524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c228616d-f0ee-4546-88ab-b3416f27a554 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 5e8aaf30-ff82-4601-a487-73de1780adb3] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:33:12.589367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:12.605433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:12.609429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:12.610772 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a2667b9b-180c-4d1d-a031-6b3e9824dd40 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1319 microversion: 2.21 time: 0.261143 Oct 28 13:33:12.637009 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2723/5528] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:12 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:12.828574 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c228616d-f0ee-4546-88ab-b3416f27a554 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3" status: 204 len: 0 microversion: 2.1 time: 0.452734 Oct 28 13:33:12.831145 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2806/5529] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:33:12 2022] DELETE /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:33:12.839176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a725cf2-3471-41f2-8ea5-f1896b1eb4ef tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:12.839881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a725cf2-3471-41f2-8ea5-f1896b1eb4ef tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 5e8aaf30-ff82-4601-a487-73de1780adb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:12.876069 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6a725cf2-3471-41f2-8ea5-f1896b1eb4ef tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a725cf2-3471-41f2-8ea5-f1896b1eb4ef tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 HTTP/1.1 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '5e8aaf30-ff82-4601-a487-73de1780adb3'} Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 5e8aaf30-ff82-4601-a487-73de1780adb3 Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:12.879433 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a725cf2-3471-41f2-8ea5-f1896b1eb4ef tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:12.886336 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a725cf2-3471-41f2-8ea5-f1896b1eb4ef tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3" status: 404 len: 111 microversion: 2.1 time: 0.045838 Oct 28 13:33:12.891071 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2724/5530] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:12 2022] GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:33:13.075981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1733199466", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f6719c5f-6a3e-4187-8df7-d08ef3f7deb2"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:13.079358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:13.080651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:13.098029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.098387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.098855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.099572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.100036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.100471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.184060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] validate_networks() for [('f6719c5f-6a3e-4187-8df7-d08ef3f7deb2', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:33:13.457069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:13.472497 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fbca2b18-1eb4-4a95-ae4f-74d8ff1ce416 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.404748 Oct 28 13:33:13.483864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2807/5531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:13 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:13.725249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Calling method '.version_select at 0x7f27b85058b0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:13.727772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.732122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.732122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.765075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.765774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.766298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.787135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.792431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.793121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.803525 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-721052d1-173a-425d-a94f-8de0b1054586 tempest-PortsAdminExtendedAttrsTestJSON-1951093334 tempest-PortsAdminExtendedAttrsTestJSON-1951093334-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.316729 Oct 28 13:33:13.807213 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2808/5532] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 13:33:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:13.818024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:13.818936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:13.827947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.828658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.829315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.830221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.830914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.831502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.844749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:33:13.845800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:33:13.846405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:33:13.846957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:33:13.847532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:33:13.861967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.862520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.863092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.863945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:13.866776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:13.868613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:13.896534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:33:13.903532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for user ba2dd748101e4b3492c9bea6a26cea14 and project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:33:13.922552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:33:13.926326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:33:14.053134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:14.062218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:14.065605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:14.067316 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09038578-3b67-4f13-a214-f8466ce471e7 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.258907 Oct 28 13:33:14.087462 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2809/5533] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:13 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:14.097417 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9229c9e-f888-4d60-af27-887a46a05e63 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024841 Oct 28 13:33:14.099019 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2725/5534] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:33:14.112762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25d0a5e4-0fc2-4519-8745-357d4c9243fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:14.114421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25d0a5e4-0fc2-4519-8745-357d4c9243fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:14.241347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-25d0a5e4-0fc2-4519-8745-357d4c9243fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:14.250152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25d0a5e4-0fc2-4519-8745-357d4c9243fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1215 microversion: 2.1 time: 0.144141 Oct 28 13:33:14.255266 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2810/5535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:14 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:14.503275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:14.506400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:14.511212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:14.511996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:14.512516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:14.514668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:14.515536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:14.516195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:14.720372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:14.742117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd6ab24a-4489-45b1-bc91-8a7f7601e5e4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.244084 Oct 28 13:33:14.742117 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2726/5536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:14 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:15.102941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:15.104451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:15.113339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:15.117596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:15.117596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:15.117596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:15.117596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:15.117596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:15.274241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95c74552-991c-4e6f-9a9d-e5cdaa12de01 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:15.275611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95c74552-991c-4e6f-9a9d-e5cdaa12de01 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:15.362258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95c74552-991c-4e6f-9a9d-e5cdaa12de01 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:15.370557 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95c74552-991c-4e6f-9a9d-e5cdaa12de01 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1215 microversion: 2.1 time: 0.100712 Oct 28 13:33:15.390410 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2727/5537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:15 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:15.495961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:15.519338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:15.536598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:15.547422 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-922805fb-06b1-442f-809c-72b47436624c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.449672 Oct 28 13:33:15.549192 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2811/5538] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:15 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:15.751824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9eb47bbd-adc1-43b5-bdd9-e5bd8b97544a req-47a7582b-1543-4487-bea1-f1aa9e13c1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29df2ee3-1d4c-40d4-a962-ef75d47be51a", "tag": "050b8bab-5650-40f7-987f-ed7b764c07d4"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:15.764279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:15.765055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:15.777666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:15.778321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:15.779654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:15.786682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:15.787340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:15.787853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:15.788416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9eb47bbd-adc1-43b5-bdd9-e5bd8b97544a req-47a7582b-1543-4487-bea1-f1aa9e13c1a9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:15.789355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9eb47bbd-adc1-43b5-bdd9-e5bd8b97544a req-47a7582b-1543-4487-bea1-f1aa9e13c1a9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:15.789952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9eb47bbd-adc1-43b5-bdd9-e5bd8b97544a req-47a7582b-1543-4487-bea1-f1aa9e13c1a9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:15.804048 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9eb47bbd-adc1-43b5-bdd9-e5bd8b97544a req-47a7582b-1543-4487-bea1-f1aa9e13c1a9 service nova] Creating event network-changed:050b8bab-5650-40f7-987f-ed7b764c07d4 for instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a on n-h1-862876-2 Oct 28 13:33:15.810634 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9eb47bbd-adc1-43b5-bdd9-e5bd8b97544a req-47a7582b-1543-4487-bea1-f1aa9e13c1a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062035 Oct 28 13:33:15.811885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2728/5539] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:16.398578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:16.401294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:16.418983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:16.420679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:16.421539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:16.426036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:16.427706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:16.428378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:16.510832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:16.517920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:16.521883 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba59672b-638d-4133-910f-1205d117eb6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1267 microversion: 2.1 time: 0.130533 Oct 28 13:33:16.522518 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2729/5540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:16 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:16.589550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:16.591187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:16.599163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:16.600174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:16.600646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:16.601603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:16.602193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:16.602712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:16.657050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:16.673033 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78349d75-76b6-4a9f-94a7-67f611b18a92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.912570 Oct 28 13:33:16.687736 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2812/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:15 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:16.815017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:16.824306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:16.825880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:16.827053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-129ccb8a-7f25-4f84-a6d9-7e3e86c30626 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.245921 Oct 28 13:33:16.827627 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2730/5542] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:16 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:17.546047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:17.546558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:17.562271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:17.564554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:17.567234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:17.567971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:17.568439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:17.570378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:17.700470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:17.702615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:17.721388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:17.721828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:17.721828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:17.721828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:17.721828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:17.721828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:17.721828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:17.722279 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01ae60c5-401b-42b6-9d2d-9d4cdd9688e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1273 microversion: 2.1 time: 0.176579 Oct 28 13:33:17.722279 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2813/5543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:17 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:17.854075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:17.855000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:17.867891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:17.869049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:17.869662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:17.871011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:17.871635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:17.872236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:17.880694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:17.890216 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-21baa63c-2b2d-4c6e-b959-f2dec7e8bdac tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.195031 Oct 28 13:33:17.905195 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2731/5544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:17 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:18.226041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:18.237134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:18.238979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:18.240686 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da7975fa-b253-4b6d-bf56-7777ac4092df tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.391746 Oct 28 13:33:18.241261 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2814/5545] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:17 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:33:18.744218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:18.745448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:18.747445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:18.752604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:18.754920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:18.754920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:18.754920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:18.754920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:18.755560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:18.918172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:18.919550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:18.933910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:18.934679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:18.935516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:18.936767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:18.938319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:18.940802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:18.968444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:18.976781 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b73688e1-aadc-45c5-8867-3ad47f476b9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.236680 Oct 28 13:33:18.978632 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2732/5546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:18 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:18.981881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:19.180428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:19.197380 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db9cc759-b982-4402-9112-0a53a2ff33de tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.283755 Oct 28 13:33:19.211501 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2815/5547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:18 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:19.271554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:19.272174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:19.279280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:19.279961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:19.280602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:19.281482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:19.282106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:19.282727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:19.609656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:19.620198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:19.621979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:19.624094 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2dbb0524-db54-4500-b43f-89572550dfda tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.357016 Oct 28 13:33:19.639436 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2733/5548] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:19 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:20.003099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:20.004749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:20.012525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.013010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.013527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.014219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.014914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.015344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.115731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5b04fda8-5279-4f00-919e-2f2e570a229c req-472d7b8e-8c8a-4e36-9e61-757260bca45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88db8198-40b7-4adb-bf60-34abbc8b2b3a", "tag": "1cf182a6-efd8-405c-ad35-44a368d96809"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:20.132296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5b04fda8-5279-4f00-919e-2f2e570a229c req-472d7b8e-8c8a-4e36-9e61-757260bca45a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.133497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5b04fda8-5279-4f00-919e-2f2e570a229c req-472d7b8e-8c8a-4e36-9e61-757260bca45a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.134177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5b04fda8-5279-4f00-919e-2f2e570a229c req-472d7b8e-8c8a-4e36-9e61-757260bca45a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.170600 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5b04fda8-5279-4f00-919e-2f2e570a229c req-472d7b8e-8c8a-4e36-9e61-757260bca45a service nova] Creating event network-changed:1cf182a6-efd8-405c-ad35-44a368d96809 for instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a on n-h2-862876-2 Oct 28 13:33:20.175849 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5b04fda8-5279-4f00-919e-2f2e570a229c req-472d7b8e-8c8a-4e36-9e61-757260bca45a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068691 Oct 28 13:33:20.177026 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2734/5549] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:33:20.192353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:20.197596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:20.213593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.218299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.218299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.218299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.218299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.218299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.269734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:20.289778 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5eb3db4-074e-4538-90eb-deb34a4525ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action" status: 200 len: 24576 microversion: 2.1 time: 0.098977 Oct 28 13:33:20.289778 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2735/5550] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:33:20 2022] POST /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d/action => generated 24576 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:33:20.290350 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e30ad7bf-ae94-4aab-b2af-22bc8ec2afdc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.293154 Oct 28 13:33:20.291001 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2816/5551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:19 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:20.294933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:20.296355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:20.304530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.305263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.306436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.307375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.307835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.308424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.569102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:20.590788 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4cce899a-c885-4e7e-9b7e-d94fe801da51 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1735 microversion: 2.1 time: 0.303748 Oct 28 13:33:20.599572 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2736/5552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:20 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1735 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:20.653080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:20.653963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:20.665894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.668895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.669592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:20.670885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:20.672182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:20.672848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:21.046268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:21.065666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:21.067187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:21.068808 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-758342bd-7fc9-4cb6-9eb4-0cadf2c60499 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.420568 Oct 28 13:33:21.069854 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2817/5553] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:20 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:21.322133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:21.322769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:21.356721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:21.357237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:21.357685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:21.358424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:21.358919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:21.359552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:21.558469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:21.566244 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7827cfe4-160e-449d-b6f5-d516439b19e5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.249243 Oct 28 13:33:21.566852 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2737/5554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:21 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:21.613404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:21.614010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:21.627934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:21.628625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:21.629128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:21.629784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:21.630243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:21.630776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:21.772424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:21.781208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-45d7e85f-5a0a-4f40-ae56-ce96f15a047d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1715 microversion: 2.1 time: 0.171695 Oct 28 13:33:21.781858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2818/5555] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:21 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1715 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:21.898710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:21.899238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:21.906015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:21.906502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:21.906979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:21.907810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:21.908164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:21.908601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:21.993260 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Cannot 'detach_volume' instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa while it is in vm_state rescued Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments/6aa24519-825d-4916-94f2-4b0113832875 HTTP/1.1 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: exception: Cannot 'detach_volume' instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa while it is in vm_state rescued Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': 'ffd7fdfa-5067-4a02-82a4-87d4ee670caa', 'id': '6aa24519-825d-4916-94f2-4b0113832875'} Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa while it is in vm_state rescued Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:21.994941 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa while it is in vm_state rescued Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 409 to user: Cannot 'detach_volume' instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa while it is in vm_state rescued {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ea16de3-ae1c-4b73-81c8-2e906f9d477f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments/6aa24519-825d-4916-94f2-4b0113832875" status: 409 len: 152 microversion: 2.1 time: 0.102116 Oct 28 13:33:22.004950 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2738/5556] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:33:21 2022] DELETE /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments/6aa24519-825d-4916-94f2-4b0113832875 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:33:22.009810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:22.009810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:22.016783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.017842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.018278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.019271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.019587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.020266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.094983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:22.096252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:22.111774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.112809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.113868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.115541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.116085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.116517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.259840 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-747fbd00-22b5-4ba1-876c-066d0d889e7c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/action" status: 202 len: 0 microversion: 2.1 time: 0.255012 Oct 28 13:33:22.261671 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2819/5557] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:33:22 2022] POST /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:33:22.276130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:22.281516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:22.290782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.294403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.303275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.304254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.304741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.305797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.320407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:22.336696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:22.339647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:22.341571 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7b5a01d-ba95-4427-a056-ac585b15978f tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.251498 Oct 28 13:33:22.362136 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2739/5558] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:22 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:33:22.592569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:22.594023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:22.609896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.611774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.617557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.617557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:22.617557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:22.617557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:22.703282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:22.712352 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e79569a5-48b7-4919-a444-036e010ec0f4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1723 microversion: 2.1 time: 0.442384 Oct 28 13:33:22.715522 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2820/5559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:22 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:22.839240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:22.848699 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37bacbee-892e-4038-bdb3-f11968153c43 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.262926 Oct 28 13:33:22.849881 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2740/5560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:22 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:23.371888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-962979a8-929a-4f1a-a1a8-9f844737759e req-61d50810-25fc-4f4f-b80f-d8a18062ca9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29df2ee3-1d4c-40d4-a962-ef75d47be51a", "name": "network-vif-plugged", "status": "completed", "tag": "050b8bab-5650-40f7-987f-ed7b764c07d4"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:23.372398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:23.373006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:23.380665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:23.381080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:23.382459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:23.382459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:23.382698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:23.383107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:23.388253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-962979a8-929a-4f1a-a1a8-9f844737759e req-61d50810-25fc-4f4f-b80f-d8a18062ca9a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:23.389073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-962979a8-929a-4f1a-a1a8-9f844737759e req-61d50810-25fc-4f4f-b80f-d8a18062ca9a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:23.389744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-962979a8-929a-4f1a-a1a8-9f844737759e req-61d50810-25fc-4f4f-b80f-d8a18062ca9a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:23.403574 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-962979a8-929a-4f1a-a1a8-9f844737759e req-61d50810-25fc-4f4f-b80f-d8a18062ca9a service nova] Creating event network-vif-plugged:050b8bab-5650-40f7-987f-ed7b764c07d4 for instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a on n-h1-862876-2 Oct 28 13:33:23.428691 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-962979a8-929a-4f1a-a1a8-9f844737759e req-61d50810-25fc-4f4f-b80f-d8a18062ca9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290769 Oct 28 13:33:23.431863 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2821/5561] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:23.700609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:23.713503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:23.715655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:23.717057 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-322b181c-5fa0-4e5c-b0ec-085ed97b663d tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.348755 Oct 28 13:33:23.717649 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2741/5562] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:23 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:23.739660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:23.740374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:23.747723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:23.748224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:23.748669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:23.749375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:23.749843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:23.750600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:23.879560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:23.879560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:23.887083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:23.889084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:23.891465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:23.893161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:23.897772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:23.898143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:23.898670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:23.943588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:23.957591 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27ad98ab-fd5f-4dd3-b3fd-b7ae8a324ccd tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1723 microversion: 2.1 time: 0.223436 Oct 28 13:33:23.983220 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2822/5563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:23 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:24.061486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:24.072198 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5f1bf12-bc2d-45bf-8d9a-a735c504193e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.200510 Oct 28 13:33:24.088297 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2742/5564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:23 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:24.744424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:24.745044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:24.748247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:24.758367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:24.758985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:24.759994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:24.761110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:24.761688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:24.763193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:24.995219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:24.996951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:25.007980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:25.008631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:25.009325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:25.011124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:25.012084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:25.013135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:25.067452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:25.083289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:25.087321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:25.094911 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-081bd215-f5ce-4e51-82df-5147e443827b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1359 microversion: 2.21 time: 0.354308 Oct 28 13:33:25.096917 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2823/5565] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:24 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1359 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:25.108281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:25.109653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:25.121880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:25.122662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:25.123148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:25.123848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:25.124300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:25.124717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:25.204068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:25.215262 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4cddd5bf-6224-41f5-8cee-331d975a874d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1723 microversion: 2.1 time: 0.225689 Oct 28 13:33:25.229509 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2743/5566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:24 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:25.322808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:25.347590 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-31eaca2e-9b43-45c8-8587-207cc970105b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.248493 Oct 28 13:33:25.348750 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2824/5567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:25 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:26.122714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:26.123420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:26.131494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=20 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:26.135370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.138082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.139969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.143041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.143803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.144483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.246355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:26.247025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:26.260260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.261187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.261793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.262909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.263527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.264194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.413817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:26.432400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:26.436498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:26.441518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:26.441968 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0c604f88-3645-45f5-93a8-91f97b44fbc6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1723 microversion: 2.1 time: 0.200064 Oct 28 13:33:26.446858 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2825/5568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:26 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:26.447022 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a8266a0-0fb9-4581-9ea0-857da8362e44 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1552 microversion: 2.21 time: 0.325847 Oct 28 13:33:26.447022 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2744/5569] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:26 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1552 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:26.453630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:26.454246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:26.469230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:26.469743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:26.475163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.475668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.483402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.483402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.483402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.483402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.494191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.494719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.495193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.495961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.496365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.496789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.527102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:33:26.674571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:26.683104 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c6afe375-403c-4fe5-8f5d-c04821dae0e0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.239183 Oct 28 13:33:26.684186 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2826/5570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:26 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:26.687546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:26.798703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:26.799349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:26.802208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:26.805809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.806297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.806840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.816894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.817412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.821724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.930129 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c3ba0d88-fc10-4168-b88f-ac642502f3dd tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 204 len: 0 microversion: 2.21 time: 0.464887 Oct 28 13:33:26.931239 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2745/5571] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:33:26 2022] DELETE /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 13:33:26.941157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:26.941727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:26.949783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.950516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.951160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:26.952113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:26.952721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:26.953328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.032395 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-753f42bf-62e4-4fd0-9b46-6abf59a7a77f tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1833 microversion: 2.1 time: 0.237292 Oct 28 13:33:27.033103 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2827/5572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:26 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1833 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:27.255145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:27.273266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:27.275013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:27.279013 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f43f6707-f26f-41c0-b035-7c1e2561b7be tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1558 microversion: 2.21 time: 0.342376 Oct 28 13:33:27.281659 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2746/5573] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:26 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1558 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:33:27.467066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:27.467674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:27.478302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:27.482115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:27.482942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.490315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:27.492664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:27.492664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.696733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:27.706203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:27.706939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:27.709576 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d3df01db-4bbf-406e-be21-33bc66c4418b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1729 microversion: 2.1 time: 0.246564 Oct 28 13:33:27.713986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:27.714716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:27.715448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.716650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:27.717413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:27.718160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.727589 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2828/5574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:27 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:27.736449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:27.737220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:27.747944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:27.748825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:27.749534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.750506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:27.751240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:27.751971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.871446 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7a677121-3978-4bc8-8200-3518360b778e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141305 Oct 28 13:33:27.872201 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2829/5575] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:33:27 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:27.877426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-715c6a9a-069c-4651-9103-907665de522d req-daf07092-2d6b-495d-8b95-d172d9c76b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88db8198-40b7-4adb-bf60-34abbc8b2b3a", "name": "network-vif-plugged", "status": "completed", "tag": "1cf182a6-efd8-405c-ad35-44a368d96809"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:27.889014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-715c6a9a-069c-4651-9103-907665de522d req-daf07092-2d6b-495d-8b95-d172d9c76b79 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:27.889689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-715c6a9a-069c-4651-9103-907665de522d req-daf07092-2d6b-495d-8b95-d172d9c76b79 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:27.890122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-715c6a9a-069c-4651-9103-907665de522d req-daf07092-2d6b-495d-8b95-d172d9c76b79 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:27.905779 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-715c6a9a-069c-4651-9103-907665de522d req-daf07092-2d6b-495d-8b95-d172d9c76b79 service nova] Creating event network-vif-plugged:1cf182a6-efd8-405c-ad35-44a368d96809 for instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a on n-h2-862876-2 Oct 28 13:33:27.912349 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-715c6a9a-069c-4651-9103-907665de522d req-daf07092-2d6b-495d-8b95-d172d9c76b79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038897 Oct 28 13:33:27.913395 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2830/5576] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:28.121634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:28.135387 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-03163161-ca1b-49c4-9743-59edd60678df tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.433524 Oct 28 13:33:28.136151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2747/5577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:27 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:28.313274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:28.313519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:28.324048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:28.324514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:28.324950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:28.326190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:28.326190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:28.326526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:28.728623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:28.729758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:28.742698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:28.743782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:28.744564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:28.745501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:28.746245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:28.747183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:28.806353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:33:28.906276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:28.919620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:28.921194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:28.932228 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c1189f0-b72a-4582-a2c0-76ac5eafb07b tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1558 microversion: 2.21 time: 0.626428 Oct 28 13:33:28.947198 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2831/5578] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:28 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1558 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:28.956837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-524b9316-011f-43a9-ab93-3d17c36336c5 req-4a0aa4b6-752c-4126-87f0-499e63fc582d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:28.966830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-524b9316-011f-43a9-ab93-3d17c36336c5 req-4a0aa4b6-752c-4126-87f0-499e63fc582d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:28.967571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-524b9316-011f-43a9-ab93-3d17c36336c5 req-4a0aa4b6-752c-4126-87f0-499e63fc582d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:28.968411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-524b9316-011f-43a9-ab93-3d17c36336c5 req-4a0aa4b6-752c-4126-87f0-499e63fc582d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:28.984568 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-524b9316-011f-43a9-ab93-3d17c36336c5 req-4a0aa4b6-752c-4126-87f0-499e63fc582d service nova] Creating event network-changed:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h2-862876-2 Oct 28 13:33:28.992056 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-524b9316-011f-43a9-ab93-3d17c36336c5 req-4a0aa4b6-752c-4126-87f0-499e63fc582d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043466 Oct 28 13:33:28.993478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2832/5579] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:29.159524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:29.160221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:29.165610 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96ffaf67-fd29-4396-87a2-26b9cd137a03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 204 len: 0 microversion: 2.1 time: 0.440388 Oct 28 13:33:29.170337 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2748/5580] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:33:28 2022] DELETE /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:33:29.172762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:29.180715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:29.181775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:29.183963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:29.185883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:29.190381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:29.191805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:29.193306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:29.201503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:29.202214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:29.202762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:29.206093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:29.209218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:29.209846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:29.240613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:29.577657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:29.591990 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab88b678-4f38-4e2e-82b9-1fec81c0027d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1688 microversion: 2.1 time: 0.420241 Oct 28 13:33:29.595614 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2749/5581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:29 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1688 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:29.853443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:29.863452 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dd1e673f-fb28-4786-976f-ace8e59c8020 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1315 microversion: 2.1 time: 0.708299 Oct 28 13:33:29.864260 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2833/5582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:29 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:29.962249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:29.963717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:29.973499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:29.974385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:29.975234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:29.976241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:29.976938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:29.977647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:30.120905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:30.136589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:30.148975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:30.150468 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88bbcd0f-ec87-4cb0-8da0-41b311e1ced0 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1516 microversion: 2.21 time: 0.192905 Oct 28 13:33:30.151659 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2750/5583] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:29 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:33:30.197860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e7e5a8af-a271-4ede-b5cc-df7db007d6a9 req-faf036b6-3024-40c8-a391-7cdd196bbe41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29df2ee3-1d4c-40d4-a962-ef75d47be51a", "name": "network-vif-deleted", "tag": "050b8bab-5650-40f7-987f-ed7b764c07d4"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:30.218530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e7e5a8af-a271-4ede-b5cc-df7db007d6a9 req-faf036b6-3024-40c8-a391-7cdd196bbe41 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:30.219277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e7e5a8af-a271-4ede-b5cc-df7db007d6a9 req-faf036b6-3024-40c8-a391-7cdd196bbe41 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:30.220404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e7e5a8af-a271-4ede-b5cc-df7db007d6a9 req-faf036b6-3024-40c8-a391-7cdd196bbe41 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:30.250999 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e7e5a8af-a271-4ede-b5cc-df7db007d6a9 req-faf036b6-3024-40c8-a391-7cdd196bbe41 service nova] Creating event network-vif-deleted:050b8bab-5650-40f7-987f-ed7b764c07d4 for instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a on n-h1-862876-2 Oct 28 13:33:30.265615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e7e5a8af-a271-4ede-b5cc-df7db007d6a9 req-faf036b6-3024-40c8-a391-7cdd196bbe41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071685 Oct 28 13:33:30.278963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2834/5584] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:30.620333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:30.620962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:30.639237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:30.639754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:30.640200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:30.640937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:30.641408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:30.642485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.090857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:31.090857 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-20b55aff-3125-4d40-b80d-c92190bfbf73 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1688 microversion: 2.1 time: 0.267123 Oct 28 13:33:31.090857 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2751/5585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:30 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1688 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.096535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.180703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:31.181329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:31.193254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.194091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.194868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.195808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.196648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.197628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.289813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.290309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.291429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.291901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lazy-loading 'fault' on Instance uuid 29df2ee3-1d4c-40d4-a962-ef75d47be51a {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:33:31.426973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:31.439317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:31.461824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '983e1719c2a245fca99f081b1fd7e800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43bbe69e12d4975bfbf88a6d30301e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:31.465226 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d93521c-3522-49c5-a5ec-43020cf65a72 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 200 len: 1349 microversion: 2.21 time: 0.288545 Oct 28 13:33:31.465834 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2752/5586] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:31 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 1349 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:33:31.674669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:31.689825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ca2355d-fb3e-48f0-a630-f0375f9b5fbd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1503 microversion: 2.1 time: 0.787137 Oct 28 13:33:31.707698 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2835/5587] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:30 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1503 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:31.714391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:31.715258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:31.723120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.723860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.724453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.725370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.726697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.728008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.920042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:31.924766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:31.933238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.934492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.935175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:31.936656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:31.937346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:31.938018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.299874 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-835d96ea-9ec9-44aa-ad87-21031b8e33c5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a/action" status: 202 len: 0 microversion: 2.1 time: 0.589226 Oct 28 13:33:32.304279 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2753/5588] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:33:31 2022] POST /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:33:32.314500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:32.321512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:32.328397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:32.341069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88368305-d989-4f32-8d58-33e3980b6497 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1688 microversion: 2.1 time: 0.431027 Oct 28 13:33:32.346237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.346738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.347120 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2836/5589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:31 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1688 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:32.352826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.356260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d3e7b774-e15b-4d85-8940-ebef4dc9609f req-a6967500-d4a3-43a2-b171-28e882f0e72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd7fdfa-5067-4a02-82a4-87d4ee670caa", "tag": "eab335fd-c705-40e7-9d38-6f99af3c756a"}, {"name": "network-changed", "server_uuid": "ffd7fdfa-5067-4a02-82a4-87d4ee670caa", "tag": "eab335fd-c705-40e7-9d38-6f99af3c756a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:32.356736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.357409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.358006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.376963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d3e7b774-e15b-4d85-8940-ebef4dc9609f req-a6967500-d4a3-43a2-b171-28e882f0e72d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.377779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d3e7b774-e15b-4d85-8940-ebef4dc9609f req-a6967500-d4a3-43a2-b171-28e882f0e72d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.378405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d3e7b774-e15b-4d85-8940-ebef4dc9609f req-a6967500-d4a3-43a2-b171-28e882f0e72d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.416008 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d3e7b774-e15b-4d85-8940-ebef4dc9609f req-a6967500-d4a3-43a2-b171-28e882f0e72d service nova] Creating event network-changed:eab335fd-c705-40e7-9d38-6f99af3c756a for instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa on n-h1-862876-2 Oct 28 13:33:32.416520 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d3e7b774-e15b-4d85-8940-ebef4dc9609f req-a6967500-d4a3-43a2-b171-28e882f0e72d service nova] Creating event network-changed:eab335fd-c705-40e7-9d38-6f99af3c756a for instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa on n-h1-862876-2 Oct 28 13:33:32.423740 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d3e7b774-e15b-4d85-8940-ebef4dc9609f req-a6967500-d4a3-43a2-b171-28e882f0e72d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072419 Oct 28 13:33:32.423987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2837/5590] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:32.496862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:32.497774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:32.517172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.517172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.517172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.521781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.522299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.522760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.564262 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] HTTP exception thrown: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Request method failure captured: Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a HTTP/1.1 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9oTJ9wvNhPqgeuDqcYRM4s3Z91BsnHqARYqj7001lcu7t_pjLLKUag6dzXPmjn4ad1xObAe2rcnWOxuwf_ZFqqTnDwxwjx8iZ_0RXr1zKhKBNf4BwBmR2gQ8JPbie_rCsdAI7_rXVW3hEZ3AC17dEcI36HcXnT9eHkPdFwyKBIs45o Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c43bbe69e12d4975bfbf88a6d30301e7 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c43bbe69e12d4975bfbf88a6d30301e7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c43bbe69e12d4975bfbf88a6d30301e7 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-InstanceActionsV221TestJSON-2074291779-project Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 983e1719c2a245fca99f081b1fd7e800 Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-InstanceActionsV221TestJSON-2074291779-project Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '29df2ee3-1d4c-40d4-a962-ef75d47be51a'} Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.567116 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.576127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Returning 404 to user: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:32.578594 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19d791d8-e318-4050-9665-ef08b89f0c49 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 404 len: 111 microversion: 2.21 time: 0.086696 Oct 28 13:33:32.580243 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2838/5591] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:32 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:33:32.593408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '.version_select at 0x7f27b85d70d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:32.600128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:32.613412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.617444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.618024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.620656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.623302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.623810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.663264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:32.677486 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a96b3111-e4a0-4882-9cfa-526c2bcad845 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1508 microversion: 2.1 time: 0.368178 Oct 28 13:33:32.691490 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2754/5592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:32 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:32.804577 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8c1d6ed-13c8-49bc-b863-2ed52763685c tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.218409 Oct 28 13:33:32.805504 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2839/5593] 10.222.0.25 () {60 vars in 1337 bytes} [Fri Oct 28 13:33:32 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a/os-instance-actions => generated 611 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:33:32.819804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:32.820333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:32.852832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.855838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.856797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.858081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.858835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.861634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.912840 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] HTTP exception thrown: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Request method failure captured: Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a HTTP/1.1 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9oTJ9wvNhPqgeuDqcYRM4s3Z91BsnHqARYqj7001lcu7t_pjLLKUag6dzXPmjn4ad1xObAe2rcnWOxuwf_ZFqqTnDwxwjx8iZ_0RXr1zKhKBNf4BwBmR2gQ8JPbie_rCsdAI7_rXVW3hEZ3AC17dEcI36HcXnT9eHkPdFwyKBIs45o Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c43bbe69e12d4975bfbf88a6d30301e7 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c43bbe69e12d4975bfbf88a6d30301e7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c43bbe69e12d4975bfbf88a6d30301e7 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-InstanceActionsV221TestJSON-2074291779-project Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 983e1719c2a245fca99f081b1fd7e800 Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-InstanceActionsV221TestJSON-2074291779-project Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '29df2ee3-1d4c-40d4-a962-ef75d47be51a'} Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:32.915486 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Returning 404 to user: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ccefff1-f57b-4868-ab7d-eb3421629769 tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 404 len: 111 microversion: 2.21 time: 0.102378 Oct 28 13:33:32.920510 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2755/5594] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:33:32 2022] DELETE /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:33:32.926709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:32.927355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] [instance: 29df2ee3-1d4c-40d4-a962-ef75d47be51a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:32.935454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.936198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.936871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:32.937686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:32.940458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:32.941691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:33.021542 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] HTTP exception thrown: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Request method failure captured: Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a HTTP/1.1 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9oTJ9wvNhPqgeuDqcYRM4s3Z91BsnHqARYqj7001lcu7t_pjLLKUag6dzXPmjn4ad1xObAe2rcnWOxuwf_ZFqqTnDwxwjx8iZ_0RXr1zKhKBNf4BwBmR2gQ8JPbie_rCsdAI7_rXVW3hEZ3AC17dEcI36HcXnT9eHkPdFwyKBIs45o Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c43bbe69e12d4975bfbf88a6d30301e7 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c43bbe69e12d4975bfbf88a6d30301e7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c43bbe69e12d4975bfbf88a6d30301e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c43bbe69e12d4975bfbf88a6d30301e7 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2074291779 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-InstanceActionsV221TestJSON-2074291779-project Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 983e1719c2a245fca99f081b1fd7e800 Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-InstanceActionsV221TestJSON-2074291779-project Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '29df2ee3-1d4c-40d4-a962-ef75d47be51a'} Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:33.028464 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. Oct 28 13:33:33.034083 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:33.035311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] Returning 404 to user: Instance 29df2ee3-1d4c-40d4-a962-ef75d47be51a could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:33.036741 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d90b0399-702c-4c7a-ae62-dc684a945fcf tempest-InstanceActionsV221TestJSON-2074291779 tempest-InstanceActionsV221TestJSON-2074291779-project] 10.222.0.25 "GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a" status: 404 len: 111 microversion: 2.21 time: 0.113909 Oct 28 13:33:33.040449 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2840/5595] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:33:32 2022] GET /compute/v2.1/servers/29df2ee3-1d4c-40d4-a962-ef75d47be51a => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:33:33.372285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:33.375847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:33.387760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:33.388514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:33.389173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:33.390946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:33.391790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:33.393191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:33.482597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:33.485215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:33.486310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:33.486886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lazy-loading 'fault' on Instance uuid ba176c9c-1099-44c2-88e8-cd7dab531d2d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:33:33.613844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:33.628383 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-404e77c1-f55b-4e37-a4ca-b827f0493b6d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 200 len: 1357 microversion: 2.1 time: 0.265966 Oct 28 13:33:33.629623 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2756/5596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:33 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:33:33.704097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:33.705066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:33.734237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:33.738781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:33.739161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:33.739919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:33.740386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:33.741005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:34.129681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:34.149066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5cb88d6-7112-420e-8373-771a7d846443 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1488 microversion: 2.1 time: 0.448858 Oct 28 13:33:34.153203 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2841/5597] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:33 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1488 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:34.182362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:34.191125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:34.221009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:34.222260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:34.223649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:34.224659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:34.225356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:34.226052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:34.256118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:33:34.444631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a5267efc-df8f-4722-8896-b67432bb30e6 req-1cbc50c9-580b-4fc8-a6b0-ed9151e4a24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba176c9c-1099-44c2-88e8-cd7dab531d2d", "name": "network-vif-deleted", "tag": "d4a743a8-e719-4703-a8a7-3ab9c4350821"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:34.454912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5267efc-df8f-4722-8896-b67432bb30e6 req-1cbc50c9-580b-4fc8-a6b0-ed9151e4a24f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:34.455629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5267efc-df8f-4722-8896-b67432bb30e6 req-1cbc50c9-580b-4fc8-a6b0-ed9151e4a24f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:34.456210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5267efc-df8f-4722-8896-b67432bb30e6 req-1cbc50c9-580b-4fc8-a6b0-ed9151e4a24f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:34.468783 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a5267efc-df8f-4722-8896-b67432bb30e6 req-1cbc50c9-580b-4fc8-a6b0-ed9151e4a24f service nova] Creating event network-vif-deleted:d4a743a8-e719-4703-a8a7-3ab9c4350821 for instance ba176c9c-1099-44c2-88e8-cd7dab531d2d on n-h2-862876-2 Oct 28 13:33:34.476425 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a5267efc-df8f-4722-8896-b67432bb30e6 req-1cbc50c9-580b-4fc8-a6b0-ed9151e4a24f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035393 Oct 28 13:33:34.477755 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2842/5598] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:34.654604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:34.655456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ba176c9c-1099-44c2-88e8-cd7dab531d2d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:34.667872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:34.668749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:34.669496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:34.670504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:34.671981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:34.672864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:34.689787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] HTTP exception thrown: Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d could not be found. Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Request method failure captured: Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d HTTP/1.1 Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9mayMITvj1WED7X4-LI_q-dqZgc6OMnHWkdghjk9JQGeng-uxFEkU53_e-hKVT8JReAQuIzjf8cMQzD6unQJiHZ6RiF5Zncy6jWXUSZ0QjnsCHVhZ3Y4I-81dkCR4L5abLF2-ERrK5ZpIzHeFr0wDrf-jAm3DxliK9sL-hRfID35aI Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_727d3fc63e0847efae144898701cbf5c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a5283ffea73c4febbbcce05e56bdd6cc Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d could not be found. Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ba176c9c-1099-44c2-88e8-cd7dab531d2d'} Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d could not be found. Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d could not be found. Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:34.700363 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d could not be found. Oct 28 13:33:34.704283 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:34.709542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Returning 404 to user: Instance ba176c9c-1099-44c2-88e8-cd7dab531d2d could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:34.710728 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c482b24b-4277-4eeb-8276-91e5f88adef0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d" status: 404 len: 111 microversion: 2.1 time: 0.062419 Oct 28 13:33:34.712046 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2843/5599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:34 2022] GET /compute/v2.1/servers/ba176c9c-1099-44c2-88e8-cd7dab531d2d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:33:34.725052 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-73abc4cd-22c6-45c0-873f-9fbf8d838695 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 204 len: 0 microversion: 2.1 time: 0.554693 Oct 28 13:33:34.726490 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2757/5600] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:33:34 2022] DELETE /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:33:34.745538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:34.747268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:34.761792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:34.761792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:34.761792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:34.765324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:34.765832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:34.766282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:35.602297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:35.620103 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a9e6c4a-084a-4b95-bbd4-cfde6ba89e2d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1494 microversion: 2.1 time: 0.878433 Oct 28 13:33:35.622172 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2844/5601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:34 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1494 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:36.648105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:36.649582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:36.669657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:36.670529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:36.671177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:36.680480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:36.680480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:36.680480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:36.680480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=93,nova_cell1:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:37.405674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a1bf8527-04da-4b5d-bdc8-07a17a1246de req-5cae1a7d-2f86-4909-98c1-2526ade7e17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88db8198-40b7-4adb-bf60-34abbc8b2b3a", "name": "network-vif-deleted", "tag": "1cf182a6-efd8-405c-ad35-44a368d96809"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:37.422139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a1bf8527-04da-4b5d-bdc8-07a17a1246de req-5cae1a7d-2f86-4909-98c1-2526ade7e17a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:37.422139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a1bf8527-04da-4b5d-bdc8-07a17a1246de req-5cae1a7d-2f86-4909-98c1-2526ade7e17a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:37.422139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a1bf8527-04da-4b5d-bdc8-07a17a1246de req-5cae1a7d-2f86-4909-98c1-2526ade7e17a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:38.021353 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a1bf8527-04da-4b5d-bdc8-07a17a1246de req-5cae1a7d-2f86-4909-98c1-2526ade7e17a service nova] Creating event network-vif-deleted:1cf182a6-efd8-405c-ad35-44a368d96809 for instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a on n-h2-862876-2 Oct 28 13:33:38.037825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a1bf8527-04da-4b5d-bdc8-07a17a1246de req-5cae1a7d-2f86-4909-98c1-2526ade7e17a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.637448 Oct 28 13:33:38.039253 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2845/5602] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:33:38.070417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:38.101907 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e02138bf-9153-49f3-a401-2365782d7cc0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1494 microversion: 2.1 time: 1.459841 Oct 28 13:33:38.103929 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2758/5603] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:36 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1494 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:39.131991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:39.144037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:39.160111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:39.160478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:39.172485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:39.172485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:39.172485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:39.174548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:39.289917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:39.290534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:39.293475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:39.293903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lazy-loading 'fault' on Instance uuid 88db8198-40b7-4adb-bf60-34abbc8b2b3a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:33:39.427573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:39.447054 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a1f9b19-13d6-4c7f-9531-7de300c210aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 200 len: 1305 microversion: 2.1 time: 0.319979 Oct 28 13:33:39.449126 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2846/5604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:39 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 1305 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:40.496043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:40.496821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:40.506376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:40.515169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:40.517940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:40.519066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:40.522099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:40.524357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:40.583423 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a HTTP/1.1 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '88db8198-40b7-4adb-bf60-34abbc8b2b3a'} Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:40.585269 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:40.592869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9700133f-c90a-4531-8359-a30f50c71c47 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 404 len: 111 microversion: 2.1 time: 0.102780 Oct 28 13:33:40.628388 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2759/5605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:40 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:33:40.800182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-870045373", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f6719c5f-6a3e-4187-8df7-d08ef3f7deb2"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:40.972645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] validate_networks() for [('f6719c5f-6a3e-4187-8df7-d08ef3f7deb2', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:33:41.817980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:33:41.819293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:33:41.819810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:33:41.820233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:33:41.820653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:33:41.831957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:41.836240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:41.836240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:41.836240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:41.836240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:41.836240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:41.854860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:33:41.861809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for user ba2dd748101e4b3492c9bea6a26cea14 and project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:33:41.876719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:33:41.879073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:33:42.057734 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3941f89c-072c-4925-a2db-3c587286a744 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258055 Oct 28 13:33:42.068727 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2847/5606] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:33:42.081697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a48ef31c-0924-4d79-a214-42886cfe0c97 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:42.082326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a48ef31c-0924-4d79-a214-42886cfe0c97 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:42.210127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a48ef31c-0924-4d79-a214-42886cfe0c97 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:42.230252 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a48ef31c-0924-4d79-a214-42886cfe0c97 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1214 microversion: 2.1 time: 0.153028 Oct 28 13:33:42.252802 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2760/5607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:42 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:43.259186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f05f7af8-7fb8-406f-b445-46d4dee27f8d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:43.264313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f05f7af8-7fb8-406f-b445-46d4dee27f8d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:43.350016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f05f7af8-7fb8-406f-b445-46d4dee27f8d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:43.358315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f05f7af8-7fb8-406f-b445-46d4dee27f8d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1214 microversion: 2.1 time: 0.104022 Oct 28 13:33:43.359235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2848/5608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:43 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:43.615362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6dbe454c-f510-4df0-b5e0-cb768fcef095 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '.version_select at 0x7f27b8878790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:43.767340 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6dbe454c-f510-4df0-b5e0-cb768fcef095 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1137896014" status: 202 len: 0 microversion: 2.1 time: 0.158525 Oct 28 13:33:43.768289 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2761/5609] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 13:33:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1137896014 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:33:43.805299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2caef83c-e23c-4ad4-b3ce-c0332205aacc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: .version_select at 0x7f27b824bd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1286622647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKD0X0TCcdNFhk63jiBD/0X9+Ns+a55/DweJ1Vub+8XJfDPXNHkuRjGmE7Idd99OuW0qEfQYi3Y9qX8VzQ4CQk+cLIHxX0FvGGjoaKiuCrFLpqXVSS7lKrNM8ww5fLQkXw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:43.822393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2caef83c-e23c-4ad4-b3ce-c0332205aacc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:33:43.828038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2caef83c-e23c-4ad4-b3ce-c0332205aacc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:33:43.994659 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2caef83c-e23c-4ad4-b3ce-c0332205aacc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.193521 Oct 28 13:33:43.995308 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2849/5610] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:33:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:44.387356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:44.390957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:44.412898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:44.422936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:44.422936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:44.422936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:44.422936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:44.422936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:44.586242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:44.609087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce2ce4d6-ad2d-411f-926b-21925e36d41e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1266 microversion: 2.1 time: 0.221310 Oct 28 13:33:44.609332 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2762/5611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:44 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:45.631722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:45.632641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:45.642408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:45.642984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:45.643430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:45.644244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:45.644710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:45.645407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:45.822930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:45.843180 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-29d22721-62c5-4529-81dd-b1e96149ee1c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1284 microversion: 2.1 time: 0.218409 Oct 28 13:33:45.844300 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2850/5612] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:45 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1284 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:46.871321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:46.872255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:46.880523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:46.881035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:46.881491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:46.882232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:46.882691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:46.883155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:47.375832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:47.385964 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-66068122-a71d-4718-a853-ee65f64cfd9a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1314 microversion: 2.1 time: 0.518441 Oct 28 13:33:47.398835 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2763/5613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:46 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:48.410144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:48.410778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:48.420108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:48.428835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:48.429526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:48.430415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:48.431078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:48.431663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:48.796965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:48.809138 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f86ca142-f826-47ee-889a-f0080fed196e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1314 microversion: 2.1 time: 0.403396 Oct 28 13:33:48.822799 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2851/5614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:48 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:49.530238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d06a7771-4658-4b23-ab47-c20e92d3768b req-6a1d74d1-b7c9-4ee9-8efe-336871c4111b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e061c84-d890-4b90-9717-128de818f090", "tag": "eaf68681-0800-44e9-bc3b-de2159a53814"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:49.543162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d06a7771-4658-4b23-ab47-c20e92d3768b req-6a1d74d1-b7c9-4ee9-8efe-336871c4111b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:49.543993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d06a7771-4658-4b23-ab47-c20e92d3768b req-6a1d74d1-b7c9-4ee9-8efe-336871c4111b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:49.545438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d06a7771-4658-4b23-ab47-c20e92d3768b req-6a1d74d1-b7c9-4ee9-8efe-336871c4111b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:49.562858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d06a7771-4658-4b23-ab47-c20e92d3768b req-6a1d74d1-b7c9-4ee9-8efe-336871c4111b service nova] Creating event network-changed:eaf68681-0800-44e9-bc3b-de2159a53814 for instance 0e061c84-d890-4b90-9717-128de818f090 on n-h1-862876-2 Oct 28 13:33:49.569392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d06a7771-4658-4b23-ab47-c20e92d3768b req-6a1d74d1-b7c9-4ee9-8efe-336871c4111b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402320 Oct 28 13:33:49.571090 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2764/5615] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:49.837208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:49.841670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:49.859631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:49.864181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:49.864181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:49.864181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:49.865753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:49.867309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:50.417367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:50.426201 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e53c652-3276-429f-8373-2d96c81c3627 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1314 microversion: 2.1 time: 0.593942 Oct 28 13:33:50.431865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2852/5616] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:49 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:51.454847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:51.457131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:51.469297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:51.472087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:51.474572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:51.475289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:51.476263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:51.477891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:51.489785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:51.962030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:51.982665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c0a14226-81fd-4326-aff4-5d033c5e9e29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1314 microversion: 2.1 time: 0.536668 Oct 28 13:33:52.001447 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2765/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:51 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:53.007591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:53.008358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:53.010968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:53.017008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:53.017703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:53.023721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:53.023721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:53.023721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:53.023721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:53.226207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:53.233069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e4bbe5d-39d5-4d86-8833-9ed954bb7ba7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1314 microversion: 2.1 time: 0.229964 Oct 28 13:33:53.244891 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2853/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:53 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:54.257207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:54.258943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:54.264725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:54.267546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:54.268287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:54.268972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:54.269938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:54.270918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:54.271556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:54.923571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:54.943786 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-699289b8-bbd5-42e2-a029-922e50e591cb tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1314 microversion: 2.1 time: 0.690305 Oct 28 13:33:54.944866 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2766/5619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:54 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:55.191433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d342c7db-09d9-4f37-a3d0-f1691ea59e7b req-33e15bb5-229d-44a6-a940-8695bc559e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e061c84-d890-4b90-9717-128de818f090", "name": "network-vif-plugged", "status": "completed", "tag": "eaf68681-0800-44e9-bc3b-de2159a53814"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:55.209560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:55.217628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d342c7db-09d9-4f37-a3d0-f1691ea59e7b req-33e15bb5-229d-44a6-a940-8695bc559e50 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:55.218118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d342c7db-09d9-4f37-a3d0-f1691ea59e7b req-33e15bb5-229d-44a6-a940-8695bc559e50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:55.225220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d342c7db-09d9-4f37-a3d0-f1691ea59e7b req-33e15bb5-229d-44a6-a940-8695bc559e50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:55.243274 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d342c7db-09d9-4f37-a3d0-f1691ea59e7b req-33e15bb5-229d-44a6-a940-8695bc559e50 service nova] Creating event network-vif-plugged:eaf68681-0800-44e9-bc3b-de2159a53814 for instance 0e061c84-d890-4b90-9717-128de818f090 on n-h1-862876-2 Oct 28 13:33:55.257492 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d342c7db-09d9-4f37-a3d0-f1691ea59e7b req-33e15bb5-229d-44a6-a940-8695bc559e50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071054 Oct 28 13:33:55.264900 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2854/5620] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:33:55.975243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:55.976477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:56.005822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:56.011134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:56.011821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:56.012739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:56.013365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:56.014478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:57.041852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:57.059403 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50bbc8ac-5545-4c79-9db7-02c3c58cf91e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1314 microversion: 2.1 time: 1.091621 Oct 28 13:33:57.064612 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2767/5621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:55 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1314 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:57.480153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5eae8d8f-e82e-43d2-b5f0-fb69f46e60d8 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Action: 'create', calling method: .version_select at 0x7f27b838ae50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:57.527419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5eae8d8f-e82e-43d2-b5f0-fb69f46e60d8 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Getting quotas for project 4f426aeacc1e4c1ab7104ae5b5fce4ad. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:33:57.549704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5eae8d8f-e82e-43d2-b5f0-fb69f46e60d8 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Getting quotas for user bdd5d619768d4c79b855f9692ebd10b8 and project 4f426aeacc1e4c1ab7104ae5b5fce4ad. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:33:57.722606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:57.743699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5eae8d8f-e82e-43d2-b5f0-fb69f46e60d8 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Getting quotas for project 4f426aeacc1e4c1ab7104ae5b5fce4ad. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:33:57.752602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5eae8d8f-e82e-43d2-b5f0-fb69f46e60d8 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Getting quotas for user bdd5d619768d4c79b855f9692ebd10b8 and project 4f426aeacc1e4c1ab7104ae5b5fce4ad. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:33:57.786622 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5eae8d8f-e82e-43d2-b5f0-fb69f46e60d8 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.556390 Oct 28 13:33:57.791271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2855/5622] 10.222.0.25 () {62 vars in 1214 bytes} [Fri Oct 28 13:33:57 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:33:57.804336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-78a5376f-3609-4831-94f8-f4a05bd4588f tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:57.857964 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-78a5376f-3609-4831-94f8-f4a05bd4588f tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.057687 Oct 28 13:33:57.859179 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2768/5623] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Oct 28 13:33:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:33:57.870108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-47ab45be-a26d-4ead-9401-6726417cc754 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:57.901883 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-47ab45be-a26d-4ead-9401-6726417cc754 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/a495746d-61e3-4310-9631-24a7e5770046" status: 200 len: 235 microversion: 2.64 time: 0.030862 Oct 28 13:33:57.903756 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2856/5624] 10.222.0.25 () {60 vars in 1304 bytes} [Fri Oct 28 13:33:57 2022] GET /compute/v2.1/os-server-groups/a495746d-61e3-4310-9631-24a7e5770046 => generated 235 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:33:57.916518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7f4a9aa-7268-4f06-8a17-3b7e65772a8a tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:58.065718 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7f4a9aa-7268-4f06-8a17-3b7e65772a8a tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/a495746d-61e3-4310-9631-24a7e5770046" status: 204 len: 0 microversion: 2.64 time: 0.153992 Oct 28 13:33:58.075587 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2769/5625] 10.222.0.25 () {60 vars in 1307 bytes} [Fri Oct 28 13:33:57 2022] DELETE /compute/v2.1/os-server-groups/a495746d-61e3-4310-9631-24a7e5770046 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:33:58.080963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c5ea284-0fa0-444d-a8e2-ac8a7b8e0f11 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:58.090772 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-8c5ea284-0fa0-444d-a8e2-ac8a7b8e0f11 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] HTTP exception thrown: Instance group a495746d-61e3-4310-9631-24a7e5770046 could not be found. Oct 28 13:33:58.091550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:58.092664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:58.102854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:58.103882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:58.104483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c5ea284-0fa0-444d-a8e2-ac8a7b8e0f11 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Request method failure captured: Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-server-groups/a495746d-61e3-4310-9631-24a7e5770046 HTTP/1.1 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9pFcIm5UJBnm_MDQc9cR3fzzM_upVHFXqawp3K9QWPVx6OdbAH6IWHCRCMZ7ilkpKCT7J1Xbq64QjH37PnDAMTuWW_EmUF6AVnFWcPYjE0oDLOfJJGGZuo4SMTJrQmYt6pLDnIKn3rezHhOMtANxH3A0Wpzr02Klb_52EaE8lrOsfk Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.64 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 4f426aeacc1e4c1ab7104ae5b5fce4ad Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerGroup264TestJSON-1385005625 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f426aeacc1e4c1ab7104ae5b5fce4ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4f426aeacc1e4c1ab7104ae5b5fce4ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4f426aeacc1e4c1ab7104ae5b5fce4ad", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4f426aeacc1e4c1ab7104ae5b5fce4ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerGroup264TestJSON-1385005625 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 4f426aeacc1e4c1ab7104ae5b5fce4ad Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1385005625 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerGroup264TestJSON-1385005625-project Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: bdd5d619768d4c79b855f9692ebd10b8 Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerGroup264TestJSON-1385005625-project Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance group a495746d-61e3-4310-9631-24a7e5770046 could not be found. Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'a495746d-61e3-4310-9631-24a7e5770046'} Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a495746d-61e3-4310-9631-24a7e5770046 could not be found. Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a495746d-61e3-4310-9631-24a7e5770046 could not be found. Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:58.105108 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a495746d-61e3-4310-9631-24a7e5770046 could not be found. Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c5ea284-0fa0-444d-a8e2-ac8a7b8e0f11 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] Returning 404 to user: Instance group a495746d-61e3-4310-9631-24a7e5770046 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c5ea284-0fa0-444d-a8e2-ac8a7b8e0f11 tempest-ServerGroup264TestJSON-1385005625 tempest-ServerGroup264TestJSON-1385005625-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/a495746d-61e3-4310-9631-24a7e5770046" status: 404 len: 117 microversion: 2.64 time: 0.029935 Oct 28 13:33:58.110682 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2857/5626] 10.222.0.25 () {60 vars in 1307 bytes} [Fri Oct 28 13:33:58 2022] DELETE /compute/v2.1/os-server-groups/a495746d-61e3-4310-9631-24a7e5770046 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:33:58.127065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:58.127875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:58.128468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:58.801916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:33:58.810261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0a74735e-7328-4cb9-9608-d1c606c850da tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1501 microversion: 2.1 time: 0.727159 Oct 28 13:33:58.812222 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2770/5627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:58 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1501 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:33:58.838938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:33:58.840163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:58.859972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:58.863321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:58.864703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:58.867071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:58.868510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:58.870180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:58.929571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lazy-loading 'flavor' on Instance uuid 0e061c84-d890-4b90-9717-128de818f090 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:33:59.383000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:33:59.701573 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b41b5e3-3e22-4acc-b797-eeb05ff59594 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090/action" status: 202 len: 0 microversion: 2.1 time: 0.866719 Oct 28 13:33:59.702460 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2858/5628] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:33:58 2022] POST /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090/action => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:33:59.712641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:33:59.713218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:33:59.732662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:59.733462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:59.734085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:33:59.735123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:33:59.735746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:33:59.736345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:00.808049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:00.829760 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5229ffa4-62e1-486a-bbe2-93e475a151a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 1.112276 Oct 28 13:34:00.829760 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2771/5629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:33:59 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:01.290541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:01.292151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:01.307278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:01.309514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:01.313041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:01.317129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:01.317780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:01.318363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:01.456057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'services' on Instance uuid ffd7fdfa-5067-4a02-82a4-87d4ee670caa {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:34:01.757869 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac3d7359-c167-4e3e-8c7e-84c0b2316855 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments/6aa24519-825d-4916-94f2-4b0113832875" status: 202 len: 0 microversion: 2.1 time: 0.471357 Oct 28 13:34:01.759414 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2859/5630] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 13:34:01 2022] DELETE /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments/6aa24519-825d-4916-94f2-4b0113832875 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:34:01.776632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:01.785461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:01.798829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:01.799425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:01.799927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:01.800894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:01.801727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:01.809206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:01.851013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:01.851496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:01.865532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:01.866441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:01.867870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:01.870634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:01.871391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:01.891804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:01.899681 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9fc880fe-2b31-491d-b9f7-3446e6c9ca8b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135417 Oct 28 13:34:01.908404 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2772/5631] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:01 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:02.223132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:02.245530 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c4a701e6-361e-4e82-b27e-75fdd493ac73 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.401227 Oct 28 13:34:02.252353 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2860/5632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:01 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:02.918009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:02.920519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:02.936553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:02.942422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:02.943312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:02.944270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:02.944912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:02.945511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:03.027061 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9730aa13-8fe1-4d6c-8041-312758ea20e0 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113806 Oct 28 13:34:03.045222 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2773/5633] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:02 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:03.282088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:03.282629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:03.294672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:03.295213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:03.306264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:03.306264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:03.312263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:03.312762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:03.752212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:03.764449 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49b7a1f8-e2df-4e0c-b46b-f78f5a545c6b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.486643 Oct 28 13:34:03.766849 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2861/5634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:03 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:04.054062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:04.056485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:04.082725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:04.083511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:04.084992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:04.085645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:04.086073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:04.086515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:04.144014 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fdbf228d-d71b-4d54-bf65-101a91cee113 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094199 Oct 28 13:34:04.149464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2774/5635] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:04 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:04.793613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:04.794234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:04.809296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:04.810016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:04.810644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:04.811747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:04.812596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:04.813218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:05.167561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:05.167561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:05.178528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:05.179267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:05.181485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:05.182251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:05.182726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:05.186582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:05.260922 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a35ad898-d43a-424b-9427-3e90f743c2f3 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107620 Oct 28 13:34:05.262323 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2775/5636] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:05 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:05.414158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1806077070", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "8187f3ff-ca3d-451e-86f7-508d0fa09ade"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1286622647", "security_groups": [{"name": "tempest-secgroup-smoke-1745724375"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:05.446146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:05.455345 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8d8bb38a-66f2-45ab-9627-4ef67b932be3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.665665 Oct 28 13:34:05.456486 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2862/5637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:04 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:05.707068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] validate_networks() for [('8187f3ff-ca3d-451e-86f7-508d0fa09ade', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:34:06.277960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:06.277960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:06.327724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:06.329417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:06.330950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:06.334662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:06.339744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:06.339744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:06.414698 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3210a829-b731-4ce4-b232-a00ed7b62abc tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142446 Oct 28 13:34:06.416002 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2863/5638] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:06 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:06.490295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:06.491779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:06.503454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:06.507169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:06.510974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:06.510974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:06.510974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:06.510974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:06.867235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:06.879874 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b04b7807-f79c-4a96-a194-9f80a6ccafcc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.390229 Oct 28 13:34:06.879874 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2864/5639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:06 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:07.427302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:07.429499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:07.436177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:07.436951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:07.437662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:07.438627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:07.439274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:07.439874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:07.515730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2f8e9b4-4b22-450f-9dc8-092267c5234f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092275 Oct 28 13:34:07.521183 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2865/5640] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:07 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:07.902557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:07.903216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:07.915393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:07.917715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:07.918228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:07.929212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:07.930455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:07.936149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:07.936857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:08.074062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:34:08.075162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:34:08.075794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:34:08.076361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:34:08.076956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:34:08.100038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:08.104125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:08.105701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:08.110000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:08.112527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:08.113156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:08.133576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=76 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:08.147702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:08.156018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:08.188361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:34:08.192377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:34:08.226601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:08.234901 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a96e09a3-e5c9-49cc-a11c-e43bcf1f8c14 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.336759 Oct 28 13:34:08.254937 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2866/5641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:07 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:08.354424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-68f3e277-9f59-4661-a857-bfe7b5965ad7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.944388 Oct 28 13:34:08.357568 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2776/5642] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:34:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:34:08.371570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a83811ab-e6ae-4c1f-a499-680fe1a7e5fe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:08.372521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a83811ab-e6ae-4c1f-a499-680fe1a7e5fe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:08.538324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:08.546914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a83811ab-e6ae-4c1f-a499-680fe1a7e5fe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:08.553625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:08.559280 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a83811ab-e6ae-4c1f-a499-680fe1a7e5fe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1267 microversion: 2.1 time: 0.193213 Oct 28 13:34:08.560716 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2867/5643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:08 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:08.563280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:08.566094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:08.566593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:08.567436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:08.567857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:08.568291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:08.696675 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-feeda396-4cab-4522-b393-a2de6e995608 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169989 Oct 28 13:34:08.705195 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2777/5644] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:08 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:09.283306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:09.284114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:09.305178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:09.305844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:09.306397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:09.307279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:09.307853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:09.308391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:09.585878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ef874c81-1867-44b2-a2ba-28a1dc8ad64a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:09.587134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ef874c81-1867-44b2-a2ba-28a1dc8ad64a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:09.704022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:09.724519 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25d60c6c-7dc5-4a12-b13c-f44245591cfa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.463096 Oct 28 13:34:09.726600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ef874c81-1867-44b2-a2ba-28a1dc8ad64a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:09.727284 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2868/5645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:09 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:09.739415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:09.743863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:09.749456 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ef874c81-1867-44b2-a2ba-28a1dc8ad64a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1267 microversion: 2.1 time: 0.167480 Oct 28 13:34:09.751216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2778/5646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:09 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:09.771760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:09.777615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:09.778800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:09.779793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:09.780503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:09.781163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:09.839531 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ad5bf31-c984-425f-b01d-0efc46580cb6 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110861 Oct 28 13:34:09.847654 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2869/5647] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:09 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:10.749460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:10.750231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:10.762314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:10.762314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:10.762314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:10.762314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:10.762314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:10.763038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:10.778249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:10.779606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:10.794914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:10.795686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:10.796323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:10.798278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:10.798684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:10.805648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:11.159210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:11.173125 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-516422a7-6dc3-4644-a571-dcb1ab74f44f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1319 microversion: 2.1 time: 0.399307 Oct 28 13:34:11.174307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2870/5648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:10 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:11.191572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:11.194374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:11.208416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:11.210816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:11.215316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:11.216240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:11.216860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:11.217447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:11.228661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:11.262916 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c797a06-a104-49a9-8545-1915bedacb82 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.516439 Oct 28 13:34:11.263751 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2779/5649] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:10 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:11.286602 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c8540de-44e6-4185-a169-d81195459b92 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110821 Oct 28 13:34:11.291694 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2871/5650] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:11 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:12.205575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:12.205575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:12.218169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:12.220702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:12.221164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:12.221928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:12.222400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:12.222866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:12.288537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:12.289003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:12.323949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:12.325081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:12.325542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:12.331255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:12.332222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:12.332767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:12.368977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:12.381843 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-995ab02e-1039-4fb7-a90a-007d7f6cc6a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1325 microversion: 2.1 time: 0.186523 Oct 28 13:34:12.385163 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2780/5651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:12 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:12.403906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:12.407950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:12.428730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:12.428730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:12.428730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:12.430393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:12.431787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:12.432347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:12.485376 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cffa1a5f-ebcc-4f2e-aa7e-6e0fdda49829 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098864 Oct 28 13:34:12.485975 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2781/5652] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:12 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:12.826018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:12.865891 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bebb138d-8876-4954-8fee-cdcd51ef7b7c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.578712 Oct 28 13:34:12.871954 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2872/5653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:12 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:13.414097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:13.419607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:13.439319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.440038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.440621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.442393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.443137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.445565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.503229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:13.506207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:13.528481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.528481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.528799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.529775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.533421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.534190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.610727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9e862c31-8260-42f8-ba15-c46f098d5676 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116261 Oct 28 13:34:13.613924 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2873/5654] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 13:34:13 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 13:34:13.759301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:13.761949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:13.769738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.776721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.776721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.776721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.776721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.776721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.811009 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Cannot 'reboot' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action HTTP/1.1 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 28 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: {"reboot": {"type": "HARD"}} Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: exception: Cannot 'reboot' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f84d5e6a-5429-4e85-8595-b17f9dcf17b5', 'body': {'reboot': {'type': 'HARD'}}} Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:34:13.813453 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.817774 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.820369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 409 to user: Cannot 'reboot' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:13.822359 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-612bb30e-34b8-464a-aae5-048116b9f1ed tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action" status: 409 len: 145 microversion: 2.1 time: 0.067384 Oct 28 13:34:13.823135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2874/5655] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:34:13 2022] POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:34:13.836328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:13.840574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:13.848319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.849016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.849630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.851129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.851806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.852415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.913096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:13.928949 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c800eed4-bb10-456e-b0ba-900e848cc1c3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.515096 Oct 28 13:34:13.939662 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2782/5656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:13 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:13.940897 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Cannot 'rebuild' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.947580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action HTTP/1.1 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 65 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: exception: Cannot 'rebuild' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f84d5e6a-5429-4e85-8595-b17f9dcf17b5', 'body': {'rebuild': {'imageRef': '65e1a51d-1f44-4651-86a6-90233a26cd48'}}} Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:34:13.948359 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued Oct 28 13:34:13.953026 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:13.961218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:13.963177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 409 to user: Cannot 'rebuild' instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 while it is in vm_state rescued {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:13.964084 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ee404abc-6457-44a2-b424-06662a635585 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action" status: 409 len: 146 microversion: 2.1 time: 0.134623 Oct 28 13:34:13.964872 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2875/5657] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:34:13 2022] POST /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 13:34:13.991436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:13.991436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:13.991918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:13.993313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:13.993922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:13.997620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:14.001654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:14.002307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:14.016209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:14.022532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:14.022532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:14.022532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:14.022532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:14.022532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:14.075992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:14.104838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:34:14.689340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4f7079a-e3a2-40fc-987e-823d08752c7e tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 204 len: 0 microversion: 2.1 time: 0.710901 Oct 28 13:34:14.689340 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2876/5658] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:34:13 2022] DELETE /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:34:14.699449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:14.700161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:14.707964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:14.708464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:14.708905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:14.709613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:14.710067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:14.710490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:14.902183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:14.911869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2811a087-5b44-4915-8519-54faba9481d8 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.979708 Oct 28 13:34:14.912472 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2783/5659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:13 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:14.966561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:14.967251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:14.974631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:14.975527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:14.983589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:14.983589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:14.983589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:14.983589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:15.139698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:15.177567 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-840b81b8-64f7-4fd4-803b-8401406fd0bb tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1689 microversion: 2.1 time: 0.484993 Oct 28 13:34:15.208347 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2877/5660] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:14 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1689 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:15.343593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:15.357712 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-55488107-aaf4-428c-98e8-09b5a4b6ee10 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.399629 Oct 28 13:34:15.377691 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2784/5661] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:14 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:15.941531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:15.942307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:15.950707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:15.951558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:15.961203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:15.961203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:15.961203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:15.961203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:16.236461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:16.237834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:16.252601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:16.263662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:16.264286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:16.265247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:16.267872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:16.268387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:16.414295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:16.433094 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e254d992-524d-4162-b2ff-e59a28f15369 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.499045 Oct 28 13:34:16.434257 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2878/5662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:15 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:16.466195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:16.466733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:16.507335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:16.507335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:16.507335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:16.507335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:16.507335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:16.507884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:17.385925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:17.415336 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-68979364-4241-4948-9633-5a5487d2862d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1689 microversion: 2.1 time: 1.181317 Oct 28 13:34:17.418185 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2785/5663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:16 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1689 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:17.443474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-86ab47bf-a98d-4c06-9096-754b4b288356 req-e60f269c-c709-4817-aa43-9c997557a959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:17.493725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-86ab47bf-a98d-4c06-9096-754b4b288356 req-e60f269c-c709-4817-aa43-9c997557a959 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:17.498136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-86ab47bf-a98d-4c06-9096-754b4b288356 req-e60f269c-c709-4817-aa43-9c997557a959 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:17.498774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-86ab47bf-a98d-4c06-9096-754b4b288356 req-e60f269c-c709-4817-aa43-9c997557a959 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:17.551428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-86ab47bf-a98d-4c06-9096-754b4b288356 req-e60f269c-c709-4817-aa43-9c997557a959 service nova] Creating event network-changed:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:34:17.564113 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-86ab47bf-a98d-4c06-9096-754b4b288356 req-e60f269c-c709-4817-aa43-9c997557a959 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144493 Oct 28 13:34:17.572827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2786/5664] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:17.596352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:17.597260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:17.604735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:17.605238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:17.605671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:17.606682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:17.607376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:17.607944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:17.856183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:17.865538 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b15e2a6c-2caf-4f53-b7ea-d2a43e714d24 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 1.430007 Oct 28 13:34:17.866714 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2879/5665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:16 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:18.014302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:18.028407 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b6146871-cfd7-4eb7-9f27-9a2c8e2cdc6c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.436942 Oct 28 13:34:18.030896 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2787/5666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:17 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:18.441840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:18.443470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:18.459371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:18.460142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:18.460787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:18.463993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:18.465383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:18.465947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:18.567643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:18.899012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:18.899714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:18.903914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:18.934368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:18.938277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:18.939818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:18.944055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:18.969260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:18.984777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:19.147710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:19.167787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63ae1566-41ef-4b60-bfc4-99f348e7f5b4 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1689 microversion: 2.1 time: 0.729412 Oct 28 13:34:19.169747 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2880/5667] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:18 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1689 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:19.174989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:19.175830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:19.210301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:19.211155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:19.212811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:19.214049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:19.215337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:19.216707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:19.474263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:19.493023 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b09dd7f2-3cf7-4993-8b0e-6a74206bcb9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.599795 Oct 28 13:34:19.508262 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2788/5668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:18 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:19.911751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:19.929619 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-feff36b2-8b7d-4fed-b323-b814d0957195 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.758966 Oct 28 13:34:19.930229 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2881/5669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:19 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:20.195064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:20.196241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:20.208203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:20.226999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:20.232045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:20.240201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:20.240201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:20.240201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:20.240201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:20.518076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:20.519390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:20.535508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:20.535508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:20.535901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:20.540120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:20.540606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:20.541113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:20.776743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:20.785693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ac589d23-1b15-417c-b08e-5d6c3813649a tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1689 microversion: 2.1 time: 0.594701 Oct 28 13:34:20.786289 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2789/5670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:20 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1689 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:21.043002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:21.081302 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-036585c6-82db-47bf-86dc-33d4361297d6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.562004 Oct 28 13:34:21.094391 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2882/5671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:20 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:21.116444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:21.117346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:21.138628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:21.139680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:21.140367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:21.143975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:21.144816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:21.147340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:21.241966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b440fdc-3c85-4877-bc4c-e4dc36f5c891 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Action: 'create', calling method: .version_select at 0x7f27b888fdc0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1569861875", "policies": ["affinity"]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:21.270971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0b440fdc-3c85-4877-bc4c-e4dc36f5c891 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:21.285446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0b440fdc-3c85-4877-bc4c-e4dc36f5c891 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:21.419730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0b440fdc-3c85-4877-bc4c-e4dc36f5c891 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:21.429349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0b440fdc-3c85-4877-bc4c-e4dc36f5c891 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:21.460164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:21.474649 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b440fdc-3c85-4877-bc4c-e4dc36f5c891 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.526061 Oct 28 13:34:21.483326 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2790/5672] 10.222.0.25 () {60 vars in 1174 bytes} [Fri Oct 28 13:34:20 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:21.490080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f043db40-f427-40b6-b9c4-0c3875030e97 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Action: 'create', calling method: .version_select at 0x7f27b873c040>, body: {"server_group": {"name": "tempest-server-group-1653392244", "policies": ["affinity"]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:21.515879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f043db40-f427-40b6-b9c4-0c3875030e97 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:21.521806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f043db40-f427-40b6-b9c4-0c3875030e97 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:21.630931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:21.637521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-818e9697-01bc-4cd8-bf79-f60f411917fe tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.530407 Oct 28 13:34:21.638529 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2883/5673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:21 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:21.771918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f043db40-f427-40b6-b9c4-0c3875030e97 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:21.778560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f043db40-f427-40b6-b9c4-0c3875030e97 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:21.793893 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f043db40-f427-40b6-b9c4-0c3875030e97 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.309030 Oct 28 13:34:21.795665 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2791/5674] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Oct 28 13:34:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:21.809836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-03947d68-ac99-47fd-b1f9-34f2aadca94e tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Action: 'create', calling method: .version_select at 0x7f27b82eeca0>, body: {"server_group": {"name": "tempest-server-group-1653392244", "policies": ["affinity"]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:21.820337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:21.821455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:21.832623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:21.836980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:21.839658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:21.840432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:21.841038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:21.841512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:21.856205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-03947d68-ac99-47fd-b1f9-34f2aadca94e tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:21.868085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-03947d68-ac99-47fd-b1f9-34f2aadca94e tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:21.970405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:21.985125 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6a77e66-b576-4316-b538-b2f01f2bb7f8 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1622 microversion: 2.1 time: 0.170614 Oct 28 13:34:21.985853 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2792/5675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:21 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1622 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:22.003821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b86aafa5-33ad-4058-b4f8-4561f7ddc62f req-0f39eed8-9072-4e4b-85e7-501f6a0d462b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd7fdfa-5067-4a02-82a4-87d4ee670caa", "name": "network-vif-deleted", "tag": "eab335fd-c705-40e7-9d38-6f99af3c756a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:22.023729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b86aafa5-33ad-4058-b4f8-4561f7ddc62f req-0f39eed8-9072-4e4b-85e7-501f6a0d462b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:22.025627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b86aafa5-33ad-4058-b4f8-4561f7ddc62f req-0f39eed8-9072-4e4b-85e7-501f6a0d462b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:22.026085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b86aafa5-33ad-4058-b4f8-4561f7ddc62f req-0f39eed8-9072-4e4b-85e7-501f6a0d462b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:22.061701 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b86aafa5-33ad-4058-b4f8-4561f7ddc62f req-0f39eed8-9072-4e4b-85e7-501f6a0d462b service nova] Creating event network-vif-deleted:eab335fd-c705-40e7-9d38-6f99af3c756a for instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa on n-h1-862876-2 Oct 28 13:34:22.067894 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b86aafa5-33ad-4058-b4f8-4561f7ddc62f req-0f39eed8-9072-4e4b-85e7-501f6a0d462b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079827 Oct 28 13:34:22.069072 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2793/5676] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:22.120980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:22.121902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:22.135768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-03947d68-ac99-47fd-b1f9-34f2aadca94e tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:22.136108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:22.136211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:22.136601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:22.139572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:22.140052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:22.140491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:22.146770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-03947d68-ac99-47fd-b1f9-34f2aadca94e tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:22.183584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:22.186424 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-03947d68-ac99-47fd-b1f9-34f2aadca94e tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.381395 Oct 28 13:34:22.190037 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2884/5677] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Oct 28 13:34:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:22.200781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b31c323a-700f-4491-b1d1-6d9b6cd25876 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:22.346118 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b31c323a-700f-4491-b1d1-6d9b6cd25876 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/18ed5d97-626f-47dc-acd8-c6782858c216" status: 204 len: 0 microversion: 2.1 time: 0.148881 Oct 28 13:34:22.351067 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2885/5678] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:22 2022] DELETE /compute/v2.1/os-server-groups/18ed5d97-626f-47dc-acd8-c6782858c216 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:34:22.358721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-742b68a3-6bad-4f49-9ade-ae2c7f8db43b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:22.369957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:22.382417 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f76b322-8c4e-44a7-8c83-c7838bc3daa7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.267079 Oct 28 13:34:22.385271 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2794/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:22 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:22.411170 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-742b68a3-6bad-4f49-9ade-ae2c7f8db43b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.057077 Oct 28 13:34:22.416684 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2886/5680] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:34:22 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:22.428722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ce991d5-48cc-4ad1-894a-cc560aef3269 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:22.576167 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ce991d5-48cc-4ad1-894a-cc560aef3269 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/c9529e08-ef5e-4b90-a56b-31cbd672a78e" status: 204 len: 0 microversion: 2.1 time: 0.151248 Oct 28 13:34:22.577222 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2795/5681] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:22 2022] DELETE /compute/v2.1/os-server-groups/c9529e08-ef5e-4b90-a56b-31cbd672a78e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:34:22.587076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-101981aa-fcf3-4d8c-aa83-3ed884cdb265 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:22.628234 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-101981aa-fcf3-4d8c-aa83-3ed884cdb265 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043878 Oct 28 13:34:22.636484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2887/5682] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:34:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:22.643455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6bf889cd-db86-4f73-aa17-d034c02d1344 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Action: 'create', calling method: .version_select at 0x7f27b888f670>, body: {"server_group": {"name": "tempest-server-group-1256795000", "policies": ["affinity"]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:22.664362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:22.664995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:22.680491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:22.681185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:22.681634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:22.682351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:22.685895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6bf889cd-db86-4f73-aa17-d034c02d1344 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:22.687177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:22.694998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:22.698340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6bf889cd-db86-4f73-aa17-d034c02d1344 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:22.920495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6bf889cd-db86-4f73-aa17-d034c02d1344 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:22.932798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6bf889cd-db86-4f73-aa17-d034c02d1344 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:22.963026 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6bf889cd-db86-4f73-aa17-d034c02d1344 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.324400 Oct 28 13:34:22.965516 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2796/5683] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Oct 28 13:34:22 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:22.983399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4168e67-afd0-4040-bea2-9a9df29c19ab tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:23.132503 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4168e67-afd0-4040-bea2-9a9df29c19ab tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/437d65e6-b75a-40fc-9a3a-77cf44f65cb8" status: 204 len: 0 microversion: 2.1 time: 0.154872 Oct 28 13:34:23.133309 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2797/5684] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:22 2022] DELETE /compute/v2.1/os-server-groups/437d65e6-b75a-40fc-9a3a-77cf44f65cb8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:34:23.141514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:23.143282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:23.161738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:23.161738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:23.161738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:23.167614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:23.167614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:23.168285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:23.235311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:23.235884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:23.237023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:23.238362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'fault' on Instance uuid ffd7fdfa-5067-4a02-82a4-87d4ee670caa {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:34:23.300642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:23.307807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:23.308610 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b9a57b13-5441-4757-bef6-aff459bcc156 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 200 len: 1334 microversion: 2.1 time: 0.174132 Oct 28 13:34:23.316946 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2798/5685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:23 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 1334 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:23.322268 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe34f092-99f9-4895-918f-ea8d8df73d7f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.660812 Oct 28 13:34:23.322268 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2888/5686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:22 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:23.327984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c3bc2a8-5158-484d-909c-f6a92e2b6f96 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:23.360660 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c3bc2a8-5158-484d-909c-f6a92e2b6f96 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042171 Oct 28 13:34:23.361274 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2799/5687] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:34:23 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:23.374761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1e2ee6a3-74d1-4276-87a9-e67e38b2f15d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Action: 'create', calling method: .version_select at 0x7f27b8395f70>, body: {"server_group": {"name": "tempest-server-group-836039297", "policies": ["anti-affinity"]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:23.397674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1e2ee6a3-74d1-4276-87a9-e67e38b2f15d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:23.410010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1e2ee6a3-74d1-4276-87a9-e67e38b2f15d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:23.412605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:23.417469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:23.463651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:23.464341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:23.464906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:23.465539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:23.465999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:23.466432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:23.577362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1e2ee6a3-74d1-4276-87a9-e67e38b2f15d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:23.585107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1e2ee6a3-74d1-4276-87a9-e67e38b2f15d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_groups'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:23.611514 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1e2ee6a3-74d1-4276-87a9-e67e38b2f15d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.241427 Oct 28 13:34:23.612901 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2889/5688] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Oct 28 13:34:23 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:23.632156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99833eed-0cfa-4354-887e-63f1c2fdaac6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:23.680380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:23.692251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b327624c-c44e-4320-b6cd-769c448bb50b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.287637 Oct 28 13:34:23.704997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2800/5689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:23 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:23.774787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99833eed-0cfa-4354-887e-63f1c2fdaac6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2" status: 204 len: 0 microversion: 2.1 time: 0.154710 Oct 28 13:34:23.776205 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2890/5690] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:23 2022] DELETE /compute/v2.1/os-server-groups/9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:34:23.789687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f66b820-0e16-4624-83c9-ca2c807fdfa5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:23.817402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f66b820-0e16-4624-83c9-ca2c807fdfa5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034217 Oct 28 13:34:23.822205 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2801/5691] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:34:23 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:23.918036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1922694560", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "bc4afbb2-7158-4011-bf6d-8e5fcff01caa"}]}, "os:scheduler_hints": {"group": "7050eead-7786-465f-ad1b-bbf25f16c008"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:23.981162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] validate_networks() for [('bc4afbb2-7158-4011-bf6d-8e5fcff01caa', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:34:24.336916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:24.337705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: ffd7fdfa-5067-4a02-82a4-87d4ee670caa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:24.345832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:24.346340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:24.346795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:24.347757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:24.348420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:24.349012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:24.368302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa could not be found. Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa HTTP/1.1 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa could not be found. Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'ffd7fdfa-5067-4a02-82a4-87d4ee670caa'} Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa could not be found. Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa could not be found. Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:24.369997 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa could not be found. Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 404 to user: Instance ffd7fdfa-5067-4a02-82a4-87d4ee670caa could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a2ed38fb-a044-4198-a24a-04679d16641f tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa" status: 404 len: 111 microversion: 2.1 time: 0.038642 Oct 28 13:34:24.376109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2802/5692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:24 2022] GET /compute/v2.1/servers/ffd7fdfa-5067-4a02-82a4-87d4ee670caa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:34:24.383819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:24.384491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:24.391222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:24.391719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:24.392618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:24.393329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:24.393785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:24.394214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:24.399105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:24.643856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:24.654367 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da556021-d7bd-4840-a922-aa1735d362c9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1507 microversion: 2.1 time: 0.277153 Oct 28 13:34:24.655592 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2803/5693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:24 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:24.661250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d2341081-b03a-4cca-a4bb-be1f86c18d9d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '.version_select at 0x7f27bd9a1700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:24.845465 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d2341081-b03a-4cca-a4bb-be1f86c18d9d tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268261442" status: 202 len: 0 microversion: 2.1 time: 0.187918 Oct 28 13:34:24.846368 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2804/5694] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 13:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268261442 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:34:24.854625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:24.855561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:24.862508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:24.863376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:24.864079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:24.864984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:24.865631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:24.866252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:25.185382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:25.216410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83e59304-2dbe-49de-8661-5aafa3396451 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.365513 Oct 28 13:34:25.217803 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2805/5695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:24 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:25.331766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:34:25.336884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:34:25.337670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:34:25.338302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:34:25.339047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:34:25.369789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:25.370283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:25.371091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:25.372518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:25.373159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:25.373745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:25.401559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:25.416316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:25.460396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:34:25.471372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:34:25.681964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:25.683717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:25.691769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:25.693246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:25.694151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:25.695432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:25.696463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:25.697531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:25.960698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:25.969881 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d30dba91-d240-466b-9f19-e3c598e757ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1528 microversion: 2.1 time: 0.291077 Oct 28 13:34:25.970006 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2806/5696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:25 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:26.005480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:26.013813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:26.143872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for project 7d15a912f681484db97410d704abd49a. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:34:26.151247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Getting quotas for user d7f7dcd0b84b4a759cbdfbbdf6780e21 and project 7d15a912f681484db97410d704abd49a. Resources: {'server_group_members'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:34:26.191024 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50a57f28-96e8-457d-baae-bf25ac343fd1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276682 Oct 28 13:34:26.192388 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2891/5697] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:34:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:34:26.207825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9163bcfe-9ea5-434f-bc17-7cc65f19abdb tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:26.207825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9163bcfe-9ea5-434f-bc17-7cc65f19abdb tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:26.207825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:26.240482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:26.241206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:26.257672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:26.258861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:26.263697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:26.266077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:26.266077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:26.266077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:26.458450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9163bcfe-9ea5-434f-bc17-7cc65f19abdb tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:26.465771 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9163bcfe-9ea5-434f-bc17-7cc65f19abdb tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1213 microversion: 2.1 time: 0.266530 Oct 28 13:34:26.466363 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2807/5698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:26 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1213 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:26.634127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:26.649544 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea02b8b6-9add-49b1-a634-61b58b32757a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.413076 Oct 28 13:34:26.655056 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2892/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:26 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:26.711263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bd56c7a4-3ff3-479b-a13c-ad2ba9901ace req-02c2a1c4-bfb2-41e2-8f5e-2d9475f63b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "name": "network-vif-plugged", "status": "completed", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:26.729631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd56c7a4-3ff3-479b-a13c-ad2ba9901ace req-02c2a1c4-bfb2-41e2-8f5e-2d9475f63b88 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:26.730125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd56c7a4-3ff3-479b-a13c-ad2ba9901ace req-02c2a1c4-bfb2-41e2-8f5e-2d9475f63b88 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:26.730562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd56c7a4-3ff3-479b-a13c-ad2ba9901ace req-02c2a1c4-bfb2-41e2-8f5e-2d9475f63b88 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:26.761916 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bd56c7a4-3ff3-479b-a13c-ad2ba9901ace req-02c2a1c4-bfb2-41e2-8f5e-2d9475f63b88 service nova] Creating event network-vif-plugged:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:34:26.769501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bd56c7a4-3ff3-479b-a13c-ad2ba9901ace req-02c2a1c4-bfb2-41e2-8f5e-2d9475f63b88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061670 Oct 28 13:34:26.771024 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2808/5700] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:27.009839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:27.010537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:27.035090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:27.038683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:27.039552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:27.040535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:27.042032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:27.042472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:27.431277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:27.462559 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-322a706d-97b2-4a00-9c07-83329bcbf3a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1528 microversion: 2.1 time: 0.469002 Oct 28 13:34:27.482700 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2893/5701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:26 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1528 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:27.494377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d7451463-b9c8-472b-8ec0-33a2008262b5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:27.495247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d7451463-b9c8-472b-8ec0-33a2008262b5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:27.676930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:27.677721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:27.691584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:27.693726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d7451463-b9c8-472b-8ec0-33a2008262b5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:27.694028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:27.694864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:27.695778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:27.696870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:27.698075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:27.720064 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d7451463-b9c8-472b-8ec0-33a2008262b5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1213 microversion: 2.1 time: 0.212384 Oct 28 13:34:27.722228 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2809/5702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:27 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:27.941377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:27.955564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14dd62dc-bf50-4f72-a7ff-7b196aa89a0c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1393 microversion: 2.1 time: 0.282685 Oct 28 13:34:27.971639 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2894/5703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:27 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1393 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:28.490587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:28.491257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:28.503859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:28.507028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:28.507644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:28.509895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:28.511732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:28.517449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:28.745384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:28.746121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:28.760815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:28.761758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:28.761758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:28.762467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:28.762971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:28.763410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:28.887941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:28.905168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b70fedd-69e0-4c69-943a-650114a534cf tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1217 microversion: 2.1 time: 0.159847 Oct 28 13:34:28.912205 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2895/5704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:28 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:28.981749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:28.982384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:28.985055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:28.997446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:29.002271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:29.002850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:29.003638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:29.012731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:29.013204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:29.161590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:29.187243 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-396fd4e0-e870-43cb-a523-7a28de383176 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.701100 Oct 28 13:34:29.192182 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2810/5705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:28 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:29.405134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:29.414332 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dcd98784-3cf0-4fcd-a2f1-5275638db993 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1565 microversion: 2.1 time: 0.436723 Oct 28 13:34:29.416750 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2896/5706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:28 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1565 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:29.442030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a50daea1-4eb4-4c87-b497-16063a895bdd req-d5d432b4-9b77-4247-a653-2a3f0de6ccc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e061c84-d890-4b90-9717-128de818f090", "name": "network-vif-plugged", "status": "completed", "tag": "eaf68681-0800-44e9-bc3b-de2159a53814"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:29.452725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a50daea1-4eb4-4c87-b497-16063a895bdd req-d5d432b4-9b77-4247-a653-2a3f0de6ccc9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:29.459751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a50daea1-4eb4-4c87-b497-16063a895bdd req-d5d432b4-9b77-4247-a653-2a3f0de6ccc9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:29.459865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:29.459965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a50daea1-4eb4-4c87-b497-16063a895bdd req-d5d432b4-9b77-4247-a653-2a3f0de6ccc9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:29.460057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:29.470668 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a50daea1-4eb4-4c87-b497-16063a895bdd req-d5d432b4-9b77-4247-a653-2a3f0de6ccc9 service nova] Creating event network-vif-plugged:eaf68681-0800-44e9-bc3b-de2159a53814 for instance 0e061c84-d890-4b90-9717-128de818f090 on n-h1-862876-2 Oct 28 13:34:29.475841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:29.476285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:29.479603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:29.480263 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a50daea1-4eb4-4c87-b497-16063a895bdd req-d5d432b4-9b77-4247-a653-2a3f0de6ccc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042236 Oct 28 13:34:29.480380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:29.480944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:29.481545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:29.482357 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2811/5707] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:29.718071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:29.727464 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6b96ed2-68ec-467e-9def-73683968366f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1565 microversion: 2.1 time: 0.280905 Oct 28 13:34:29.768088 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2897/5708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:29 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1565 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:29.925750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:29.927132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:29.949888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:29.953101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:29.954652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:29.958073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:29.958568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:29.959040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:30.147537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:30.157330 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b1debcfc-175a-4e55-893f-4d718fd1ec40 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1265 microversion: 2.1 time: 0.237356 Oct 28 13:34:30.160903 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2812/5709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:29 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:30.219241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:30.219980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:30.235140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:30.235574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:30.236025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:30.236751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:30.237224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:30.237663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:30.291354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:31.189811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:31.189811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:31.203492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:31.204018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:31.204478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:31.205220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:31.205686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:31.208497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:31.391196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:31.400956 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bf3e5efd-0b63-467b-9623-2d28c6a09762 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1271 microversion: 2.1 time: 0.219236 Oct 28 13:34:31.402592 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2813/5710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:31 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:31.647389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:31.660649 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-26b5da59-fdd0-4ddc-86ec-2f99d10d899e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 1.445520 Oct 28 13:34:31.677759 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2898/5711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:30 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:32.428254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:32.429839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:32.446682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:32.447211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:32.447655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:32.466437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:32.467817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:32.469515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:32.640638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:32.648337 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76bda0b4-cf53-4189-97e5-790e9d9c392c tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1271 microversion: 2.1 time: 0.225548 Oct 28 13:34:32.668761 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2814/5712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:32 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:32.691802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:32.703573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:32.705986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:32.708201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:32.709820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:32.711160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:32.713050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:32.713659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:33.183682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:33.192243 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1339ba71-627f-4440-be8c-55f9ecad70e4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.505437 Oct 28 13:34:33.199226 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2899/5713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:32 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:33.677345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:33.678055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:33.717086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:33.721786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:33.726944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:33.726944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:33.726944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:33.726944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:34.250799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:34.251837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:34.284246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:34.287219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:34.291365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:34.292769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:34.293575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:34.295692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:34.829111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:34.838594 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a578f49-ea58-4921-9cc7-09449ee0b087 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 1.167964 Oct 28 13:34:34.861649 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2815/5714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:33 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:35.260571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:35.284667 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5585644f-afbf-4682-9727-69ce5938c790 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 1.042368 Oct 28 13:34:35.295656 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2900/5715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:34 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:35.869759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:35.870397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:35.905652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:35.905919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:35.906337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:35.907377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:35.908095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:35.908751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:36.337451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:36.341628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:36.355501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:36.357319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=30 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:36.361690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:36.363159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:36.364770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:36.366493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:36.367625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:36.368894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:36.413525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:36.445087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f862d881-9b36-424c-a5cb-d8daa8f62d62 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 0.572170 Oct 28 13:34:36.479904 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2816/5716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:35 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:36.781839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:36.790593 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e13bec3e-8def-4f2f-b836-7b2e34ceb57e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.474356 Oct 28 13:34:36.793039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2901/5717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:36 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:36.940072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:36.941064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:36.954329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:36.955113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:36.955349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:36.959550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:36.960541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:36.961171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:37.029554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:34:37.176869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b93cae85-d951-4f80-b8e1-23ebb2457c03 req-fff3659a-ca72-45c2-b25f-641e9a3a2e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6beaa8-bc6e-4c04-b221-181d17058496", "tag": "cb3ff488-84ae-4924-b533-f4badee99c0f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:37.209503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b93cae85-d951-4f80-b8e1-23ebb2457c03 req-fff3659a-ca72-45c2-b25f-641e9a3a2e8b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:37.210242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b93cae85-d951-4f80-b8e1-23ebb2457c03 req-fff3659a-ca72-45c2-b25f-641e9a3a2e8b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:37.210856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b93cae85-d951-4f80-b8e1-23ebb2457c03 req-fff3659a-ca72-45c2-b25f-641e9a3a2e8b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:37.271307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b93cae85-d951-4f80-b8e1-23ebb2457c03 req-fff3659a-ca72-45c2-b25f-641e9a3a2e8b service nova] Creating event network-changed:cb3ff488-84ae-4924-b533-f4badee99c0f for instance cb6beaa8-bc6e-4c04-b221-181d17058496 on n-h1-862876-2 Oct 28 13:34:37.300890 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b93cae85-d951-4f80-b8e1-23ebb2457c03 req-fff3659a-ca72-45c2-b25f-641e9a3a2e8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127601 Oct 28 13:34:37.301504 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2902/5718] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:37.495678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:37.502488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:37.512563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:37.513081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:37.513531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:37.514261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:37.514718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:37.515681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:37.579776 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1e393a6-1224-4394-810c-8ac5a0804a90 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 204 len: 0 microversion: 2.1 time: 0.643601 Oct 28 13:34:37.582670 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2817/5719] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:34:36 2022] DELETE /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:34:37.589859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:37.591412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:37.608855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:37.610282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:37.610930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:37.613698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:37.614938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:37.616044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:37.704402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=28 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:37.996442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:38.011541 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12558456-49c0-4d7f-ae00-c27f71751bc2 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1508 microversion: 2.1 time: 0.426150 Oct 28 13:34:38.013142 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2818/5720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:37 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:38.019186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:38.020083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:38.036377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:38.040438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:38.044068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:38.045029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:38.045514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:38.045945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:38.184711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:38.193448 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3eb08cb9-de97-48ff-a6c9-d68485a2c112 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 0.703575 Oct 28 13:34:38.194035 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2903/5721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:37 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:38.480618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:38.490963 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-89052da3-2329-4de3-815b-51bf62bcb8cd tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.476434 Oct 28 13:34:38.493324 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2819/5722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:38 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:38.542565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:38.543128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:38.557041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:38.557571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:38.557967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:38.560898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:38.561381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:38.564324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:38.933412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:38.941655 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f220859-1a2f-4302-bf03-8453f00056fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1565 microversion: 2.1 time: 0.403264 Oct 28 13:34:38.945597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2904/5723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:38 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1565 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:39.039234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:39.040428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:39.054978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:39.057764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:39.057764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:39.057764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:39.065132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:39.065723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:39.221342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:39.221874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:39.233021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:39.233530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:39.234016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:39.235448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:39.239107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:39.239791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:39.552893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:39.568976 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d51348fd-1d93-4892-8f50-ecac30cf79f4 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 0.351805 Oct 28 13:34:39.583957 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2905/5724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:39 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:39.594360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8e6167ca-c1a7-42aa-908f-c2d137c9bb2c req-eeb03a04-c6d8-4c33-b814-f3e0e85d992e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:39.605526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8e6167ca-c1a7-42aa-908f-c2d137c9bb2c req-eeb03a04-c6d8-4c33-b814-f3e0e85d992e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:39.606240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8e6167ca-c1a7-42aa-908f-c2d137c9bb2c req-eeb03a04-c6d8-4c33-b814-f3e0e85d992e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:39.606848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8e6167ca-c1a7-42aa-908f-c2d137c9bb2c req-eeb03a04-c6d8-4c33-b814-f3e0e85d992e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:39.621146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8e6167ca-c1a7-42aa-908f-c2d137c9bb2c req-eeb03a04-c6d8-4c33-b814-f3e0e85d992e service nova] Creating event network-changed:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:34:39.642491 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8e6167ca-c1a7-42aa-908f-c2d137c9bb2c req-eeb03a04-c6d8-4c33-b814-f3e0e85d992e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056960 Oct 28 13:34:39.643640 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2906/5725] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:39.650696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:39.651627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:39.663303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:39.664266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:39.664886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:39.665999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:39.666914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:39.667992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:39.680594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:39.696623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00aebad0-0b9f-4923-a630-4297b90fedaf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1508 microversion: 2.1 time: 0.661526 Oct 28 13:34:39.705302 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2820/5726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:39 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:40.597771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:40.598383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:40.613257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:40.613712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:40.614152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:40.614882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:40.626181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:40.626640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:40.941684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:40.978521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66cfc5c6-7a46-44b4-9ca4-630a687ffc8e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 1.331872 Oct 28 13:34:40.979865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2907/5727] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:39 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:41.000029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:41.021399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:41.027953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:41.035340 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-631078d7-4817-479d-bb42-efc6702438be tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 0.435505 Oct 28 13:34:41.036367 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2821/5728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:40 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:41.067973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:41.070644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:41.072480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:41.074689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:41.078920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:41.081743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:42.006207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:42.006866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:42.020316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:42.021335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:42.025678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:42.025678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:42.025678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:42.025678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:42.072362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:42.368561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:42.394888 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ddcb97f-177e-4fb7-9b17-9fcbabcee928 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1508 microversion: 2.1 time: 1.397893 Oct 28 13:34:42.394888 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2908/5729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:40 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1508 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:42.394888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:42.394888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:42.394888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:42.395404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:42.395538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:42.396687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:42.397948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:42.398786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:42.407355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:42.419328 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c0d5007-79f5-4d13-87e1-fa1f740624e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.417636 Oct 28 13:34:42.420500 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2822/5730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:42 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:42.820485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8406720f-220f-451d-8a31-4a5649b85324 req-d8a626a6-b2aa-4e0d-b794-7e3beb64202c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84d5e6a-5429-4e85-8595-b17f9dcf17b5", "name": "network-vif-deleted", "tag": "885c4a89-eec4-4bff-9787-c06c44e55466"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:42.841064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8406720f-220f-451d-8a31-4a5649b85324 req-d8a626a6-b2aa-4e0d-b794-7e3beb64202c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:42.841562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8406720f-220f-451d-8a31-4a5649b85324 req-d8a626a6-b2aa-4e0d-b794-7e3beb64202c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:42.841999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8406720f-220f-451d-8a31-4a5649b85324 req-d8a626a6-b2aa-4e0d-b794-7e3beb64202c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:42.867239 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8406720f-220f-451d-8a31-4a5649b85324 req-d8a626a6-b2aa-4e0d-b794-7e3beb64202c service nova] Creating event network-vif-deleted:885c4a89-eec4-4bff-9787-c06c44e55466 for instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 on n-h2-862876-2 Oct 28 13:34:42.884694 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8406720f-220f-451d-8a31-4a5649b85324 req-d8a626a6-b2aa-4e0d-b794-7e3beb64202c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067865 Oct 28 13:34:42.885877 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2823/5731] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:43.170927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:43.183634 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7eec3c6-39dc-47ba-a0cd-7200542758fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 0.799348 Oct 28 13:34:43.200021 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2909/5732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:42 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:43.424930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:43.425743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:43.446776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:43.447413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:43.453695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:43.454205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:43.454655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:43.461088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:43.468527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:43.472018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:43.472800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:43.473282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:43.473718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:43.477199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:43.478002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:43.478625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:43.592120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:43.594497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:43.595172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:43.595877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'fault' on Instance uuid f84d5e6a-5429-4e85-8595-b17f9dcf17b5 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:34:43.708544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:43.719557 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee319093-4236-44a9-b94f-8032bf9b4912 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 200 len: 1312 microversion: 2.1 time: 0.312719 Oct 28 13:34:43.779658 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2824/5733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:43 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:44.166666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:44.184140 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-83d57f6b-4ff1-4f54-b0d2-d1de25d4c5d9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.741122 Oct 28 13:34:44.185169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2910/5734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:43 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:44.212486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:44.213512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:44.227801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:44.228707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:44.232341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:44.233982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:44.233982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:44.237119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:44.249279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b1e92c0e-6ff6-45b0-9c40-2f1e4b8e0dc1 req-35cd9ba1-24ff-43bb-b805-fa06583b6529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6beaa8-bc6e-4c04-b221-181d17058496", "name": "network-vif-plugged", "status": "completed", "tag": "cb3ff488-84ae-4924-b533-f4badee99c0f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:44.292639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b1e92c0e-6ff6-45b0-9c40-2f1e4b8e0dc1 req-35cd9ba1-24ff-43bb-b805-fa06583b6529 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:44.294293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b1e92c0e-6ff6-45b0-9c40-2f1e4b8e0dc1 req-35cd9ba1-24ff-43bb-b805-fa06583b6529 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:44.295542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b1e92c0e-6ff6-45b0-9c40-2f1e4b8e0dc1 req-35cd9ba1-24ff-43bb-b805-fa06583b6529 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:44.323031 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b1e92c0e-6ff6-45b0-9c40-2f1e4b8e0dc1 req-35cd9ba1-24ff-43bb-b805-fa06583b6529 service nova] Creating event network-vif-plugged:cb3ff488-84ae-4924-b533-f4badee99c0f for instance cb6beaa8-bc6e-4c04-b221-181d17058496 on n-h1-862876-2 Oct 28 13:34:44.355587 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b1e92c0e-6ff6-45b0-9c40-2f1e4b8e0dc1 req-35cd9ba1-24ff-43bb-b805-fa06583b6529 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107144 Oct 28 13:34:44.357820 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2911/5735] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:44.572000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:44.581711 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5d8ee6ee-1607-47cb-88ee-5b467be3fb91 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 0.374166 Oct 28 13:34:44.583642 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2825/5736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:44 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:44.746584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:44.747335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: f84d5e6a-5429-4e85-8595-b17f9dcf17b5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:44.755253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:44.755761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:44.756213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:44.756982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:44.757458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:44.757881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:44.784756 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 could not be found. Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 HTTP/1.1 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 could not be found. Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f84d5e6a-5429-4e85-8595-b17f9dcf17b5'} Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 could not be found. Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 could not be found. Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:44.786897 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 could not be found. Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 404 to user: Instance f84d5e6a-5429-4e85-8595-b17f9dcf17b5 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6d195f6a-ce4d-45ad-8609-1256e7864caa tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5" status: 404 len: 111 microversion: 2.1 time: 0.051717 Oct 28 13:34:44.797045 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2912/5737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:44 2022] GET /compute/v2.1/servers/f84d5e6a-5429-4e85-8595-b17f9dcf17b5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:44.804361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:44.804876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:44.812006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:44.813011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:44.813459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:44.814172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:44.814637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:44.815094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:44.877319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:34:45.224314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:45.227110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:45.247575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:45.256566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:45.258264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:45.259133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:45.261880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:45.275239 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6696b577-4d76-466c-8511-39e8c35d530b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 204 len: 0 microversion: 2.1 time: 0.470580 Oct 28 13:34:45.277112 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2826/5738] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:34:44 2022] DELETE /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:34:45.284952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:45.294571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:45.300614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:45.328851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:45.341028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:45.341530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:45.342314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:45.342773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:45.343247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:45.632141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:45.649002 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-926d0281-750d-4c5c-8f9e-bdf0bda5e468 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.438657 Oct 28 13:34:45.650071 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2913/5739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:45 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:45.655960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:45.656885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:45.673288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:45.673871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:45.674564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:45.678163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:45.679105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:45.679840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:45.811143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:45.821229 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25314ac2-532e-441a-8ab2-c1391ad2cf1b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.539322 Oct 28 13:34:45.834910 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2827/5740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:45 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:45.946689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:45.957128 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5560175-4a2f-4dba-b8b6-0ee723573b44 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1313 microversion: 2.1 time: 0.305388 Oct 28 13:34:45.958042 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2914/5741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:45 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:46.675461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:46.676482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:46.690164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:46.695412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:46.696159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:46.697141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:46.697857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:46.703444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:46.847989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:46.848591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:46.871943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:46.872472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:46.872921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:46.873628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:46.874087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:46.879163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:47.198724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:47.214046 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74bdf100-ac11-418e-a526-cad4e7ffe0b5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.543109 Oct 28 13:34:47.216843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2828/5742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:46 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:47.226440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:47.240239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:47.260894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:47.261794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:47.271574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:47.275199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:47.275689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:47.276125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:47.317034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:47.327251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9969f4c9-ef08-4406-9172-ad62d54441e5 tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.483996 Oct 28 13:34:47.330706 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2915/5743] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:46 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:48.257197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:48.258262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:48.277874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:48.280787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:48.281499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:48.283637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:48.288066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:48.288812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:48.361273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:48.383247 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce406058-b296-41b5-883f-09ca0f5101fc tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1497 microversion: 2.1 time: 1.162043 Oct 28 13:34:48.388753 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2829/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:47 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1497 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:48.405525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:48.418176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:48.436347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:48.445936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:48.448486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:48.453782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:48.455224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:48.465325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:48.569497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:48.582758 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1eb34b83-8ed1-4d4c-9fe8-c69707b197c7 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.343480 Oct 28 13:34:48.586893 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2916/5745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:48 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:48.600180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-843b7569-0a10-4d02-b282-5a3f3bf8555b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:48.632206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.server_groups [None req-843b7569-0a10-4d02-b282-5a3f3bf8555b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Querying cell 449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) for 1 instances {{(pid=127793) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 13:34:48.633202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-843b7569-0a10-4d02-b282-5a3f3bf8555b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:48.634023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-843b7569-0a10-4d02-b282-5a3f3bf8555b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:48.634705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-843b7569-0a10-4d02-b282-5a3f3bf8555b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:48.663153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:48.686564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-843b7569-0a10-4d02-b282-5a3f3bf8555b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/7050eead-7786-465f-ad1b-bbf25f16c008" status: 200 len: 222 microversion: 2.1 time: 0.096847 Oct 28 13:34:48.687271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2917/5746] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:34:48 2022] GET /compute/v2.1/os-server-groups/7050eead-7786-465f-ad1b-bbf25f16c008 => generated 222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:48.698493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:48.701630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:48.716926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:48.717714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:48.719216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:48.721582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:48.723455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:48.725052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:48.782182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:34:49.046267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:49.066872 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7d3a2fe-6585-4bf8-99b5-62757909240c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1522 microversion: 2.1 time: 0.676912 Oct 28 13:34:49.069766 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2830/5747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:48 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1522 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:49.177622 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f665d8be-8180-4e23-968a-53d803f1b25f tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 204 len: 0 microversion: 2.1 time: 0.482048 Oct 28 13:34:49.178951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2918/5748] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:34:48 2022] DELETE /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:34:49.187526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:49.189273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:49.201371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:49.202240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:49.202992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:49.207501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:49.208268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:49.210006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:49.615200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:49.617001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:49.646018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:49.658235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:49.659011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:49.659962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:49.660596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:49.662444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:49.914836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:49.927474 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-34e4ef68-0b4b-4c18-9056-81dc1431cb99 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1503 microversion: 2.1 time: 0.744212 Oct 28 13:34:49.929329 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2831/5749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:49 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1503 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:49.934599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e341cbe5-1959-4461-a7b2-3916bf5c3a35 req-db661d49-0ec0-4a37-8fa4-eb200a8521a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc0c05a-ae51-4799-bfa7-8321c75a7bb1", "name": "network-vif-deleted", "tag": "98989e25-0295-479a-b6db-9849c0cf340f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:49.987478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e341cbe5-1959-4461-a7b2-3916bf5c3a35 req-db661d49-0ec0-4a37-8fa4-eb200a8521a6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:49.987976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e341cbe5-1959-4461-a7b2-3916bf5c3a35 req-db661d49-0ec0-4a37-8fa4-eb200a8521a6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:50.003572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e341cbe5-1959-4461-a7b2-3916bf5c3a35 req-db661d49-0ec0-4a37-8fa4-eb200a8521a6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:50.018552 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e341cbe5-1959-4461-a7b2-3916bf5c3a35 req-db661d49-0ec0-4a37-8fa4-eb200a8521a6 service nova] Creating event network-vif-deleted:98989e25-0295-479a-b6db-9849c0cf340f for instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 on n-h2-862876-2 Oct 28 13:34:50.049511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e341cbe5-1959-4461-a7b2-3916bf5c3a35 req-db661d49-0ec0-4a37-8fa4-eb200a8521a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118635 Oct 28 13:34:50.064115 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2832/5750] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:50.097783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:50.098895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:50.116454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:50.118248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:50.120422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:50.126298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:50.127074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:50.130250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:50.135587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:50.149408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48e526ad-0436-4f0e-b191-c18b07d2cc29 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.540491 Oct 28 13:34:50.151376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2919/5751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:49 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:50.263493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:50.288438 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-950f9f7b-dec5-4634-bd2d-47cd35e82daf tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1306 microversion: 2.1 time: 0.195402 Oct 28 13:34:50.292986 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2833/5752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:50 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:50.958577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:50.959327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:50.974828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:50.982945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:50.983612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:50.984418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:50.984897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:50.985645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:51.180510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:51.182390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:51.200334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:51.200334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:51.200334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:51.200334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:51.200334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:51.200334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:51.262998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:51.274104 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0826bb4-e87b-4a0d-a99c-6b13853200de tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1503 microversion: 2.1 time: 0.323513 Oct 28 13:34:51.290860 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2920/5753] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:50 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:51.319897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:51.320910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:51.334053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:51.334485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:51.335060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:51.337942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:51.338701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:51.339291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:51.426090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:51.426690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:51.427565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:51.431503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lazy-loading 'fault' on Instance uuid 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:34:51.498100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65484989d170478c88a1ff8a1f378b2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c35af71a13b4eabbb2c5f021ee5c983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:51.512298 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70776efa-e902-449f-8431-f9a8f7ca391c tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 200 len: 1311 microversion: 2.1 time: 0.197885 Oct 28 13:34:51.513963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2921/5754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:51 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 1311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:51.580578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:51.602067 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e70d7e62-e2f0-4504-a8c9-631b5872520a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.426591 Oct 28 13:34:51.624390 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2834/5755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:51 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:34:52.132931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5812c548-88a5-47ed-91d2-daf8236a7766 req-e91eabe7-338a-46ce-a6b0-f1a5b8693379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6beaa8-bc6e-4c04-b221-181d17058496", "name": "network-vif-deleted", "tag": "cb3ff488-84ae-4924-b533-f4badee99c0f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:52.152205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5812c548-88a5-47ed-91d2-daf8236a7766 req-e91eabe7-338a-46ce-a6b0-f1a5b8693379 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.153631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5812c548-88a5-47ed-91d2-daf8236a7766 req-e91eabe7-338a-46ce-a6b0-f1a5b8693379 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.178244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5812c548-88a5-47ed-91d2-daf8236a7766 req-e91eabe7-338a-46ce-a6b0-f1a5b8693379 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:52.215644 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5812c548-88a5-47ed-91d2-daf8236a7766 req-e91eabe7-338a-46ce-a6b0-f1a5b8693379 service nova] Creating event network-vif-deleted:cb3ff488-84ae-4924-b533-f4badee99c0f for instance cb6beaa8-bc6e-4c04-b221-181d17058496 on n-h1-862876-2 Oct 28 13:34:52.233543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5812c548-88a5-47ed-91d2-daf8236a7766 req-e91eabe7-338a-46ce-a6b0-f1a5b8693379 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101620 Oct 28 13:34:52.234854 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2922/5756] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:52.297795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:52.298435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:52.313471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.313968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.314404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:52.315165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.315622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.316045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:52.372865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.373443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.373985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:52.374576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lazy-loading 'fault' on Instance uuid cb6beaa8-bc6e-4c04-b221-181d17058496 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:34:52.429796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f7dcd0b84b4a759cbdfbbdf6780e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15a912f681484db97410d704abd49a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:52.438154 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9ff94e5d-a88b-4b75-81bb-ab8f6fd940db tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 200 len: 1303 microversion: 2.1 time: 0.144504 Oct 28 13:34:52.438734 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2835/5757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:52 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:52.541864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:52.543512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] [instance: 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:52.555667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.564965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.572079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:52.572079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.572079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.572079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:52.586633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] HTTP exception thrown: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 could not be found. Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Request method failure captured: Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 HTTP/1.1 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9lMHC_cvTDIt84yag1K8IdwnE_JakAE9eTxZz8-03rIL2nSTZzaKpNL9LFkP7F_TtMK-jX1Zt3AjT9A5CS_n7apSetf40rsIrx1IITAA1zwMiCmTqSZuEajoXhAhlmT3HMAzFZXWKmBzcSMr6pHKxlBsn9iIJkzIK7aRbUAYEn_1Ho Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6c35af71a13b4eabbb2c5f021ee5c983", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6c35af71a13b4eabbb2c5f021ee5c983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6c35af71a13b4eabbb2c5f021ee5c983 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1190462904 Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 65484989d170478c88a1ff8a1f378b2a Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1190462904-project Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 could not be found. Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '5dc0c05a-ae51-4799-bfa7-8321c75a7bb1'} Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 could not be found. Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 could not be found. Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:52.588587 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 could not be found. Oct 28 13:34:52.593850 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:52.595433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] Returning 404 to user: Instance 5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:52.596309 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d54772b6-804b-4274-8a59-6275ee7cf68b tempest-ServerRescueNegativeTestJSON-1190462904 tempest-ServerRescueNegativeTestJSON-1190462904-project] 10.222.0.25 "GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1" status: 404 len: 111 microversion: 2.1 time: 0.062439 Oct 28 13:34:52.596891 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2923/5758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:52 2022] GET /compute/v2.1/servers/5dc0c05a-ae51-4799-bfa7-8321c75a7bb1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:52.638223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:52.638934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:52.653387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.653889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.654505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:52.656095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:52.656715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:52.657296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.002734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:53.012949 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-751e7170-037c-4bd2-b0d5-775020cd5a5a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1523 microversion: 2.1 time: 0.380826 Oct 28 13:34:53.015393 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2836/5759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:52 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:53.469828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.471500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:53.481749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.487336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.487336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.487336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.487336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.487336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.512781 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] HTTP exception thrown: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Request method failure captured: Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 HTTP/1.1 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9pctzOZ2Xopd1E7DwcWL4EGMl-QtjlJY5O23B9E9zJESJ-BCHqdJ_tp94AsR50dO9-yVZEyn4Xaa3A330rQOtdjzPZUmnBSzRuoJyQF1M6qNCVdbTaThK2HTKY1XNbbORIQAtm4zAUZaRi_PgNL5lAA6UFgnGuswDWiZfJbngT8gi0 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d15a912f681484db97410d704abd49a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d15a912f681484db97410d704abd49a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d7f7dcd0b84b4a759cbdfbbdf6780e21 Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'cb6beaa8-bc6e-4c04-b221-181d17058496'} Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.515449 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Returning 404 to user: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9826061c-1f1a-471d-a06c-673e9a493c8a tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 404 len: 111 microversion: 2.1 time: 0.052842 Oct 28 13:34:53.526127 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2924/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:53 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:53.531840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-24a311b2-3639-4bf5-94cc-68869beb4281 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.563811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:53.566219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:53.576184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.578261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.578261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.578261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.583251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.583800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.588160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.server_groups [None req-24a311b2-3639-4bf5-94cc-68869beb4281 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Querying cell 449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) for 1 instances {{(pid=127794) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 13:34:53.588953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24a311b2-3639-4bf5-94cc-68869beb4281 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.589439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24a311b2-3639-4bf5-94cc-68869beb4281 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.590048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24a311b2-3639-4bf5-94cc-68869beb4281 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.613693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-24a311b2-3639-4bf5-94cc-68869beb4281 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.087083 Oct 28 13:34:53.621585 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2837/5761] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:34:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:53.633690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9d577d42-2e26-4782-830a-727235226ff6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.664163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.server_groups [None req-9d577d42-2e26-4782-830a-727235226ff6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Querying cell 449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) for 1 instances {{(pid=127794) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 13:34:53.664899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d577d42-2e26-4782-830a-727235226ff6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.665442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d577d42-2e26-4782-830a-727235226ff6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.665885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d577d42-2e26-4782-830a-727235226ff6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.679202 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9d577d42-2e26-4782-830a-727235226ff6 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/7050eead-7786-465f-ad1b-bbf25f16c008" status: 200 len: 184 microversion: 2.1 time: 0.054609 Oct 28 13:34:53.680252 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2838/5762] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Oct 28 13:34:53 2022] GET /compute/v2.1/os-server-groups/7050eead-7786-465f-ad1b-bbf25f16c008 => generated 184 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:34:53.683242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5b33646-c3ee-444e-99be-8914c1441ddb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action" status: 200 len: 24569 microversion: 2.1 time: 0.122855 Oct 28 13:34:53.686114 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2925/5763] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:34:53 2022] POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action => generated 24569 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:34:53.692127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.693604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:53.701333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.702210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.704144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.705000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.705544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.706068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.722329 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] HTTP exception thrown: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Request method failure captured: Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 HTTP/1.1 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9pctzOZ2Xopd1E7DwcWL4EGMl-QtjlJY5O23B9E9zJESJ-BCHqdJ_tp94AsR50dO9-yVZEyn4Xaa3A330rQOtdjzPZUmnBSzRuoJyQF1M6qNCVdbTaThK2HTKY1XNbbORIQAtm4zAUZaRi_PgNL5lAA6UFgnGuswDWiZfJbngT8gi0 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d15a912f681484db97410d704abd49a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d15a912f681484db97410d704abd49a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d7f7dcd0b84b4a759cbdfbbdf6780e21 Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'cb6beaa8-bc6e-4c04-b221-181d17058496'} Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:34:53.724329 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Returning 404 to user: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-64539bca-39c5-4d1d-94c6-c72c6b6916b3 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 404 len: 111 microversion: 2.1 time: 0.037684 Oct 28 13:34:53.729301 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2839/5764] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:34:53 2022] DELETE /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:53.743123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.744380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] [instance: cb6beaa8-bc6e-4c04-b221-181d17058496] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:53.754861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.755613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.757262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.757262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:53.757827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:53.758498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:53.777983 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] HTTP exception thrown: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Request method failure captured: Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 HTTP/1.1 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9pctzOZ2Xopd1E7DwcWL4EGMl-QtjlJY5O23B9E9zJESJ-BCHqdJ_tp94AsR50dO9-yVZEyn4Xaa3A330rQOtdjzPZUmnBSzRuoJyQF1M6qNCVdbTaThK2HTKY1XNbbORIQAtm4zAUZaRi_PgNL5lAA6UFgnGuswDWiZfJbngT8gi0 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d15a912f681484db97410d704abd49a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d15a912f681484db97410d704abd49a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d7f7dcd0b84b4a759cbdfbbdf6780e21 Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'cb6beaa8-bc6e-4c04-b221-181d17058496'} Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.780946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Returning 404 to user: Instance cb6beaa8-bc6e-4c04-b221-181d17058496 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a905d8a-5e99-4ec8-a4b8-f67d6c1a89c1 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496" status: 404 len: 111 microversion: 2.1 time: 0.052931 Oct 28 13:34:53.793495 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2926/5765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:53 2022] GET /compute/v2.1/servers/cb6beaa8-bc6e-4c04-b221-181d17058496 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:53.798412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccc156bd-9103-46b3-a8f1-6b1c57ce57d5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.806125 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ccc156bd-9103-46b3-a8f1-6b1c57ce57d5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] HTTP exception thrown: Instance group 9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 could not be found. Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccc156bd-9103-46b3-a8f1-6b1c57ce57d5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Request method failure captured: Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-server-groups/9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 HTTP/1.1 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9pctzOZ2Xopd1E7DwcWL4EGMl-QtjlJY5O23B9E9zJESJ-BCHqdJ_tp94AsR50dO9-yVZEyn4Xaa3A330rQOtdjzPZUmnBSzRuoJyQF1M6qNCVdbTaThK2HTKY1XNbbORIQAtm4zAUZaRi_PgNL5lAA6UFgnGuswDWiZfJbngT8gi0 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d15a912f681484db97410d704abd49a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d15a912f681484db97410d704abd49a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d7f7dcd0b84b4a759cbdfbbdf6780e21 Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance group 9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 could not be found. Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2'} Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 could not be found. Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 could not be found. Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.809331 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 could not be found. Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccc156bd-9103-46b3-a8f1-6b1c57ce57d5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Returning 404 to user: Instance group 9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:53.814099 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ccc156bd-9103-46b3-a8f1-6b1c57ce57d5 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2" status: 404 len: 117 microversion: 2.1 time: 0.020315 Oct 28 13:34:53.816045 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2840/5766] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:53 2022] DELETE /compute/v2.1/os-server-groups/9bbff0ee-5364-4c4d-a9fe-cf238ae59ef2 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:53.821806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67285696-e297-4d83-99f8-f8ec12918089 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.829579 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-67285696-e297-4d83-99f8-f8ec12918089 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] HTTP exception thrown: Instance group 437d65e6-b75a-40fc-9a3a-77cf44f65cb8 could not be found. Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67285696-e297-4d83-99f8-f8ec12918089 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Request method failure captured: Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-server-groups/437d65e6-b75a-40fc-9a3a-77cf44f65cb8 HTTP/1.1 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9pctzOZ2Xopd1E7DwcWL4EGMl-QtjlJY5O23B9E9zJESJ-BCHqdJ_tp94AsR50dO9-yVZEyn4Xaa3A330rQOtdjzPZUmnBSzRuoJyQF1M6qNCVdbTaThK2HTKY1XNbbORIQAtm4zAUZaRi_PgNL5lAA6UFgnGuswDWiZfJbngT8gi0 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d15a912f681484db97410d704abd49a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d15a912f681484db97410d704abd49a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d7f7dcd0b84b4a759cbdfbbdf6780e21 Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance group 437d65e6-b75a-40fc-9a3a-77cf44f65cb8 could not be found. Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '437d65e6-b75a-40fc-9a3a-77cf44f65cb8'} Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 437d65e6-b75a-40fc-9a3a-77cf44f65cb8 could not be found. Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 437d65e6-b75a-40fc-9a3a-77cf44f65cb8 could not be found. Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.831378 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.837071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.837071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.837071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:53.837071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:53.837071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 437d65e6-b75a-40fc-9a3a-77cf44f65cb8 could not be found. Oct 28 13:34:53.837071 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.839873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67285696-e297-4d83-99f8-f8ec12918089 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Returning 404 to user: Instance group 437d65e6-b75a-40fc-9a3a-77cf44f65cb8 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:53.841043 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-67285696-e297-4d83-99f8-f8ec12918089 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/437d65e6-b75a-40fc-9a3a-77cf44f65cb8" status: 404 len: 117 microversion: 2.1 time: 0.023907 Oct 28 13:34:53.842168 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2927/5767] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:53 2022] DELETE /compute/v2.1/os-server-groups/437d65e6-b75a-40fc-9a3a-77cf44f65cb8 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:53.851508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a505f863-cda5-4481-a6f6-cd7e49a78172 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.860103 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a505f863-cda5-4481-a6f6-cd7e49a78172 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] HTTP exception thrown: Instance group c9529e08-ef5e-4b90-a56b-31cbd672a78e could not be found. Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a505f863-cda5-4481-a6f6-cd7e49a78172 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Request method failure captured: Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-server-groups/c9529e08-ef5e-4b90-a56b-31cbd672a78e HTTP/1.1 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9pctzOZ2Xopd1E7DwcWL4EGMl-QtjlJY5O23B9E9zJESJ-BCHqdJ_tp94AsR50dO9-yVZEyn4Xaa3A330rQOtdjzPZUmnBSzRuoJyQF1M6qNCVdbTaThK2HTKY1XNbbORIQAtm4zAUZaRi_PgNL5lAA6UFgnGuswDWiZfJbngT8gi0 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d15a912f681484db97410d704abd49a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d15a912f681484db97410d704abd49a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: d7f7dcd0b84b4a759cbdfbbdf6780e21 Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance group c9529e08-ef5e-4b90-a56b-31cbd672a78e could not be found. Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'c9529e08-ef5e-4b90-a56b-31cbd672a78e'} Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c9529e08-ef5e-4b90-a56b-31cbd672a78e could not be found. Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c9529e08-ef5e-4b90-a56b-31cbd672a78e could not be found. Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.873984 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c9529e08-ef5e-4b90-a56b-31cbd672a78e could not be found. Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a505f863-cda5-4481-a6f6-cd7e49a78172 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Returning 404 to user: Instance group c9529e08-ef5e-4b90-a56b-31cbd672a78e could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a505f863-cda5-4481-a6f6-cd7e49a78172 tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/c9529e08-ef5e-4b90-a56b-31cbd672a78e" status: 404 len: 117 microversion: 2.1 time: 0.030234 Oct 28 13:34:53.884254 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2841/5768] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:53 2022] DELETE /compute/v2.1/os-server-groups/c9529e08-ef5e-4b90-a56b-31cbd672a78e => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:34:53.890860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7355677f-5525-4c6b-8faf-d5f9af105c2d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.900083 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7355677f-5525-4c6b-8faf-d5f9af105c2d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] HTTP exception thrown: Instance group 18ed5d97-626f-47dc-acd8-c6782858c216 could not be found. Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7355677f-5525-4c6b-8faf-d5f9af105c2d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Request method failure captured: Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-server-groups/18ed5d97-626f-47dc-acd8-c6782858c216 HTTP/1.1 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9pctzOZ2Xopd1E7DwcWL4EGMl-QtjlJY5O23B9E9zJESJ-BCHqdJ_tp94AsR50dO9-yVZEyn4Xaa3A330rQOtdjzPZUmnBSzRuoJyQF1M6qNCVdbTaThK2HTKY1XNbbORIQAtm4zAUZaRi_PgNL5lAA6UFgnGuswDWiZfJbngT8gi0 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d15a912f681484db97410d704abd49a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d15a912f681484db97410d704abd49a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d15a912f681484db97410d704abd49a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 7d15a912f681484db97410d704abd49a Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerGroupTestJSON-754525699 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: d7f7dcd0b84b4a759cbdfbbdf6780e21 Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerGroupTestJSON-754525699-project Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance group 18ed5d97-626f-47dc-acd8-c6782858c216 could not be found. Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '18ed5d97-626f-47dc-acd8-c6782858c216'} Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 18ed5d97-626f-47dc-acd8-c6782858c216 could not be found. Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 18ed5d97-626f-47dc-acd8-c6782858c216 could not be found. Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.901687 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 18ed5d97-626f-47dc-acd8-c6782858c216 could not be found. Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7355677f-5525-4c6b-8faf-d5f9af105c2d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Returning 404 to user: Instance group 18ed5d97-626f-47dc-acd8-c6782858c216 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7355677f-5525-4c6b-8faf-d5f9af105c2d tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/18ed5d97-626f-47dc-acd8-c6782858c216" status: 404 len: 117 microversion: 2.1 time: 0.016982 Oct 28 13:34:53.911397 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2928/5769] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:53 2022] DELETE /compute/v2.1/os-server-groups/18ed5d97-626f-47dc-acd8-c6782858c216 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:34:53.913739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62f8ccfd-e71e-495e-b100-a9189925618b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:53.936498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:54.054150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:54.054824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:54.065124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:54.066153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:54.066857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:54.067989 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62f8ccfd-e71e-495e-b100-a9189925618b tempest-ServerGroupTestJSON-754525699 tempest-ServerGroupTestJSON-754525699-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/7050eead-7786-465f-ad1b-bbf25f16c008" status: 204 len: 0 microversion: 2.1 time: 0.158174 Oct 28 13:34:54.068654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:54.069398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:54.070043 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2842/5770] 10.222.0.25 () {58 vars in 1266 bytes} [Fri Oct 28 13:34:53 2022] DELETE /compute/v2.1/os-server-groups/7050eead-7786-465f-ad1b-bbf25f16c008 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:34:54.070312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:54.442820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:54.459739 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4d3636be-5b70-405e-b3f2-de3c47a68d52 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1505 microversion: 2.1 time: 0.419389 Oct 28 13:34:54.460456 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2929/5771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:54 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:55.492927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:55.494212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:55.525018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:55.525525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:55.525959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:55.526678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:55.527166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:55.527634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:55.530553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:34:55.868410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:55.878537 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-19b2081b-2285-474b-a086-0790ab7b79d4 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1505 microversion: 2.1 time: 0.392425 Oct 28 13:34:55.880292 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2843/5772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:55 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:56.906928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:56.907728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:56.921433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:56.928470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:56.929200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:56.930089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:56.930671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:56.931219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:57.310842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-df17213a-9a77-4baa-a3e1-88efef430fec req-83188ae5-b0e9-42ae-afd9-ef38fbb05921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e061c84-d890-4b90-9717-128de818f090", "name": "network-vif-unplugged", "status": "completed", "tag": "eaf68681-0800-44e9-bc3b-de2159a53814"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:34:57.347384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-df17213a-9a77-4baa-a3e1-88efef430fec req-83188ae5-b0e9-42ae-afd9-ef38fbb05921 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:57.352159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-df17213a-9a77-4baa-a3e1-88efef430fec req-83188ae5-b0e9-42ae-afd9-ef38fbb05921 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:57.352159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-df17213a-9a77-4baa-a3e1-88efef430fec req-83188ae5-b0e9-42ae-afd9-ef38fbb05921 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:57.408086 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-df17213a-9a77-4baa-a3e1-88efef430fec req-83188ae5-b0e9-42ae-afd9-ef38fbb05921 service nova] Creating event network-vif-unplugged:eaf68681-0800-44e9-bc3b-de2159a53814 for instance 0e061c84-d890-4b90-9717-128de818f090 on n-h1-862876-2 Oct 28 13:34:57.426508 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-df17213a-9a77-4baa-a3e1-88efef430fec req-83188ae5-b0e9-42ae-afd9-ef38fbb05921 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118919 Oct 28 13:34:57.428127 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2844/5773] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:34:58.274721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:34:58.286861 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b8e6c63-91cc-4819-90b1-8b4ba494a421 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1505 microversion: 2.1 time: 1.386261 Oct 28 13:34:58.287936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2930/5774] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:56 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1505 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:34:59.316033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:34:59.316749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:34:59.328841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:59.329583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:59.330184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:34:59.331205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:34:59.331838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:34:59.332585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:00.011782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:00.012410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:00.028045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:00.031863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:00.036515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:00.043015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:00.044048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:00.044701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:00.045337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:00.111053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:00.125429 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c43b9256-fd41-4fc4-b83a-a10a9f930eab tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 200 len: 1448 microversion: 2.1 time: 0.815208 Oct 28 13:35:00.131180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2845/5775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:34:59 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 1448 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:00.149036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:00.149829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:00.159236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:00.159947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:00.160544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:00.161675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:00.162366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:00.163053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:00.201405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:35:00.209428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.compute.api [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Working on deleting snapshot 6154f43c-d9cc-4085-ba0d-4304d1724e6b from shelved instance... Oct 28 13:35:00.540096 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2f97b2c-31e4-498e-9bd7-c1c243b42285 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1834 microversion: 2.1 time: 0.533053 Oct 28 13:35:00.541365 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2931/5776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:00 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1834 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:00.578458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:00.579576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:00.590407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:00.592286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:00.595465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:00.596601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:00.606612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:00.607340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:01.407939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:01.419110 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-05049365-ccff-47ec-aa0c-8db0d8f0eab8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1683 microversion: 2.1 time: 0.850097 Oct 28 13:35:01.442890 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2932/5777] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:00 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1683 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:01.672211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:01.674708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:01.686002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:01.687081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:01.687529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:01.688238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:01.688696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:01.689120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:01.777872 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c81a220-632a-4666-9eb2-d79c56933e64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action" status: 200 len: 32644 microversion: 2.1 time: 0.110461 Oct 28 13:35:01.786010 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2933/5778] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:35:01 2022] POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action => generated 32644 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:35:01.958232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:01.960298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:01.996384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:02.000121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:02.002336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:02.006291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:02.007602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:02.010728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:02.079994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd3e41af9d3c4502ad7e0d95c62be43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de72f802cbe2440187ac424eb389eb51', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:02.081037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] flavor_id is None. Assuming migration. {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 13:35:02.081796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 13:35:02.411504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Doing local delete in cell 449af092-e0dd-4ca5-9b08-6f21fe3ed78d(cell1) {{(pid=127794) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 13:35:02.412240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:02.412735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:02.413179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:02.413851 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.compute.api [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 13:35:02.417978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] deallocate_for_instance() {{(pid=127794) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 13:35:02.463724 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f917bfc9-f5a1-434d-badd-759ac0bc13a2 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action" status: 202 len: 0 microversion: 2.1 time: 0.516714 Oct 28 13:35:02.465295 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2934/5779] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:35:01 2022] POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:35:02.479910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:02.480836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:02.489936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:02.490634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:02.491285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:02.492574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:02.493236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:02.493919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:02.776356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:02.787924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7da15c58-2601-46af-96da-124abcbfd24c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1692 microversion: 2.1 time: 0.310311 Oct 28 13:35:02.788558 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2935/5780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:02 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1692 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:03.391500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Updating instance_info_cache with network_info: [] {{(pid=127794) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 13:35:03.633440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d4f5bd8e-fd6a-4258-bae9-d3c9d5941f1b req-dfa421c2-bd8f-4b70-a518-94702c3bb7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e061c84-d890-4b90-9717-128de818f090", "name": "network-vif-deleted", "tag": "eaf68681-0800-44e9-bc3b-de2159a53814"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:03.665943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4f5bd8e-fd6a-4258-bae9-d3c9d5941f1b req-dfa421c2-bd8f-4b70-a518-94702c3bb7a5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:03.667851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4f5bd8e-fd6a-4258-bae9-d3c9d5941f1b req-dfa421c2-bd8f-4b70-a518-94702c3bb7a5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:03.668549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4f5bd8e-fd6a-4258-bae9-d3c9d5941f1b req-dfa421c2-bd8f-4b70-a518-94702c3bb7a5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:03.681056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:03.709588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.server_external_events [req-d4f5bd8e-fd6a-4258-bae9-d3c9d5941f1b req-dfa421c2-bd8f-4b70-a518-94702c3bb7a5 service nova] Unable to find a host for instance 0e061c84-d890-4b90-9717-128de818f090. Dropping event network-vif-deleted {{(pid=127793) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 13:35:03.710580 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d4f5bd8e-fd6a-4258-bae9-d3c9d5941f1b req-dfa421c2-bd8f-4b70-a518-94702c3bb7a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.379296 Oct 28 13:35:03.715751 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2936/5781] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 385 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 13:35:03.812599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:03.813239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:03.824542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:03.825057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:03.825508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:03.826290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:03.826691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:03.827781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:04.109823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:04.123866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a7eb3d94-4fdd-4e8b-9b05-48635852814c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1692 microversion: 2.1 time: 0.315881 Oct 28 13:35:04.126307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2937/5782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:03 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1692 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:04.326290 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d76c7b02-e7be-495f-8d95-1920e47b28b2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 204 len: 0 microversion: 2.1 time: 4.181675 Oct 28 13:35:04.327786 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2846/5783] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:35:00 2022] DELETE /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 0 bytes in 4184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:35:04.339990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:04.340617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:04.363221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:04.369059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:04.371156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:04.371882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:04.372353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:04.372785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:04.392489 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 HTTP/1.1 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '0e061c84-d890-4b90-9717-128de818f090'} Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:35:04.394483 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:04.399505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:35:04.399505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:35:04.399505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:35:04.399505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:35:04.399505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:35:04.399505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:35:04.399505 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:04.401967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:35:04.403141 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-775773f9-b218-4044-8ab6-58393885654f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 404 len: 111 microversion: 2.1 time: 0.067813 Oct 28 13:35:04.408039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2938/5784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:04 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:35:04.650975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-410101709", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f6719c5f-6a3e-4187-8df7-d08ef3f7deb2"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:04.714349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] validate_networks() for [('f6719c5f-6a3e-4187-8df7-d08ef3f7deb2', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:35:05.152700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:05.153381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:05.162637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:05.164000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:05.164700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:05.165649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:05.166259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:05.166979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:05.214737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:35:05.215718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:35:05.216499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:35:05.217108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:35:05.219238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:35:05.232601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:05.233100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:05.236630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:05.239775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:05.240495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:05.246606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:05.286200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:35:05.297031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for user ba2dd748101e4b3492c9bea6a26cea14 and project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:35:05.314277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:35:05.317290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:35:05.416302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:05.431461 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-562c9e60-201d-4f6e-8ed5-3df0e6bacd85 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1692 microversion: 2.1 time: 0.285447 Oct 28 13:35:05.446429 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2939/5785] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:05 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1692 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:05.478348 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5e23c290-091b-40bb-978d-afc4580bc8a1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832202 Oct 28 13:35:05.484653 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2847/5786] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:35:05.496903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dcbb037d-a8c8-4618-b838-88c52a762d6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:05.497541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dcbb037d-a8c8-4618-b838-88c52a762d6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:05.617032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dcbb037d-a8c8-4618-b838-88c52a762d6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:05.625794 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dcbb037d-a8c8-4618-b838-88c52a762d6a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1214 microversion: 2.1 time: 0.134653 Oct 28 13:35:05.626762 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2940/5787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:05 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:06.473953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:06.477107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:06.497302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:06.497918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:06.498239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:06.499606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:06.503863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:06.504334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:06.652223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:06.652999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:06.676296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:06.679131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:06.681723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:06.681723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:06.685088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:06.685629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:06.773164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:06.787691 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3f017c79-679b-405c-b668-38bd8deac952 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1692 microversion: 2.1 time: 0.333987 Oct 28 13:35:06.810298 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2848/5788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:06 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1692 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:06.849169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:06.859761 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-539bbf6e-3058-4be3-942c-27830fb19da2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1218 microversion: 2.1 time: 0.212585 Oct 28 13:35:06.884333 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2941/5789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:06 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:07.817550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:07.819374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:07.829299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:07.830079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:07.830701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:07.831608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:07.832232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:07.832679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:07.889126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:07.890305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:07.906978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:07.907891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:07.908603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:07.909472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:07.910004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:07.910438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:08.198241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:08.210226 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ef745be-3b42-44e4-9050-8fca653311c0 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 0.395571 Oct 28 13:35:08.239191 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2849/5790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:07 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:08.359273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:08.445410 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c9bc1275-c81b-4658-ad99-14a834713726 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1266 microversion: 2.1 time: 0.560382 Oct 28 13:35:08.448969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2942/5791] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:07 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1266 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:09.271543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:09.272467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:09.305342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:09.306174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:09.307082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:09.308034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:09.309081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:09.309742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:09.482288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:09.483835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:09.501882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:09.504733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:09.506537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:09.508311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:09.510341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:09.511794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:10.480856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:10.480856 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5781ff19-25ea-4652-baab-cd27d0b6ae10 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1272 microversion: 2.1 time: 0.811143 Oct 28 13:35:10.480856 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2943/5792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:09 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1272 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:11.323139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:11.324425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:11.344190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:11.350940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:11.350940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:11.350940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:11.350940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:11.350940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:11.419819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:11.439561 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-701b9d81-9d8d-4a75-846a-d29a70209370 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 2.172420 Oct 28 13:35:11.453496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2850/5793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:09 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:11.725375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:11.739806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe1f22c2-112d-4ab6-9372-213fb3cb06dc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.419522 Oct 28 13:35:11.740354 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2944/5794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:11 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:12.466230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:12.467054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:12.481538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:12.482265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:12.482909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:12.486782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:12.487414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:12.488201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:12.761212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-55809f90-ed83-47a4-b33c-79d10684e5bd req-3f73a43c-d1ab-438e-aee0-ad3799472dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec2eee6-9121-4d27-bea1-873346cc1e79", "tag": "6d729abf-0823-4e2b-8504-926a78591b6c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:12.803148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-55809f90-ed83-47a4-b33c-79d10684e5bd req-3f73a43c-d1ab-438e-aee0-ad3799472dab service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:12.804087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-55809f90-ed83-47a4-b33c-79d10684e5bd req-3f73a43c-d1ab-438e-aee0-ad3799472dab service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:12.805867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-55809f90-ed83-47a4-b33c-79d10684e5bd req-3f73a43c-d1ab-438e-aee0-ad3799472dab service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:12.828235 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-55809f90-ed83-47a4-b33c-79d10684e5bd req-3f73a43c-d1ab-438e-aee0-ad3799472dab service nova] Creating event network-changed:6d729abf-0823-4e2b-8504-926a78591b6c for instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 on n-h1-862876-2 Oct 28 13:35:12.835952 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-55809f90-ed83-47a4-b33c-79d10684e5bd req-3f73a43c-d1ab-438e-aee0-ad3799472dab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080199 Oct 28 13:35:12.837337 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2945/5795] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:35:12.864046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:12.865759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:12.866252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:12.874348 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c6a94e9-ffcb-413f-a1f4-7f403ebde660 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 0.411821 Oct 28 13:35:12.878515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:12.879314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:12.879861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:12.880799 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2851/5796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:12 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:12.881632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:12.883461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:12.883994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:13.588571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:13.602044 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0e0e821f-1abf-40a7-b5ab-aa5541252944 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.763008 Oct 28 13:35:13.602798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2946/5797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:12 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:13.952872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:14.595196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:14.613287 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-231d3f2f-3f62-4809-9dde-18f64223e28a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 0.713255 Oct 28 13:35:14.635049 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2852/5798] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:13 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:14.642249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:14.642249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:14.656388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:14.658217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:14.663742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:14.664655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:14.665208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:14.667500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:14.882221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:14.892089 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-418211c3-fae4-4f9d-83c1-177918c568aa tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.263570 Oct 28 13:35:14.893274 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2947/5799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:14 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:15.642464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:15.642879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:15.653016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:15.655879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:15.658608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:15.660757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:15.663277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:15.667357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:15.667357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:15.667357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:15.925091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:15.926329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:15.944552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:15.951416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:15.953178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:15.956053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:15.958705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:15.958705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:15.958705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:16.474482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:16.487730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-67332ecc-037a-488f-a438-985412f27987 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.565964 Oct 28 13:35:16.488805 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2948/5800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:15 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:16.682192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:16.703390 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-56028638-4593-4032-a654-196e9083b298 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 1.064738 Oct 28 13:35:16.704867 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2853/5801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:15 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:17.516320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:17.517700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:17.527814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:17.528553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:17.529156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:17.531077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:17.531706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:17.532284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:17.729626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:17.730454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:17.743824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:17.744914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:17.746017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:17.748469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:17.750207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:17.755366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:18.052228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:18.064451 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b17f6e2a-dfb6-4c93-acc3-a43adbcb497d tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.552423 Oct 28 13:35:18.069021 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2949/5802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:17 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:18.397625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:18.404259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:18.415742 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bb2e7510-c4e1-4ed0-8b71-e19127cf9bda tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 0.689991 Oct 28 13:35:18.417736 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2854/5803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:17 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:19.098051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:19.120117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:19.145371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:19.146489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:19.148024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:19.149445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:19.150102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:19.150988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:19.457268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:19.458653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:19.483529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:19.484035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:19.484476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:19.485191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:19.500052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:19.500244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:19.500746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:19.512555 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-13fe062a-b59a-4bf1-8da9-eafc8a1e303e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.418191 Oct 28 13:35:19.513735 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2950/5804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:19 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:20.539576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:20.547010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:20.554452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:20.555311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:20.555922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:20.557430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:20.558389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:20.559208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:20.559649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:20.569529 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9833d4d4-8088-4c4b-becf-9b5956eb3143 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 1.128147 Oct 28 13:35:20.592791 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2855/5805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:19 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:20.878140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:20.910050 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b75a5be2-791e-44a7-a09b-676d62017b61 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.374520 Oct 28 13:35:20.914898 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2951/5806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:20 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:21.574850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a18c7ad6-7823-46a2-aeb5-f724a14d07ef tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'create', calling method: .version_select at 0x7f27b84ba790>, body: {"keypair": {"name": "tempest-keypair-1061610527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyNHGXU8ReyO4E+9UBAaMTHfYP+TQ7u50SP0E1b+0qrMX8cJqlS2iZ7MLOhLFZw70mJ9WPbknoFEfXuHhKoUrtyxAsqkjOLEOOERQgrFqaFImv4WLCILgqdS8YnDl5suA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:21.604445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:21.605074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:21.631045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a18c7ad6-7823-46a2-aeb5-f724a14d07ef tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for project a580b333d8b245b1a69b2b246b73abcc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:35:21.633581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:21.633581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:21.633581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:21.647898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a18c7ad6-7823-46a2-aeb5-f724a14d07ef tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for user ccf717948682481a87e008d912d4848c and project a580b333d8b245b1a69b2b246b73abcc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:35:21.650273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:21.659209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:21.660005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:21.758534 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a18c7ad6-7823-46a2-aeb5-f724a14d07ef tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.455705 Oct 28 13:35:21.759574 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2856/5807] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:35:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 457 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 13:35:21.942458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:21.944160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:21.965861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:21.973513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:21.976189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:21.977667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:21.979687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:21.980393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:22.174506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:22.221432 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 0.620569 Oct 28 13:35:22.221796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2952/5808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:21 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:22.567733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:22.581693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7af3ae6c-6e43-434d-bf30-564b27ef2e02 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.643791 Oct 28 13:35:22.589507 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2857/5809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:21 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:22.733293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:22.734394 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e441dc67-c79a-47c6-8a73-82314b52214f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001447 Oct 28 13:35:22.742904 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2953/5810] 10.222.0.25 () {56 vars in 886 bytes} [Fri Oct 28 13:35:22 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 13:35:22.800837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-eb328b4b-3c17-4a76-a52a-6dd030d4832b req-d4cf91bb-e236-4d77-a747-9617d3fe4629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec2eee6-9121-4d27-bea1-873346cc1e79", "name": "network-vif-plugged", "status": "completed", "tag": "6d729abf-0823-4e2b-8504-926a78591b6c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:22.823635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eb328b4b-3c17-4a76-a52a-6dd030d4832b req-d4cf91bb-e236-4d77-a747-9617d3fe4629 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:22.824406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eb328b4b-3c17-4a76-a52a-6dd030d4832b req-d4cf91bb-e236-4d77-a747-9617d3fe4629 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:22.825010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-eb328b4b-3c17-4a76-a52a-6dd030d4832b req-d4cf91bb-e236-4d77-a747-9617d3fe4629 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:22.858819 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-eb328b4b-3c17-4a76-a52a-6dd030d4832b req-d4cf91bb-e236-4d77-a747-9617d3fe4629 service nova] Creating event network-vif-plugged:6d729abf-0823-4e2b-8504-926a78591b6c for instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 on n-h1-862876-2 Oct 28 13:35:22.871501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-eb328b4b-3c17-4a76-a52a-6dd030d4832b req-d4cf91bb-e236-4d77-a747-9617d3fe4629 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074669 Oct 28 13:35:22.874318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2858/5811] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:23.256157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:23.256882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:23.277332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:23.281183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:23.282197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:23.283570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:23.285864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:23.290988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:23.554604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:23.564498 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f121986-dccc-474f-94da-e15422584e5a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 0.321241 Oct 28 13:35:23.581899 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2954/5812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:23 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:23.620414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:23.621826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:23.635075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:23.638633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:23.641279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:23.642210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:23.643285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:23.646851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:24.140451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:24.159521 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e3367ba6-17ca-4681-9149-c1bac85cf565 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1314 microversion: 2.1 time: 0.544529 Oct 28 13:35:24.164154 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2859/5813] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:23 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:24.588572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:24.589767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:24.600098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:24.609752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:24.609752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:24.621502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:24.622312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:24.625625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:25.183793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:25.184413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:25.197975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:25.203538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:25.204569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:25.209853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:25.209853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:25.209853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:25.741134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:25.758509 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-75ef13d0-7e5f-4076-808c-ad5e7a90ea39 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1697 microversion: 2.1 time: 1.173668 Oct 28 13:35:25.760070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2955/5814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:24 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1697 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:25.808270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:25.822676 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47e1e144-0cc8-4b25-af54-dea3f89b247c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1502 microversion: 2.1 time: 0.644134 Oct 28 13:35:25.840823 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2860/5815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:25 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1502 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:25.858429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb14ba01-c740-4585-939c-ba1f951bb919 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:25.868785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb14ba01-c740-4585-939c-ba1f951bb919 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:25.884668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb14ba01-c740-4585-939c-ba1f951bb919 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:25.884668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb14ba01-c740-4585-939c-ba1f951bb919 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:25.945106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb14ba01-c740-4585-939c-ba1f951bb919 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 13:35:25.961020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:26.189851 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb14ba01-c740-4585-939c-ba1f951bb919 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79/action" status: 202 len: 0 microversion: 2.1 time: 0.335932 Oct 28 13:35:26.194209 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2956/5816] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:35:25 2022] POST /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:35:26.199482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:26.200105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:26.215102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:26.215603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:26.221089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:26.223471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:26.226156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:26.226687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:26.791789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:26.793187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:26.813152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:26.814441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:26.823462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:26.823462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:26.823462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:26.823462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:27.596389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:27.614021 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ae67f50-99af-4b94-acdc-8ed69883d327 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 1.410297 Oct 28 13:35:27.614999 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2861/5817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:26 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:27.641246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a0a3dd25-3344-4d8d-9a67-aab80f6d4c05 req-26abc17f-3864-4e4b-b071-03d3bd634593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:27.665364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:27.681430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a0a3dd25-3344-4d8d-9a67-aab80f6d4c05 req-26abc17f-3864-4e4b-b071-03d3bd634593 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:27.690846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a0a3dd25-3344-4d8d-9a67-aab80f6d4c05 req-26abc17f-3864-4e4b-b071-03d3bd634593 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:27.692595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a0a3dd25-3344-4d8d-9a67-aab80f6d4c05 req-26abc17f-3864-4e4b-b071-03d3bd634593 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:27.718709 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a0a3dd25-3344-4d8d-9a67-aab80f6d4c05 req-26abc17f-3864-4e4b-b071-03d3bd634593 service nova] Creating event network-vif-unplugged:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h1-862876-2 Oct 28 13:35:27.730466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-a0a3dd25-3344-4d8d-9a67-aab80f6d4c05 req-26abc17f-3864-4e4b-b071-03d3bd634593 service nova] Instance ac1686c2-7a30-409e-862b-778f46a24aad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:35:27.772991 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a0a3dd25-3344-4d8d-9a67-aab80f6d4c05 req-26abc17f-3864-4e4b-b071-03d3bd634593 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156513 Oct 28 13:35:27.788364 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2862/5818] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:27.844493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:27.859521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e91a2c24-eb03-4b97-a10b-8246884c0227 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1696 microversion: 2.1 time: 1.071968 Oct 28 13:35:27.860764 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2957/5819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:26 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1696 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:28.649386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:28.650128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:28.671808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:28.672342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:28.672798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:28.673536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:28.674052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:28.674498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:28.892925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:28.894242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:28.913030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:28.913568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:28.914000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:28.914717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:28.923690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:28.924950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:29.017569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:29.037385 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d21b7952-a735-4f62-8a40-ce0fae3a9226 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.399385 Oct 28 13:35:29.038870 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2863/5820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:28 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:29.718909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:29.727842 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a72f8979-8654-4545-8edb-1171437b6cbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1696 microversion: 2.1 time: 0.839535 Oct 28 13:35:29.728458 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2958/5821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:28 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1696 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:29.981217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-614a776d-bd79-4045-b7ae-3c46e07e94b8 req-0174e29a-17fe-4c84-b0fb-7feecfb0729d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:30.011679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-614a776d-bd79-4045-b7ae-3c46e07e94b8 req-0174e29a-17fe-4c84-b0fb-7feecfb0729d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:30.016001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-614a776d-bd79-4045-b7ae-3c46e07e94b8 req-0174e29a-17fe-4c84-b0fb-7feecfb0729d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:30.018222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-614a776d-bd79-4045-b7ae-3c46e07e94b8 req-0174e29a-17fe-4c84-b0fb-7feecfb0729d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:30.066539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:30.067187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:30.067961 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-614a776d-bd79-4045-b7ae-3c46e07e94b8 req-0174e29a-17fe-4c84-b0fb-7feecfb0729d service nova] Creating event network-changed:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h1-862876-2 Oct 28 13:35:30.074839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-614a776d-bd79-4045-b7ae-3c46e07e94b8 req-0174e29a-17fe-4c84-b0fb-7feecfb0729d service nova] Instance ac1686c2-7a30-409e-862b-778f46a24aad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:35:30.082389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:30.083010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:30.083642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:30.086032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:30.087574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:30.089844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:30.117664 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-614a776d-bd79-4045-b7ae-3c46e07e94b8 req-0174e29a-17fe-4c84-b0fb-7feecfb0729d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143059 Oct 28 13:35:30.120650 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2864/5822] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:30.526602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-772339852", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6881547-1ad6-4a5f-a8ef-9efc70fde110"}], "security_groups": [{"name": "tempest-securitygroup--602717955"}], "key_name": "tempest-keypair-1061610527", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:30.738850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:30.759299 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a63f91b7-9082-4ebd-b4ae-e160d590c066 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.699406 Oct 28 13:35:30.765279 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2959/5823] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:30 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:30.775004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:30.775628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:30.777626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=60 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:30.790165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:30.790668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:30.791138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:30.791846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:30.792304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:30.792732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:30.987721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] validate_networks() for [('e6881547-1ad6-4a5f-a8ef-9efc70fde110', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:35:31.662080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:31.720552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:35:31.721119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:35:31.721662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:35:31.722336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:35:31.723029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:35:31.752342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:31.752990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:31.753514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:31.765070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:31.766446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:31.767072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:31.821557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for project a580b333d8b245b1a69b2b246b73abcc. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:35:31.826180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for user ccf717948682481a87e008d912d4848c and project a580b333d8b245b1a69b2b246b73abcc. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:35:31.841615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:35:31.849530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:35:31.982321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:31.990173 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c9da393-e59d-406d-8927-84d42d24d0b6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1696 microversion: 2.1 time: 1.223561 Oct 28 13:35:31.991025 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2960/5824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:30 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1696 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:31.995440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:31.996048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:32.002116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:32.002609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:32.003255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:32.003985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:32.004441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:32.005089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:32.146016 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b9ab808-6bdf-42af-aa35-66ea0968e810 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.624792 Oct 28 13:35:32.159132 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2865/5825] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:35:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 13:35:32.172949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c64f342-e4a3-4b37-b4e3-35914ee6a0da tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:32.175704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c64f342-e4a3-4b37-b4e3-35914ee6a0da tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:32.328634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c64f342-e4a3-4b37-b4e3-35914ee6a0da tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:32.336612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c64f342-e4a3-4b37-b4e3-35914ee6a0da tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:32.340598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c64f342-e4a3-4b37-b4e3-35914ee6a0da tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:32.340598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c64f342-e4a3-4b37-b4e3-35914ee6a0da tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1281 microversion: 2.20 time: 0.175919 Oct 28 13:35:32.340598 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2866/5826] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:32 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:35:32.563790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:32.574439 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2477091-12cf-45bf-9ec6-0bc1f7adca18 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.582567 Oct 28 13:35:32.575171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2961/5827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:31 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:33.014879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:33.015501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:33.025546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:33.026048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:33.026917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:33.027616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:33.028243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:33.028697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:33.226492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:33.237833 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f0fa68f-45da-494c-b3eb-6e272f5ecc5c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1696 microversion: 2.1 time: 0.227806 Oct 28 13:35:33.238482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2867/5828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:33 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:33.391835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f0245e6-2623-4b59-ab01-992cfc5058e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:33.392489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f0245e6-2623-4b59-ab01-992cfc5058e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:33.457968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f0245e6-2623-4b59-ab01-992cfc5058e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:33.466728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f0245e6-2623-4b59-ab01-992cfc5058e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:33.469251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f0245e6-2623-4b59-ab01-992cfc5058e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:33.470425 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f0245e6-2623-4b59-ab01-992cfc5058e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1281 microversion: 2.20 time: 0.103615 Oct 28 13:35:33.471366 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2962/5829] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:33 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:33.605850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:33.606119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:33.620023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:33.620526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:33.621182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:33.622086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:33.622882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:33.624184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:34.052651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:34.053919 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9d179a48-aec3-4444-9015-19bbc08730ed tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.459650 Oct 28 13:35:34.054498 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2868/5830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:33 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:34.263527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:34.265696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:34.279153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:34.288320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:34.288320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:34.288320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:34.288320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:34.288320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:34.496892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:34.497605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:34.509248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:34.511418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:34.516719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:34.516719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:34.516888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:34.518970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:34.705885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:34.723103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:34.732039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:34.732039 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12dba695-b255-4592-8bc0-7fa13c983c12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1333 microversion: 2.20 time: 0.234764 Oct 28 13:35:34.732039 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2869/5831] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:34 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1333 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:34.898560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:34.911884 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce554cac-bf13-467b-a592-1ba4fe816930 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1694 microversion: 2.1 time: 0.652873 Oct 28 13:35:34.913811 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2963/5832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:34 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1694 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:35.080254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:35.081425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:35.095108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:35.096550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:35.102254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:35.104760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:35.106085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:35.106893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:35.625175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:35.636174 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6af7c344-6c7b-4809-b090-d1838e5c131a tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.561262 Oct 28 13:35:35.637276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2870/5833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:35 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:35.772871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:35.773509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:35.805084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:35.805084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:35.805084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:35.805084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:35.805084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:35.805084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:35.922029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:35.934775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:35.940018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:35.940018 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-751a9a2a-3858-42fc-9fd2-28f62c4d4de5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1341 microversion: 2.20 time: 0.187664 Oct 28 13:35:35.940018 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2964/5834] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:35 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:35.941957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:35.942668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:35.967049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:35.968119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:35.968569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:35.969347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:35.972047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:35.972542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:36.289025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:36.304175 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-399f57b7-0de7-4d60-9780-196fc60077ea tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1691 microversion: 2.1 time: 0.366606 Oct 28 13:35:36.304853 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2871/5835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:35 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1691 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:36.332475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:36.333262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:36.343164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:36.343982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:36.344422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:36.345135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:36.345599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:36.346029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:36.661138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:36.662088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:36.670782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:36.673985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:36.677541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:36.678404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:36.679115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:36.679766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:36.968757 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5fb079a-e967-4fba-9c6a-7e4d86f7274f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action" status: 202 len: 0 microversion: 2.1 time: 0.639710 Oct 28 13:35:36.974790 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2965/5836] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:35:36 2022] POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:35:36.991253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:36.992342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:37.005802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:37.010097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:37.010097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:37.010097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:37.010097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:37.010097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:37.057823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:37.092889 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8b0ece9b-5377-498b-b3b6-7adb33eacef3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.435673 Oct 28 13:35:37.111950 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2872/5837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:36 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:37.134110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:37.134110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:37.145900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:37.146950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:37.147592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:37.148508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:37.149180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:37.149768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:37.632941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:37.644929 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9e753ac6-a16f-4823-a7c1-89908f632bd3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.531555 Oct 28 13:35:37.647292 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2873/5838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:37 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:37.680247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:37.690504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:37.692406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:37.693916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86dd4d48-0621-46e5-a9db-5fff565b7dc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.717613 Oct 28 13:35:37.709222 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2966/5839] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:36 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:37.759608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f6a2997f-6e2b-4cc9-8290-a44b6686c694 req-a26a50d3-7f11-468a-81f4-7f5041c10e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "name": "network-vif-plugged", "status": "completed", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:37.781378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6a2997f-6e2b-4cc9-8290-a44b6686c694 req-a26a50d3-7f11-468a-81f4-7f5041c10e4a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:37.783415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6a2997f-6e2b-4cc9-8290-a44b6686c694 req-a26a50d3-7f11-468a-81f4-7f5041c10e4a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:37.784045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6a2997f-6e2b-4cc9-8290-a44b6686c694 req-a26a50d3-7f11-468a-81f4-7f5041c10e4a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:37.841723 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f6a2997f-6e2b-4cc9-8290-a44b6686c694 req-a26a50d3-7f11-468a-81f4-7f5041c10e4a service nova] Creating event network-vif-plugged:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h1-862876-2 Oct 28 13:35:37.857366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-f6a2997f-6e2b-4cc9-8290-a44b6686c694 req-a26a50d3-7f11-468a-81f4-7f5041c10e4a service nova] Instance ac1686c2-7a30-409e-862b-778f46a24aad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:35:37.886435 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f6a2997f-6e2b-4cc9-8290-a44b6686c694 req-a26a50d3-7f11-468a-81f4-7f5041c10e4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130461 Oct 28 13:35:37.891967 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2874/5840] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:38.133746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:38.135352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:38.146910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:38.147659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:38.148539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:38.149723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:38.150362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:38.151588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:38.476673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:38.503330 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46784856-b3fa-41ba-8520-5370c6f71894 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.385623 Oct 28 13:35:38.503936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2967/5841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:38 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:38.656347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6025c027-69cc-4236-9f24-b4c087c9c87f tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b84ba700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:38.677569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:38.678200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:38.690979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:38.691484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:38.692136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:38.700229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:38.700961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:38.702438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:38.803630 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6025c027-69cc-4236-9f24-b4c087c9c87f tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/659c76cc-9fca-4023-8867-e4e7b3203c9c" status: 200 len: 350 microversion: 2.1 time: 0.152416 Oct 28 13:35:38.804981 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2875/5842] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:35:38 2022] GET /compute/v2.1/os-volumes/659c76cc-9fca-4023-8867-e4e7b3203c9c => generated 350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:38.810724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:38.811743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:38.838126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:38.839215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:38.839922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:38.848016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:38.848016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:38.848016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:39.460731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:39.471087 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2cac80b2-77b6-4364-85d7-52c6ee4d6545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.802346 Oct 28 13:35:39.481786 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2968/5843] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:38 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:39.531060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:39.533346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:39.540691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:39.541491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:39.542141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:39.543568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:39.547127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:39.547783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:39.625354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:39.627918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:39.640572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:39.640572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:39.641737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7531e17e-6203-40b8-bad7-7e33f9b7b848 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.835657 Oct 28 13:35:39.642380 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2876/5844] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:38 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:39.710460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b7f61762-eaa8-44d5-bb13-b2b9b7ce18d9 req-60c718ad-dbad-4eb6-976e-7e87f41a2913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:39.721959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b7f61762-eaa8-44d5-bb13-b2b9b7ce18d9 req-60c718ad-dbad-4eb6-976e-7e87f41a2913 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:39.722444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b7f61762-eaa8-44d5-bb13-b2b9b7ce18d9 req-60c718ad-dbad-4eb6-976e-7e87f41a2913 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:39.722916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b7f61762-eaa8-44d5-bb13-b2b9b7ce18d9 req-60c718ad-dbad-4eb6-976e-7e87f41a2913 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:39.738887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b7f61762-eaa8-44d5-bb13-b2b9b7ce18d9 req-60c718ad-dbad-4eb6-976e-7e87f41a2913 service nova] Creating event network-changed:4d9ff784-54aa-47d3-9d78-3b5fbce30ceb for instance bd5181f8-b838-41a3-a5ae-bad3451e6388 on n-h2-862876-2 Oct 28 13:35:39.741478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b7f61762-eaa8-44d5-bb13-b2b9b7ce18d9 req-60c718ad-dbad-4eb6-976e-7e87f41a2913 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035218 Oct 28 13:35:39.742395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2877/5845] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:35:39.782714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:39.791229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23bc3054-6a29-4e3d-8580-8553b85ea755 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.264152 Oct 28 13:35:39.791951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2969/5846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:39 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:40.500180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:40.500949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:40.509579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:40.511069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:40.511573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:40.512363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:40.519558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:40.520305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:40.669557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:40.670251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:40.699760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:40.704219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:40.706117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:40.707198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:40.715322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:40.717366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:40.807961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:40.818952 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a6368f6-835f-4a07-b57c-e1d2fb364085 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.323789 Oct 28 13:35:40.825484 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2878/5847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:40 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:40.825484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:40.825484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:40.833051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:40.833775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:40.834539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:40.836096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:40.836798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:40.837450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:41.124771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:41.136472 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e9cba97a-fb29-4013-85b1-44df973632ea tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.315483 Oct 28 13:35:41.147668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:41.167169 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2879/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:40 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:41.167307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:41.167307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:41.167307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-af697040-0bf5-457c-a7cc-b3a8dff782df tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.502270 Oct 28 13:35:41.171612 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2970/5849] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:40 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:41.849091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:41.849629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:41.864388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:41.866342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:41.879811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:41.880356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:41.884276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:41.885915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:41.886607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:42.100799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:42.109651 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7925fe79-8c93-4d28-92e5-93e500973de6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.264652 Oct 28 13:35:42.110354 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2880/5850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:41 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:42.165894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:42.166719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:42.179622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:42.184713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:42.185369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:42.186323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:42.187310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:42.187581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:42.199242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:42.200280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:42.224028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:42.252787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:42.252787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:42.252787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:42.252787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:42.252787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:42.252787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:42.335891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:42.480897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:42.494042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:42.495386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:42.497374 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f0ef7cd-5709-467f-8a4b-409671156ae5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.302532 Oct 28 13:35:42.507604 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2881/5851] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:42 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:42.517770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3f7a34b4-83fb-40bb-b9cc-e0b4f7ac1841 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b84ac040>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:42.584111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3f7a34b4-83fb-40bb-b9cc-e0b4f7ac1841 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/eabd7a61-1be2-4dc7-9fd1-fd57c912d02b" status: 200 len: 351 microversion: 2.1 time: 0.075277 Oct 28 13:35:42.593534 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2882/5852] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:35:42 2022] GET /compute/v2.1/os-volumes/eabd7a61-1be2-4dc7-9fd1-fd57c912d02b => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:42.812514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:42.821683 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-af6a501e-233a-4d2f-8982-2ff5493992a3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.659719 Oct 28 13:35:42.823342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2971/5853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:42 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:43.134898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:43.136153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:43.144242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:43.144746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:43.145427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:43.146142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:43.146939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:43.147720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:43.364976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:43.381766 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-558e5dcb-1a96-4fea-80a8-a5758fec68c8 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.251351 Oct 28 13:35:43.383114 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2883/5854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:43 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:43.525378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:43.526498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:43.531810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:43.553515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:43.554235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:43.554932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:43.555821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:43.556457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:43.557064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:43.728474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-513c1134-0513-45cd-89f6-85e3bafcc35f req-0bf42bb9-4c25-49fa-937e-faf32819e6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:43.748626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-513c1134-0513-45cd-89f6-85e3bafcc35f req-0bf42bb9-4c25-49fa-937e-faf32819e6e8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:43.749089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-513c1134-0513-45cd-89f6-85e3bafcc35f req-0bf42bb9-4c25-49fa-937e-faf32819e6e8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:43.749523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-513c1134-0513-45cd-89f6-85e3bafcc35f req-0bf42bb9-4c25-49fa-937e-faf32819e6e8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:43.771772 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-513c1134-0513-45cd-89f6-85e3bafcc35f req-0bf42bb9-4c25-49fa-937e-faf32819e6e8 service nova] Creating event network-vif-unplugged:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:35:43.801356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-513c1134-0513-45cd-89f6-85e3bafcc35f req-0bf42bb9-4c25-49fa-937e-faf32819e6e8 service nova] Instance ac1686c2-7a30-409e-862b-778f46a24aad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:35:43.818315 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-513c1134-0513-45cd-89f6-85e3bafcc35f req-0bf42bb9-4c25-49fa-937e-faf32819e6e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093163 Oct 28 13:35:43.820281 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2884/5855] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:35:43.851386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:43.852376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:43.856669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:43.862951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:43.863863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:43.864385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:43.865175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:43.865955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:43.866462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:43.868367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:43.869803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:43.871894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f5b545d3-544a-4e7d-a5b7-a3a4e9de6f4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.349811 Oct 28 13:35:43.879283 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2972/5856] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:43 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:44.086922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:44.098850 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0dbab8e3-0c04-469a-af48-c5f9efef0aba tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.254241 Oct 28 13:35:44.100271 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2885/5857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:43 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:44.415397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:44.416311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:44.440550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:44.444063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:44.445525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:44.451735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:44.451735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:44.451735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:44.882788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:44.898771 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-418d7135-8aea-47a8-8b5e-0a441637021a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.488285 Oct 28 13:35:44.914251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:44.916506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:44.920346 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2973/5858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:44 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:44.933099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:44.933651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:44.938098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:44.938098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:44.938098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:44.938098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:45.126082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:45.126725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:45.150035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:45.150566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:45.151050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:45.151793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:45.152267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:45.152708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:45.408315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:45.423324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:45.423324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:45.423988 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c1ac4b2-3b3d-403d-b1fa-12e7f2b31208 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.526820 Oct 28 13:35:45.425127 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2886/5859] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:44 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:35:45.461579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:45.473291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d330fddb-5986-4bb0-af0e-1d93ca4a2413 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.353656 Oct 28 13:35:45.474805 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2974/5860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:45 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:45.679170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fee4dd65-2d1c-4f0d-84ed-be389a60acc9 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b8465dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:45.770308 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fee4dd65-2d1c-4f0d-84ed-be389a60acc9 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/674431fb-7330-44ff-9be3-5c638a6c46cf" status: 200 len: 351 microversion: 2.1 time: 0.087789 Oct 28 13:35:45.770308 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2887/5861] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:35:45 2022] GET /compute/v2.1/os-volumes/674431fb-7330-44ff-9be3-5c638a6c46cf => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:45.781491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c578c56-7e28-44ad-b8dc-8d247015356b tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b86a0550>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:45.882291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-39e400a3-44cd-4dff-b414-0334592651e9 req-fc60d36a-aae3-4a50-b34c-5b78819c33ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:45.900888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-39e400a3-44cd-4dff-b414-0334592651e9 req-fc60d36a-aae3-4a50-b34c-5b78819c33ed service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:45.904137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-39e400a3-44cd-4dff-b414-0334592651e9 req-fc60d36a-aae3-4a50-b34c-5b78819c33ed service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:45.904739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-39e400a3-44cd-4dff-b414-0334592651e9 req-fc60d36a-aae3-4a50-b34c-5b78819c33ed service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:45.910993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c578c56-7e28-44ad-b8dc-8d247015356b tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.138515 Oct 28 13:35:45.912799 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2975/5862] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Oct 28 13:35:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:45.930534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:45.932585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:45.939789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-39e400a3-44cd-4dff-b414-0334592651e9 req-fc60d36a-aae3-4a50-b34c-5b78819c33ed service nova] Creating event network-changed:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:35:45.956455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:45.957125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:45.957834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:45.958690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:45.959284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:45.959818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:45.967968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-39e400a3-44cd-4dff-b414-0334592651e9 req-fc60d36a-aae3-4a50-b34c-5b78819c33ed service nova] Instance ac1686c2-7a30-409e-862b-778f46a24aad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 13:35:46.006060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-39e400a3-44cd-4dff-b414-0334592651e9 req-fc60d36a-aae3-4a50-b34c-5b78819c33ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129917 Oct 28 13:35:46.007484 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2888/5863] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:35:46.028470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7049f46d-af6c-4457-b4b8-7de83ec77a3e tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b85e64c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:46.140978 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7049f46d-af6c-4457-b4b8-7de83ec77a3e tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.131916 Oct 28 13:35:46.142019 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2889/5864] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Oct 28 13:35:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:46.159336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b5ce6d7c-0095-421c-b374-4f05976e6f9c tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b84f4670>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:46.316123 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b5ce6d7c-0095-421c-b374-4f05976e6f9c tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.161792 Oct 28 13:35:46.317005 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2890/5865] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Oct 28 13:35:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:46.334300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b77587d-1b6f-4633-9e4f-315e7363182a tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b84f4160>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:46.444738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:46.479145 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6463547f-ac94-45b3-9349-9fb452d1654e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.541626 Oct 28 13:35:46.479145 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2976/5866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:45 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:46.479145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:46.479145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:46.510478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b77587d-1b6f-4633-9e4f-315e7363182a tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.180703 Oct 28 13:35:46.520819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2891/5867] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Oct 28 13:35:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:46.526521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:46.527462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:46.530109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:46.530611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:46.542045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:46.542731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:46.542904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:46.543347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:46.543778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:46.545662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:46.547293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:46.549524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:46.552403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:46.553856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:46.988452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:47.019565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:47.019869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:47.020310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:47.020310 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7675cdeb-6195-4dbb-b448-fb4230033158 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.537654 Oct 28 13:35:47.020310 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2977/5868] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:46 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:47.020310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9eee0a2c-2f4f-4ec8-aef9-007662648b01 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27bb020940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:47.031856 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-378d105e-f6e0-4ca3-ac36-fca5fd63ec54 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.509410 Oct 28 13:35:47.034712 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2892/5869] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:46 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:47.052789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4ef22add-8b29-4bb2-a084-8c6531120e11 req-05c6b924-28ff-41ca-8e6d-1e045ca99f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "name": "network-vif-plugged", "status": "completed", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:47.064471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4ef22add-8b29-4bb2-a084-8c6531120e11 req-05c6b924-28ff-41ca-8e6d-1e045ca99f57 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:47.065228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4ef22add-8b29-4bb2-a084-8c6531120e11 req-05c6b924-28ff-41ca-8e6d-1e045ca99f57 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:47.066716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4ef22add-8b29-4bb2-a084-8c6531120e11 req-05c6b924-28ff-41ca-8e6d-1e045ca99f57 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:47.109966 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4ef22add-8b29-4bb2-a084-8c6531120e11 req-05c6b924-28ff-41ca-8e6d-1e045ca99f57 service nova] Creating event network-vif-plugged:4d9ff784-54aa-47d3-9d78-3b5fbce30ceb for instance bd5181f8-b838-41a3-a5ae-bad3451e6388 on n-h2-862876-2 Oct 28 13:35:47.123152 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4ef22add-8b29-4bb2-a084-8c6531120e11 req-05c6b924-28ff-41ca-8e6d-1e045ca99f57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086608 Oct 28 13:35:47.126973 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2893/5870] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:47.196937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9eee0a2c-2f4f-4ec8-aef9-007662648b01 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.188655 Oct 28 13:35:47.198025 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2978/5871] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Oct 28 13:35:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:47.212758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9fddf02b-d515-489e-b989-4a708a078771 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b84f4dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:47.389690 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9fddf02b-d515-489e-b989-4a708a078771 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.180931 Oct 28 13:35:47.390695 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2894/5872] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:35:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:47.405694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1e286ce-e6c1-4611-93c6-8a9ff14c8483 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b82ab8b0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:47.499540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:47.500688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:47.516533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:47.517048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:47.517485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:47.520476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:47.521827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:47.522266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:47.573207 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1e286ce-e6c1-4611-93c6-8a9ff14c8483 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.161381 Oct 28 13:35:47.573207 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2979/5873] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Oct 28 13:35:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:47.581668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85e68ef0-6ff1-4369-aa22-79c656876b47 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] Calling method '.version_select at 0x7f27b8242dc0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:47.817673 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85e68ef0-6ff1-4369-aa22-79c656876b47 tempest-VolumesTestJSON-421027618 tempest-VolumesTestJSON-421027618-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.240061 Oct 28 13:35:47.818575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2980/5874] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:35:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:47.909667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:47.923104 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ab59d69-a51c-4197-876a-f9b71cd75bed tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1690 microversion: 2.1 time: 0.428926 Oct 28 13:35:47.936559 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2895/5875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:47 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1690 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:48.048009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:48.049211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:48.059547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:48.064363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:48.065585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:48.079653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:48.080876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:48.083106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:48.085057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:48.086254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:48.099556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:48.099556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:48.099556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:48.099556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:48.106791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:48.107294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:48.457852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:48.467743 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-026c971c-f35f-4f99-9b23-b33507dc958b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 0.410036 Oct 28 13:35:48.480420 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2896/5876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:48 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:48.525013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:48.538021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:48.539820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:48.541447 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cdbe15e4-4d15-493f-85f2-350a0dc9395a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1406 microversion: 2.20 time: 0.499451 Oct 28 13:35:48.563004 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2981/5877] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:48 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:48.954546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:48.955614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:48.963950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:48.964739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:48.965468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:48.987090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:48.987631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:48.988286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:49.327944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:49.359126 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6d557b77-a783-4b59-a08b-9f64bf05f82f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1683 microversion: 2.1 time: 0.409423 Oct 28 13:35:49.363076 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2897/5878] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:48 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1683 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:49.493377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:49.494003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:49.506245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:49.515623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:49.517854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:49.518657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:49.519184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:49.521818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:49.569624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:49.570241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:49.579900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:49.580394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:49.580829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:49.584064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:49.592138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:49.592605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:49.823443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:49.853996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:49.859099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:49.862249 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-606eff62-f539-4fe5-b564-2ba37aa62c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1599 microversion: 2.20 time: 0.296468 Oct 28 13:35:49.866598 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2898/5879] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:35:49 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1599 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:35:49.897041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:49.897546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:49.913332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:49.914992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:49.915628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:49.917854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:49.921035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:49.922731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:50.122770 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-486a6fdb-b25d-4b91-a228-84749a61d4b2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.230944 Oct 28 13:35:50.127057 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2899/5880] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Oct 28 13:35:49 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:35:50.761135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:50.780698 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa4103e3-2b54-4287-836e-8ecce8ae88f5 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1512 microversion: 2.1 time: 1.291226 Oct 28 13:35:50.784309 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2982/5881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:49 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1512 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:51.819420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:51.820546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:51.839596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:51.840631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:51.841305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:51.842457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:51.843259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:51.862587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:52.458967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:52.499389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-206bafce-4b46-4377-b59b-8d9e40e48062 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1489 microversion: 2.1 time: 0.686215 Oct 28 13:35:52.502382 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2900/5882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:51 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1489 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:52.527080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:52.527525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:52.565768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:52.566298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:52.566731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:52.567487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:52.567953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:52.568384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:52.659926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:35:52.705194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cf20085e-830b-428b-afa4-caa19cba2c13 req-3a912ef7-7051-410d-a0dd-8998a8e21236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:52.731862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf20085e-830b-428b-afa4-caa19cba2c13 req-3a912ef7-7051-410d-a0dd-8998a8e21236 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:52.734584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf20085e-830b-428b-afa4-caa19cba2c13 req-3a912ef7-7051-410d-a0dd-8998a8e21236 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:52.736203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf20085e-830b-428b-afa4-caa19cba2c13 req-3a912ef7-7051-410d-a0dd-8998a8e21236 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:52.764410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cf20085e-830b-428b-afa4-caa19cba2c13 req-3a912ef7-7051-410d-a0dd-8998a8e21236 service nova] Creating event network-changed:4d9ff784-54aa-47d3-9d78-3b5fbce30ceb for instance bd5181f8-b838-41a3-a5ae-bad3451e6388 on n-h2-862876-2 Oct 28 13:35:52.783906 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cf20085e-830b-428b-afa4-caa19cba2c13 req-3a912ef7-7051-410d-a0dd-8998a8e21236 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080812 Oct 28 13:35:52.788711 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2901/5883] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:53.157499 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6362b86d-4d41-421b-8653-2598e7031748 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 204 len: 0 microversion: 2.1 time: 0.634298 Oct 28 13:35:53.160424 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2983/5884] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:35:52 2022] DELETE /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:35:53.175378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:53.176073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:53.223989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:53.224490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:53.242564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:53.243763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:53.251517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:53.252110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:53.331650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:54.072685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:54.085672 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95f9b559-7a66-49a4-a81c-4089f73e52e1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1495 microversion: 2.1 time: 0.912159 Oct 28 13:35:54.087490 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2902/5885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:53 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1495 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:54.882260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1460430e-8018-493a-840f-693275e42e59 req-01ee26eb-8c55-473a-98cf-8ea729442997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "name": "network-vif-plugged", "status": "completed", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:54.921612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1460430e-8018-493a-840f-693275e42e59 req-01ee26eb-8c55-473a-98cf-8ea729442997 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:54.922148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1460430e-8018-493a-840f-693275e42e59 req-01ee26eb-8c55-473a-98cf-8ea729442997 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:54.922604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1460430e-8018-493a-840f-693275e42e59 req-01ee26eb-8c55-473a-98cf-8ea729442997 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:54.983239 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1460430e-8018-493a-840f-693275e42e59 req-01ee26eb-8c55-473a-98cf-8ea729442997 service nova] Creating event network-vif-plugged:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:35:54.989064 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1460430e-8018-493a-840f-693275e42e59 req-01ee26eb-8c55-473a-98cf-8ea729442997 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116043 Oct 28 13:35:54.990501 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2984/5886] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:35:55.117970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:55.119354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:55.136249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:55.141575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:55.142055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:55.142954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:55.144309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:55.148739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:56.061525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-517a4786-8258-4569-83e1-9e3c57db084b req-a4513ccb-55cb-4d03-96da-992922082674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec2eee6-9121-4d27-bea1-873346cc1e79", "name": "network-vif-deleted", "tag": "6d729abf-0823-4e2b-8504-926a78591b6c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:56.091085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-517a4786-8258-4569-83e1-9e3c57db084b req-a4513ccb-55cb-4d03-96da-992922082674 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:56.091622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-517a4786-8258-4569-83e1-9e3c57db084b req-a4513ccb-55cb-4d03-96da-992922082674 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:56.095709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-517a4786-8258-4569-83e1-9e3c57db084b req-a4513ccb-55cb-4d03-96da-992922082674 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:56.112439 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-517a4786-8258-4569-83e1-9e3c57db084b req-a4513ccb-55cb-4d03-96da-992922082674 service nova] Creating event network-vif-deleted:6d729abf-0823-4e2b-8504-926a78591b6c for instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 on n-h1-862876-2 Oct 28 13:35:56.137899 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-517a4786-8258-4569-83e1-9e3c57db084b req-a4513ccb-55cb-4d03-96da-992922082674 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074712 Oct 28 13:35:56.139325 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2985/5887] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:35:56.304458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:56.331351 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-359c5792-8e37-4ff3-b338-624a077be0d3 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 200 len: 1495 microversion: 2.1 time: 1.219787 Oct 28 13:35:56.342776 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2903/5888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:55 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 1495 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:35:57.359325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:57.360579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:57.370698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:57.371430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:57.378498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:57.378498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:57.378498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:57.378498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:57.424291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 HTTP/1.1 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '8ec2eee6-9121-4d27-bea1-873346cc1e79'} Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:35:57.430196 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:35:57.435859 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2166bd6-c1e0-4c65-ae76-704d572c51ff tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 404 len: 111 microversion: 2.1 time: 0.079287 Oct 28 13:35:57.437164 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2986/5889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:57 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:35:57.629558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-259323232", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "f6719c5f-6a3e-4187-8df7-d08ef3f7deb2"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:35:57.728161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] validate_networks() for [('f6719c5f-6a3e-4187-8df7-d08ef3f7deb2', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:35:58.296857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:35:58.297281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:35:58.297753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:35:58.298467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:35:58.298842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:35:58.319203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:58.319690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:58.320182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:58.321118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:58.321577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:58.322142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:58.345244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:35:58.351081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Getting quotas for user ba2dd748101e4b3492c9bea6a26cea14 and project 38b271ae34d44681b7f2e2d839b75865. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:35:58.371429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:35:58.374809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:35:58.407180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:35:58.551425 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-72fc1cc8-e127-4fd5-b9ac-fdd82e8ac81f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937991 Oct 28 13:35:58.563068 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2904/5890] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:35:58.565653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e718e209-9318-4d77-8ba1-ca4df82ef573 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:58.566350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e718e209-9318-4d77-8ba1-ca4df82ef573 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:58.711621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e718e209-9318-4d77-8ba1-ca4df82ef573 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:58.727366 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e718e209-9318-4d77-8ba1-ca4df82ef573 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1214 microversion: 2.1 time: 0.167467 Oct 28 13:35:58.732101 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2987/5891] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:58 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:35:59.759186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:35:59.759924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:35:59.769952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:59.770533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:59.771008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:59.771988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:35:59.772449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:35:59.772877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:35:59.861838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:35:59.871205 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d9a20586-b316-4f71-a50c-bb1e52fc3775 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1218 microversion: 2.1 time: 0.117424 Oct 28 13:35:59.875513 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2905/5892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:35:59 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:00.893934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:00.895171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:00.904757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:00.906401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:00.907126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:00.907816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:00.908905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:00.911619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:00.912256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:01.069461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:01.077537 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4435025e-1773-479f-8bc4-a8f5f9ed4209 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1266 microversion: 2.1 time: 0.187643 Oct 28 13:36:01.099199 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2988/5893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:00 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:02.108581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:02.110820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:02.124698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:02.125194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:02.125629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:02.126341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:02.131214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:02.133702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:02.227595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:02.254422 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2dba4fe5-20bd-4cbe-bc2f-3a596837ef03 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1284 microversion: 2.1 time: 0.148150 Oct 28 13:36:02.254422 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2906/5894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:02 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:03.278685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:03.281143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:03.321581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:03.323112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:03.323563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:03.330634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:03.331224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:03.334173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:03.658999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:03.672226 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad9aeda2-3e9d-41fc-b196-47d72472de96 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1314 microversion: 2.1 time: 0.397076 Oct 28 13:36:03.674644 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2989/5895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:03 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:04.501154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f18ae6a0-0552-406a-bc42-9d4a9c3dc6b8 req-ce927d01-8f1a-42a7-bb1a-2d418ef57ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21506bff-2ca2-4365-b1ec-1cb1d9a24a1a", "tag": "76dc44a5-b8d5-40ba-ae8e-81420f6661fc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:04.519299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f18ae6a0-0552-406a-bc42-9d4a9c3dc6b8 req-ce927d01-8f1a-42a7-bb1a-2d418ef57ccb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:04.519784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f18ae6a0-0552-406a-bc42-9d4a9c3dc6b8 req-ce927d01-8f1a-42a7-bb1a-2d418ef57ccb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:04.520219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f18ae6a0-0552-406a-bc42-9d4a9c3dc6b8 req-ce927d01-8f1a-42a7-bb1a-2d418ef57ccb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:04.560913 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f18ae6a0-0552-406a-bc42-9d4a9c3dc6b8 req-ce927d01-8f1a-42a7-bb1a-2d418ef57ccb service nova] Creating event network-changed:76dc44a5-b8d5-40ba-ae8e-81420f6661fc for instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a on n-h1-862876-2 Oct 28 13:36:04.567058 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f18ae6a0-0552-406a-bc42-9d4a9c3dc6b8 req-ce927d01-8f1a-42a7-bb1a-2d418ef57ccb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070858 Oct 28 13:36:04.568222 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2907/5896] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:36:04.702043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:04.702974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:04.710761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:04.711541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:04.712084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:04.713050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:04.713793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:04.714334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:05.461685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:05.469503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84d82b60-63e1-42da-b095-c34cc5d3674f tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1314 microversion: 2.1 time: 0.775347 Oct 28 13:36:05.482800 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2990/5897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:04 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:06.105804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-51a86e70-0451-4997-8531-7f660ef950f4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Action: 'create', calling method: .version_select at 0x7f27b84498b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1708318848", "metadata": {"Type": "work"}}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-51a86e70-0451-4997-8531-7f660ef950f4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Request method failure captured: Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 122 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9rFRVe7XQ0iDqBgvNtTgT8L2sdU6lPDGpwA6-L1BoCmfX7tYphx2TreLyuyJvKVvehpVXzPuXJ00ufHCApIPZ032DN26f0BKKDkb9BfkWgIN6rJmQGd9PUsbb3BABW0746bC45-ot5XYsmqIx5fFsBUvMRlQsofp26ZXbpQzJt8nUU Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37106b53dab146528dd23ca266f9c335", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37106b53dab146528dd23ca266f9c335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3d3e3a20c1b046b49c15d245cea49ea5 Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1708318848", "metadata": {"Type": "work"}}} Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1708318848', 'metadata': {'Type': 'work'}}}} Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:36:06.110420 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 13:36:06.116121 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.118716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-51a86e70-0451-4997-8531-7f660ef950f4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:06.119667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-51a86e70-0451-4997-8531-7f660ef950f4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179562 Oct 28 13:36:06.120410 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2908/5898] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Oct 28 13:36:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:36:06.130855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93372af1-6b29-4f23-be76-c53670b2a3a1 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Action: 'create', calling method: .version_select at 0x7f27b9a45ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1666797822", "metadata": {"Type": "work"}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93372af1-6b29-4f23-be76-c53670b2a3a1 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Request method failure captured: Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 120 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9rFRVe7XQ0iDqBgvNtTgT8L2sdU6lPDGpwA6-L1BoCmfX7tYphx2TreLyuyJvKVvehpVXzPuXJ00ufHCApIPZ032DN26f0BKKDkb9BfkWgIN6rJmQGd9PUsbb3BABW0746bC45-ot5XYsmqIx5fFsBUvMRlQsofp26ZXbpQzJt8nUU Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37106b53dab146528dd23ca266f9c335", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37106b53dab146528dd23ca266f9c335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3d3e3a20c1b046b49c15d245cea49ea5 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1666797822", "metadata": {"Type": "work"}}} Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1666797822', 'metadata': {'Type': 'work'}}}} Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi '0' Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:36:06.135977 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 13:36:06.142383 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.144505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93372af1-6b29-4f23-be76-c53670b2a3a1 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:06.145571 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-93372af1-6b29-4f23-be76-c53670b2a3a1 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019671 Oct 28 13:36:06.146390 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2991/5899] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Oct 28 13:36:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:36:06.166168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29330259-a9a0-463d-aa4a-93cf27621eb4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Action: 'create', calling method: .version_select at 0x7f27b8404040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1691499779", "metadata": {"Type": "work"}}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29330259-a9a0-463d-aa4a-93cf27621eb4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Request method failure captured: Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 119 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9rFRVe7XQ0iDqBgvNtTgT8L2sdU6lPDGpwA6-L1BoCmfX7tYphx2TreLyuyJvKVvehpVXzPuXJ00ufHCApIPZ032DN26f0BKKDkb9BfkWgIN6rJmQGd9PUsbb3BABW0746bC45-ot5XYsmqIx5fFsBUvMRlQsofp26ZXbpQzJt8nUU Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37106b53dab146528dd23ca266f9c335", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37106b53dab146528dd23ca266f9c335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3d3e3a20c1b046b49c15d245cea49ea5 Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1691499779", "metadata": {"Type": "work"}}} Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1691499779', 'metadata': {'Type': 'work'}}}} Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '' Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 13:36:06.172289 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 13:36:06.178003 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.180821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29330259-a9a0-463d-aa4a-93cf27621eb4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:06.183037 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-29330259-a9a0-463d-aa4a-93cf27621eb4 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026690 Oct 28 13:36:06.186014 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2909/5900] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Oct 28 13:36:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:36:06.199411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46f79288-c07b-493e-a3b0-2df60da5126b tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Calling method '.version_select at 0x7f27bd925040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:06.229944 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-46f79288-c07b-493e-a3b0-2df60da5126b tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] HTTP exception thrown: Volume tempest-invalid-2073526291 could not be found. Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46f79288-c07b-493e-a3b0-2df60da5126b tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Request method failure captured: Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2073526291 HTTP/1.1 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9rFRVe7XQ0iDqBgvNtTgT8L2sdU6lPDGpwA6-L1BoCmfX7tYphx2TreLyuyJvKVvehpVXzPuXJ00ufHCApIPZ032DN26f0BKKDkb9BfkWgIN6rJmQGd9PUsbb3BABW0746bC45-ot5XYsmqIx5fFsBUvMRlQsofp26ZXbpQzJt8nUU Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37106b53dab146528dd23ca266f9c335", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37106b53dab146528dd23ca266f9c335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3d3e3a20c1b046b49c15d245cea49ea5 Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: exception: Volume tempest-invalid-2073526291 could not be found. Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'tempest-invalid-2073526291'} Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2073526291 could not be found. (HTTP 404) (Request-ID: req-7de126c5-eedb-4ac2-8c50-384b1e223f78) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:36:06.232175 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2073526291 could not be found. Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2073526291 could not be found. Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2073526291 could not be found. Oct 28 13:36:06.237442 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.240794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46f79288-c07b-493e-a3b0-2df60da5126b tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Returning 404 to user: Volume tempest-invalid-2073526291 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:06.241566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46f79288-c07b-493e-a3b0-2df60da5126b tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2073526291" status: 404 len: 99 microversion: 2.1 time: 0.050900 Oct 28 13:36:06.242372 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2992/5901] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 13:36:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2073526291 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 13:36:06.252075 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95335950-4a25-49b0-af41-762cffe7966b tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004386 Oct 28 13:36:06.252739 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2910/5902] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Oct 28 13:36:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 13:36:06.261933 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ff5370c-7171-4199-950b-139ac527a5a9 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003972 Oct 28 13:36:06.264304 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2993/5903] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Oct 28 13:36:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 13:36:06.275276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-899f1a77-2e81-4208-83f1-f6ae70366aa3 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Calling method '.version_select at 0x7f27b84651f0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:06.306406 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-899f1a77-2e81-4208-83f1-f6ae70366aa3 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] HTTP exception thrown: Volume da9eb8a3-afac-41e1-be9b-05e634fc8caf could not be found. Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-899f1a77-2e81-4208-83f1-f6ae70366aa3 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Request method failure captured: Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/os-volumes/da9eb8a3-afac-41e1-be9b-05e634fc8caf HTTP/1.1 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9rFRVe7XQ0iDqBgvNtTgT8L2sdU6lPDGpwA6-L1BoCmfX7tYphx2TreLyuyJvKVvehpVXzPuXJ00ufHCApIPZ032DN26f0BKKDkb9BfkWgIN6rJmQGd9PUsbb3BABW0746bC45-ot5XYsmqIx5fFsBUvMRlQsofp26ZXbpQzJt8nUU Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37106b53dab146528dd23ca266f9c335", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37106b53dab146528dd23ca266f9c335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 3d3e3a20c1b046b49c15d245cea49ea5 Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: method: Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: exception: Volume da9eb8a3-afac-41e1-be9b-05e634fc8caf could not be found. Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'da9eb8a3-afac-41e1-be9b-05e634fc8caf'} Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da9eb8a3-afac-41e1-be9b-05e634fc8caf could not be found. (HTTP 404) (Request-ID: req-7f09b2ce-ed7b-4c05-bda0-41fdea38b003) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:36:06.308508 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da9eb8a3-afac-41e1-be9b-05e634fc8caf could not be found. Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da9eb8a3-afac-41e1-be9b-05e634fc8caf could not be found. Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da9eb8a3-afac-41e1-be9b-05e634fc8caf could not be found. Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-899f1a77-2e81-4208-83f1-f6ae70366aa3 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Returning 404 to user: Volume da9eb8a3-afac-41e1-be9b-05e634fc8caf could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-899f1a77-2e81-4208-83f1-f6ae70366aa3 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/da9eb8a3-afac-41e1-be9b-05e634fc8caf" status: 404 len: 109 microversion: 2.1 time: 0.039121 Oct 28 13:36:06.324514 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2911/5904] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:36:06 2022] DELETE /compute/v2.1/os-volumes/da9eb8a3-afac-41e1-be9b-05e634fc8caf => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:06.350635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18fa4795-fd82-4010-9f4c-4b52af594a36 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Calling method '.version_select at 0x7f27b82ab1f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:06.399260 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-18fa4795-fd82-4010-9f4c-4b52af594a36 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] HTTP exception thrown: Volume f1198a02-0ce0-4c80-a7a8-6132ff8c1255 could not be found. Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18fa4795-fd82-4010-9f4c-4b52af594a36 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Request method failure captured: Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-volumes/f1198a02-0ce0-4c80-a7a8-6132ff8c1255 HTTP/1.1 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9rFRVe7XQ0iDqBgvNtTgT8L2sdU6lPDGpwA6-L1BoCmfX7tYphx2TreLyuyJvKVvehpVXzPuXJ00ufHCApIPZ032DN26f0BKKDkb9BfkWgIN6rJmQGd9PUsbb3BABW0746bC45-ot5XYsmqIx5fFsBUvMRlQsofp26ZXbpQzJt8nUU Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/37106b53dab146528dd23ca266f9c335"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_37106b53dab146528dd23ca266f9c335", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/37106b53dab146528dd23ca266f9c335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 37106b53dab146528dd23ca266f9c335 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesNegativeTest-845641614 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 3d3e3a20c1b046b49c15d245cea49ea5 Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesNegativeTest-845641614-project Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: exception: Volume f1198a02-0ce0-4c80-a7a8-6132ff8c1255 could not be found. Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'f1198a02-0ce0-4c80-a7a8-6132ff8c1255'} Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1198a02-0ce0-4c80-a7a8-6132ff8c1255 could not be found. (HTTP 404) (Request-ID: req-3ccf5f92-9acf-41ff-9605-d58c4f8cb08f) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:36:06.401500 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1198a02-0ce0-4c80-a7a8-6132ff8c1255 could not be found. Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1198a02-0ce0-4c80-a7a8-6132ff8c1255 could not be found. Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1198a02-0ce0-4c80-a7a8-6132ff8c1255 could not be found. Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18fa4795-fd82-4010-9f4c-4b52af594a36 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] Returning 404 to user: Volume f1198a02-0ce0-4c80-a7a8-6132ff8c1255 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-18fa4795-fd82-4010-9f4c-4b52af594a36 tempest-VolumesNegativeTest-845641614 tempest-VolumesNegativeTest-845641614-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f1198a02-0ce0-4c80-a7a8-6132ff8c1255" status: 404 len: 109 microversion: 2.1 time: 0.083489 Oct 28 13:36:06.410437 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2994/5905] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:36:06 2022] GET /compute/v2.1/os-volumes/f1198a02-0ce0-4c80-a7a8-6132ff8c1255 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:06.494285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:06.496573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:06.513310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:06.513310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:06.513310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:06.513310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:06.513310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:06.513310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:06.692963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:06.702278 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69231776-0e25-4b59-af0c-7419e41611b6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1314 microversion: 2.1 time: 0.212590 Oct 28 13:36:06.703205 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2912/5906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:06 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:07.753605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:07.754381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:07.768230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:07.769749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:07.770468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:07.771765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:07.774957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:07.774957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:08.012043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:08.025743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-04438559-9c56-494b-8f83-ce1522915d88 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1314 microversion: 2.1 time: 0.280879 Oct 28 13:36:08.026876 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2995/5907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:07 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:09.048781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:09.049392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:09.052319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:09.052795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:09.057655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:09.058142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:09.058595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:09.059316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:09.059775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:09.060737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:09.248115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:09.263905 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9bea5ec5-f2c5-4a2f-b34c-b5297ecec086 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1314 microversion: 2.1 time: 0.218224 Oct 28 13:36:09.264494 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2913/5908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:09 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:09.869224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a750907e-aeb9-470d-bd1a-552610798e97 req-075ba66d-040d-44c5-928a-6c3072f937fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21506bff-2ca2-4365-b1ec-1cb1d9a24a1a", "name": "network-vif-plugged", "status": "completed", "tag": "76dc44a5-b8d5-40ba-ae8e-81420f6661fc"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:09.879006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:09.882327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a750907e-aeb9-470d-bd1a-552610798e97 req-075ba66d-040d-44c5-928a-6c3072f937fe service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:09.883091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a750907e-aeb9-470d-bd1a-552610798e97 req-075ba66d-040d-44c5-928a-6c3072f937fe service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:09.883692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a750907e-aeb9-470d-bd1a-552610798e97 req-075ba66d-040d-44c5-928a-6c3072f937fe service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:09.898553 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a750907e-aeb9-470d-bd1a-552610798e97 req-075ba66d-040d-44c5-928a-6c3072f937fe service nova] Creating event network-vif-plugged:76dc44a5-b8d5-40ba-ae8e-81420f6661fc for instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a on n-h1-862876-2 Oct 28 13:36:09.909743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a750907e-aeb9-470d-bd1a-552610798e97 req-075ba66d-040d-44c5-928a-6c3072f937fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044553 Oct 28 13:36:09.913624 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2996/5909] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:36:10.291072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:10.291594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:10.299456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:10.299972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:10.300425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:10.301201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:10.301672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:10.302113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:10.477676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:10.487561 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3dbe6e5-4cbd-47a1-8c52-ddf195e3ff35 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1314 microversion: 2.1 time: 0.200537 Oct 28 13:36:10.488153 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2914/5910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:10 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:11.513167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:11.513985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:11.520609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:11.524263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:11.524263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:11.524263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:11.524263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:11.524263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:11.658848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:11.666577 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d6dc2afe-2517-41c0-be77-a4004f560e46 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1502 microversion: 2.1 time: 0.158650 Oct 28 13:36:11.667186 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2997/5911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:11 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:11.692183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:11.692828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:11.701464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:11.702142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:11.714051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:11.714051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:11.714051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:11.714051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:11.734578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lazy-loading 'flavor' on Instance uuid 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:36:12.162509 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7db996b5-af15-44ad-885f-5dfab71a3c17 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "POST /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a/action" status: 202 len: 0 microversion: 2.1 time: 0.475245 Oct 28 13:36:12.163613 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2915/5912] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:36:11 2022] POST /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:36:12.173355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:12.174027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:12.182597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:12.183151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:12.183800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:12.184454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:12.185015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:12.185412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:12.192568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:12.351373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:12.361936 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d5da1bd-1a0e-410a-b74c-9817a0a045d0 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1510 microversion: 2.1 time: 0.193478 Oct 28 13:36:12.362521 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2998/5913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:12 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:13.387509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:13.389884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:13.396752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:13.397230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:13.397865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:13.398796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:13.399481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:13.400212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:13.558810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:13.567239 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-acc20eeb-335a-44fe-8f37-d532128207a6 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1493 microversion: 2.1 time: 0.184851 Oct 28 13:36:13.568040 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2916/5914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:13 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1493 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:13.591090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:13.591719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:13.604920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:13.606182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:13.607177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:13.608617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:13.609592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:13.610706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:13.655171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:36:13.976893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:13.979836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:13.987263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:13.987978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:13.988600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:13.989767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:13.990398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:13.991087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:14.003733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cabb9326-50d1-4a4f-bcea-36278c15b030 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 204 len: 0 microversion: 2.1 time: 0.416799 Oct 28 13:36:14.005169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 2999/5915] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:13 2022] DELETE /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:36:14.015920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:14.016972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:14.025122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:14.025714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:14.026392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:14.027204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:14.027937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:14.028440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:14.056927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-44350a3d-dbbc-4723-b006-5cb30ea14553 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action" status: 200 len: 63175 microversion: 2.1 time: 0.355115 Oct 28 13:36:14.056927 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2917/5916] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:36:13 2022] POST /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad/action => generated 63175 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:36:14.179460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:14.188866 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-189a8369-a94d-4ab6-bc82-88b9fe22d316 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1499 microversion: 2.1 time: 0.178581 Oct 28 13:36:14.189779 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3000/5917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:14 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1499 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:36:15.231703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:15.232925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:15.249445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:15.250554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:15.251872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:15.254394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:15.255101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:15.258010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:15.489122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:15.497501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83790181-93f7-4218-b9e8-acaa47be5789 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1499 microversion: 2.1 time: 0.285271 Oct 28 13:36:15.498388 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2918/5918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:15 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1499 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:16.523353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:16.524024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:16.543900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:16.544538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:16.544999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:16.548441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:16.550314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:16.552106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:16.696276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-dc592e0a-f874-4bc6-a9ea-d49e35c75c60 req-faecef6d-8c4c-43fe-a2e1-1cb0b2139792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21506bff-2ca2-4365-b1ec-1cb1d9a24a1a", "name": "network-vif-deleted", "tag": "76dc44a5-b8d5-40ba-ae8e-81420f6661fc"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:16.719859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:16.725041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dc592e0a-f874-4bc6-a9ea-d49e35c75c60 req-faecef6d-8c4c-43fe-a2e1-1cb0b2139792 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:16.726181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dc592e0a-f874-4bc6-a9ea-d49e35c75c60 req-faecef6d-8c4c-43fe-a2e1-1cb0b2139792 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:16.727384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dc592e0a-f874-4bc6-a9ea-d49e35c75c60 req-faecef6d-8c4c-43fe-a2e1-1cb0b2139792 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:16.737762 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7790351b-a94e-44c1-bcbf-6b0d94361350 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1457 microversion: 2.1 time: 0.219954 Oct 28 13:36:16.739236 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3001/5919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:16 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1457 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:16.743355 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-dc592e0a-f874-4bc6-a9ea-d49e35c75c60 req-faecef6d-8c4c-43fe-a2e1-1cb0b2139792 service nova] Creating event network-vif-deleted:76dc44a5-b8d5-40ba-ae8e-81420f6661fc for instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a on n-h1-862876-2 Oct 28 13:36:16.754983 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-dc592e0a-f874-4bc6-a9ea-d49e35c75c60 req-faecef6d-8c4c-43fe-a2e1-1cb0b2139792 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057650 Oct 28 13:36:16.754983 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2919/5920] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:36:17.771231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:17.771231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:17.781035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:17.781747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:17.782290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:17.783117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:17.783587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:17.784198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:17.858284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:17.858284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:17.858284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:17.861699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lazy-loading 'fault' on Instance uuid 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:36:17.933690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba2dd748101e4b3492c9bea6a26cea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b271ae34d44681b7f2e2d839b75865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:17.954303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b06177ec-81a8-4954-975f-d8b29b6b3a9b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 200 len: 1304 microversion: 2.1 time: 0.185310 Oct 28 13:36:17.954303 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3002/5921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:17 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:18.976762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:18.977651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:18.985309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:18.986047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:18.986541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:18.987363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:18.987902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:18.988337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.005421 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a HTTP/1.1 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '21506bff-2ca2-4365-b1ec-1cb1d9a24a1a'} Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.007222 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c03328d7-8d1e-4d43-915a-c689f653618e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 404 len: 111 microversion: 2.1 time: 0.038268 Oct 28 13:36:19.012996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2920/5922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:18 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.021829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.022985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.040707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.041214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.041654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.042362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.047760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.047760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.070383 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a HTTP/1.1 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '21506bff-2ca2-4365-b1ec-1cb1d9a24a1a'} Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.074035 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.080099 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.083625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.084541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-554b987a-f292-4e24-bab5-c4fd2cac6311 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 404 len: 111 microversion: 2.1 time: 0.067877 Oct 28 13:36:19.085496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3003/5923] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:19 2022] DELETE /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.094404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.095176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.102896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.103576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.104168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.104974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.105634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.106548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.125304 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a HTTP/1.1 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '21506bff-2ca2-4365-b1ec-1cb1d9a24a1a'} Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.126915 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.132100 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.132100 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.132100 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.132100 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.132100 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.132100 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. Oct 28 13:36:19.132100 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.133079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 21506bff-2ca2-4365-b1ec-1cb1d9a24a1a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.134520 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-adb3dfd5-d33a-4aff-aba1-ff3eb560cc4c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a" status: 404 len: 111 microversion: 2.1 time: 0.044777 Oct 28 13:36:19.135999 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2921/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:19 2022] GET /compute/v2.1/servers/21506bff-2ca2-4365-b1ec-1cb1d9a24a1a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:36:19.152430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.156807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.165324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.168368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.168368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.168368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.168368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.168368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 HTTP/1.1 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '8ec2eee6-9121-4d27-bea1-873346cc1e79'} Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.202217 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a31f5a66-da82-43a4-b937-294605afd031 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 404 len: 111 microversion: 2.1 time: 0.055071 Oct 28 13:36:19.208197 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3004/5925] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:19 2022] DELETE /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.214577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.215274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 8ec2eee6-9121-4d27-bea1-873346cc1e79] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.222514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.223104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.223617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.224396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.227427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.231170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.247765 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 HTTP/1.1 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '8ec2eee6-9121-4d27-bea1-873346cc1e79'} Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.249965 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 8ec2eee6-9121-4d27-bea1-873346cc1e79 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.254677 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce582ad8-b483-4cea-b1bf-ca76eeed965e tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79" status: 404 len: 111 microversion: 2.1 time: 0.041644 Oct 28 13:36:19.255980 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2922/5926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:19 2022] GET /compute/v2.1/servers/8ec2eee6-9121-4d27-bea1-873346cc1e79 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.261541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.261807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.281767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.282373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.282921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.283677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.284146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.284577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.304705 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 HTTP/1.1 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '0e061c84-d890-4b90-9717-128de818f090'} Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.312420 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0324ca31-dd4a-4f02-aacd-b145d64d9b81 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 404 len: 111 microversion: 2.1 time: 0.050568 Oct 28 13:36:19.317845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3005/5927] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:19 2022] DELETE /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.322890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.323519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 0e061c84-d890-4b90-9717-128de818f090] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.331464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.331957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.332399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.333106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.334075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.335648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.352004 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 HTTP/1.1 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '0e061c84-d890-4b90-9717-128de818f090'} Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.353600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 0e061c84-d890-4b90-9717-128de818f090 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a445453-e4fd-429b-b903-bd6b0bfc7882 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090" status: 404 len: 111 microversion: 2.1 time: 0.040452 Oct 28 13:36:19.358687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2923/5928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:19 2022] GET /compute/v2.1/servers/0e061c84-d890-4b90-9717-128de818f090 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:36:19.367990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.368655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.375569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.376058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.376494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.377196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.377651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.378075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.395358 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a HTTP/1.1 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '88db8198-40b7-4adb-bf60-34abbc8b2b3a'} Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.397229 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.401640 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.403501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.406819 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-98e1bce5-a0e1-445e-956e-4b9628bf759c tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 404 len: 111 microversion: 2.1 time: 0.040984 Oct 28 13:36:19.406819 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3006/5929] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:19 2022] DELETE /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.413644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.414336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 88db8198-40b7-4adb-bf60-34abbc8b2b3a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.421501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.422059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.422778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.423693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:19.424218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:19.424732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:19.439683 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a HTTP/1.1 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '88db8198-40b7-4adb-bf60-34abbc8b2b3a'} Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.441352 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 88db8198-40b7-4adb-bf60-34abbc8b2b3a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-94001ad1-07ed-4f2c-a0f9-89c79748b0e2 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a" status: 404 len: 111 microversion: 2.1 time: 0.033014 Oct 28 13:36:19.450112 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2924/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:19 2022] GET /compute/v2.1/servers/88db8198-40b7-4adb-bf60-34abbc8b2b3a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.457599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29bcaf4c-86b3-4506-bf4e-5ec53f0b1ef1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.458229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-29bcaf4c-86b3-4506-bf4e-5ec53f0b1ef1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 5e8aaf30-ff82-4601-a487-73de1780adb3] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.464562 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-29bcaf4c-86b3-4506-bf4e-5ec53f0b1ef1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29bcaf4c-86b3-4506-bf4e-5ec53f0b1ef1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 HTTP/1.1 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '5e8aaf30-ff82-4601-a487-73de1780adb3'} Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.466371 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29bcaf4c-86b3-4506-bf4e-5ec53f0b1ef1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-29bcaf4c-86b3-4506-bf4e-5ec53f0b1ef1 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3" status: 404 len: 111 microversion: 2.1 time: 0.015744 Oct 28 13:36:19.472047 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3007/5931] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:19 2022] DELETE /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:19.477375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f196045f-b0f6-4b91-b6a5-9eb0ff730017 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:19.480155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f196045f-b0f6-4b91-b6a5-9eb0ff730017 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 5e8aaf30-ff82-4601-a487-73de1780adb3] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:19.485057 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f196045f-b0f6-4b91-b6a5-9eb0ff730017 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f196045f-b0f6-4b91-b6a5-9eb0ff730017 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 HTTP/1.1 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '5e8aaf30-ff82-4601-a487-73de1780adb3'} Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:19.486865 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f196045f-b0f6-4b91-b6a5-9eb0ff730017 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 5e8aaf30-ff82-4601-a487-73de1780adb3 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f196045f-b0f6-4b91-b6a5-9eb0ff730017 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3" status: 404 len: 111 microversion: 2.1 time: 0.015687 Oct 28 13:36:19.492641 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2925/5932] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:19 2022] GET /compute/v2.1/servers/5e8aaf30-ff82-4601-a487-73de1780adb3 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:20.539233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:20.541851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:20.550162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:20.550818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:20.551344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:20.552136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:20.552853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:20.554171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:20.786857 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-25edd746-82af-41da-b2fd-2d8bae5f06bb tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1834 microversion: 2.1 time: 0.550452 Oct 28 13:36:20.787682 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3008/5933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:20 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1834 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:22.860968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:22.861760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:22.883412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:22.885994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:22.887057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:22.894962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:22.894962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:22.895225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d898ca87-4ca6-4547-b6bc-19a0751a5227 req-92de2808-8dfd-4c10-a411-4e3dfcf8d1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:22.895689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:22.917649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d898ca87-4ca6-4547-b6bc-19a0751a5227 req-92de2808-8dfd-4c10-a411-4e3dfcf8d1cf service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:22.918138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d898ca87-4ca6-4547-b6bc-19a0751a5227 req-92de2808-8dfd-4c10-a411-4e3dfcf8d1cf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:22.918576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d898ca87-4ca6-4547-b6bc-19a0751a5227 req-92de2808-8dfd-4c10-a411-4e3dfcf8d1cf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:22.984855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:36:22.992950 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d898ca87-4ca6-4547-b6bc-19a0751a5227 req-92de2808-8dfd-4c10-a411-4e3dfcf8d1cf service nova] Creating event network-changed:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:36:23.007500 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d898ca87-4ca6-4547-b6bc-19a0751a5227 req-92de2808-8dfd-4c10-a411-4e3dfcf8d1cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118984 Oct 28 13:36:23.019824 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3009/5934] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:36:23.174478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:23.428554 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31d192ef-0a80-4261-9fc6-353e2074b1cb tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 204 len: 0 microversion: 2.1 time: 0.572332 Oct 28 13:36:23.432379 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2926/5935] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:22 2022] DELETE /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:36:23.439939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:23.440706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:23.458812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:23.461588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:23.462074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:23.463925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:23.464426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:23.468476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:24.167119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:24.181491 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9929ffd4-3e92-4924-9111-baffc0982117 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1689 microversion: 2.1 time: 0.747404 Oct 28 13:36:24.182082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3010/5936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:23 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1689 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:25.209603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:25.211079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:25.234241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:25.241112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:25.241763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:25.243811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:25.249628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:25.250153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:25.721542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:25.722384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:25.722987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:25.733895 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-79780247-d88a-4679-bd12-bc15ca484445 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1689 microversion: 2.1 time: 0.529438 Oct 28 13:36:25.735955 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2927/5937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:25 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1689 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:25.753464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:25.757937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:25.758646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:25.759442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:25.760083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:25.761175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:25.848937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d373afa9-b9f0-4690-95f8-9e45cc43fb1c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/ips" status: 200 len: 153 microversion: 2.20 time: 0.133734 Oct 28 13:36:25.883174 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3011/5938] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Oct 28 13:36:25 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/ips => generated 153 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 13:36:26.466964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:26.470212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:26.486205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.504655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.504655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.504655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.504655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.505714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.543878 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 HTTP/1.1 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7084c26d-2fae-4ddb-ace7-cd7783630182'} Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:26.545906 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b900353d-076a-487a-a8e4-69b6f106100b tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 404 len: 111 microversion: 2.1 time: 0.087553 Oct 28 13:36:26.552259 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2928/5939] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:26 2022] DELETE /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:26.566522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:26.569282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 7084c26d-2fae-4ddb-ace7-cd7783630182] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:26.583064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.587183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.592546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.593680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.598139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.599021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.649396 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 HTTP/1.1 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7084c26d-2fae-4ddb-ace7-cd7783630182'} Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.651716 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.658194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.658194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.658194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.658194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:26.658194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:26.658194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. Oct 28 13:36:26.658194 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.659596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 7084c26d-2fae-4ddb-ace7-cd7783630182 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:26.659761 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66eae326-e97f-4a7a-85eb-8019b525a074 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182" status: 404 len: 111 microversion: 2.1 time: 0.104107 Oct 28 13:36:26.664616 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3012/5940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:26 2022] GET /compute/v2.1/servers/7084c26d-2fae-4ddb-ace7-cd7783630182 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:26.668519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:26.677038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:26.689701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.690193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.690709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.691810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.691810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.692207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.715121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5d5b3a80-1055-4744-8916-56f65669f7a0 req-4348fdff-4ab1-4025-bd33-6e6cd4849e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1686c2-7a30-409e-862b-778f46a24aad", "name": "network-vif-deleted", "tag": "d1d76553-de0c-4595-be1d-2f492d2293af"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:26.731510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d HTTP/1.1 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '24cdede3-4829-4349-802a-71246263aa3d'} Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:26.732691 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:26.737900 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b92e77f1-f211-4e48-9742-24224ced20cc tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 404 len: 111 microversion: 2.1 time: 0.070204 Oct 28 13:36:26.740411 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2929/5941] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:36:26 2022] DELETE /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:36:26.757864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:26.758491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] [instance: 24cdede3-4829-4349-802a-71246263aa3d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:26.762019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5d5b3a80-1055-4744-8916-56f65669f7a0 req-4348fdff-4ab1-4025-bd33-6e6cd4849e2e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.771589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5d5b3a80-1055-4744-8916-56f65669f7a0 req-4348fdff-4ab1-4025-bd33-6e6cd4849e2e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.772730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5d5b3a80-1055-4744-8916-56f65669f7a0 req-4348fdff-4ab1-4025-bd33-6e6cd4849e2e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.784813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.785323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.786062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.786478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.786961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.787385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.830862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] HTTP exception thrown: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.836300 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5d5b3a80-1055-4744-8916-56f65669f7a0 req-4348fdff-4ab1-4025-bd33-6e6cd4849e2e service nova] Creating event network-vif-deleted:d1d76553-de0c-4595-be1d-2f492d2293af for instance ac1686c2-7a30-409e-862b-778f46a24aad on n-h2-862876-2 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Request method failure captured: Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d HTTP/1.1 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9nHpzWJwKeCUqzh15-_Gl8QTYj7m5HwNe7AyvqKlGP1m4lp8l0WKeCyoUnbqMNiXWRg8-hb9yfgkcGhbCrt9c5VeLbAizrU7JfTCbqAIEj-kQjo011d68AbYcw7XUyEwih66PYSNDGd_FzYHPoO3tHjpksTlNYxrTlZ9_SwjrcP-eI Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38b271ae34d44681b7f2e2d839b75865", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38b271ae34d44681b7f2e2d839b75865"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38b271ae34d44681b7f2e2d839b75865 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-458662655 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ba2dd748101e4b3492c9bea6a26cea14 Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-458662655-project Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '24cdede3-4829-4349-802a-71246263aa3d'} Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:26.847340 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] Returning 404 to user: Instance 24cdede3-4829-4349-802a-71246263aa3d could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea4885c0-795e-4680-96c4-b239c4930fc9 tempest-DeleteServersTestJSON-458662655 tempest-DeleteServersTestJSON-458662655-project] 10.222.0.25 "GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d" status: 404 len: 111 microversion: 2.1 time: 0.104519 Oct 28 13:36:26.856702 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2930/5942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:26 2022] GET /compute/v2.1/servers/24cdede3-4829-4349-802a-71246263aa3d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:26.857513 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5d5b3a80-1055-4744-8916-56f65669f7a0 req-4348fdff-4ab1-4025-bd33-6e6cd4849e2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145773 Oct 28 13:36:26.858543 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3013/5943] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:36:26.865864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:26.866486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:26.884704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.885862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.886487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:26.893850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:26.894607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:26.895249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:27.232782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:27.241535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a873e590-650c-4520-bd18-25a022055781 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 200 len: 1352 microversion: 2.1 time: 0.388741 Oct 28 13:36:27.246937 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2931/5944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:26 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 1352 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:36:28.284712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:28.286243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: ac1686c2-7a30-409e-862b-778f46a24aad] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:28.302106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:28.306137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:28.311346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:28.312556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:28.315295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:28.319172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:28.376398 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] HTTP exception thrown: Instance ac1686c2-7a30-409e-862b-778f46a24aad could not be found. Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Request method failure captured: Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad HTTP/1.1 Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9mayMITvj1WED7X4-LI_q-dqZgc6OMnHWkdghjk9JQGeng-uxFEkU53_e-hKVT8JReAQuIzjf8cMQzD6unQJiHZ6RiF5Zncy6jWXUSZ0QjnsCHVhZ3Y4I-81dkCR4L5abLF2-ERrK5ZpIzHeFr0wDrf-jAm3DxliK9sL-hRfID35aI Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_727d3fc63e0847efae144898701cbf5c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a5283ffea73c4febbbcce05e56bdd6cc Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ac1686c2-7a30-409e-862b-778f46a24aad could not be found. Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ac1686c2-7a30-409e-862b-778f46a24aad'} Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1686c2-7a30-409e-862b-778f46a24aad could not be found. Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1686c2-7a30-409e-862b-778f46a24aad could not be found. Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:28.378017 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1686c2-7a30-409e-862b-778f46a24aad could not be found. Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:36:28.383567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Returning 404 to user: Instance ac1686c2-7a30-409e-862b-778f46a24aad could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:28.399309 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e12f578-8894-4a8d-93c8-77805c79f05f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad" status: 404 len: 111 microversion: 2.1 time: 0.117658 Oct 28 13:36:28.405794 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3014/5945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:36:28 2022] GET /compute/v2.1/servers/ac1686c2-7a30-409e-862b-778f46a24aad => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:36:29.911644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:29.914772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:29.931526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:29.944474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:29.945265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:29.946979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:29.949002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:29.949693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:29.954906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:30.008801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lazy-loading 'flavor' on Instance uuid bd5181f8-b838-41a3-a5ae-bad3451e6388 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:36:30.747928 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-205987ba-1ead-4c38-beac-399360be669f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/action" status: 202 len: 0 microversion: 2.20 time: 0.844732 Oct 28 13:36:30.749467 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2932/5946] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:36:29 2022] POST /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:36:30.769696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:30.769696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:30.791606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:30.792125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:30.793083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:30.796990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:30.798366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:30.799010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:31.230244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:31.244291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:31.246223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:31.248967 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9fba1444-7ce8-4b91-b584-25f3ba01cd92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.495163 Oct 28 13:36:31.254681 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3015/5947] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:30 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:32.289847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:32.290548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:32.322515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:32.323080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:32.323599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:32.331398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:32.331909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:32.332354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:32.530632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:32.548378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:32.549704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:32.551105 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bc7264ea-f45c-4357-97dd-df7b2af5b136 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.269220 Oct 28 13:36:32.552167 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2933/5948] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:32 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:33.580309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:33.581561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:33.585133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:33.599413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:33.600225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:33.600954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:33.601873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:33.603569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:33.604209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:33.899489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:33.918122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:33.928961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:33.930811 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1250060a-be1a-453b-8de0-874c88616532 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.355013 Oct 28 13:36:33.949823 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3016/5949] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:33 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:34.962903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:34.964792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:34.985516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:34.986021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:34.986455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:34.991502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:34.991994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:34.992432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:35.548161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:35.563840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:35.574221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:35.576793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-725ad2b8-18d1-461a-b47b-c31989f4057f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.618710 Oct 28 13:36:35.577563 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2934/5950] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:34 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:36.604704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:36.605708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:36.631144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:36.634819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:36.635304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:36.637221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:36.637221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:36.637221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:37.186144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:37.199919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:37.203610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:37.206046 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a2e2be7-d343-4159-a82b-e28adc6acc12 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.606627 Oct 28 13:36:37.209681 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3017/5951] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:36 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:38.237681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:38.239011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:38.249347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:38.250048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:38.250583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:38.254933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:38.256424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:38.256973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:38.689665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:38.700558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:38.701494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:38.703264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e08f8acc-6171-4fb0-97ba-0b2b7c56ef52 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.470311 Oct 28 13:36:38.703827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2935/5952] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:38 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:39.050076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60a98bcb-f46c-4957-93c2-0de3b315c407 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '.version_select at 0x7f27bdadb040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:39.140108 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60a98bcb-f46c-4957-93c2-0de3b315c407 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1286622647" status: 202 len: 0 microversion: 2.1 time: 0.092324 Oct 28 13:36:39.140108 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3018/5953] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 13:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1286622647 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:36:39.200976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0eb8091-bd20-4267-8273-abd9f0488bf7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: .version_select at 0x7f27b84bd700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1275469927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUhTzlzRL8JY6wWAFU83SX6pomwUEaL96V5obuffL9s86bQGuCWpbHPcGUGuA4lzbQtKVOLLUQMmBjwxfoRGSl2MCMXhoBp+lA8a0JbTL2sUru8ZmMkjH+n/w8AalX/gg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:39.228358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e0eb8091-bd20-4267-8273-abd9f0488bf7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:36:39.235639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e0eb8091-bd20-4267-8273-abd9f0488bf7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:36:39.415070 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0eb8091-bd20-4267-8273-abd9f0488bf7 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.221132 Oct 28 13:36:39.416371 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2936/5954] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:36:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:36:39.729803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:39.730413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:39.748655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:39.749576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:39.750007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:39.750926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:39.751545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:39.752525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:40.082336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:40.091085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:40.092566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:40.093978 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ee1462b-2603-41c5-8f21-21ace532d317 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.368144 Oct 28 13:36:40.094695 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3019/5955] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:39 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:40.935616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-802440820", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": "none"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:41.028946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:36:41.029382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:36:41.030413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:36:41.030856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:36:41.040614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:36:41.060043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:41.060545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:41.061215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:41.062145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:41.062849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:41.063288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:41.081714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Getting quotas for project f4e38165e0d944bbbf6c7a58cbca8118. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:36:41.087774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Getting quotas for user 7d49c1f52823454f91125fa0e9be8d64 and project f4e38165e0d944bbbf6c7a58cbca8118. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:36:41.103904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:36:41.106560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:36:41.119477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:41.120154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:41.127434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:41.127932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:41.129739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:41.129739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:41.129739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:41.130069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:41.154051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:41.246716 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3aa3f131-66cb-46da-be02-8bb5105b8399 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.572044 Oct 28 13:36:41.248143 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2937/5956] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:36:41.263807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec5c64fb-167b-40b7-ad45-b422436cc442 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:41.265522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec5c64fb-167b-40b7-ad45-b422436cc442 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:41.308118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:41.372814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:41.386517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:41.387882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3e1c699-0129-40b5-9e23-9202f5e292f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.272385 Oct 28 13:36:41.406303 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3020/5957] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:41 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:41.446907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec5c64fb-167b-40b7-ad45-b422436cc442 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:41.473187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec5c64fb-167b-40b7-ad45-b422436cc442 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:41.479168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec5c64fb-167b-40b7-ad45-b422436cc442 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:41.487581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec5c64fb-167b-40b7-ad45-b422436cc442 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1280 microversion: 2.47 time: 0.227682 Oct 28 13:36:41.502536 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2938/5958] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:41 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:42.422545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:42.423978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:42.448327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:42.449148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:42.449855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:42.450824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:42.451440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:42.452170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:42.522691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-569593ed-d9f2-4a59-aa44-5b450411f205 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:42.523575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-569593ed-d9f2-4a59-aa44-5b450411f205 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:42.700501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-569593ed-d9f2-4a59-aa44-5b450411f205 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:42.710034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-569593ed-d9f2-4a59-aa44-5b450411f205 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:42.711925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-569593ed-d9f2-4a59-aa44-5b450411f205 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:42.713316 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-569593ed-d9f2-4a59-aa44-5b450411f205 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1280 microversion: 2.47 time: 0.199114 Oct 28 13:36:42.731043 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2939/5959] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:42 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:42.862004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:42.877045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:42.879353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:42.880775 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-588521db-851b-45fd-8515-fdedc037a92d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1745 microversion: 2.20 time: 0.464933 Oct 28 13:36:42.897040 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3021/5960] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:42 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1745 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:43.746358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:43.748098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:43.780329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:43.782259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:43.783541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:43.784460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:43.785307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:43.786780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:43.901026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:43.923463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:43.925929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:43.958422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:43.962739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:43.963011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:43.963703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:43.964139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:43.964855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:43.965310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:43.971180 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a44ddf02-7bc5-437f-809a-ac024d35ea7e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1332 microversion: 2.47 time: 0.225415 Oct 28 13:36:43.972035 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2940/5961] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:43 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1332 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:36:43.972408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:44.366264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:44.377993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:44.380281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:44.382328 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-810d8df1-0273-4395-9ec3-c08c9d1e4d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.474850 Oct 28 13:36:44.383450 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3022/5962] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:43 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:44.714809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-088b37b6-c42f-4eaa-abfa-9a155611622c req-cc14d2a8-c745-4864-8a7b-e7aff3c098e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "name": "network-vif-plugged", "status": "completed", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:44.723733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-088b37b6-c42f-4eaa-abfa-9a155611622c req-cc14d2a8-c745-4864-8a7b-e7aff3c098e3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:44.724211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-088b37b6-c42f-4eaa-abfa-9a155611622c req-cc14d2a8-c745-4864-8a7b-e7aff3c098e3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:44.724632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-088b37b6-c42f-4eaa-abfa-9a155611622c req-cc14d2a8-c745-4864-8a7b-e7aff3c098e3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:44.757985 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-088b37b6-c42f-4eaa-abfa-9a155611622c req-cc14d2a8-c745-4864-8a7b-e7aff3c098e3 service nova] Creating event network-vif-plugged:4d9ff784-54aa-47d3-9d78-3b5fbce30ceb for instance bd5181f8-b838-41a3-a5ae-bad3451e6388 on n-h2-862876-2 Oct 28 13:36:44.764085 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-088b37b6-c42f-4eaa-abfa-9a155611622c req-cc14d2a8-c745-4864-8a7b-e7aff3c098e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053630 Oct 28 13:36:44.764930 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2941/5963] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:36:45.005456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:45.006788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:45.024731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:45.025511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:45.026126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:45.027236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:45.027889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:45.028480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:45.150220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:45.166667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:45.175721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:45.192078 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-241816cd-a548-49a0-893b-4d6da35b48c1 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1338 microversion: 2.47 time: 0.178351 Oct 28 13:36:45.192078 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3023/5964] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:44 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1338 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:45.415079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:45.415781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:45.428564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:45.437738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:45.438505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:45.439732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:45.440372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:45.440977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:45.754298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:45.776576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:45.779133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:45.781378 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da023f42-0f2d-4c33-84a5-e00e52a10edd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.371557 Oct 28 13:36:45.782526 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2942/5965] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:45 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:46.224906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:46.226246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:46.233826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:46.234323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:46.234814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:46.235564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:46.236024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:46.236454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:46.353775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:46.377170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:46.378733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:46.395930 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1207c0a8-a8f0-40f2-8f0f-26f0f162a7ca tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1338 microversion: 2.47 time: 0.185698 Oct 28 13:36:46.396942 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3024/5966] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:46 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1338 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:46.812019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:46.813291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:46.822731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:46.823236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:46.823702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:46.824412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:46.825005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:46.837382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:47.428905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:47.431378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:47.449168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:47.465695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:47.466402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:47.466736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:47.470609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:47.479163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:47.479444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:47.479444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:47.479647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:47.483933 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b3ed824-8dae-4165-8f7f-637156d057ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.671927 Oct 28 13:36:47.484604 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2943/5967] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:46 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:47.628584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:47.637982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:47.647296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:47.653116 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e6e64b43-28c7-4e07-aafb-9d3f01c3306e tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1359 microversion: 2.47 time: 0.229204 Oct 28 13:36:47.665250 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3025/5968] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:47 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:47.695325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-20173395"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:47.698028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:47.718396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:47.718912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:47.721653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:47.722738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:47.723426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:47.727853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:48.512261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:48.512815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:48.526284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:48.538454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:48.538860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:48.539638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:48.540121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:48.540553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:48.570567 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9669458e-627f-4775-a2b1-264bb1c76a18 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "POST /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368/action" status: 202 len: 52 microversion: 2.47 time: 0.878838 Oct 28 13:36:48.584566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2944/5969] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:36:47 2022] POST /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368/action => generated 52 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 28 13:36:48.584566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:48.585006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:48.610447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:48.617277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:48.618463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:48.621598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:48.625366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:48.626045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:48.732829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:36:48.865728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:49.197591 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88b9e8e5-7411-4661-9ce0-f3af86fabe46 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 204 len: 0 microversion: 2.47 time: 0.616704 Oct 28 13:36:49.202826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2945/5970] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:36:48 2022] DELETE /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:36:49.209321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:49.210061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:49.229162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:49.229836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:49.230939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:49.231647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:49.238419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:49.239318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:49.476177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:49.486267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:49.497597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:49.497597 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87a83bba-a1cc-4ef6-a10f-44bc5e9c604b tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1365 microversion: 2.47 time: 0.290785 Oct 28 13:36:49.498820 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2946/5971] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:49 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:50.387391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:50.410852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:50.423779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:50.427530 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d1cc84e8-063b-4c7d-a421-566c602583a3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 1.919482 Oct 28 13:36:50.449181 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3026/5972] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:48 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:36:50.540377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:50.541961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:50.573997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:50.580022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:50.580688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:50.589224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:50.591262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:50.591926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:50.818092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:50.846260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:50.847736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:50.867334 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca2dd0e4-0a6a-4453-8982-1ad13da7f6a0 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1365 microversion: 2.47 time: 0.321244 Oct 28 13:36:50.868662 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2947/5973] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:50 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:51.463159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:51.463779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:51.514635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:51.515310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:51.515824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:51.516579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:51.573043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:51.583625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:51.906167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:51.908129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:51.910980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:51.939987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:51.940484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:51.940920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:51.941636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:51.942092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:51.973655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:52.318990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:52.328524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:52.336955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:52.352379 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-729dfd9c-02f2-44ec-bf0b-fee035171a56 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.894381 Oct 28 13:36:52.365643 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3027/5974] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:51 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:52.705306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:36:53.385387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:53.390721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:53.432348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:53.444021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:53.444501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:53.445259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:53.445730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:53.446161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:53.592754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:53.601645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:53.631096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d49c1f52823454f91125fa0e9be8d64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e38165e0d944bbbf6c7a58cbca8118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:53.640148 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-716f2f30-6fdf-4bd8-8f62-7264c705ad77 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 200 len: 1365 microversion: 2.47 time: 1.734714 Oct 28 13:36:53.641406 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2948/5975] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:51 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 1365 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:36:54.273454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:54.289913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:54.291764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:54.299023 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bd3c3a7-2ff1-44b1-8451-add2acbbf126 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.918476 Oct 28 13:36:54.302146 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3028/5976] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:53 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:54.670512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:54.676955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] [instance: 9196a5e5-f069-4fc0-8be7-5d2717f96368] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:54.692294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:54.694359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:54.695742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:54.701644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:54.707078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:54.707860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:54.771436 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] HTTP exception thrown: Instance 9196a5e5-f069-4fc0-8be7-5d2717f96368 could not be found. Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Request method failure captured: Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 HTTP/1.1 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9ron9-ofNxne3qLg6fENSbX1nDfbguMGj8axRi2I8syDWr1VP7eob-468OuP38jXDOWfh2LgDqbu7nZ0TOsch8_-o7bnRlGCY2PhloYz4Bl5iH3220ICPvUh7ik5n6E23YlZFtSAd1iFeX0xE5zSl4TbltibDaRFYLY_-tX0-psu68 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f4e38165e0d944bbbf6c7a58cbca8118 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAaction247Test-1205216095 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4e38165e0d944bbbf6c7a58cbca8118"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4e38165e0d944bbbf6c7a58cbca8118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f4e38165e0d944bbbf6c7a58cbca8118", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f4e38165e0d944bbbf6c7a58cbca8118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAaction247Test-1205216095 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f4e38165e0d944bbbf6c7a58cbca8118 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAaction247Test-1205216095 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAaction247Test-1205216095-project Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7d49c1f52823454f91125fa0e9be8d64 Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAaction247Test-1205216095-project Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 9196a5e5-f069-4fc0-8be7-5d2717f96368 could not be found. Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '9196a5e5-f069-4fc0-8be7-5d2717f96368'} Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9196a5e5-f069-4fc0-8be7-5d2717f96368 could not be found. Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9196a5e5-f069-4fc0-8be7-5d2717f96368 could not be found. Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:54.794026 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9196a5e5-f069-4fc0-8be7-5d2717f96368 could not be found. Oct 28 13:36:54.800482 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:36:54.808374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] Returning 404 to user: Instance 9196a5e5-f069-4fc0-8be7-5d2717f96368 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:36:54.812499 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d5f72638-6bd1-4463-b017-5505b584b625 tempest-ServersAaction247Test-1205216095 tempest-ServersAaction247Test-1205216095-project] 10.222.0.25 "GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368" status: 404 len: 111 microversion: 2.47 time: 0.146543 Oct 28 13:36:54.817906 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2949/5977] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:54 2022] GET /compute/v2.1/servers/9196a5e5-f069-4fc0-8be7-5d2717f96368 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:55.640465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:56.399466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:56.424667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:56.431908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:56.450493 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac4804a6-df2b-4a94-a25e-97d754501dfc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 1.108111 Oct 28 13:36:56.456405 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3029/5978] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:55 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:57.487264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:57.488527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:57.503910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:57.504894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:57.505698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:57.506629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:57.513785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:57.519008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:58.315565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:58.337065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:58.339141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:58.349604 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-53631bc3-25b1-49ce-b62f-3104205143b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.869284 Oct 28 13:36:58.355274 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2950/5979] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:57 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:36:59.382115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:36:59.382962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:36:59.396942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:59.399281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:59.399994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:59.407799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:36:59.409855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:36:59.410500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:36:59.735894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-15727514", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a8eb8638-ac79-419e-b6e3-43897b3cfd8e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1275469927", "security_groups": [{"name": "tempest-secgroup-smoke-1626704430"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:36:59.954131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:59.977016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:59.981632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:36:59.991520 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-341194da-6c91-4b09-a145-a4d01a158c54 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.610633 Oct 28 13:36:59.995773 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3030/5980] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:36:59 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:00.044379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] validate_networks() for [('a8eb8638-ac79-419e-b6e3-43897b3cfd8e', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:37:00.490125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:01.022433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:01.023648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:01.036247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:01.036673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:01.037119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:01.037838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:01.038303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:01.038738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:01.663119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:01.677816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:01.689087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:01.693655 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28dd9349-3a90-4b21-9ba0-1a83ab995af9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.675086 Oct 28 13:37:01.700859 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3031/5981] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:01 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:02.444607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:37:02.445727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:37:02.446392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:37:02.447044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:37:02.447667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:37:02.470717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:02.476143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:02.477342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:02.478251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:02.479088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:02.479364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:02.520614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:37:02.565337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:37:02.585510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:37:02.589076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:37:02.736259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:02.736893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:02.758183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:02.765988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:02.766464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:02.767274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:02.767745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:02.781621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:02.808900 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-21d4d51b-e995-4ea9-a930-d703851035aa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.077243 Oct 28 13:37:02.817318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2951/5982] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:36:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 3086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:37:02.832068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d83e31c8-b98a-4176-abf2-d82fc51abdcc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:02.832858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d83e31c8-b98a-4176-abf2-d82fc51abdcc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:03.006316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d83e31c8-b98a-4176-abf2-d82fc51abdcc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:03.024342 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d83e31c8-b98a-4176-abf2-d82fc51abdcc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1265 microversion: 2.1 time: 0.203778 Oct 28 13:37:03.025231 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2952/5983] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:02 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:03.238095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:03.267236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:03.269061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:03.270836 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-644d3ed0-3e79-45dd-b5fe-2168cc8eeefb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.538629 Oct 28 13:37:03.272486 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3032/5984] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:02 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:04.049302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c41d29b-15ac-4190-8b5e-203cf7921c92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:04.049941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c41d29b-15ac-4190-8b5e-203cf7921c92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:04.148620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c41d29b-15ac-4190-8b5e-203cf7921c92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:04.158049 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c41d29b-15ac-4190-8b5e-203cf7921c92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1265 microversion: 2.1 time: 0.112983 Oct 28 13:37:04.196732 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2953/5985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:04 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:04.299921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:04.301597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:04.329180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:04.330722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:04.331880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:04.344293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:04.347609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:04.348160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:04.940312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:04.952715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:04.954688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:04.956795 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf82f2ce-c57a-4ea3-8695-4ae697e781ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.661365 Oct 28 13:37:04.973969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3033/5986] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:04 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:05.185820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:05.187244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:05.194880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:05.195369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:05.195802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:05.196503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:05.196958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:05.197383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:05.260264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:05.268451 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e38037aa-4e8c-4dea-a7de-5e0c955bbdbe tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1269 microversion: 2.1 time: 0.086522 Oct 28 13:37:05.269040 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2954/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:05 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:05.983907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:05.984744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:06.009699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:06.015617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:06.016432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:06.017786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:06.018288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:06.021981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:06.291685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:06.292295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:06.315026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:06.316345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:06.322733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:06.323709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:06.324323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:06.331356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:06.556961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:06.566139 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-44597fda-d3e9-4d93-b2a4-a59accbb7d91 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1317 microversion: 2.1 time: 0.278376 Oct 28 13:37:06.568226 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2955/5988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:06 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:37:06.640326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:06.650648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:06.652639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:06.654315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf91d071-a913-420a-ba41-7cb0825fb2a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.675155 Oct 28 13:37:06.678054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3034/5989] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:05 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:07.593812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:07.594430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:07.609981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:07.610830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:07.631026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:07.632060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:07.639453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:07.640553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:07.687236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:07.687859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:07.694912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:07.719377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:07.721736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:07.725533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:07.727642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:07.736802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:07.738017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:07.912832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:07.935435 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-212b15c1-e9bc-48ad-9c0c-2ef2476c820c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1323 microversion: 2.1 time: 0.342320 Oct 28 13:37:07.942418 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2956/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:07 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1323 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:08.313470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:08.327981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:08.327981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:08.361292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ddce6b8d-6417-4271-964f-3e2871f8d9ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.677557 Oct 28 13:37:08.364657 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3035/5991] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:07 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:08.964342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:08.970195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:09.011335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:09.012013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:09.015215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:09.018280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:09.024171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:09.025836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:09.292800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:09.310259 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7ae75f9e-5ed5-4a8a-a514-fbdca8e810cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1323 microversion: 2.1 time: 0.350919 Oct 28 13:37:09.312554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2957/5992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:08 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:09.396406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:09.397053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:09.441031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:09.449846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:09.451106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:09.455486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:09.460549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:09.466582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:10.339102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:10.340492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:10.352771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:10.354466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:10.357409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:10.360670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:10.361315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:10.362936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:10.520192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:10.554972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:10.562524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:10.564429 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50830734-7f2e-4268-8140-fc62d2ba2aa9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 1.173454 Oct 28 13:37:10.566286 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3036/5993] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:09 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:10.862338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:10.872577 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1eb8b577-c6a9-4a60-9a96-f3623d235eb4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 0.540071 Oct 28 13:37:10.876179 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2958/5994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:10 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:11.597535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:11.598705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:11.615153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:11.615939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:11.617954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:11.618919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:11.620878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:11.621633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:11.649101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:11.899336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:11.899965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:11.916112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:11.916547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:11.916996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:11.917705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:11.918167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:11.918591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:12.498175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:12.538276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:12.549751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:12.568955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:12.570229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ec611817-e623-4a1c-aa87-f3516b85f1d1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.977286 Oct 28 13:37:12.574781 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3037/5995] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:11 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:12.901232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:12.932588 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-516704e6-3450-4782-bb2c-10ce88dea181 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 1.034578 Oct 28 13:37:12.934241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2959/5996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:11 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:13.149692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5714b543-b640-4f10-88dc-da058032416f req-b165da0f-7275-4142-9633-ad889767d80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a40daf9-c546-4eeb-9890-f6a1631afb49", "tag": "b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:13.191041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5714b543-b640-4f10-88dc-da058032416f req-b165da0f-7275-4142-9633-ad889767d80a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:13.191737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5714b543-b640-4f10-88dc-da058032416f req-b165da0f-7275-4142-9633-ad889767d80a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:13.192188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5714b543-b640-4f10-88dc-da058032416f req-b165da0f-7275-4142-9633-ad889767d80a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:13.256281 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5714b543-b640-4f10-88dc-da058032416f req-b165da0f-7275-4142-9633-ad889767d80a service nova] Creating event network-changed:b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414 for instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 on n-h1-862876-2 Oct 28 13:37:13.272279 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5714b543-b640-4f10-88dc-da058032416f req-b165da0f-7275-4142-9633-ad889767d80a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125849 Oct 28 13:37:13.274249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3038/5997] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:37:13.600790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:13.601480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:13.612540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:13.615426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:13.616002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:13.621080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:13.624449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:13.631100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:13.962556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:13.963399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:13.988356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:13.991223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:13.991906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:13.992749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:13.999519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:14.002936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:14.155994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=10 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:14.466993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:14.477918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:14.499375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:14.506984 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd22ed1b-7633-49d7-af52-e61690cb3e6b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.909184 Oct 28 13:37:14.510004 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2960/5998] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:13 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:15.144857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:15.182302 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1dae362-6ca1-48b1-a988-0fcc64ae6f6b tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 1.224323 Oct 28 13:37:15.183353 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3039/5999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:13 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:37:15.542043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:15.543639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:15.556805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:15.559104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:15.561139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:15.564572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:15.565241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:15.567295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:16.222045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:16.222989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:16.229564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:16.235265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:16.235937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:16.236617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:16.237633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:16.238965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:16.239748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:16.250531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:16.252989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:16.255563 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-30361f5f-ef86-4aa2-a493-86e7c3b073e9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 0.716819 Oct 28 13:37:16.256886 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2961/6000] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:15 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:17.048998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:17.058239 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-604f0061-a249-4b7b-b7d8-1135897ee203 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 0.840519 Oct 28 13:37:17.065551 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3040/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:16 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:17.285452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:17.286073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:17.298776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:17.302988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:17.305425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:17.305425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:17.305425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:17.305425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:18.081550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:18.082939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:18.096229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:18.097078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:18.097767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:18.098726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:18.100339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:18.111629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:18.420211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:18.431573 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b077c467-db4c-41c1-8d6e-82cba0331e56 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 0.353805 Oct 28 13:37:18.433549 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3041/6002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:18 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:37:18.563141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:18.581639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:18.585764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:18.587493 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5074a9db-ccb0-4ad2-8b4a-a53c5424ea98 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1740 microversion: 2.20 time: 1.307551 Oct 28 13:37:18.588293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2962/6003] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:17 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1740 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:19.458408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:19.460153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:19.475050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:19.475847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:19.476489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:19.480131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:19.480131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:19.480131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:19.637908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:19.640319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:19.666589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:19.668576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:19.674980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:19.685457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:19.686846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:19.691109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:20.085463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:20.094350 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07528a02-759d-46aa-81fd-abc64e5b7a0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 0.642367 Oct 28 13:37:20.098202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3042/6004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:19 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:20.240526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:20.249234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:20.250690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:20.251897 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa03933d-b8e0-413f-b133-79aff865703a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1722 microversion: 2.20 time: 0.618022 Oct 28 13:37:20.268937 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2963/6005] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:19 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1722 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:21.126066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:21.128281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:21.140443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:21.141298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:21.141964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:21.145515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:21.146281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:21.151091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:21.285459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:21.286268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:21.298117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:21.303704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:21.304248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:21.305588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:21.306287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:21.306959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:21.363968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:21.445600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:21.454727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-80aaf6f4-4a7a-4799-989c-3a462c9daa4f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 0.335734 Oct 28 13:37:21.455963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3043/6006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:21 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:21.758027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:21.767410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:21.779700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:21.782952 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00c48610-8ef0-435e-babc-8ab632b7b4bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1722 microversion: 2.20 time: 0.501900 Oct 28 13:37:21.785740 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2964/6007] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:21 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:21.990249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-225929339", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "04880eaf-27b5-4656-9900-06a30ab28127"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:22.052545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] validate_networks() for [('04880eaf-27b5-4656-9900-06a30ab28127', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:37:22.189747 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 13:37:22.191041 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 13:37:22.486579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:22.488765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:22.497586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:22.499769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:22.502612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:22.504667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:22.505717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:22.507770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:23.076066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:23.094302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7cb6e659-1b3f-47c6-b79a-f66c39d3a463 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 0.617381 Oct 28 13:37:23.099669 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2965/6008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:22 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:37:23.124555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:23.127416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:23.136777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:23.137651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:23.138312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:23.140590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:23.141067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:23.141512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:23.196233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:37:23.196810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:37:23.197742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:37:23.198483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:37:23.199132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:37:23.212355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:23.212858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:23.213409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:23.214589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:23.215252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:23.215890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:23.239559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Getting quotas for project a0c696c2b41747739738a27dac4f0fb8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:37:23.250117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Getting quotas for user 445d146910d44319a0821658d39c6ef4 and project a0c696c2b41747739738a27dac4f0fb8. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:37:23.267066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:37:23.269671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:37:23.457101 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-334a8add-0a88-4278-864c-8c69f3c9914a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.683901 Oct 28 13:37:23.458335 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3044/6009] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:37:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 13:37:23.468123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5380bbec-1bca-4eca-ac08-a6ab08588024 req-cbf70ebb-ed49-4566-a4f9-c0308aba7aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a40daf9-c546-4eeb-9890-f6a1631afb49", "name": "network-vif-plugged", "status": "completed", "tag": "b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:23.494008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:23.495681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5380bbec-1bca-4eca-ac08-a6ab08588024 req-cbf70ebb-ed49-4566-a4f9-c0308aba7aed service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:23.498451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5380bbec-1bca-4eca-ac08-a6ab08588024 req-cbf70ebb-ed49-4566-a4f9-c0308aba7aed service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:23.499640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5380bbec-1bca-4eca-ac08-a6ab08588024 req-cbf70ebb-ed49-4566-a4f9-c0308aba7aed service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:23.534368 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5380bbec-1bca-4eca-ac08-a6ab08588024 req-cbf70ebb-ed49-4566-a4f9-c0308aba7aed service nova] Creating event network-vif-plugged:b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414 for instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 on n-h1-862876-2 Oct 28 13:37:23.549833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:23.552656 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5380bbec-1bca-4eca-ac08-a6ab08588024 req-cbf70ebb-ed49-4566-a4f9-c0308aba7aed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092821 Oct 28 13:37:23.553687 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3045/6010] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:37:23.558256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:23.561081 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7aeaeef-0386-4e78-be7b-0da7b8bb3b49 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1665 microversion: 2.20 time: 0.458511 Oct 28 13:37:23.568633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8a05447b-033f-4d34-9c8d-5305cfbb881a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:23.575148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8a05447b-033f-4d34-9c8d-5305cfbb881a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:23.610530 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2966/6011] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:23 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1665 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:23.626029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4cc45b7-d060-4407-90a4-35bb1675e6ec"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:23.636254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:23.649532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:23.650266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:23.651885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:23.653203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:23.654449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:23.655098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:24.018858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8a05447b-033f-4d34-9c8d-5305cfbb881a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:24.027427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8a05447b-033f-4d34-9c8d-5305cfbb881a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:24.028937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8a05447b-033f-4d34-9c8d-5305cfbb881a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:24.033344 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8a05447b-033f-4d34-9c8d-5305cfbb881a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1261 microversion: 2.26 time: 0.478336 Oct 28 13:37:24.046258 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3046/6012] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:23 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1261 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:24.130025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:24.131146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:24.149689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:24.150125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:24.150611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:24.151536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:24.152006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:24.152441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:24.339549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:24.351886 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7bf37c71-8e8b-4ab3-8e32-37434b27a9cf tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1391 microversion: 2.1 time: 0.225913 Oct 28 13:37:24.353348 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3047/6013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:24 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:25.062867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7fa1cfd-474c-4b8e-88d1-c4b8d703848a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:25.063702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b7fa1cfd-474c-4b8e-88d1-c4b8d703848a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:25.188159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7fa1cfd-474c-4b8e-88d1-c4b8d703848a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:25.197249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7fa1cfd-474c-4b8e-88d1-c4b8d703848a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:25.198693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7fa1cfd-474c-4b8e-88d1-c4b8d703848a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:25.201516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7fa1cfd-474c-4b8e-88d1-c4b8d703848a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1261 microversion: 2.26 time: 0.142883 Oct 28 13:37:25.203140 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3048/6014] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:25 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:25.252074 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3146825a-3049-4eea-b32b-d27276147840 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.639560 Oct 28 13:37:25.252706 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2967/6015] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Oct 28 13:37:23 2022] POST /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 188 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:37:25.381263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:25.382504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:25.409170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:25.410028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:25.410636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:25.411942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:25.412581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:25.413160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:25.522672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:25.524335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:25.615699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:25.635718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:25.641551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:25.648615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:25.651788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:25.665948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:25.830002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127794) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 13:37:25.886634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:25.895640 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-99aa72b0-5adc-4f97-8058-ffc159f7dca9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1563 microversion: 2.1 time: 0.518957 Oct 28 13:37:25.896243 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3049/6016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:25 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1563 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:25.946777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-09f03521-d90b-4477-9c16-b25376fea2e4 req-d1a80797-8d36-440b-983e-bf6ccbeb0925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "name": "network-vif-unplugged", "status": "completed", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:25.976284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-09f03521-d90b-4477-9c16-b25376fea2e4 req-d1a80797-8d36-440b-983e-bf6ccbeb0925 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:25.978926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-09f03521-d90b-4477-9c16-b25376fea2e4 req-d1a80797-8d36-440b-983e-bf6ccbeb0925 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:25.979522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-09f03521-d90b-4477-9c16-b25376fea2e4 req-d1a80797-8d36-440b-983e-bf6ccbeb0925 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:26.018307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.server_external_events [req-09f03521-d90b-4477-9c16-b25376fea2e4 req-d1a80797-8d36-440b-983e-bf6ccbeb0925 service nova] Unable to find a host for instance bd5181f8-b838-41a3-a5ae-bad3451e6388. Dropping event network-vif-unplugged {{(pid=127793) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 13:37:26.026561 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-09f03521-d90b-4477-9c16-b25376fea2e4 req-d1a80797-8d36-440b-983e-bf6ccbeb0925 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.107620 Oct 28 13:37:26.027401 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3050/6017] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 110 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 13:37:26.060622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:26.067327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:26.121614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:26.122177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:26.122634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:26.124771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:26.125401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:26.127306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:26.319395 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f0ec03a-7e83-4dd0-8d17-3b253ad84b0e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/action" status: 202 len: 0 microversion: 2.20 time: 0.793891 Oct 28 13:37:26.320482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2968/6018] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:37:25 2022] POST /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:37:26.330416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:26.365716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:26.396686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:26.397856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:26.398456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:26.400053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:26.401067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:26.401988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:26.674770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:26.698481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:26.701401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:26.710824 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfe5c006-b8f0-45e1-817a-f37e2dd1aeda tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1313 microversion: 2.26 time: 0.380637 Oct 28 13:37:26.711844 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2969/6019] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:26 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:26.747720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:26.750931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:26.764911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:26.765612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:26.766722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:26.768147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:26.770644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:26.771287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:26.787214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:26.798340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-43db2145-a44b-416d-9211-d74a9e6c42a3 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1563 microversion: 2.1 time: 0.769622 Oct 28 13:37:26.805699 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3051/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:26 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1563 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:27.731440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:27.742017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:27.742705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:27.761096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:27.761600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:27.762051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:27.769144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:27.771391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:27.776858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-078bbd89-8e02-4fbf-8704-017db130b226 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1751 microversion: 2.20 time: 1.044776 Oct 28 13:37:27.776858 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2970/6021] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:26 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1751 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:27.814539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:27.815279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.052s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:27.815839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:28.798461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:28.812302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:28.813739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:28.828966 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a355a4eb-f2c7-4478-b67b-2093c187097e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1331 microversion: 2.26 time: 1.077339 Oct 28 13:37:28.836320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:28.837533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:28.843547 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3052/6022] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:27 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1331 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:28.849054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:28.849837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:28.851124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:28.859608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:28.860274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:28.860764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:29.561726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:29.579128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:29.589570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:29.593449 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-392f8609-5440-4439-be9b-b515c5ebcd83 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1751 microversion: 2.20 time: 0.760390 Oct 28 13:37:29.614088 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2971/6023] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:28 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1751 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:29.863379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:29.864006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:29.882520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:29.883528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:29.887268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:29.889043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:29.890207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:29.894643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:30.196705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:30.212342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:30.221585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:30.223528 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c2afdc7-9ed9-4214-bbd5-1446659b2b27 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1319 microversion: 2.26 time: 0.364581 Oct 28 13:37:30.229691 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3053/6024] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:29 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:30.632366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:30.633508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:30.644833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:30.648517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:30.651262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:30.652346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:30.654550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:30.655506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:30.949201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:30.962051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:30.963911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:30.965338 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec3646fe-a738-4322-97da-155d34ecb02c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1753 microversion: 2.20 time: 0.337229 Oct 28 13:37:30.967412 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2972/6025] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:30 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1753 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:31.268227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:31.269002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:31.279458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:31.281577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:31.282772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:31.283861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:31.284611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:31.285188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:32.000603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:32.001259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:32.026772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:32.028369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:32.036772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:32.037522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:32.038491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:32.039186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:32.039821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:32.160634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:32.190077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:32.192633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:32.201563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-631dfb1a-48ce-4a25-a627-f259f50b157c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.944440 Oct 28 13:37:32.219053 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3054/6026] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:31 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:32.268089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:32.292377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:32.296408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:32.302496 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de6f228f-61b6-470d-a99c-dee02a2e618f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1753 microversion: 2.20 time: 0.304912 Oct 28 13:37:32.304881 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2973/6027] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:31 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1753 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:33.236049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:33.236708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:33.245740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:33.251780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:33.251780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:33.251780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:33.251780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:33.251780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:33.251780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:33.345698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:33.345698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:33.355461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:33.355954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:33.356389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:33.357099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:33.357543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:33.357961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:33.738989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:33.754700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:33.756945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:33.758164 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e41c25ab-2a6b-49ac-bf83-19e80ac02c1d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1753 microversion: 2.20 time: 0.420513 Oct 28 13:37:33.758801 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2974/6028] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:33 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1753 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:33.764822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:33.774240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:33.776749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:33.778267 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88f9ec0b-c7db-4663-8451-bf4f88ecd058 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.546951 Oct 28 13:37:33.779807 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3055/6029] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:33 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:34.788524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:34.789789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:34.816178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:34.820249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:34.831784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:34.841074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:34.843875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:34.844570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:34.849849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:34.850091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:34.850673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:34.851216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:34.852992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:34.857578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:34.859332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:34.862311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:35.192824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:35.364236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:35.368152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:35.377676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:35.379393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:35.380705 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dde6345a-2089-4e7e-a15b-8f6f3921c63f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.578115 Oct 28 13:37:35.381739 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3056/6030] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:34 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:35.393354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:35.398705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:35.399848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:35.409284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:35.409499 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ed8bd29-6793-46be-bd07-edbce48eeed4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1753 microversion: 2.20 time: 0.625935 Oct 28 13:37:35.417853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:35.418358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:35.418863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:35.419576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:35.420031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:35.420458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:35.435345 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2975/6031] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:34 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1753 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:35.444751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-95e20497-5422-4868-b5b8-75b09f29bdcb req-2c2c0b0b-eb23-4328-a659-270eb8fad0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a40daf9-c546-4eeb-9890-f6a1631afb49", "tag": "b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:35.497606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-95e20497-5422-4868-b5b8-75b09f29bdcb req-2c2c0b0b-eb23-4328-a659-270eb8fad0ad service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:35.498091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-95e20497-5422-4868-b5b8-75b09f29bdcb req-2c2c0b0b-eb23-4328-a659-270eb8fad0ad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:35.498518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-95e20497-5422-4868-b5b8-75b09f29bdcb req-2c2c0b0b-eb23-4328-a659-270eb8fad0ad service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:35.521330 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-95e20497-5422-4868-b5b8-75b09f29bdcb req-2c2c0b0b-eb23-4328-a659-270eb8fad0ad service nova] Creating event network-changed:b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414 for instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 on n-h1-862876-2 Oct 28 13:37:35.535920 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-95e20497-5422-4868-b5b8-75b09f29bdcb req-2c2c0b0b-eb23-4328-a659-270eb8fad0ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097377 Oct 28 13:37:35.536825 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2976/6032] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:37:36.078589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:36.087635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b124993c-0b6f-442f-a761-d8ba3b48309e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1563 microversion: 2.1 time: 0.693076 Oct 28 13:37:36.095163 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3057/6033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:37:35 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1563 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:36.408919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:36.409629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:36.424837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:36.425566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:36.426225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:36.427150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:36.427997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:36.428601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:36.450662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:36.451478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:36.465759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:36.466151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:36.473244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:36.474028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:36.474510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:36.474975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:36.541268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:36.681796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:36.701843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:36.707492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:36.712549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3daa2e5b-56dc-4335-9f13-c8ca0823d92c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.307810 Oct 28 13:37:36.718784 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2977/6034] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:36 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:37.568299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:37.578004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-df84af16-e633-4409-860a-a7c60ea8de14 req-0bf1f03c-a945-45da-a8f0-328e151b693c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03481f8c-88a4-4625-a75c-1be2da3e0331", "tag": "2cf109e4-463d-4c4b-991b-c32910da624e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:37.586217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:37.591449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:37.598047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81539cb6-0ed7-4434-9ea3-a9b4eb45c73e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1753 microversion: 2.20 time: 1.150749 Oct 28 13:37:37.599535 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3058/6035] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:36 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1753 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:37.631478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-df84af16-e633-4409-860a-a7c60ea8de14 req-0bf1f03c-a945-45da-a8f0-328e151b693c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:37.631981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-df84af16-e633-4409-860a-a7c60ea8de14 req-0bf1f03c-a945-45da-a8f0-328e151b693c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:37.638836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-df84af16-e633-4409-860a-a7c60ea8de14 req-0bf1f03c-a945-45da-a8f0-328e151b693c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:37.657070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:37.686673 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-df84af16-e633-4409-860a-a7c60ea8de14 req-0bf1f03c-a945-45da-a8f0-328e151b693c service nova] Creating event network-changed:2cf109e4-463d-4c4b-991b-c32910da624e for instance 03481f8c-88a4-4625-a75c-1be2da3e0331 on n-h2-862876-2 Oct 28 13:37:37.705139 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-df84af16-e633-4409-860a-a7c60ea8de14 req-0bf1f03c-a945-45da-a8f0-328e151b693c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134476 Oct 28 13:37:37.707353 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2978/6036] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:37:37.746739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:37.747532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:37.769710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:37.775453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:37.776035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:37.777007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:37.785702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:37.786161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:38.243861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:38.257362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:38.260836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:38.262413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4264c475-2718-47ec-8f31-14d2235d1d00 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.520627 Oct 28 13:37:38.293839 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3059/6037] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:37 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:38.632831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:38.635636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:38.660929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:38.660929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:38.660929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:38.660929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:38.660929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:38.660929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:39.052383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:39.077610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:39.079633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:39.081038 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6325b14-76f1-41ae-b729-2167e59cc6b8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1753 microversion: 2.20 time: 0.455976 Oct 28 13:37:39.081996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2979/6038] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:38 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1753 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:39.301605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:39.301605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:39.322553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:39.323030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:39.323477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:39.324197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:39.327285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:39.328270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:39.646584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:39.662447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:39.664078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:39.665366 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-514c5a53-f136-497d-822d-a560d534ee65 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.371752 Oct 28 13:37:39.666054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3060/6039] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:39 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:40.114635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:40.125361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:40.148890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:40.154416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:40.155989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:40.157803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:40.160101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:40.161377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:40.619262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:40.653917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:40.655961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:40.662603 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-450e878d-82aa-44e5-808c-112ffd8ba025 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1753 microversion: 2.20 time: 0.557494 Oct 28 13:37:40.665400 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2980/6040] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:40 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1753 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:40.699506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:40.700853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:40.710212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:40.712444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:40.713054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:40.713615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:40.714437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:40.715026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:40.715685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:41.344445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:41.356792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:41.360464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:41.369163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bc21888c-5383-40a6-8ec9-524abbfa3be7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.679357 Oct 28 13:37:41.370413 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3061/6041] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:40 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:41.698340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:41.698989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:41.715034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:41.715705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:41.716434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:41.717161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:41.717678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:41.718614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:42.095269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:42.105407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:42.107239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:42.109315 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7fe354a8-8496-481e-a3ef-9c4b982500b5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.414912 Oct 28 13:37:42.110435 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2981/6042] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:41 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:42.398337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:42.399086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:42.413703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:42.417664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:42.418168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:42.423536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:42.423536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:42.423967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:42.763998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:42.789898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:42.792617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:42.798839 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2a0cb53-5895-42ee-b4ed-5ef58f7d7b45 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.404341 Oct 28 13:37:42.805410 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3062/6043] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:42 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:43.084612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-aa18fd45-1262-40ad-9093-83dbf587030e req-b103265c-95e6-4abf-a5cf-a8be0c88e87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03481f8c-88a4-4625-a75c-1be2da3e0331", "name": "network-vif-plugged", "status": "completed", "tag": "2cf109e4-463d-4c4b-991b-c32910da624e"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:43.101808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aa18fd45-1262-40ad-9093-83dbf587030e req-b103265c-95e6-4abf-a5cf-a8be0c88e87a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:43.106609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aa18fd45-1262-40ad-9093-83dbf587030e req-b103265c-95e6-4abf-a5cf-a8be0c88e87a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:43.106609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aa18fd45-1262-40ad-9093-83dbf587030e req-b103265c-95e6-4abf-a5cf-a8be0c88e87a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:43.136271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:43.137118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:43.148180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:43.148917 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-aa18fd45-1262-40ad-9093-83dbf587030e req-b103265c-95e6-4abf-a5cf-a8be0c88e87a service nova] Creating event network-vif-plugged:2cf109e4-463d-4c4b-991b-c32910da624e for instance 03481f8c-88a4-4625-a75c-1be2da3e0331 on n-h2-862876-2 Oct 28 13:37:43.151369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:43.152794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:43.156038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:43.156511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:43.157035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:43.160414 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-aa18fd45-1262-40ad-9093-83dbf587030e req-b103265c-95e6-4abf-a5cf-a8be0c88e87a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079367 Oct 28 13:37:43.161028 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2982/6044] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:37:43.379309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6366c342-4743-46e4-b013-f8396033eb6b req-11718fa1-8c64-4a79-8a83-0a5194141a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:43.396373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6366c342-4743-46e4-b013-f8396033eb6b req-11718fa1-8c64-4a79-8a83-0a5194141a04 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:43.397467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6366c342-4743-46e4-b013-f8396033eb6b req-11718fa1-8c64-4a79-8a83-0a5194141a04 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:43.398118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6366c342-4743-46e4-b013-f8396033eb6b req-11718fa1-8c64-4a79-8a83-0a5194141a04 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:43.415094 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6366c342-4743-46e4-b013-f8396033eb6b req-11718fa1-8c64-4a79-8a83-0a5194141a04 service nova] Creating event network-changed:4d9ff784-54aa-47d3-9d78-3b5fbce30ceb for instance bd5181f8-b838-41a3-a5ae-bad3451e6388 on n-h1-862876-2 Oct 28 13:37:43.425993 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6366c342-4743-46e4-b013-f8396033eb6b req-11718fa1-8c64-4a79-8a83-0a5194141a04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052301 Oct 28 13:37:43.428142 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2983/6045] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:37:43.683154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:43.706021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:43.706021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:43.706456 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-42bf3445-db28-4965-8ed8-f1cf2250db86 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.574750 Oct 28 13:37:43.707960 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3063/6046] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:43 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:43.841092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:43.841745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:43.861679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:43.862242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:43.862807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:43.865744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:43.868114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:43.872363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:44.226525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:44.240066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:44.244455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:44.247001 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7875f9a-b81f-42ab-88f0-fd5f380f854c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1361 microversion: 2.26 time: 0.412273 Oct 28 13:37:44.248794 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2984/6047] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:43 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1361 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:44.739022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:44.739887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:44.756553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:44.757107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:44.758813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:44.761289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:44.762010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:44.763605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:45.250084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:45.278717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:45.280169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:45.286356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:45.290879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:45.293446 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d13eafc7-23c8-4eac-9a61-53b3bbb8999f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.563449 Oct 28 13:37:45.294717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:45.299990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:45.305088 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3064/6048] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:44 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:45.305199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:45.305199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:45.305199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:45.307001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:45.676733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:45.698114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:45.704743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:45.708341 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9300483a-7a5a-4f19-82ce-7be39c50afe6 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1544 microversion: 2.26 time: 0.434787 Oct 28 13:37:45.713477 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2985/6049] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:45 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1544 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:45.745539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b88003a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:45.767305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:45.768890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:45.769998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:45.775135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:45.788508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:45.791761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:45.794833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:45.796220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:45.800230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:45.800230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:45.880692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:45.880692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:45.880692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:45.947761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:45.948933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:45.951074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.097108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:46.197540 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5914d554-4858-4795-a87b-861be57e4789 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-326010398" status: 201 len: 0 microversion: 2.26 time: 0.456182 Oct 28 13:37:46.206047 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3065/6050] 10.222.0.25 () {62 vars in 1377 bytes} [Fri Oct 28 13:37:45 2022] PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-326010398 => generated 0 bytes in 466 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 28 13:37:46.213134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-398cbce0-842c-4969-9e87-b1525d78e4dd tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b84ba3a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:46.242506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398cbce0-842c-4969-9e87-b1525d78e4dd tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.243034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398cbce0-842c-4969-9e87-b1525d78e4dd tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.243480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398cbce0-842c-4969-9e87-b1525d78e4dd tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.324302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-398cbce0-842c-4969-9e87-b1525d78e4dd tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-326010398" status: 204 len: 0 microversion: 2.26 time: 0.116068 Oct 28 13:37:46.330636 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2986/6051] 10.222.0.25 () {60 vars in 1358 bytes} [Fri Oct 28 13:37:46 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-326010398 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:46.330989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:46.330989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:46.343890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27bd905f70>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:46.344087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.351044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.355037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.359537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.362075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.369598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.391608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.392112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.392556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.399993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:46.425270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.432935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.433556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.434329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.434845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.435290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.534699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.536441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.537178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.641210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:46.695592 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aa663db1-0965-4f72-b5d9-0927ba92ac11 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 204 len: 0 microversion: 2.26 time: 0.361786 Oct 28 13:37:46.701726 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2987/6052] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Oct 28 13:37:46 2022] DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:46.717116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-27d210d9-a9c5-4b68-a2f1-eed79ee0fb2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b8859430>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:46.741924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d210d9-a9c5-4b68-a2f1-eed79ee0fb2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.747681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d210d9-a9c5-4b68-a2f1-eed79ee0fb2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.747681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-27d210d9-a9c5-4b68-a2f1-eed79ee0fb2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.761816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:46.775463 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-27d210d9-a9c5-4b68-a2f1-eed79ee0fb2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 200 len: 12 microversion: 2.26 time: 0.065993 Oct 28 13:37:46.776770 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2988/6053] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 13:37:46 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:46.787964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:46.789915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b87500d0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:46.793302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:46.814758 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d911a3e-8cbf-467e-841c-b9a0220e4e4d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.483619 Oct 28 13:37:46.814758 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3066/6054] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:46 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:46.814951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.814951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.814951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.815434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:46.830240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.830757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.831224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.833069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.833546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.834116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.923484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.923484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.923484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:46.953139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:46.954328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:46.955698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.049442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:47.105333 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a90bc49-fbe1-4e10-bad1-ae3700b8e12e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-156000278" status: 201 len: 0 microversion: 2.26 time: 0.322181 Oct 28 13:37:47.106315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2989/6055] 10.222.0.25 () {62 vars in 1377 bytes} [Fri Oct 28 13:37:46 2022] PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-156000278 => generated 0 bytes in 324 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 28 13:37:47.118823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-74297269-e191-4809-9801-d89034cb286c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b86a0940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:47.145135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74297269-e191-4809-9801-d89034cb286c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.147211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74297269-e191-4809-9801-d89034cb286c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.147712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-74297269-e191-4809-9801-d89034cb286c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.192893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-74297269-e191-4809-9801-d89034cb286c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 200 len: 35 microversion: 2.26 time: 0.079702 Oct 28 13:37:47.199005 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3067/6056] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 13:37:47 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 35 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:47.210592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b84514c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:47.250900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.251499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.252033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.252676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:47.263694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.264429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.264935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.268246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.268246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.268246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.308589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.310247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.310703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.422932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:47.442249 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2267054c-c2a4-4c0a-a5fd-a5bbe818ef55 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-156000278" status: 204 len: 0 microversion: 2.26 time: 0.242137 Oct 28 13:37:47.453268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-16c58fde-78d3-4191-9db5-a3a9b76779b3 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b9b62e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:47.458141 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2990/6057] 10.222.0.25 () {60 vars in 1361 bytes} [Fri Oct 28 13:37:47 2022] DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-156000278 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:47.461996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16c58fde-78d3-4191-9db5-a3a9b76779b3 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.462760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16c58fde-78d3-4191-9db5-a3a9b76779b3 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.463413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16c58fde-78d3-4191-9db5-a3a9b76779b3 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.475185 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-16c58fde-78d3-4191-9db5-a3a9b76779b3 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 200 len: 12 microversion: 2.26 time: 0.026200 Oct 28 13:37:47.481825 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3068/6058] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 13:37:47 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:47.487750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b84bd4c0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:47.502990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.504084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.505119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.506127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:47.515472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.516618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.517398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.518355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.519074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.519716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.570922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.571640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.572237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.634523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:47.658106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-03ed05db-257c-4d5d-948e-b755b97bac93 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 204 len: 0 microversion: 2.26 time: 0.174836 Oct 28 13:37:47.670699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b86a05e0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:47.674805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2991/6059] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Oct 28 13:37:47 2022] DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:47.681952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.695547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.696237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.705786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:47.719470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.723155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.725323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.726277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.726945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.728938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.783555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.784812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.785448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.800765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.801512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.802129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.845110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:47.846590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:47.869612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.870236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.870798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.878566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:47.878566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:47.878566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:47.964630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:48.016536 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2aa4a337-0d01-4f17-af15-80bcf9d10485 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-2103749751" status: 201 len: 0 microversion: 2.26 time: 0.351557 Oct 28 13:37:48.023230 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3069/6060] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Oct 28 13:37:47 2022] PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-2103749751 => generated 0 bytes in 359 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 13:37:48.059310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b9b62310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:48.090677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.091118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.091568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.092062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:48.124750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.135156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.136017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.136979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.137683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.138355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.222727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.228391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.231555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.259069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.259908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.260597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.392592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:48.395123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:48.414521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a09696f2-59fc-4958-ac95-87dbfbdd7372 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-1561851203" status: 201 len: 0 microversion: 2.26 time: 0.389713 Oct 28 13:37:48.418801 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3070/6061] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Oct 28 13:37:48 2022] PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-1561851203 => generated 0 bytes in 391 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 13:37:48.435017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27bba10ca0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:48.460624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.462981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.465451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.466304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:48.480973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.486390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.487029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.488034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.492451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.493184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.556147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.556889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.557442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.649487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:48.659199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:48.683356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:48.685124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:48.687749 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a848c9c-98ab-42b8-8521-32fd053f0bd8 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.846118 Oct 28 13:37:48.691955 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2992/6062] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:47 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:48.720007 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0211dd40-53be-4104-97fa-512001fa2179 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 204 len: 0 microversion: 2.26 time: 0.298468 Oct 28 13:37:48.724105 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3071/6063] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Oct 28 13:37:48 2022] DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:48.731001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-040b7a54-9255-436b-93c8-f60f502eaf0e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b8451a60>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:48.743057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-040b7a54-9255-436b-93c8-f60f502eaf0e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.744356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-040b7a54-9255-436b-93c8-f60f502eaf0e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.745245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-040b7a54-9255-436b-93c8-f60f502eaf0e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.760259 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-040b7a54-9255-436b-93c8-f60f502eaf0e tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 200 len: 12 microversion: 2.26 time: 0.034205 Oct 28 13:37:48.767965 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2993/6064] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 13:37:48 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:48.774458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b937f550>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:48.788725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.790006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.790758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.791401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:48.802367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.803256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.803956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.805277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.805686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.806268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.839390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.840347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.841125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.861039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:48.892222 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b26e764-7f37-4738-bade-ad4a10b88eb4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 204 len: 0 microversion: 2.26 time: 0.122971 Oct 28 13:37:48.893478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3072/6065] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Oct 28 13:37:48 2022] DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:48.905161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b8451280>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:48.931297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.932464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.933120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.934046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:48.943748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.944493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.945100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.958077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:48.958689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:48.959305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:48.979668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:37:49.003033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.003799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.004316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.026599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.027480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.028699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.134341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:49.175892 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f05a4d6-5ec9-4ec2-b900-715d5735ba76 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-1787301658" status: 201 len: 0 microversion: 2.26 time: 0.275300 Oct 28 13:37:49.177749 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2994/6066] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Oct 28 13:37:48 2022] PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-1787301658 => generated 0 bytes in 279 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 13:37:49.191417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b9af8430>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:49.206571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.207893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.208694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.209529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:49.222697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.222697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.222697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.222697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.222697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.222697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.261484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.266823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.267394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.291359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.291858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.292443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.433389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:49.466940 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e3c806da-368e-488a-bdc5-50216b26bcc7 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-1415348249" status: 201 len: 0 microversion: 2.26 time: 0.282954 Oct 28 13:37:49.467738 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3073/6067] 10.222.0.25 () {62 vars in 1380 bytes} [Fri Oct 28 13:37:49 2022] PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags/tempest-tag-1415348249 => generated 0 bytes in 285 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 13:37:49.480466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Action: 'update_all', calling method: .version_select at 0x7f27b88595e0>, body: {"tags": ["tempest-tag-1068011446", "tempest-tag-1763494009"]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:49.492215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.493358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.493998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.495205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:49.507790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.509163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.509768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.510511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.511201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.512474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.545380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.546630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.547431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.651482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:49.670260 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b108289-4a6d-4f48-bb48-d7f0073bba2f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 200 len: 62 microversion: 2.26 time: 0.196929 Oct 28 13:37:49.671073 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2995/6068] 10.222.0.25 () {62 vars in 1312 bytes} [Fri Oct 28 13:37:49 2022] PUT /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 62 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:37:49.683239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4647275e-496e-42e1-8ced-0e4f1212afe4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b9d4de50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:49.718435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4647275e-496e-42e1-8ced-0e4f1212afe4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.720434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4647275e-496e-42e1-8ced-0e4f1212afe4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.723467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:49.724336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4647275e-496e-42e1-8ced-0e4f1212afe4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.725039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:49.742132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.744479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.746382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.747386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.747712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.750863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.761814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4647275e-496e-42e1-8ced-0e4f1212afe4 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 200 len: 62 microversion: 2.26 time: 0.083922 Oct 28 13:37:49.776927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3074/6069] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Oct 28 13:37:49 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 62 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:37:49.791235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '.version_select at 0x7f27b8800d30>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:49.819846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.820542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.821691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.822192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:49.830815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.835939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.836708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.842090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.842090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.842090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.863593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:49.864295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:49.864882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:49.965726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'flavor' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:50.000495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:50.000886 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1de4d486-ed4a-427d-90a2-3e12baa79e8a tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags" status: 204 len: 0 microversion: 2.26 time: 0.221961 Oct 28 13:37:50.004960 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3075/6070] 10.222.0.25 () {60 vars in 1295 bytes} [Fri Oct 28 13:37:49 2022] DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331/tags => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:50.014577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:50.022038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:50.023309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:50.024554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:50.026159 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-485d7474-911f-4c62-8aee-c7f27a955f65 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.307701 Oct 28 13:37:50.042960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:50.043752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:50.044348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:50.045216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:50.046397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:50.047002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:50.051670 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2996/6071] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:49 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:50.097561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:37:50.369701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:50.372482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:50.384556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:50.385521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:50.386096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:50.386909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:50.387381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:50.387819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:50.513739 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3763af5e-c7a5-49c4-8043-70be83b5b40f tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 204 len: 0 microversion: 2.26 time: 0.499109 Oct 28 13:37:50.513739 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3076/6072] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:37:50 2022] DELETE /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:37:50.521328 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b2dd69d7-2cc3-490a-93ea-abee1207abb6 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action" status: 200 len: 24568 microversion: 2.1 time: 0.157107 Oct 28 13:37:50.531222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:50.533189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:50.542455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:50.550641 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2997/6073] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:37:50 2022] POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action => generated 24568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:37:50.555185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:50.555889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:50.565765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:50.566292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:50.566776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:50.883006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:50.909213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:50.911064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:50.912340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3938183c-cfc8-4fc9-ba62-f55000d20e0c tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1550 microversion: 2.26 time: 0.394257 Oct 28 13:37:50.912900 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3077/6074] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:50 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1550 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:51.061215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:51.062565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:51.070269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:51.071011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:51.071646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:51.072514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:51.073166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:51.073749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:51.372251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:51.382717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:51.383763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:51.385296 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad140ec9-f0ef-4e5e-9dcd-da5712c21376 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.329684 Oct 28 13:37:51.395201 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2998/6075] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:51 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:51.941441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:51.942073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:51.949093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:51.953017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:51.957222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:51.957222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:51.957222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:51.957222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:52.416141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:52.416809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:52.435133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:52.435702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:52.437072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:52.437634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:52.438141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:52.438619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:52.666432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:52.677967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:52.680230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:52.680453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:52.682684 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44b3afcb-714f-4aac-8c96-d8f43ba22c47 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1550 microversion: 2.26 time: 0.744690 Oct 28 13:37:52.684012 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3078/6076] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:51 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1550 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:52.716747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:52.722087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:52.725521 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7463c50-2892-4ce7-9f08-479e680cf1b4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.313697 Oct 28 13:37:52.741216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 2999/6077] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:52 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:37:53.226008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-300c5b27-7499-45c7-86e7-ce44e205a85b req-b81efb30-912d-4538-b229-a3bccc869a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03481f8c-88a4-4625-a75c-1be2da3e0331", "name": "network-vif-deleted", "tag": "2cf109e4-463d-4c4b-991b-c32910da624e"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:37:53.255279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-300c5b27-7499-45c7-86e7-ce44e205a85b req-b81efb30-912d-4538-b229-a3bccc869a6f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:53.256835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-300c5b27-7499-45c7-86e7-ce44e205a85b req-b81efb30-912d-4538-b229-a3bccc869a6f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:53.258125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-300c5b27-7499-45c7-86e7-ce44e205a85b req-b81efb30-912d-4538-b229-a3bccc869a6f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:53.305080 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-300c5b27-7499-45c7-86e7-ce44e205a85b req-b81efb30-912d-4538-b229-a3bccc869a6f service nova] Creating event network-vif-deleted:2cf109e4-463d-4c4b-991b-c32910da624e for instance 03481f8c-88a4-4625-a75c-1be2da3e0331 on n-h2-862876-2 Oct 28 13:37:53.340895 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-300c5b27-7499-45c7-86e7-ce44e205a85b req-b81efb30-912d-4538-b229-a3bccc869a6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106620 Oct 28 13:37:53.342509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3079/6078] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:37:53.716456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:53.717106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:53.730967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:53.731503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:53.731947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:53.732767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:53.733343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:53.733853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:53.758902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:53.759883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:53.770916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:53.771659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:53.779012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:53.779012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:53.779012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:53.779012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:53.823549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:53.824082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:53.824581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:53.825106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lazy-loading 'fault' on Instance uuid 03481f8c-88a4-4625-a75c-1be2da3e0331 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:37:53.895240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:53.934084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:53.935774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '445d146910d44319a0821658d39c6ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c696c2b41747739738a27dac4f0fb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:53.937246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d92c1431-b013-4ff0-96ab-cb5d6648c325 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 200 len: 1351 microversion: 2.26 time: 0.229091 Oct 28 13:37:53.937939 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3000/6079] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:53 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 1351 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:54.156122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:54.165967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:54.183880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:54.185189 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ced38232-5788-48ca-b999-a3044947a71e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.432463 Oct 28 13:37:54.185833 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3080/6080] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:53 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:54.973640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:54.974284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] [instance: 03481f8c-88a4-4625-a75c-1be2da3e0331] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:54.981425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:54.981920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:54.982362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:54.983125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:54.983585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:54.984013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:54.999982 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] HTTP exception thrown: Instance 03481f8c-88a4-4625-a75c-1be2da3e0331 could not be found. Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Request method failure captured: Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 HTTP/1.1 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9sRSvXe21YyxTGmBgg-eldSqtxIeaXsm6-Dcp9FVv-_yEz28O0beHpzkPSQt13Mj0TA6Aw4utpxKc3JrGf3OjGl1kzOsHIIsV9wQsHKnC82ywBe6iqWitIC_96mQJWwzK7xcDWJNzgvVAr3pN6ihmlYcZtWwCiaL5Ma43Ij4bLNZyg Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.26 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a0c696c2b41747739738a27dac4f0fb8 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerTagsTestJSON-1089053721 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0c696c2b41747739738a27dac4f0fb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0c696c2b41747739738a27dac4f0fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0c696c2b41747739738a27dac4f0fb8", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0c696c2b41747739738a27dac4f0fb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerTagsTestJSON-1089053721 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a0c696c2b41747739738a27dac4f0fb8 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerTagsTestJSON-1089053721 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerTagsTestJSON-1089053721-project Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 445d146910d44319a0821658d39c6ef4 Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerTagsTestJSON-1089053721-project Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 03481f8c-88a4-4625-a75c-1be2da3e0331 could not be found. Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '03481f8c-88a4-4625-a75c-1be2da3e0331'} Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03481f8c-88a4-4625-a75c-1be2da3e0331 could not be found. Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03481f8c-88a4-4625-a75c-1be2da3e0331 could not be found. Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:37:55.001732 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03481f8c-88a4-4625-a75c-1be2da3e0331 could not be found. Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] Returning 404 to user: Instance 03481f8c-88a4-4625-a75c-1be2da3e0331 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69c8519c-7541-4f5e-b271-589ea15df368 tempest-ServerTagsTestJSON-1089053721 tempest-ServerTagsTestJSON-1089053721-project] 10.222.0.25 "GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331" status: 404 len: 111 microversion: 2.26 time: 0.033590 Oct 28 13:37:55.016600 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3001/6081] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:54 2022] GET /compute/v2.1/servers/03481f8c-88a4-4625-a75c-1be2da3e0331 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:37:55.216052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:55.217564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:55.230610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:55.235348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:55.239636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:55.239636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:55.239636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:55.239636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:55.551556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:55.574148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:55.576026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:55.577494 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b69a2a8-7728-4a65-9124-2986b5493bdc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.365532 Oct 28 13:37:55.578094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3081/6082] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:55 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:56.605402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:56.606687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:56.620097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:56.620912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:56.621633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:56.622955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:56.623783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:56.626480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:57.183767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:57.199931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:57.203372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:57.206251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4fcdd2b-be89-40fb-9013-7827c27f84dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.605713 Oct 28 13:37:57.228562 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3002/6083] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:56 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:58.250574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:58.270105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:58.285591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:58.301325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:58.302215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:58.303698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:58.305110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:58.309031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:58.802585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:58.814598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:58.818470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:37:58.826145 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-218d9472-5624-4ca5-b69d-e41e89a840aa tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.589022 Oct 28 13:37:58.847760 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3082/6084] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:58 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:37:59.854202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:37:59.854975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:37:59.871543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:59.872211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:59.872842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:37:59.873703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:37:59.875092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:37:59.875813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:00.301948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:00.341901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:00.344092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:00.345853 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aff15343-838e-4e0c-a4a7-5d5222edbdd9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.495690 Oct 28 13:38:00.351340 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3003/6085] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:37:59 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:01.375769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:01.376664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:01.386796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:01.386796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:01.387215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:01.393898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:01.394398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:01.407329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:01.439736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:01.557829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:01.559758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:01.569638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:01.570107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:01.571184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:01.572183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:01.573483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:01.574206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:01.625974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:01.635439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:01.637349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:01.638830 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b3bc3306-4d21-4a98-bcdd-cad866664ae4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.270466 Oct 28 13:38:01.659896 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3083/6086] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:01 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:01.979608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:01.993846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50b7569b-0e20-44be-9933-1b0ef6580b02 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1681 microversion: 2.1 time: 0.455539 Oct 28 13:38:01.995218 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3004/6087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:01 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1681 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:02.212927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:02.216714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:02.227480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.228167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.230145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.230145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.230145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.231008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.298150 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-969d7083-bddd-41e5-b188-5ccead01e396 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action" status: 200 len: 32638 microversion: 2.1 time: 0.093469 Oct 28 13:38:02.302660 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3084/6088] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:38:02 2022] POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action => generated 32638 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:02.463040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:02.466786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:02.478131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.479656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.480648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.483970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.485184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.485773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.668563 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-154bc4ed-5c8e-4199-9ce8-8507677ae175 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1832 microversion: 2.1 time: 0.208800 Oct 28 13:38:02.670205 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3005/6089] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:02 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1832 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:02.674611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:02.675683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:02.684243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.685435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.686154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.687160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.687822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.688494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.706786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:02.709669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:02.724290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.724813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.728862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.735625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:02.736389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:02.737610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:02.796659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lazy-loading 'flavor' on Instance uuid 6a40daf9-c546-4eeb-9890-f6a1631afb49 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:38:02.824536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Going to try to live migrate instance to another host {{(pid=127794) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 13:38:02.897601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:02.908072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:02.909517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:02.910920 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c710df2-abc9-419a-bd5d-a6988bd20eda tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.243642 Oct 28 13:38:02.911765 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3085/6090] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:02 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:03.943627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:03.944314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:03.995805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:03.997913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:04.004841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:04.006336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:04.007095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:04.008424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:04.294116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:04.309385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:04.311177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:04.313626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7b76006-9fcb-4f38-9df4-494f0367786a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.377821 Oct 28 13:38:04.314870 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3086/6091] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:03 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:05.345781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:05.348533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:05.364577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:05.364577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:05.364577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:05.364577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:05.364577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:05.364577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:05.532715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:05.552450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:05.554138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:05.555399 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.215587 Oct 28 13:38:05.556331 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3087/6092] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:05 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:38:06.508039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:06.509037 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-33e665f5-0f65-4b32-bc84-7880f249825d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001370 Oct 28 13:38:06.515155 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3088/6093] 10.222.0.25 () {56 vars in 886 bytes} [Fri Oct 28 13:38:06 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 13:38:06.581420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:06.582035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:06.590492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:06.591096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:06.591774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:06.593470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:06.594321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:06.594845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:06.809523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:06.819757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:06.821596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:06.823026 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-888ca93a-8fbc-483f-8630-671c2e7efd1a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.245488 Oct 28 13:38:06.853653 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3089/6094] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:06 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:38:07.855306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:07.855991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:07.863701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:07.864196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:07.864645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:07.865441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:07.865905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:07.866339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:08.057290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:08.066099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:08.067559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:08.068719 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0be3326a-4001-410b-bfc5-bffb37d0c68f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.219216 Oct 28 13:38:08.069567 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3090/6095] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:07 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:38:08.168291 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7dcbe16e-543a-45d0-b394-287518312f58 tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action" status: 202 len: 0 microversion: 2.1 time: 5.466389 Oct 28 13:38:08.172997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3006/6096] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:38:02 2022] POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action => generated 0 bytes in 5472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:38:08.179923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:08.180542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:08.190441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:08.191184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:08.191741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:08.193441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:08.194007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:08.194671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:08.466600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:08.498132 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-16216b41-72ee-47ae-a0c0-6e204121e40c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.323983 Oct 28 13:38:08.509989 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3091/6097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:08 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:09.095183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:09.095987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:09.101188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=84 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:09.112434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:09.113417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:09.114109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:09.115584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:09.116280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:09.116889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:09.146860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=1,nova_cell1:UPDATE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:09.391291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:09.413758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:09.416912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:09.419068 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6aa263aa-015a-4266-bda9-04d68a9a8303 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.328387 Oct 28 13:38:09.420231 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3007/6098] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:09 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:09.524277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:09.525883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:09.566324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:09.567072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:09.567680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:09.568393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:09.568926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:09.569505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:09.757970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-069c443c-42b0-4508-a0b8-210fcc830b5a tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] Calling method '.version_select at 0x7f27b883f820>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:09.837594 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-069c443c-42b0-4508-a0b8-210fcc830b5a tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.278096 Oct 28 13:38:09.838738 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3008/6099] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:38:09 2022] GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9/defaults => generated 371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:09.853810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c9946431-0c03-484e-a151-187fb1029ea5 tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] Calling method '.version_select at 0x7f27b88b6790>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:09.958176 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c9946431-0c03-484e-a151-187fb1029ea5 tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9" status: 200 len: 371 microversion: 2.1 time: 0.108369 Oct 28 13:38:09.959337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:09.961610 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3009/6100] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 13:38:09 2022] GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:09.973279 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c7529ad-ecac-434c-864f-c949f07df380 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.453539 Oct 28 13:38:09.975400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3092/6101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:09 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:09.978893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d987c4f6-70f2-4bd3-846a-21d8bf12b7ab tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] Calling method '.version_select at 0x7f27b889bd30>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:10.106122 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d987c4f6-70f2-4bd3-846a-21d8bf12b7ab tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.131080 Oct 28 13:38:10.108893 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3010/6102] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:38:09 2022] GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9/defaults => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:10.125377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6adcc498-1ce4-46eb-990d-ffd306dfc1ec tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] Calling method '.version_select at 0x7f27b9d781f0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:10.257673 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6adcc498-1ce4-46eb-990d-ffd306dfc1ec tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9" status: 200 len: 371 microversion: 2.1 time: 0.136638 Oct 28 13:38:10.265037 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3093/6103] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 13:38:10 2022] GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:10.286537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0df36157-149b-4e14-b21f-bbc8565c0d94 tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] Calling method '.version_select at 0x7f27bd9a1ca0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:10.446117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:10.447170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:10.458329 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0df36157-149b-4e14-b21f-bbc8565c0d94 tempest-QuotasTestJSON-1638683334 tempest-QuotasTestJSON-1638683334-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9?user_id=a5901626fa094340a1cef80f55e7db02" status: 200 len: 371 microversion: 2.1 time: 0.184213 Oct 28 13:38:10.463144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:10.475879 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3011/6104] 10.222.0.25 () {58 vars in 1323 bytes} [Fri Oct 28 13:38:10 2022] GET /compute/v2.1/os-quota-sets/7789e82438594888bb40881f98c6a9d9?user_id=a5901626fa094340a1cef80f55e7db02 => generated 371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:10.476089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:10.484394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:10.485701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:10.486424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:10.487181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:10.853551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:10.873183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:10.876300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:10.879834 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-29f36386-6552-4e98-a769-dfc1afc90416 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.437954 Oct 28 13:38:10.880963 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3094/6105] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:10 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:10.963065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a7b3fd8f-d951-4b94-b0f3-4881f9b351af req-714b286b-825d-4b0f-83a6-832719b3b376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a40daf9-c546-4eeb-9890-f6a1631afb49", "name": "network-vif-unplugged", "status": "completed", "tag": "b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:10.972743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a7b3fd8f-d951-4b94-b0f3-4881f9b351af req-714b286b-825d-4b0f-83a6-832719b3b376 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:10.974163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a7b3fd8f-d951-4b94-b0f3-4881f9b351af req-714b286b-825d-4b0f-83a6-832719b3b376 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:10.975313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a7b3fd8f-d951-4b94-b0f3-4881f9b351af req-714b286b-825d-4b0f-83a6-832719b3b376 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:10.993693 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a7b3fd8f-d951-4b94-b0f3-4881f9b351af req-714b286b-825d-4b0f-83a6-832719b3b376 service nova] Creating event network-vif-unplugged:b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414 for instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 on n-h1-862876-2 Oct 28 13:38:11.002119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:11.002999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:11.004070 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a7b3fd8f-d951-4b94-b0f3-4881f9b351af req-714b286b-825d-4b0f-83a6-832719b3b376 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044523 Oct 28 13:38:11.006569 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3012/6106] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:11.008803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:11.010671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:11.017895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:11.017895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:11.017895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:11.017895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:11.017895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:11.576314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:11.595382 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3eb7d553-4267-4d8a-b229-451013ef14ab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.597595 Oct 28 13:38:11.599907 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3095/6107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:10 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:38:11.908632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:11.910265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:11.919051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:11.919898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:11.920821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:11.921756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:11.922423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:11.923217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:12.111878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:12.121132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:12.122850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:12.124728 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95fe953e-edec-4251-a0ed-51867bb76e6f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.220972 Oct 28 13:38:12.125386 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3013/6108] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:11 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:38:12.343967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a68270e0-807c-47e5-923a-2ddc92b267e8 req-270b378b-f2f7-4e49-a354-db5e1f20b10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "name": "network-vif-plugged", "status": "completed", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:12.358794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a68270e0-807c-47e5-923a-2ddc92b267e8 req-270b378b-f2f7-4e49-a354-db5e1f20b10e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:12.359301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a68270e0-807c-47e5-923a-2ddc92b267e8 req-270b378b-f2f7-4e49-a354-db5e1f20b10e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:12.359718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a68270e0-807c-47e5-923a-2ddc92b267e8 req-270b378b-f2f7-4e49-a354-db5e1f20b10e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:12.373271 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a68270e0-807c-47e5-923a-2ddc92b267e8 req-270b378b-f2f7-4e49-a354-db5e1f20b10e service nova] Creating event network-vif-plugged:4d9ff784-54aa-47d3-9d78-3b5fbce30ceb for instance bd5181f8-b838-41a3-a5ae-bad3451e6388 on n-h1-862876-2 Oct 28 13:38:12.379924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a68270e0-807c-47e5-923a-2ddc92b267e8 req-270b378b-f2f7-4e49-a354-db5e1f20b10e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039971 Oct 28 13:38:12.380869 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3096/6109] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:12.625621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:12.626324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:12.646940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:12.650298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:12.652252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:12.653575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:12.654384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:12.657195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:13.005948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:13.022067 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce21c814-7b73-480a-8750-6ff6910a92d9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.397171 Oct 28 13:38:13.023060 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3014/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:12 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:13.076578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-68eb17c4-e5ed-4714-aef4-dc6a14e8b59e req-cc400666-ac20-4515-9981-dd5e7fb2be8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a40daf9-c546-4eeb-9890-f6a1631afb49", "tag": "b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:13.089593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68eb17c4-e5ed-4714-aef4-dc6a14e8b59e req-cc400666-ac20-4515-9981-dd5e7fb2be8c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:13.092465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68eb17c4-e5ed-4714-aef4-dc6a14e8b59e req-cc400666-ac20-4515-9981-dd5e7fb2be8c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:13.093379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68eb17c4-e5ed-4714-aef4-dc6a14e8b59e req-cc400666-ac20-4515-9981-dd5e7fb2be8c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:13.120448 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-68eb17c4-e5ed-4714-aef4-dc6a14e8b59e req-cc400666-ac20-4515-9981-dd5e7fb2be8c service nova] Creating event network-changed:b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414 for instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 on n-h1-862876-2 Oct 28 13:38:13.130441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-68eb17c4-e5ed-4714-aef4-dc6a14e8b59e req-cc400666-ac20-4515-9981-dd5e7fb2be8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066618 Oct 28 13:38:13.134966 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3097/6111] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:13.152726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:13.162771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:13.162771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:13.163118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:13.164290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:13.165265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:13.165950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:13.166666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:13.356302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:13.382909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:13.384373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:13.388142 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b1e27dc-ad56-4753-aecd-fd9122df2d2e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.240708 Oct 28 13:38:13.393395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3015/6112] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:13 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:14.050092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:14.051483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:14.079200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:14.079731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:14.085235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:14.086011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:14.086499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:14.091853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:14.289442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e5de819-c786-4349-a587-ac1b945a768d tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Action: 'create', calling method: .version_select at 0x7f27b9490c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1055994164", "metadata": {"Type": "work"}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:14.963422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:14.986061 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e1adce52-9399-413d-a029-079c20951bb1 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.937431 Oct 28 13:38:14.986061 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3016/6113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:14 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:15.017423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:15.018461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:15.024722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:15.025210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:15.025704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:15.026953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:15.027417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:15.027844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:15.407516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e5de819-c786-4349-a587-ac1b945a768d tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.383650 Oct 28 13:38:15.413753 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3098/6114] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Oct 28 13:38:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1386 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 13:38:15.430346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d3c686f-f02d-48e9-887a-b9446c64ebb2 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b9bc9280>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:15.510084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:15.529187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:15.554357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d3c686f-f02d-48e9-887a-b9446c64ebb2 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 353 microversion: 2.1 time: 0.136147 Oct 28 13:38:15.555297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3099/6115] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:15 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:15.564462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:15.565983 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42e3183c-d879-4370-b653-dfb702da58a4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1809 microversion: 2.20 time: 0.583495 Oct 28 13:38:15.568153 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3017/6116] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:14 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1809 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:16.013404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:16.016523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:16.030927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:16.034319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:16.034877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:16.036329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:16.041747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:16.042274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:16.440162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:16.451759 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c62b39cc-2a88-4fad-9260-b30320320b3f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.449577 Oct 28 13:38:16.454587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3100/6117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:16 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:16.570968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ded83d5c-96c4-4fd7-8271-2ca80f499815 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b88b6310>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:16.594855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:16.595691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:16.613041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:16.613862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:16.616408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:16.617383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:16.618571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:16.618571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:16.680749 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ded83d5c-96c4-4fd7-8271-2ca80f499815 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 353 microversion: 2.1 time: 0.114943 Oct 28 13:38:16.683655 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3018/6118] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:16 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:17.390128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:17.409505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:17.416323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:17.417590 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-21131cec-ac07-4c3f-a9a4-a9700f2fbb76 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1796 microversion: 2.20 time: 0.826967 Oct 28 13:38:17.423904 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3101/6119] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:16 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1796 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:17.481163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:17.486992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:17.506884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:17.506884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:17.506884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:17.506884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:17.506884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:17.506884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:17.707306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b7754f78-11d5-43d4-b3e5-f7bb5f6402f8 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b881b280>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:17.800214 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b7754f78-11d5-43d4-b3e5-f7bb5f6402f8 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 353 microversion: 2.1 time: 0.106301 Oct 28 13:38:17.801483 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3102/6120] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:17 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:17.892190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:17.907742 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a59b4fb0-c21e-4d4c-b402-87e5964d2aab tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.430725 Oct 28 13:38:17.927515 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3019/6121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:17 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:18.817172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a01751c0-49eb-4aa6-9cce-fc2927d32aee tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27bda773a0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:18.914800 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a01751c0-49eb-4aa6-9cce-fc2927d32aee tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 354 microversion: 2.1 time: 0.103726 Oct 28 13:38:18.916345 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3103/6122] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:18 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:18.929624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69224c9b-8b83-4895-9c83-63a52e330d6f tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b84ba3a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:18.941239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:18.942154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:18.971507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:18.972109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:18.972472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:18.973197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:18.973653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:18.974075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:19.029449 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69224c9b-8b83-4895-9c83-63a52e330d6f tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 354 microversion: 2.1 time: 0.103902 Oct 28 13:38:19.030027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3020/6123] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:18 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:19.044782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e5c7ec5-b042-4827-b2e7-c86908482899 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b888faf0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:19.433802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:19.442248 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66c38a70-480f-4198-8658-f36926ac247e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.505517 Oct 28 13:38:19.458895 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3104/6124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:18 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:19.694145 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e5c7ec5-b042-4827-b2e7-c86908482899 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 202 len: 0 microversion: 2.1 time: 0.650900 Oct 28 13:38:19.694145 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3021/6125] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Oct 28 13:38:19 2022] DELETE /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:38:19.703739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-586adcfd-e032-40af-90d2-504ea5fd6eb5 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b9c36940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:19.792233 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-586adcfd-e032-40af-90d2-504ea5fd6eb5 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 353 microversion: 2.1 time: 0.095024 Oct 28 13:38:19.795143 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3105/6126] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:19 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:20.463915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:20.470088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:20.470976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:20.485065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:20.485065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:20.485065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:20.498271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:20.499103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:20.499630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:20.804547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:20.810769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-479aeaa0-cb25-4b51-b2b6-85a0c84ea7ff tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b86ac280>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:20.859238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:20.870117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d54059ec-8cfb-491d-a843-07330eba803a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1691 microversion: 2.1 time: 0.408208 Oct 28 13:38:20.870709 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3022/6127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:20 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1691 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:20.878689 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-479aeaa0-cb25-4b51-b2b6-85a0c84ea7ff tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 353 microversion: 2.1 time: 0.075722 Oct 28 13:38:20.879801 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3106/6128] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:20 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:38:21.896883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ee0d56d-98a1-44a2-bde6-e63eeee19e00 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27b889b700>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:21.897423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:21.898032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:21.910448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:21.913489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:21.917841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:21.919028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:21.946139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:21.950554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:22.076821 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ee0d56d-98a1-44a2-bde6-e63eeee19e00 tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 200 len: 353 microversion: 2.1 time: 0.186959 Oct 28 13:38:22.079413 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3023/6129] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:21 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:22.752617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:22.762051 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aa9c07d6-d09b-41bb-86dd-9b21bba98265 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1681 microversion: 2.1 time: 0.870228 Oct 28 13:38:22.762978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3107/6130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:21 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1681 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:38:22.786347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:22.787006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:22.794161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:22.794847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:22.795439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:22.796336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:22.796800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:22.797377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:23.092691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-050db70b-6429-4878-bd1b-522c2794653e tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Calling method '.version_select at 0x7f27bd9d3040>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:23.126937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-050db70b-6429-4878-bd1b-522c2794653e tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] HTTP exception thrown: Volume e7484ca2-9284-406a-a5a9-e163dcf839b4 could not be found. Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-050db70b-6429-4878-bd1b-522c2794653e tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Request method failure captured: Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 HTTP/1.1 Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9tFMR1zjgkhFMhFSk-D2GMQK7Swus9mJozT-Yq1D3gYia_se1d-Kg4iZ7cc5TRb4QxCwY5ew8ZLtWS4UCRACTRO0TwN5Xrz3B5r5jGnYuU5vJ6qaKVmInuVC_kYge4uiB00TyoeT3nIlaq--DENg2rEtOmpTbLQLIM-5N22fiA0AtQ Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 0a2441170601465bb5618592c5e4766f Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesGetTestJSON-328850004 Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a2441170601465bb5618592c5e4766f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0a2441170601465bb5618592c5e4766f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0a2441170601465bb5618592c5e4766f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0a2441170601465bb5618592c5e4766f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesGetTestJSON-328850004 Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 0a2441170601465bb5618592c5e4766f Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesGetTestJSON-328850004 Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesGetTestJSON-328850004-project Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 09450685e58f48f99af4b8aa645a31bb Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesGetTestJSON-328850004-project Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: method: Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: exception: Volume e7484ca2-9284-406a-a5a9-e163dcf839b4 could not be found. Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'e7484ca2-9284-406a-a5a9-e163dcf839b4'} Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7484ca2-9284-406a-a5a9-e163dcf839b4 could not be found. (HTTP 404) (Request-ID: req-25e029fb-cd5a-4b41-969d-51447b570ef8) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 13:38:23.129335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7484ca2-9284-406a-a5a9-e163dcf839b4 could not be found. Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7484ca2-9284-406a-a5a9-e163dcf839b4 could not be found. Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7484ca2-9284-406a-a5a9-e163dcf839b4 could not be found. Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-050db70b-6429-4878-bd1b-522c2794653e tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] Returning 404 to user: Volume e7484ca2-9284-406a-a5a9-e163dcf839b4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-050db70b-6429-4878-bd1b-522c2794653e tempest-VolumesGetTestJSON-328850004 tempest-VolumesGetTestJSON-328850004-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4" status: 404 len: 109 microversion: 2.1 time: 0.042336 Oct 28 13:38:23.138059 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3108/6131] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Oct 28 13:38:23 2022] GET /compute/v2.1/os-volumes/e7484ca2-9284-406a-a5a9-e163dcf839b4 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:38:23.388774 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bbec3f36-22a9-4c63-afbe-6e226bc5030c tempest-TestNetworkAdvancedServerOps-291598437 tempest-TestNetworkAdvancedServerOps-291598437-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1832 microversion: 2.1 time: 0.606488 Oct 28 13:38:23.389367 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3024/6132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:22 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1832 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:23.416200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:23.417289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:23.424948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:23.425710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:23.426146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:23.427051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:23.427509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:23.427928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:23.607600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:23.617895 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-867f89bf-b971-4080-90e1-9b3c1afa02fd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1681 microversion: 2.1 time: 0.206933 Oct 28 13:38:23.620273 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3109/6133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:23 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:25.888604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:25.891539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:25.899966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:25.900783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:25.901694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:25.902611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:25.903288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:25.903912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:25.962946 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e755957-4667-4c54-a393-71a3bf09bf03 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action" status: 200 len: 38659 microversion: 2.1 time: 0.077510 Oct 28 13:38:25.964312 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3025/6134] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:38:25 2022] POST /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49/action => generated 38659 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:27.262036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4706dc96-2af1-4c13-8b40-d9671bd1b71b req-4147838f-ff24-4b7a-97da-3ec358213d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a40daf9-c546-4eeb-9890-f6a1631afb49", "tag": "b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:27.265237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:27.265770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:27.281923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:27.282729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:27.285984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4706dc96-2af1-4c13-8b40-d9671bd1b71b req-4147838f-ff24-4b7a-97da-3ec358213d08 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:27.286659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:27.287766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:27.288427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:27.289053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:27.292537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4706dc96-2af1-4c13-8b40-d9671bd1b71b req-4147838f-ff24-4b7a-97da-3ec358213d08 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:27.293220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4706dc96-2af1-4c13-8b40-d9671bd1b71b req-4147838f-ff24-4b7a-97da-3ec358213d08 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:27.325165 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4706dc96-2af1-4c13-8b40-d9671bd1b71b req-4147838f-ff24-4b7a-97da-3ec358213d08 service nova] Creating event network-changed:b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414 for instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 on n-h2-862876-2 Oct 28 13:38:27.334736 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4706dc96-2af1-4c13-8b40-d9671bd1b71b req-4147838f-ff24-4b7a-97da-3ec358213d08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076571 Oct 28 13:38:27.341066 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3026/6135] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:27.346829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:38:27.353845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:27.678109 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60f335c3-8de3-4a52-9cc3-d21b6dc6244a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 204 len: 0 microversion: 2.1 time: 0.423463 Oct 28 13:38:27.688728 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3110/6136] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:38:27 2022] DELETE /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:38:27.689438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:27.691286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:27.698458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:27.699490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:27.700484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:27.701428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:27.702620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:27.703297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:27.989939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:28.012263 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50dff01d-c1aa-4dd9-a58a-fed80467ac0a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1687 microversion: 2.1 time: 0.325641 Oct 28 13:38:28.013838 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3027/6137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:27 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1687 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:29.040362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:29.041994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:29.052053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:29.053729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:29.054443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:29.055397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:29.056079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:29.056598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:29.791808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:29.800116 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c098c124-ba0d-4932-ad9c-d0548b33ae92 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 200 len: 1569 microversion: 2.1 time: 0.765413 Oct 28 13:38:29.800695 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3111/6138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:29 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 1569 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:29.977269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7c24527d-1d69-4d69-902b-6aa285454e08 req-3a0b9128-c0aa-4af1-8a92-faf56542f3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a40daf9-c546-4eeb-9890-f6a1631afb49", "name": "network-vif-deleted", "tag": "b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:30.012992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7c24527d-1d69-4d69-902b-6aa285454e08 req-3a0b9128-c0aa-4af1-8a92-faf56542f3da service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:30.013927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7c24527d-1d69-4d69-902b-6aa285454e08 req-3a0b9128-c0aa-4af1-8a92-faf56542f3da service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:30.014771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7c24527d-1d69-4d69-902b-6aa285454e08 req-3a0b9128-c0aa-4af1-8a92-faf56542f3da service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:30.079610 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7c24527d-1d69-4d69-902b-6aa285454e08 req-3a0b9128-c0aa-4af1-8a92-faf56542f3da service nova] Creating event network-vif-deleted:b8d5eec3-40ef-4b4c-9fcf-7f8e395ac414 for instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 on n-h2-862876-2 Oct 28 13:38:30.087303 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7c24527d-1d69-4d69-902b-6aa285454e08 req-3a0b9128-c0aa-4af1-8a92-faf56542f3da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114784 Oct 28 13:38:30.088843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3028/6139] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:30.824614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:30.825225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 6a40daf9-c546-4eeb-9890-f6a1631afb49] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:30.832882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:30.833586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:30.841614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:30.841614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:30.841614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:30.841614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:30.849775 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] HTTP exception thrown: Instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 could not be found. Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Request method failure captured: Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 HTTP/1.1 Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9mayMITvj1WED7X4-LI_q-dqZgc6OMnHWkdghjk9JQGeng-uxFEkU53_e-hKVT8JReAQuIzjf8cMQzD6unQJiHZ6RiF5Zncy6jWXUSZ0QjnsCHVhZ3Y4I-81dkCR4L5abLF2-ERrK5ZpIzHeFr0wDrf-jAm3DxliK9sL-hRfID35aI Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_727d3fc63e0847efae144898701cbf5c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: a5283ffea73c4febbbcce05e56bdd6cc Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 could not be found. Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6a40daf9-c546-4eeb-9890-f6a1631afb49'} Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 could not be found. Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 could not be found. Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:30.851469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 could not be found. Oct 28 13:38:30.855547 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:38:30.856709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Returning 404 to user: Instance 6a40daf9-c546-4eeb-9890-f6a1631afb49 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:38:30.857698 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51e1ccf7-c0c7-4b7f-8234-701592083811 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49" status: 404 len: 111 microversion: 2.1 time: 0.037039 Oct 28 13:38:30.858435 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3112/6140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:30 2022] GET /compute/v2.1/servers/6a40daf9-c546-4eeb-9890-f6a1631afb49 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:38:36.651064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3fb5edae-040d-43e5-9c5e-e87bccd19a09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '.version_select at 0x7f27b84ba3a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:36.771419 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3fb5edae-040d-43e5-9c5e-e87bccd19a09 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1275469927" status: 202 len: 0 microversion: 2.1 time: 0.127146 Oct 28 13:38:36.772346 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3029/6141] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 13:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1275469927 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:38:36.805039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a63b090-f954-4e72-9c30-f05c249b0185 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: .version_select at 0x7f27b96f5c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1734478620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB++C19Ulqrtzf/qFZwVQGhvaK82Vn4xmJsqvEozquQyBRyeDefLrwh3/wN+KywuQtov0/L6Pqk7slgDfMOFMiTWwkZ5WTn71/HYABm0PtsyOae7RQbtf4x199g1igzsA=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:36.825437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-0a63b090-f954-4e72-9c30-f05c249b0185 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:38:36.832673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-0a63b090-f954-4e72-9c30-f05c249b0185 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:38:36.951219 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a63b090-f954-4e72-9c30-f05c249b0185 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.150025 Oct 28 13:38:36.952803 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3113/6142] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:38:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:47.019303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:47.024095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:47.032611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=68 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:47.039497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:47.041501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:47.058498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:47.060610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:47.063645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:47.067715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:47.070270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:47.162294 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6212cb48-cecd-4abb-96e6-d69bd2e9d466 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments/d4cc45b7-d060-4407-90a4-35bb1675e6ec" status: 200 len: 194 microversion: 2.20 time: 0.146133 Oct 28 13:38:47.163985 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3030/6143] 10.222.0.25 () {60 vars in 1454 bytes} [Fri Oct 28 13:38:47 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments/d4cc45b7-d060-4407-90a4-35bb1675e6ec => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:47.295359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:47.297776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:47.298965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:38:47.304015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:47.304739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:47.312482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:47.316913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:47.316913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:47.316913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:47.316913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:47.316913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:47.434148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lazy-loading 'services' on Instance uuid bd5181f8-b838-41a3-a5ae-bad3451e6388 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:38:47.782072 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5b0b268-ef82-4804-a69f-1888a1e2bfec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments/d4cc45b7-d060-4407-90a4-35bb1675e6ec" status: 202 len: 0 microversion: 2.20 time: 0.487920 Oct 28 13:38:47.796872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:47.799609 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3114/6144] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Oct 28 13:38:47 2022] DELETE /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments/d4cc45b7-d060-4407-90a4-35bb1675e6ec => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:38:47.801957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:47.824947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:47.824947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:47.824947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:47.831347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:47.835570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:47.837669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:47.962800 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec076592-7339-4c8e-8550-9cdb5c2ff51d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.171934 Oct 28 13:38:47.975507 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3031/6145] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:47 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:48.979508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:48.982322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:48.991509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:48.992009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:48.992448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:48.993305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:48.993767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:48.994199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:49.029933 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d7fa037-aa3b-49d0-8722-0bddd66c1c87 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056105 Oct 28 13:38:49.031171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3115/6146] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:48 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:50.043878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:50.049151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:50.085655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:50.095242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:50.095814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:50.096589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:50.097077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:50.097515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:50.221868 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-98a5d7fa-78b1-474b-8dee-d2707f06f38f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182450 Oct 28 13:38:50.223562 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3032/6147] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:50 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:50.553208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-405602993", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "64c6ec05-216c-4249-9da1-d56e7a28fbd7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1734478620", "security_groups": [{"name": "tempest-secgroup-smoke-1498560292"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:50.783227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] validate_networks() for [('64c6ec05-216c-4249-9da1-d56e7a28fbd7', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:38:51.233855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:51.236851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:51.252546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:51.253390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:51.254064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:51.255051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:51.255823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:51.265392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:51.321071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf128e29-ca8b-49a3-b95c-3097a87e6a93 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091207 Oct 28 13:38:51.335602 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3033/6148] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:51 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:51.831977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:38:51.843864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:38:51.843864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:38:51.843864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:38:51.843864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:38:51.843864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:51.844767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:51.845532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:51.846459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:51.847144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:51.847573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:51.866975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:38:51.873160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Getting quotas for user a5283ffea73c4febbbcce05e56bdd6cc and project 727d3fc63e0847efae144898701cbf5c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:38:51.888000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:38:51.891345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:38:52.056834 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1e8a8172-4470-48fa-8319-20ef6b3f2e21 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.527258 Oct 28 13:38:52.058124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3116/6149] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:38:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:38:52.069843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8eca0298-a0af-4408-a1d3-5216dc8925cd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:52.071221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8eca0298-a0af-4408-a1d3-5216dc8925cd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:52.220492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8eca0298-a0af-4408-a1d3-5216dc8925cd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:52.235000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8eca0298-a0af-4408-a1d3-5216dc8925cd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1266 microversion: 2.1 time: 0.162828 Oct 28 13:38:52.235000 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3034/6150] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:52 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:52.351622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:52.358605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:52.388156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:52.390215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:52.390891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:52.393058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:52.393746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:52.395118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:52.489192 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2ed1b908-9132-4005-80e0-4a460755dc84 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138665 Oct 28 13:38:52.495346 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3117/6151] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:52 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:53.258643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9ef66d46-8422-4d3f-8955-ca7bdab89d6f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:53.259297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9ef66d46-8422-4d3f-8955-ca7bdab89d6f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:53.466535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9ef66d46-8422-4d3f-8955-ca7bdab89d6f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:53.475227 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9ef66d46-8422-4d3f-8955-ca7bdab89d6f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1266 microversion: 2.1 time: 0.221510 Oct 28 13:38:53.475830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3035/6152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:53 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:53.502257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:53.504660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:53.516578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:53.516986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:53.517424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:53.518204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:53.528732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:53.529379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:53.603487 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f54112a-e850-4316-8ac4-ac9c780455e4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105810 Oct 28 13:38:53.604084 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3118/6153] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:53 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:54.502604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:54.505041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:54.534391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:54.535565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:54.536031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:54.536778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:54.537240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:54.537680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:54.617882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:54.630794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:54.651564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:54.652106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:54.667485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:54.671699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:54.673149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:54.673608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:54.800913 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-349c51e0-22ce-4a91-85d2-4862ddbb2381 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.187593 Oct 28 13:38:54.803109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3119/6154] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:54 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:54.896014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:54.910517 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3623180c-6479-4d7c-a616-6b2a0ecab7a9 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1318 microversion: 2.1 time: 0.413044 Oct 28 13:38:54.911162 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3036/6155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:54 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:55.814011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:55.816449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:55.831189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:55.831777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:55.832257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:55.833122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:55.833468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:55.833952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:55.907445 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-399823c6-e787-4911-9954-4a555dc7fae6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097783 Oct 28 13:38:55.910920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3120/6156] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:55 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:38:55.937944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:55.938613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:55.967347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:55.971100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:55.973460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:55.976553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:55.980665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:55.992442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:56.185141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:56.204836 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0d7b24bd-6c9b-4767-b1d7-ce0df91f6b64 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1324 microversion: 2.1 time: 0.267772 Oct 28 13:38:56.206202 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3037/6157] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:55 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:56.921053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:56.924328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:56.940745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:56.941504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:56.942042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:56.943656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:56.944473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:56.945890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:57.032648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4387fa64-8c40-405b-94c2-c9faca2590bd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.116420 Oct 28 13:38:57.039375 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3121/6158] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:38:56 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:57.142585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:57.143804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:57.160264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:57.161015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:57.161711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:57.165169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:57.174775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:57.175490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:57.237274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:38:57.237459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:57.237459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:57.241662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:57.242389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:57.243084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:57.243872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:57.244410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:57.244931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:57.615557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:57.625647 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bbf9a1f6-33b0-47ce-9877-1be73a907d47 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1392 microversion: 2.1 time: 0.397051 Oct 28 13:38:57.635039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3122/6159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:57 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:38:57.750087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ecb57ee0-b61e-431e-8cb4-34344c7dadf6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 204 len: 0 microversion: 2.20 time: 0.603227 Oct 28 13:38:57.750087 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3038/6160] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:38:57 2022] DELETE /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:38:57.754935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:57.755556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:57.761758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:57.762532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:57.763242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:57.764292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:57.765717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:57.766519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:57.989305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:57.999415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:58.011330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:58.013891 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ede5d85-e5bc-45bd-90f0-4dc8f8796992 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.262925 Oct 28 13:38:58.015196 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3123/6161] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:57 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:38:58.658668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:58.659332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:58.672869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:58.673378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:58.674007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:58.677388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:58.678460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:58.679199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:58.827060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4dae6019-ea8e-46b0-b369-e2b806f41513 req-820d2100-892c-4411-b180-ba84ef3af35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1c6b74-e7c1-4dde-9389-0bf4014a44f1", "tag": "b1433bbe-5a7e-4c94-a4e5-799a2384af4a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:38:58.842353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4dae6019-ea8e-46b0-b369-e2b806f41513 req-820d2100-892c-4411-b180-ba84ef3af35d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:58.843501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4dae6019-ea8e-46b0-b369-e2b806f41513 req-820d2100-892c-4411-b180-ba84ef3af35d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:58.844118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4dae6019-ea8e-46b0-b369-e2b806f41513 req-820d2100-892c-4411-b180-ba84ef3af35d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:58.874569 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4dae6019-ea8e-46b0-b369-e2b806f41513 req-820d2100-892c-4411-b180-ba84ef3af35d service nova] Creating event network-changed:b1433bbe-5a7e-4c94-a4e5-799a2384af4a for instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 on n-h2-862876-2 Oct 28 13:38:58.882332 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4dae6019-ea8e-46b0-b369-e2b806f41513 req-820d2100-892c-4411-b180-ba84ef3af35d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275895 Oct 28 13:38:58.883355 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3039/6162] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:38:58.996512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:59.003613 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4d908a6b-e706-4297-9b42-ebc97d5e204f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1392 microversion: 2.1 time: 0.350059 Oct 28 13:38:59.004352 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3124/6163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:38:58 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:38:59.043396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:38:59.044199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:38:59.051268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:59.051882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:59.052332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:59.053027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:38:59.053484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:38:59.053904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:38:59.232564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:59.246156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:59.248767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:38:59.250994 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ea1e93a8-69a8-4ed0-a55c-498dabf71162 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1724 microversion: 2.20 time: 0.212880 Oct 28 13:38:59.264117 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3040/6164] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:38:59 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:00.029346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:00.029909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:00.037623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:00.038280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:00.038541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:00.039264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:00.039718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:00.040143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:00.274174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:00.284030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:00.284030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:00.287357 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-75e51f77-c6c2-4e15-80bb-24c74c828bce tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1392 microversion: 2.1 time: 0.259758 Oct 28 13:39:00.288649 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3125/6165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:00 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1392 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:00.293148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:00.294336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:00.295317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:00.296328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:00.297046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:00.297576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:00.386319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:00.401403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:00.403754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:00.406109 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab8b1d54-1620-4813-9838-1a25f7fb060e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1657 microversion: 2.20 time: 0.131335 Oct 28 13:39:00.406677 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3041/6166] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:00 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1657 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:00.932307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-90757f1c-c534-4092-afa3-01b6608c5cd2 req-d5af3751-629f-4693-b3da-b52339e30685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5181f8-b838-41a3-a5ae-bad3451e6388", "name": "network-vif-deleted", "tag": "4d9ff784-54aa-47d3-9d78-3b5fbce30ceb"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:00.942819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90757f1c-c534-4092-afa3-01b6608c5cd2 req-d5af3751-629f-4693-b3da-b52339e30685 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:00.943310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90757f1c-c534-4092-afa3-01b6608c5cd2 req-d5af3751-629f-4693-b3da-b52339e30685 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:00.943840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90757f1c-c534-4092-afa3-01b6608c5cd2 req-d5af3751-629f-4693-b3da-b52339e30685 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:00.956757 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-90757f1c-c534-4092-afa3-01b6608c5cd2 req-d5af3751-629f-4693-b3da-b52339e30685 service nova] Creating event network-vif-deleted:4d9ff784-54aa-47d3-9d78-3b5fbce30ceb for instance bd5181f8-b838-41a3-a5ae-bad3451e6388 on n-h1-862876-2 Oct 28 13:39:00.963326 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-90757f1c-c534-4092-afa3-01b6608c5cd2 req-d5af3751-629f-4693-b3da-b52339e30685 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033463 Oct 28 13:39:00.963949 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3126/6167] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:39:01.313759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:01.315128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:01.323785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:01.324478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:01.325200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:01.326148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:01.327147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:01.327769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:01.434585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:01.435599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:01.442772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:01.443275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:01.443709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:01.444626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:01.445318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:01.446270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:01.481020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:01.481797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:01.482434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:01.482961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lazy-loading 'fault' on Instance uuid bd5181f8-b838-41a3-a5ae-bad3451e6388 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:39:01.508027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:01.518923 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c2d3191-1126-47cb-86b8-28cc52f50354 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1392 microversion: 2.1 time: 0.210329 Oct 28 13:39:01.520438 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3042/6168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:01 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:01.558079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:01.569995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:01.572435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:01.574229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ac87cff-5ffe-4b65-a9f7-576bc2cf67d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 200 len: 1371 microversion: 2.20 time: 0.145771 Oct 28 13:39:01.575775 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3127/6169] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:01 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:02.542563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:02.543217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:02.551169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:02.551841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:02.552292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:02.553008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:02.553470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:02.553901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:02.601449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:02.602080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:02.604213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:02.604952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:02.612222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:02.612728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:02.613398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:02.614115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:02.614649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:02.615274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:02.631163 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] HTTP exception thrown: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Request method failure captured: Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 HTTP/1.1 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9qZEMKoF6702qsjBLIKNc48PZGPG6E3Ufyw4fHZc1CSB3DgbKxtbIW9NUXosXKhYiokqw9TNZggF0WTEnLpvdLdUPNWAvervFJM9ef1DvWjqrVDxBTxYqVyktIx5dErlLNcWX4a00kiR1E_Gi0AY66SX8fCSUyFggW8cVlNo93GBHc Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a580b333d8b245b1a69b2b246b73abcc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ccf717948682481a87e008d912d4848c Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bd5181f8-b838-41a3-a5ae-bad3451e6388'} Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:39:02.633249 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Returning 404 to user: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:39:02.637631 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d63f84ee-1016-4210-9c96-43d95a492f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 404 len: 111 microversion: 2.20 time: 0.037509 Oct 28 13:39:02.641619 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3128/6170] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:02 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 13:39:02.645302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9943a19a-1897-41fc-83c7-0ae2fb9212af tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '.version_select at 0x7f27b86a0e50>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:02.722798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:02.734703 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3bff564f-d85d-4ef1-b29c-7fdf50c8c545 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1392 microversion: 2.1 time: 0.196179 Oct 28 13:39:02.735648 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3043/6171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:02 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:02.792920 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9943a19a-1897-41fc-83c7-0ae2fb9212af tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061610527" status: 204 len: 0 microversion: 2.20 time: 0.143701 Oct 28 13:39:02.792920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3129/6172] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:39:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061610527 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:39:03.366475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e18fde87-85a8-47de-a987-c4a2cfac2903 req-b6e87f59-7ff2-4fe1-9784-f2cba7239e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1c6b74-e7c1-4dde-9389-0bf4014a44f1", "name": "network-vif-plugged", "status": "completed", "tag": "b1433bbe-5a7e-4c94-a4e5-799a2384af4a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:03.403111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e18fde87-85a8-47de-a987-c4a2cfac2903 req-b6e87f59-7ff2-4fe1-9784-f2cba7239e55 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:03.403111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e18fde87-85a8-47de-a987-c4a2cfac2903 req-b6e87f59-7ff2-4fe1-9784-f2cba7239e55 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:03.403111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e18fde87-85a8-47de-a987-c4a2cfac2903 req-b6e87f59-7ff2-4fe1-9784-f2cba7239e55 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:03.441552 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e18fde87-85a8-47de-a987-c4a2cfac2903 req-b6e87f59-7ff2-4fe1-9784-f2cba7239e55 service nova] Creating event network-vif-plugged:b1433bbe-5a7e-4c94-a4e5-799a2384af4a for instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 on n-h2-862876-2 Oct 28 13:39:03.453501 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e18fde87-85a8-47de-a987-c4a2cfac2903 req-b6e87f59-7ff2-4fe1-9784-f2cba7239e55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291588 Oct 28 13:39:03.455046 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3044/6173] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:39:03.761945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:03.763254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:03.769945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:03.770734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:03.771298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:03.772109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:03.772652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:03.773158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:03.984033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:04.011575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b00abdc7-f244-4bf6-8898-a73d56ecb6ac tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1392 microversion: 2.1 time: 0.255816 Oct 28 13:39:04.012174 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3130/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:03 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:04.328459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:04.333533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9601ae5-857a-4328-9b5d-2af962ca13be tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'create', calling method: .version_select at 0x7f27b87939d0>, body: {"keypair": {"name": "tempest-keypair-1952149381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSAAMVgLnYtst4GFBWXu5352HmiqGGfBUc9/80KqPAj8I3i+kRpjCotqihqbMa8mZjFq+G0aPFxSJiN9J7m0oHZzKdKT4N/e878H2eZwH+SiSI3oEleRe9TDUKOmV/5Hg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:04.350651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f9601ae5-857a-4328-9b5d-2af962ca13be tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for project a580b333d8b245b1a69b2b246b73abcc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:39:04.356673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f9601ae5-857a-4328-9b5d-2af962ca13be tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for user ccf717948682481a87e008d912d4848c and project a580b333d8b245b1a69b2b246b73abcc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:39:04.481826 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9601ae5-857a-4328-9b5d-2af962ca13be tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.154828 Oct 28 13:39:04.483095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3045/6175] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Oct 28 13:39:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 13:39:05.039627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:05.040245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:05.049357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:05.051304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:05.051304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:05.051905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:05.052610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:05.053204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:05.230634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:05.245381 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d1e376ff-fc2e-43c0-a83a-cadbff24cc9a tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1564 microversion: 2.1 time: 0.209624 Oct 28 13:39:05.248738 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3131/6176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:05 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1564 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:05.270919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:05.271658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:05.284123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:05.285036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:05.299862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:05.299862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:05.299862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:05.299862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:05.532110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:05.543508 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e74182ed-bebf-4e34-803c-b01f40cbab13 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1564 microversion: 2.1 time: 0.276634 Oct 28 13:39:05.547746 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3046/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:05 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1564 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:08.832446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1745143897", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6881547-1ad6-4a5f-a8ef-9efc70fde110"}], "security_groups": [{"name": "tempest-securitygroup--544493066"}], "key_name": "tempest-keypair-1952149381", "user_data": "}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:09.026114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] validate_networks() for [('e6881547-1ad6-4a5f-a8ef-9efc70fde110', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:39:09.828257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:39:09.828686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:39:09.829170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:39:09.829583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:39:09.830436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:39:09.849486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:09.851504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:09.851991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:09.852729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:09.853197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:09.858069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:09.904081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for project a580b333d8b245b1a69b2b246b73abcc. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:39:09.918986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:09.924927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:09.925361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Getting quotas for user ccf717948682481a87e008d912d4848c and project a580b333d8b245b1a69b2b246b73abcc. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:39:09.938775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:09.939329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:09.939775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:09.940483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:09.940939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:09.941363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:09.956137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:39:09.959164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:39:10.182372 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ecdfd407-1ccd-41fd-881d-ffa9c73df3d5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.342023 Oct 28 13:39:10.191372 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3132/6178] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Oct 28 13:39:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 13:39:10.221203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-fa460468-88dc-4a74-92d7-70e8b310ead7 req-7e2db185-d797-4d9a-8ece-a78859b15763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1c6b74-e7c1-4dde-9389-0bf4014a44f1", "tag": "b1433bbe-5a7e-4c94-a4e5-799a2384af4a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:10.243185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fa460468-88dc-4a74-92d7-70e8b310ead7 req-7e2db185-d797-4d9a-8ece-a78859b15763 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:10.244127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fa460468-88dc-4a74-92d7-70e8b310ead7 req-7e2db185-d797-4d9a-8ece-a78859b15763 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:10.244756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-fa460468-88dc-4a74-92d7-70e8b310ead7 req-7e2db185-d797-4d9a-8ece-a78859b15763 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:10.257747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:10.261065 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-fa460468-88dc-4a74-92d7-70e8b310ead7 req-7e2db185-d797-4d9a-8ece-a78859b15763 service nova] Creating event network-changed:b1433bbe-5a7e-4c94-a4e5-799a2384af4a for instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 on n-h2-862876-2 Oct 28 13:39:10.268592 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-fa460468-88dc-4a74-92d7-70e8b310ead7 req-7e2db185-d797-4d9a-8ece-a78859b15763 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075072 Oct 28 13:39:10.273316 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3133/6179] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:39:10.275320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a2642c0-02ab-4d57-a9d3-1be7acbe0baf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:10.276211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7a2642c0-02ab-4d57-a9d3-1be7acbe0baf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:10.514155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7a2642c0-02ab-4d57-a9d3-1be7acbe0baf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:10.527057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7a2642c0-02ab-4d57-a9d3-1be7acbe0baf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:10.549861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7a2642c0-02ab-4d57-a9d3-1be7acbe0baf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:10.551671 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7a2642c0-02ab-4d57-a9d3-1be7acbe0baf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1282 microversion: 2.20 time: 0.281098 Oct 28 13:39:10.555452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3134/6180] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:10 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1282 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:10.804124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:10.819731 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-163ecefc-cb2b-4b43-8d98-1cd366559a96 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1564 microversion: 2.1 time: 0.904890 Oct 28 13:39:10.824466 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3047/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:09 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1564 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:11.582111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e414fd93-6a50-438e-a92a-dedb0c261e31 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:11.583629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e414fd93-6a50-438e-a92a-dedb0c261e31 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:11.658857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e414fd93-6a50-438e-a92a-dedb0c261e31 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:11.677325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e414fd93-6a50-438e-a92a-dedb0c261e31 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:11.695229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e414fd93-6a50-438e-a92a-dedb0c261e31 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:11.695229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e414fd93-6a50-438e-a92a-dedb0c261e31 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1282 microversion: 2.20 time: 0.105078 Oct 28 13:39:11.695229 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3135/6182] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:11 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:12.709221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:12.710536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:12.718678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:12.719444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:12.720096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:12.720805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:12.721316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:12.721747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:12.790414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:12.798792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:12.800230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:12.801369 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3eb98cfc-82bf-48d8-8640-bf2c72838386 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1334 microversion: 2.20 time: 0.096051 Oct 28 13:39:12.801938 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3048/6183] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:12 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:13.844527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:13.844527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:13.852685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:13.853491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:13.854123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:13.855208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:13.855931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:13.856657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:13.975352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:13.998090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:14.000980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:14.002251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f29542cd-a9f0-4904-b822-f3beb56bab99 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1340 microversion: 2.20 time: 0.173895 Oct 28 13:39:14.007740 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3136/6184] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:13 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1340 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:15.031310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:15.032000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:15.046055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:15.046569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:15.053300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:15.054444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:15.054972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:15.055828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:15.067254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:15.442263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:15.454908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:15.459949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:15.462601 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7cf96fd-4dc2-4dbe-b4b7-97327e86c3fb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.437036 Oct 28 13:39:15.478203 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3049/6185] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:15 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:16.481938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-90d6331d-e4be-43c9-ae39-4989d9f5ad97 req-ef855388-d756-4c12-9a6e-da7e64f4f49f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:16.496198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:16.497382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90d6331d-e4be-43c9-ae39-4989d9f5ad97 req-ef855388-d756-4c12-9a6e-da7e64f4f49f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:16.497518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:16.497616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90d6331d-e4be-43c9-ae39-4989d9f5ad97 req-ef855388-d756-4c12-9a6e-da7e64f4f49f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:16.497985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-90d6331d-e4be-43c9-ae39-4989d9f5ad97 req-ef855388-d756-4c12-9a6e-da7e64f4f49f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:16.513819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:16.516539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:16.517041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:16.518655 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-90d6331d-e4be-43c9-ae39-4989d9f5ad97 req-ef855388-d756-4c12-9a6e-da7e64f4f49f service nova] Creating event network-changed:71e2709c-2621-4715-abef-d0eb6e49342b for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 on n-h1-862876-2 Oct 28 13:39:16.520827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:16.521477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:16.521921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:16.531816 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-90d6331d-e4be-43c9-ae39-4989d9f5ad97 req-ef855388-d756-4c12-9a6e-da7e64f4f49f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054855 Oct 28 13:39:16.533246 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3137/6186] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:39:16.806171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:16.815653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:16.819023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:16.823773 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a071fc9-bae7-4dae-8807-8a49b3749ea1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.332986 Oct 28 13:39:16.824568 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3050/6187] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:16 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:39:17.858500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:17.859244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:17.866416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:17.866951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:17.867387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:17.868088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:17.868542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:17.868965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:18.004305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:18.012660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:18.014116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:18.015837 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-929c296f-63d7-48d3-8337-0df9bdcddfdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.161762 Oct 28 13:39:18.016349 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3138/6188] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:17 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:19.041680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:19.042306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:19.050271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:19.050803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:19.051254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:19.051969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:19.052428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:19.052854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:19.256603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:19.270086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:19.272382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:19.273870 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86d67585-0c2c-4cb6-bbc6-91998e5338d2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.236285 Oct 28 13:39:19.274591 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3051/6189] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:19 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:20.303050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:20.304222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:20.307224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:20.313836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:20.314335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:20.314810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:20.315529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:20.315991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:20.316421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:20.507510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:20.517757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:20.528943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:20.528943 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-687c9b39-a3ab-430d-b164-2aec20050f41 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.221684 Oct 28 13:39:20.528943 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3139/6190] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:20 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:21.548283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:21.548750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:21.552496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:21.558988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:21.558988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:21.560605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:21.562200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:21.563130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:21.563750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:21.564245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:21.982963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:21.991857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:21.993628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:21.994918 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd29f870-a01d-42b0-95f4-1d35348cc67f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.451936 Oct 28 13:39:21.995802 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3052/6191] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:21 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:23.021598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:23.022217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:23.026161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:23.038181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:23.038181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:23.038181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:23.038181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:23.038181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:23.038181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:23.038181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:23.316211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:23.334012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:23.335917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:23.337219 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc42c928-7999-41e7-b5c5-8848fb5b36f3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.319502 Oct 28 13:39:23.338295 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3140/6192] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:23 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:24.364253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:24.365391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:24.372704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:24.373194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:24.373630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:24.374869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:24.375367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:24.375984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:24.553163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:24.562178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:24.563763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:24.565008 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1faebb9e-e649-42d7-a764-9c3a097f2a1f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.205843 Oct 28 13:39:24.565673 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3053/6193] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:24 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:24.640161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d5f596f4-8759-44e0-bcf3-ee8d4b4abd26 req-b0aaccc4-c2f2-43d0-a2a2-e3253044a5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "name": "network-vif-plugged", "status": "completed", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:24.651023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d5f596f4-8759-44e0-bcf3-ee8d4b4abd26 req-b0aaccc4-c2f2-43d0-a2a2-e3253044a5d0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:24.651712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d5f596f4-8759-44e0-bcf3-ee8d4b4abd26 req-b0aaccc4-c2f2-43d0-a2a2-e3253044a5d0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:24.653575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d5f596f4-8759-44e0-bcf3-ee8d4b4abd26 req-b0aaccc4-c2f2-43d0-a2a2-e3253044a5d0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:24.665420 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d5f596f4-8759-44e0-bcf3-ee8d4b4abd26 req-b0aaccc4-c2f2-43d0-a2a2-e3253044a5d0 service nova] Creating event network-vif-plugged:71e2709c-2621-4715-abef-d0eb6e49342b for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 on n-h1-862876-2 Oct 28 13:39:24.670536 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d5f596f4-8759-44e0-bcf3-ee8d4b4abd26 req-b0aaccc4-c2f2-43d0-a2a2-e3253044a5d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034965 Oct 28 13:39:24.671766 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3141/6194] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:39:25.592914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:25.593630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:25.601104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:25.601728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:25.602335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:25.603329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:25.603896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:25.604430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:25.783332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:25.819322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:25.837122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:25.843745 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-368c1c1e-b1b4-47b7-854b-2c2e1a68ae64 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1407 microversion: 2.20 time: 0.251045 Oct 28 13:39:25.843745 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3054/6195] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:25 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:26.868680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:26.869394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:26.877675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:26.878168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:26.878851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:26.879554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:26.880167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:26.880954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:27.023163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:27.033415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:27.034909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:27.036089 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb8a53d5-d421-4f45-977c-e2b0a479bc81 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1599 microversion: 2.20 time: 0.171609 Oct 28 13:39:27.036664 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3142/6196] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:39:26 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:39:27.063058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:27.063712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:27.073372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:27.074106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:27.074693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:27.075604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:27.076315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:27.076749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:27.174656 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c410b44d-eac9-4cff-a857-3cfca0eedef6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116506 Oct 28 13:39:27.175791 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3055/6197] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Oct 28 13:39:27 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:39:28.305090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d925b652-3cca-4296-8f82-b00b178b43ea req-0ae9eb69-b817-4778-a6bb-513b6ebdb93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:28.324322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d925b652-3cca-4296-8f82-b00b178b43ea req-0ae9eb69-b817-4778-a6bb-513b6ebdb93b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:28.324823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d925b652-3cca-4296-8f82-b00b178b43ea req-0ae9eb69-b817-4778-a6bb-513b6ebdb93b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:28.325392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d925b652-3cca-4296-8f82-b00b178b43ea req-0ae9eb69-b817-4778-a6bb-513b6ebdb93b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:28.345764 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d925b652-3cca-4296-8f82-b00b178b43ea req-0ae9eb69-b817-4778-a6bb-513b6ebdb93b service nova] Creating event network-changed:71e2709c-2621-4715-abef-d0eb6e49342b for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 on n-h1-862876-2 Oct 28 13:39:28.355496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d925b652-3cca-4296-8f82-b00b178b43ea req-0ae9eb69-b817-4778-a6bb-513b6ebdb93b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054806 Oct 28 13:39:28.356101 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3143/6198] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:39:29.370540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:29.373476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:29.385817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:29.386635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:29.387313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:29.388261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:29.388885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:29.389560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:29.466398 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62a7aadb-e5cc-4ac3-9804-98817f035275 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1/action" status: 200 len: 24570 microversion: 2.1 time: 0.099090 Oct 28 13:39:29.467310 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3056/6199] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:39:29 2022] POST /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1/action => generated 24570 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:39:35.908867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:35.912686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:35.932661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:35.933495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:35.935580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:35.936642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:35.937330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:35.938061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:36.120095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:39:36.120095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:39:36.120095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:39:36.120095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:39:36.124345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:39:36.409242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:36.415983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:36.416562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:36.418043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:36.418864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:36.419403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:36.419906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:36.457298 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4075a08e-c05d-4935-81c7-7e78d30dfb78 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1/action" status: 202 len: 1137 microversion: 2.1 time: 0.554169 Oct 28 13:39:36.458056 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3144/6200] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:39:35 2022] POST /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1/action => generated 1137 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 13:39:36.482006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:36.483153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:36.492532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:36.492532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:36.492532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:36.496338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:36.499857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:36.499857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:36.717410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:36.727131 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4afe210a-5837-4f8b-aa12-93c3add2e3a4 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.253314 Oct 28 13:39:36.728317 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3057/6201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:36 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:37.755475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:37.756184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:37.763145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:37.763634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:37.764249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:37.765167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:37.765780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:37.766361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:37.960037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:37.972039 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e3cac289-c1fc-4e5f-b8b8-fda4a82b835f tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.220568 Oct 28 13:39:37.972624 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3145/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:37 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:39.001461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:39.002632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:39.012734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:39.016188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:39.025300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:39.025300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:39.025300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:39.025300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:39.208205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:39.218255 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f9f1b8b-54a9-427e-a0f2-c7b3596e4abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.221331 Oct 28 13:39:39.218852 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3058/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:38 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:40.246711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:40.247349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:40.266321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:40.266848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:40.267297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:40.268145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:40.268612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:40.269038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:40.436412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:40.445375 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da556290-49a2-4c01-82be-067ba27b9677 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.206717 Oct 28 13:39:40.450782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3146/6204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:40 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:41.472058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:41.472768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:41.480564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:41.481160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:41.482047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:41.482927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:41.488649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:41.489144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:41.819455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:41.837876 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-196d3918-ced3-451d-a6ea-601f4cddb673 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.365486 Oct 28 13:39:41.837876 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3059/6205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:41 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:42.860530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:42.871004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:42.871004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:42.871004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:42.871004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:42.871004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:42.871475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:42.871639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:43.068326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:43.078413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0b5d243f-8ee0-4560-97ce-1c2c802decc5 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.222639 Oct 28 13:39:43.083727 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3147/6206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:42 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:44.103580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:44.104116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:44.117633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:44.119733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:44.122767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:44.123298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:44.125536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:44.126157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:44.428271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:44.438528 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52c99760-796f-432a-aefc-2a3d1b45da54 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.340723 Oct 28 13:39:44.440819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3060/6207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:44 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:45.465548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:45.467036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:45.505250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:45.508837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:45.509514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:45.511820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:45.513284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:45.515777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:45.544443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:45.968813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:45.977469 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b78f477b-f95b-4f65-a1cb-19b5f76355fa tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.515829 Oct 28 13:39:45.998172 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3148/6208] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:45 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:47.011198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:47.013858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:47.022211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:47.022715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:47.023209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:47.023935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:47.024395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:47.024834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:47.208834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:47.220234 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3f35fbd9-1fcf-4ae1-8941-afd455f0b17d tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.217536 Oct 28 13:39:47.222829 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3061/6209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:47 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:48.252411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:48.253045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:48.270461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:48.270461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:48.270461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:48.270461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:48.274692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:48.275265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:48.559742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:48.568208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7fc3dd1b-fb50-4249-b079-6e1efebc649e tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1692 microversion: 2.1 time: 0.324498 Oct 28 13:39:48.569158 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3149/6210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:48 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1692 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:49.610648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:49.612512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:49.631964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:49.632903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:49.638210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:49.639035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:49.639573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:49.643625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:49.649063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=73 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:50.039567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:50.047476 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23e253a4-9bc9-4231-bb69-74a72b2e4773 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1698 microversion: 2.1 time: 0.455232 Oct 28 13:39:50.048705 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3062/6211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:49 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1698 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:51.079155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:51.080316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:51.089077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:51.089732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:51.091246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:51.092184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:51.093432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:51.094080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:51.306991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:51.331376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f210f571-0192-445a-a649-7e427ebef308 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1698 microversion: 2.1 time: 0.256560 Oct 28 13:39:51.331376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3150/6212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:51 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1698 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:52.354961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:52.355499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:52.363577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:52.364066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:52.364504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:52.365201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:52.365943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:52.366063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:52.502129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:39:52.512066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-217f7b4c-6b78-4433-834d-a9dbb06acaae tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1683 microversion: 2.1 time: 0.161045 Oct 28 13:39:52.519114 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3063/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:39:52 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:39:53.510105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3647d38a-f4b3-4cd9-8cb4-c93d6ddd3a67 req-281211fd-4706-4cef-a92e-66878ccd534d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1c6b74-e7c1-4dde-9389-0bf4014a44f1", "name": "network-vif-plugged", "status": "completed", "tag": "b1433bbe-5a7e-4c94-a4e5-799a2384af4a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:39:53.541899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3647d38a-f4b3-4cd9-8cb4-c93d6ddd3a67 req-281211fd-4706-4cef-a92e-66878ccd534d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:53.542445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3647d38a-f4b3-4cd9-8cb4-c93d6ddd3a67 req-281211fd-4706-4cef-a92e-66878ccd534d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:53.546724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3647d38a-f4b3-4cd9-8cb4-c93d6ddd3a67 req-281211fd-4706-4cef-a92e-66878ccd534d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:53.564605 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3647d38a-f4b3-4cd9-8cb4-c93d6ddd3a67 req-281211fd-4706-4cef-a92e-66878ccd534d service nova] Creating event network-vif-plugged:b1433bbe-5a7e-4c94-a4e5-799a2384af4a for instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 on n-h2-862876-2 Oct 28 13:39:53.571328 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3647d38a-f4b3-4cd9-8cb4-c93d6ddd3a67 req-281211fd-4706-4cef-a92e-66878ccd534d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069014 Oct 28 13:39:53.572346 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3151/6214] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:39:57.428995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:39:57.429504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:39:57.448372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=24 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:39:57.454172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:57.454436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:57.455118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:57.456002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:39:57.456624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:39:57.457209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:39:57.485746 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ca112c5-40b0-429c-b31f-472a5aabf299 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.060774 Oct 28 13:39:57.487010 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3064/6215] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Oct 28 13:39:57 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:40:01.175124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:01.175124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:01.177474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=28 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:01.181028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:01.181511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:01.181942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:01.182630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:01.183134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:01.184036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:01.215115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lazy-loading 'flavor' on Instance uuid ce9ca08e-c2f8-4409-916c-114c1f94c0e2 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:40:01.966184 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d6544ac-df24-4eee-aa6c-15964e653b69 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/action" status: 202 len: 0 microversion: 2.20 time: 0.797550 Oct 28 13:40:01.967066 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3152/6216] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:40:01 2022] POST /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:40:01.989762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:01.990526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:01.998440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:01.999290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:01.999882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:02.000654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:02.001177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:02.015534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:02.531525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:02.580869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:02.584066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:02.588653 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0ba8d09-bc70-43e7-8108-ee5cf134a902 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.603234 Oct 28 13:40:02.589917 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3065/6217] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:01 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:03.070944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-191149548", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a849b8e5-fc97-468b-8da7-15d10bd94d28"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:03.179046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] validate_networks() for [('a849b8e5-fc97-468b-8da7-15d10bd94d28', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:40:03.619968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:03.621294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:03.637471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:03.638176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:03.639064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:03.640577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:03.641289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:03.641944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:03.832007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:03.845306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:03.846908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:03.848189 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41b8ceaf-e1fb-4dce-bc3f-38e54a7cb5ff tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.232463 Oct 28 13:40:03.848853 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3066/6218] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:03 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:04.003057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:40:04.003057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:40:04.003057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:40:04.003449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:40:04.003920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:40:04.038208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:04.039739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:04.040202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:04.043245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:04.043797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:04.044241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:04.093218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Getting quotas for project 8843e45195f545f3b1b4c500b67a792b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:40:04.104248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Getting quotas for user dc7be8d2c7fb4f2e9e3d6bd59cedca7b and project 8843e45195f545f3b1b4c500b67a792b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:40:04.138082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:40:04.146581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:40:04.366586 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51cff336-aee7-4387-9637-a836193232a2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308689 Oct 28 13:40:04.368178 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3153/6219] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:40:04.384895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5791226-a964-4407-9b98-c0c8ad0ca75d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:04.385228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5791226-a964-4407-9b98-c0c8ad0ca75d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:04.471051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e5791226-a964-4407-9b98-c0c8ad0ca75d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:04.488539 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5791226-a964-4407-9b98-c0c8ad0ca75d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1213 microversion: 2.1 time: 0.112180 Oct 28 13:40:04.489247 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3067/6220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:04 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:04.875147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:04.875935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:04.891915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:04.892809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:04.893388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:04.894933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:04.895535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:04.896033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:05.239107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:05.250644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:05.252308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:05.253566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4407db3-da54-4b3e-892b-e55c58fec6f0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.384071 Oct 28 13:40:05.254668 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3154/6221] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:04 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:05.516272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d572f233-4a2b-49de-9f78-a39fa9f10c68 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:05.516870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d572f233-4a2b-49de-9f78-a39fa9f10c68 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:05.691813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d572f233-4a2b-49de-9f78-a39fa9f10c68 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:05.701861 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d572f233-4a2b-49de-9f78-a39fa9f10c68 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1213 microversion: 2.1 time: 0.189672 Oct 28 13:40:05.703801 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3068/6222] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:05 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:06.279226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:06.286948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:06.298081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:06.298739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:06.299209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:06.300058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:06.300787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:06.301220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:06.568447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:06.581970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:06.584375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:06.587228 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-67b86cc7-41b6-4975-a5ee-9dc2f884d22a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.312061 Oct 28 13:40:06.588196 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3155/6223] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:06 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:06.728905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:06.731850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:06.743916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:06.744670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:06.747308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:06.747308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:06.747308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:06.747721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:06.847533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:06.859473 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4274983-36ba-48f9-bedd-218f253aa431 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1265 microversion: 2.1 time: 0.136400 Oct 28 13:40:06.860092 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3069/6224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:06 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:07.616268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:07.616925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:07.627481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:07.628220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:07.628741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:07.629709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:07.630343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:07.630925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:07.884391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:07.885091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:07.897263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:07.904409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:07.907190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:07.909104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:07.909983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:07.911215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:08.001379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:08.013571 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-93b8934d-d163-4871-b40d-f3dadb3a56d2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1271 microversion: 2.1 time: 0.133092 Oct 28 13:40:08.016891 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3070/6225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:07 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:08.188818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:08.202639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:08.204376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:08.205956 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4fecd6a0-5ebd-41ea-a137-8c93e732b19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.595740 Oct 28 13:40:08.206879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3156/6226] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:07 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:09.040867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:09.041499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:09.048699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:09.049456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:09.049906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:09.050678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:09.051209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:09.051650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:09.232783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:09.235170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:09.246358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:09.254431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:09.255143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:09.256065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:09.257901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:09.264132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:09.352591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:09.366657 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3045cfa9-8fd5-4d7f-932d-ba2b9f52650e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1313 microversion: 2.1 time: 0.325768 Oct 28 13:40:09.369767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3071/6227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:09 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:09.607642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:09.617250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:09.630909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:09.630909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fe54cab-baa4-44e1-960d-63729924bed6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.391602 Oct 28 13:40:09.630909 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3157/6228] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:09 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:10.317380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-69b1474f-3789-49d9-b59e-5c4319350be2 req-36cd4901-e7ce-4015-a88d-9c2fe2509a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467f2a13-7bd6-49d7-88da-c8b47878c515", "tag": "cddf96c3-8a18-4f2b-a64b-050c6ebc2223"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:10.333023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-69b1474f-3789-49d9-b59e-5c4319350be2 req-36cd4901-e7ce-4015-a88d-9c2fe2509a48 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:10.335713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-69b1474f-3789-49d9-b59e-5c4319350be2 req-36cd4901-e7ce-4015-a88d-9c2fe2509a48 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:10.336331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-69b1474f-3789-49d9-b59e-5c4319350be2 req-36cd4901-e7ce-4015-a88d-9c2fe2509a48 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:10.375921 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-69b1474f-3789-49d9-b59e-5c4319350be2 req-36cd4901-e7ce-4015-a88d-9c2fe2509a48 service nova] Creating event network-changed:cddf96c3-8a18-4f2b-a64b-050c6ebc2223 for instance 467f2a13-7bd6-49d7-88da-c8b47878c515 on n-h1-862876-2 Oct 28 13:40:10.387688 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-69b1474f-3789-49d9-b59e-5c4319350be2 req-36cd4901-e7ce-4015-a88d-9c2fe2509a48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087126 Oct 28 13:40:10.389121 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3072/6229] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:40:10.404145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:10.406154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:10.418511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:10.419883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:10.428188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:10.433888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:10.433888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:10.434210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:10.648244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:10.653027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:10.664318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:10.665238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:10.665894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:10.666894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:10.667537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:10.669381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:10.776727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:10.789154 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84e6d7d4-93cb-47ff-8269-fe48cac51a25 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1313 microversion: 2.1 time: 0.389231 Oct 28 13:40:10.789764 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3158/6230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:10 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:10.951949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:10.962447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:10.964313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:10.966009 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4e7c2e17-a0ce-4dfa-a3f8-55f68f0b973c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.324095 Oct 28 13:40:10.967331 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3073/6231] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:10 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:11.816851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:11.817467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:11.825548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:11.826394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:11.827399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:11.828124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:11.828576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:11.829147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:12.002267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:12.002936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:12.032338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:12.034032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:12.035144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:12.036227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:12.038696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:12.042690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:12.056423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:12.071505 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a9f109f-5ac2-4ea5-abe8-06b161733600 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1313 microversion: 2.1 time: 0.256123 Oct 28 13:40:12.071505 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3159/6232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:11 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:12.203350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:12.212428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:12.216519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:12.217765 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ed19c9a-966f-4481-9acc-b26c68953ff5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.221655 Oct 28 13:40:12.218336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3074/6233] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:11 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:13.093067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:13.093676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:13.101300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:13.101786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:13.102219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:13.102937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:13.103390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:13.103863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:13.243707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:13.244583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:13.253126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:13.253917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:13.254794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:13.255828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:13.256585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:13.257215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:13.364344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:13.378886 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07bbc9af-adbe-478f-a23c-c122150faa20 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1313 microversion: 2.1 time: 0.289299 Oct 28 13:40:13.390788 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3160/6234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:13 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:13.416225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:13.426105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:13.427875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:13.429070 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-46a1379f-eecc-45e9-a735-1895b6c76710 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.190246 Oct 28 13:40:13.429807 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3075/6235] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:13 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:14.402526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:14.403217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:14.405463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:14.407220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:14.433980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:14.435172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:14.435792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:14.437252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:14.437945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:14.438927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:14.460518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:14.460518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:14.481160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:14.481773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:14.482774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:14.487694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:14.487694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:14.487694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:14.722983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:14.738486 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-784b2d15-1665-4184-bcd6-ff7eda4d3a94 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1313 microversion: 2.1 time: 0.338631 Oct 28 13:40:14.747233 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3161/6236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:14 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:14.781147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:14.781147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:14.781333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:14.781423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:14.781423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:14.781423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:14.781423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:14.781423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:14.781423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:14.781840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:14.781840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:14.781840 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdfcadcc-3891-422f-ad8e-b63f98d1e32b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.326010 Oct 28 13:40:14.781840 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3076/6237] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:14 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:14.832635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3f73a373-dc53-47fc-9247-98caf9d4b55c tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "POST /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1/action" status: 200 len: 24573 microversion: 2.1 time: 0.082405 Oct 28 13:40:14.839948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3162/6238] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:40:14 2022] POST /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:40:15.763691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:15.764318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:15.767217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:15.774474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:15.775000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:15.775443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:15.776144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:15.776611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:15.777036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:15.809401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:15.811965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:15.826127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:15.826639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:15.829951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:15.830724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:15.831271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:15.834406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:15.844225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:16.103033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:16.117529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:16.119421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:16.121324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8c74b34b-5868-4878-9963-33b07594cfc4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.317180 Oct 28 13:40:16.122174 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3163/6239] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:15 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:16.353073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:16.361710 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f489e22a-af5d-47cb-a795-0adbb281c5b9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1313 microversion: 2.1 time: 0.601851 Oct 28 13:40:16.362381 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3077/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:15 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:16.816989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4e4ea218-695a-444d-9a58-6b75f96fcc02 req-68679598-212a-4a19-9ede-19c3a5427efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467f2a13-7bd6-49d7-88da-c8b47878c515", "name": "network-vif-plugged", "status": "completed", "tag": "cddf96c3-8a18-4f2b-a64b-050c6ebc2223"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:16.831518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4e4ea218-695a-444d-9a58-6b75f96fcc02 req-68679598-212a-4a19-9ede-19c3a5427efd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:16.832205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4e4ea218-695a-444d-9a58-6b75f96fcc02 req-68679598-212a-4a19-9ede-19c3a5427efd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:16.832707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4e4ea218-695a-444d-9a58-6b75f96fcc02 req-68679598-212a-4a19-9ede-19c3a5427efd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:16.844588 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4e4ea218-695a-444d-9a58-6b75f96fcc02 req-68679598-212a-4a19-9ede-19c3a5427efd service nova] Creating event network-vif-plugged:cddf96c3-8a18-4f2b-a64b-050c6ebc2223 for instance 467f2a13-7bd6-49d7-88da-c8b47878c515 on n-h1-862876-2 Oct 28 13:40:16.850650 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4e4ea218-695a-444d-9a58-6b75f96fcc02 req-68679598-212a-4a19-9ede-19c3a5427efd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037417 Oct 28 13:40:16.851997 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3164/6241] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:40:17.155256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:17.156871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:17.166492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:17.167720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:17.169125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:17.169888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:17.170368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:17.171377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:17.387510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:17.390777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:17.399371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:17.401379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:17.401842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:17.402579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:17.403073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:17.403695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:17.414912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:17.426322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:17.431778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:17.433560 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2fc261c6-ffe9-4949-b375-7821dae5830d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.283377 Oct 28 13:40:17.449168 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3078/6242] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:17 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:17.609748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:17.623485 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cb9d5ffd-34b4-41aa-a9a3-e4b7d8b36b62 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1313 microversion: 2.1 time: 0.240828 Oct 28 13:40:17.637809 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3165/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:17 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:18.461749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:18.462473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:18.470652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:18.471242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:18.471727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:18.472443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:18.472901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:18.473329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:18.652726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:18.654392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:18.665367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:18.666122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:18.670955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:18.670955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:18.670955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:18.670955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:18.677815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:18.687335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:18.692706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:18.698111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-34ae7ef4-72cd-4795-a799-6e5dcd43f15e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1744 microversion: 2.20 time: 0.240232 Oct 28 13:40:18.699268 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3079/6244] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:18 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1744 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:18.940135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:18.949218 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86093dae-ae27-48ee-97aa-40460562f9c7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1496 microversion: 2.1 time: 0.301640 Oct 28 13:40:18.950457 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3166/6245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:18 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1496 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:19.735044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:19.736217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:19.748944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:19.749610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:19.750554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:19.752176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:19.753659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:19.754507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:19.918335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:19.927301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:19.933800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:19.933800 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9941b332-7c60-4e2b-8e5d-5f2021cc8980 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1744 microversion: 2.20 time: 0.204382 Oct 28 13:40:19.933800 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3080/6246] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:19 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:20.150138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:20.151956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:20.180115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:20.181855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:20.181855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:20.182063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:20.182437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:20.185287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:20.242736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:40:20.571485 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ca1caac6-1acb-4818-9b36-c8583c128623 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "DELETE /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 204 len: 0 microversion: 2.1 time: 0.432561 Oct 28 13:40:20.572700 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3167/6247] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:40:20 2022] DELETE /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:40:20.581015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:20.581639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:20.591509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:20.592013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:20.592974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:20.594807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:20.595285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:20.595727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:20.851272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:20.859235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:20.864827 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07d8740d-1c2e-4620-9af3-2b53110f3134 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1502 microversion: 2.1 time: 0.287798 Oct 28 13:40:20.866857 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3081/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:20 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:20.959859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:20.960272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:20.974583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:20.975561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:20.976010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:20.976822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:20.977221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:20.977645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:21.172444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:21.185430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:21.185430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:21.185720 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10ea6a11-4af9-43ac-b1f2-f1c18c98d588 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.231528 Oct 28 13:40:21.186645 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3168/6249] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:20 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:21.894187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:21.895317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:21.911729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:21.914693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:21.917648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:21.920924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:21.929465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:21.930685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:22.205158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:22.217202 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4b75ee2-bf20-4715-b6be-df360c58853b tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1502 microversion: 2.1 time: 0.329970 Oct 28 13:40:22.218454 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3082/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:21 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1502 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:22.874308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:22.874971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:22.888775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:22.890147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:22.890836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:22.891818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:22.892856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:22.893583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:22.914092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d93c870f-d448-4db0-aa6d-868fc2412e42 req-db72594d-5df6-4f72-b8b3-008ce524b6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "name": "network-vif-plugged", "status": "completed", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:22.929088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d93c870f-d448-4db0-aa6d-868fc2412e42 req-db72594d-5df6-4f72-b8b3-008ce524b6e0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:22.930024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d93c870f-d448-4db0-aa6d-868fc2412e42 req-db72594d-5df6-4f72-b8b3-008ce524b6e0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:22.930893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d93c870f-d448-4db0-aa6d-868fc2412e42 req-db72594d-5df6-4f72-b8b3-008ce524b6e0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:22.945810 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d93c870f-d448-4db0-aa6d-868fc2412e42 req-db72594d-5df6-4f72-b8b3-008ce524b6e0 service nova] Creating event network-vif-plugged:71e2709c-2621-4715-abef-d0eb6e49342b for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 on n-h1-862876-2 Oct 28 13:40:22.951781 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d93c870f-d448-4db0-aa6d-868fc2412e42 req-db72594d-5df6-4f72-b8b3-008ce524b6e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043011 Oct 28 13:40:22.953226 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3083/6251] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:40:23.072904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:23.083170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:23.084856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:23.089439 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5cbdba00-520c-4dd9-bfae-3f9f40d5a9f7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.879525 Oct 28 13:40:23.090560 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3169/6252] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:22 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:23.250423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:23.257080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:23.274415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:23.276265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:23.277213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:23.279293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:23.281189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:23.283537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:23.348491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-833025bc-c9b3-4ce7-a0ba-d2122b70ed71 req-1896b2b8-cfbe-4293-ba0b-1729f380ab50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467f2a13-7bd6-49d7-88da-c8b47878c515", "name": "network-vif-deleted", "tag": "cddf96c3-8a18-4f2b-a64b-050c6ebc2223"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:23.381982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-833025bc-c9b3-4ce7-a0ba-d2122b70ed71 req-1896b2b8-cfbe-4293-ba0b-1729f380ab50 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:23.382490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-833025bc-c9b3-4ce7-a0ba-d2122b70ed71 req-1896b2b8-cfbe-4293-ba0b-1729f380ab50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:23.382970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-833025bc-c9b3-4ce7-a0ba-d2122b70ed71 req-1896b2b8-cfbe-4293-ba0b-1729f380ab50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:23.425083 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-833025bc-c9b3-4ce7-a0ba-d2122b70ed71 req-1896b2b8-cfbe-4293-ba0b-1729f380ab50 service nova] Creating event network-vif-deleted:cddf96c3-8a18-4f2b-a64b-050c6ebc2223 for instance 467f2a13-7bd6-49d7-88da-c8b47878c515 on n-h1-862876-2 Oct 28 13:40:23.431119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:23.443428 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-833025bc-c9b3-4ce7-a0ba-d2122b70ed71 req-1896b2b8-cfbe-4293-ba0b-1729f380ab50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093484 Oct 28 13:40:23.444196 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3170/6253] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:40:23.446689 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81b730cd-81dd-487c-aae2-93fd2f918f96 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1460 microversion: 2.1 time: 0.209771 Oct 28 13:40:23.447707 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3084/6254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:23 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1460 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:24.118718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:24.128735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:24.140595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:24.141101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:24.141545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:24.145887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:24.146583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:24.147283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:24.438731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:24.460594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:24.462117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:24.463411 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d9492172-7099-4bde-8a4c-a917be74b60e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.351038 Oct 28 13:40:24.474484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:24.479560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:24.488069 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3171/6255] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:24 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:24.492616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:24.493136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:24.493588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:24.494315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:24.494807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:24.495314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:24.544003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:24.544761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:24.545368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:24.546037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lazy-loading 'fault' on Instance uuid 467f2a13-7bd6-49d7-88da-c8b47878c515 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:40:24.640524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:24.652478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-68e7c125-cd7c-488c-b9d6-269916ebe935 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 200 len: 1303 microversion: 2.1 time: 0.182425 Oct 28 13:40:24.659963 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3085/6256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:24 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:25.515693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:25.516319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:25.536421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:25.537191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:25.537862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:25.539077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:25.539715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:25.540308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:25.685700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:25.687723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 467f2a13-7bd6-49d7-88da-c8b47878c515] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:25.697502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:25.698606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:25.699414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:25.701525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:25.705719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:25.706214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:25.726302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] HTTP exception thrown: Instance 467f2a13-7bd6-49d7-88da-c8b47878c515 could not be found. Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Request method failure captured: Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 HTTP/1.1 Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9uvXtCxI_uJWLWzLs4GvwKp5ew7ImBRt53pd6Muu2lc7k17-Iu1xjv8yRCVA41xTzDKezN5ddl_GbZjrVVs4hx6w9yMHvIMxjBoXBGTakRwi-RX806-rRFo1zf0QOGqr2UPIo7ifF0nW5cBdgDa898F_XHRJgUx2eFun5NZt5qGSpo Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 8843e45195f545f3b1b4c500b67a792b Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-VolumesActionsTest-1747544475 Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8843e45195f545f3b1b4c500b67a792b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8843e45195f545f3b1b4c500b67a792b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8843e45195f545f3b1b4c500b67a792b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8843e45195f545f3b1b4c500b67a792b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-VolumesActionsTest-1747544475 Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 8843e45195f545f3b1b4c500b67a792b Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-VolumesActionsTest-1747544475 Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-VolumesActionsTest-1747544475-project Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: dc7be8d2c7fb4f2e9e3d6bd59cedca7b Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-VolumesActionsTest-1747544475-project Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 467f2a13-7bd6-49d7-88da-c8b47878c515 could not be found. Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '467f2a13-7bd6-49d7-88da-c8b47878c515'} Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 467f2a13-7bd6-49d7-88da-c8b47878c515 could not be found. Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 467f2a13-7bd6-49d7-88da-c8b47878c515 could not be found. Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:40:25.730083 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:25.735854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:40:25.735854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:40:25.735854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:40:25.735854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:40:25.735854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:40:25.735854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 467f2a13-7bd6-49d7-88da-c8b47878c515 could not be found. Oct 28 13:40:25.735854 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:25.738720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:25.754000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Returning 404 to user: Instance 467f2a13-7bd6-49d7-88da-c8b47878c515 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:40:25.754000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c63ccb7-da0b-497d-935a-1a08a523e832 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515" status: 404 len: 111 microversion: 2.1 time: 0.071874 Oct 28 13:40:25.754234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:25.754357 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3086/6257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:25 2022] GET /compute/v2.1/servers/467f2a13-7bd6-49d7-88da-c8b47878c515 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:40:25.757775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:25.759275 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a73316e-082e-4097-971a-02581bd8ad9c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.248267 Oct 28 13:40:25.770368 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3172/6258] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:25 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:25.972874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1295648580", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "a849b8e5-fc97-468b-8da7-15d10bd94d28"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:26.789678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:26.790942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:26.804380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:26.804870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:26.810797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:26.812489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:26.819463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:26.820275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:27.193731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:27.211090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:27.212834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:27.216107 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef8d66f6-673c-4eb0-bbc1-91a7c476157c tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.432679 Oct 28 13:40:27.226565 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3173/6259] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:26 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:27.926397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:27.928640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:27.946856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:27.946856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:27.946856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:27.952145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:27.956059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:27.959235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:28.055409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:40:28.555466 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-686f1597-a87b-4a28-8d75-4e3c566e28cc tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 204 len: 0 microversion: 2.1 time: 0.634403 Oct 28 13:40:28.560738 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3174/6260] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:40:27 2022] DELETE /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:40:28.822651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-de48fbe4-ad05-4bf5-a967-3ff589f9d412 req-70bb6591-1ae3-4621-bd92-1d36142739fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1c6b74-e7c1-4dde-9389-0bf4014a44f1", "tag": "b1433bbe-5a7e-4c94-a4e5-799a2384af4a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:28.838909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-de48fbe4-ad05-4bf5-a967-3ff589f9d412 req-70bb6591-1ae3-4621-bd92-1d36142739fe service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:28.840172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-de48fbe4-ad05-4bf5-a967-3ff589f9d412 req-70bb6591-1ae3-4621-bd92-1d36142739fe service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:28.842111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-de48fbe4-ad05-4bf5-a967-3ff589f9d412 req-70bb6591-1ae3-4621-bd92-1d36142739fe service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:28.878264 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-de48fbe4-ad05-4bf5-a967-3ff589f9d412 req-70bb6591-1ae3-4621-bd92-1d36142739fe service nova] Creating event network-changed:b1433bbe-5a7e-4c94-a4e5-799a2384af4a for instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 on n-h2-862876-2 Oct 28 13:40:28.898187 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-de48fbe4-ad05-4bf5-a967-3ff589f9d412 req-70bb6591-1ae3-4621-bd92-1d36142739fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340630 Oct 28 13:40:28.900459 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3175/6261] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:40:28.923077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:28.923951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:28.953497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:28.954162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:28.954452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:28.959421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:28.963101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:28.963101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:29.367522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:29.387253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:29.392254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:29.395235 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-721587c9-61a0-4309-aad3-dc2e4bd7beb0 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.493655 Oct 28 13:40:29.397649 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3176/6262] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:28 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:29.408853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:29.413409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:29.427915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:29.429390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:29.429390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:29.430383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:29.433239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:29.433956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:29.673229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] validate_networks() for [('a849b8e5-fc97-468b-8da7-15d10bd94d28', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:40:29.991264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:30.010484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-893f914d-46c4-4929-a90c-8bae53e7e598 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1689 microversion: 2.1 time: 0.605019 Oct 28 13:40:30.012779 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3177/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:29 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1689 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:30.427513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:30.430158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:30.448573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:30.451023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:30.453964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:30.455007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:30.457272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:30.461213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:30.590944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:31.325135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:40:31.325665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:40:31.326245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:40:31.326665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:40:31.327220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:40:31.343706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:31.346401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:31.346978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:31.350341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:31.350601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:31.351029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:31.397815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Getting quotas for project 8843e45195f545f3b1b4c500b67a792b. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:40:31.417734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Getting quotas for user dc7be8d2c7fb4f2e9e3d6bd59cedca7b and project 8843e45195f545f3b1b4c500b67a792b. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:40:31.462723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:40:31.465910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:40:31.690180 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [4a3f207e-cc75-4fac-aca5-e2695f7c666e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 13:40:31.708004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:31.737400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:31.745952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:31.753548 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ef3fcf6-5601-4a31-bcce-44489a6d7b5b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 1.326766 Oct 28 13:40:31.755710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3178/6264] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:30 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:31.773026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:31.773719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:31.824034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:31.824610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:31.829530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:31.834254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:31.838289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:31.842731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:32.124125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:32.137935 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e353aecb-301a-4cbd-bea8-00ad7579d707 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1621 microversion: 2.1 time: 0.374525 Oct 28 13:40:32.138618 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3179/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:31 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1621 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:32.268371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-861ddb66-0274-443f-8953-2a095723a0e8 req-5feddbf6-cd48-4ba2-82fb-4699a2e10057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1c6b74-e7c1-4dde-9389-0bf4014a44f1", "name": "network-vif-deleted", "tag": "b1433bbe-5a7e-4c94-a4e5-799a2384af4a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:32.293327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-861ddb66-0274-443f-8953-2a095723a0e8 req-5feddbf6-cd48-4ba2-82fb-4699a2e10057 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:32.294138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-861ddb66-0274-443f-8953-2a095723a0e8 req-5feddbf6-cd48-4ba2-82fb-4699a2e10057 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:32.297441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-861ddb66-0274-443f-8953-2a095723a0e8 req-5feddbf6-cd48-4ba2-82fb-4699a2e10057 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:32.325888 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-861ddb66-0274-443f-8953-2a095723a0e8 req-5feddbf6-cd48-4ba2-82fb-4699a2e10057 service nova] Creating event network-vif-deleted:b1433bbe-5a7e-4c94-a4e5-799a2384af4a for instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 on n-h2-862876-2 Oct 28 13:40:32.343419 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-861ddb66-0274-443f-8953-2a095723a0e8 req-5feddbf6-cd48-4ba2-82fb-4699a2e10057 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079382 Oct 28 13:40:32.355948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3180/6266] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:40:32.704346 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [4a3f207e-cc75-4fac-aca5-e2695f7c666e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39994. Oct 28 13:40:32.718086 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f7ecd9c8-923c-4d6c-847a-437c71e73b1a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.748481 Oct 28 13:40:32.721578 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3087/6267] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:40:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 6753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:40:32.736478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78fabbde-ae74-42d6-8707-84cc5f0ca7a9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:32.737181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78fabbde-ae74-42d6-8707-84cc5f0ca7a9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:32.785678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:32.786229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:32.788990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:32.802956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:32.803449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:32.803864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:32.804597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:32.805038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:32.805467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:33.087575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-78fabbde-ae74-42d6-8707-84cc5f0ca7a9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:33.097973 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78fabbde-ae74-42d6-8707-84cc5f0ca7a9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1214 microversion: 2.1 time: 0.367670 Oct 28 13:40:33.112164 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3181/6268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:32 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1214 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:33.162796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:33.163427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:33.166982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:33.189651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:33.190403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:33.191048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:33.192164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:33.192886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:33.193458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:33.232648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:33.238545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:33.239069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:33.239538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lazy-loading 'fault' on Instance uuid 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:40:33.500382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5283ffea73c4febbbcce05e56bdd6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d3fc63e0847efae144898701cbf5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:33.512596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1caf051-5b40-4bbc-81b7-92675314d187 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 200 len: 1507 microversion: 2.1 time: 0.354258 Oct 28 13:40:33.513714 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3182/6269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:33 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:33.637345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:33.648802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:33.650970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:33.652586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-faad12b7-ff40-4fc3-88b4-0e6b727304eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.872885 Oct 28 13:40:33.665109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3088/6270] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:32 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:34.123196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e7b7b02-65d7-45cd-9d1e-dbf5280e0850 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:34.124696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9e7b7b02-65d7-45cd-9d1e-dbf5280e0850 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:34.251419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9e7b7b02-65d7-45cd-9d1e-dbf5280e0850 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:34.277503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9e7b7b02-65d7-45cd-9d1e-dbf5280e0850 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1214 microversion: 2.1 time: 0.148992 Oct 28 13:40:34.312027 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3183/6271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:34 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:34.538559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:34.547265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] [instance: 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:34.553239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:34.554208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:34.554938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:34.555843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:34.556466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:34.557087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:34.575270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] HTTP exception thrown: Instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 could not be found. Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Request method failure captured: Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 HTTP/1.1 Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9mayMITvj1WED7X4-LI_q-dqZgc6OMnHWkdghjk9JQGeng-uxFEkU53_e-hKVT8JReAQuIzjf8cMQzD6unQJiHZ6RiF5Zncy6jWXUSZ0QjnsCHVhZ3Y4I-81dkCR4L5abLF2-ERrK5ZpIzHeFr0wDrf-jAm3DxliK9sL-hRfID35aI Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_727d3fc63e0847efae144898701cbf5c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/727d3fc63e0847efae144898701cbf5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 727d3fc63e0847efae144898701cbf5c Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-445380870 Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a5283ffea73c4febbbcce05e56bdd6cc Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestNetworkAdvancedServerOps-445380870-project Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 could not be found. Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '1f1c6b74-e7c1-4dde-9389-0bf4014a44f1'} Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 could not be found. Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 could not be found. Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:34.576430 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 could not be found. Oct 28 13:40:34.581842 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:40:34.583399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Returning 404 to user: Instance 1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:40:34.584678 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ee9be41-790d-4e2d-9bb2-4d03234d4116 tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1" status: 404 len: 111 microversion: 2.1 time: 0.051142 Oct 28 13:40:34.589246 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3089/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:34 2022] GET /compute/v2.1/servers/1f1c6b74-e7c1-4dde-9389-0bf4014a44f1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:40:34.704451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:34.705133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:34.724412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:34.725815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:34.727952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:34.732093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:34.732616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:34.736212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:35.319362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:35.320233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:35.330411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:35.339281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:35.340177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:35.343585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:35.344562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:35.347164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:35.348290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:35.348781 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-444a6235-dadc-4f9e-8edb-62c323feb655 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.661166 Oct 28 13:40:35.349517 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3184/6273] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:34 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:35.351856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:35.358023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:35.780677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:35.790414 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f3188495-1f25-4105-a096-e62374feec87 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1210 microversion: 2.1 time: 0.475437 Oct 28 13:40:35.812006 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3090/6274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:35 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1210 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:36.381993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:36.382611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:36.400347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:36.400347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:36.400347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:36.403445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:36.403939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:36.404384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:36.819265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:36.820386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:36.837579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:36.838826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:36.843681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:36.845543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:36.847443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:36.851230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:37.032008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:37.051406 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7d149026-29be-44b9-aaa6-58c06c002860 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1274 microversion: 2.1 time: 0.236555 Oct 28 13:40:37.064057 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3091/6275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:36 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:37.085395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:37.099424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:37.105286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:37.116642 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8b3242b-d6d1-4b71-abde-13f2e7f6cba6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.738943 Oct 28 13:40:37.124575 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3185/6276] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:36 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:38.081343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:38.082913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:38.099862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:38.100706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:38.101334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:38.104688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:38.105352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:38.106034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:38.152197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:38.152814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:38.168963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:38.169478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:38.170013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:38.180258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:38.186098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:38.198072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:38.533071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:38.549785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-523340ea-d7be-4780-8c01-9e96621ab5bd tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1272 microversion: 2.1 time: 0.474232 Oct 28 13:40:38.553602 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3092/6277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:38 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:38.924066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:38.941256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:38.943157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:38.947743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fcdf315-d6d4-47e8-bbdd-d23a466810ca tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.799397 Oct 28 13:40:38.951258 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3186/6278] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:38 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:39.574973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:39.575603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:39.585586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:39.586085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:39.586531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:39.591028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:39.597764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:39.604920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:39.898290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:39.909482 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cddd7354-b9da-4b29-9432-f9fc6b8713ab tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1272 microversion: 2.1 time: 0.338428 Oct 28 13:40:39.910081 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3093/6279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:39 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:39.980903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:39.981684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:39.995032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:39.995640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:39.996179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:39.999897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:40.001805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:40.004341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:40.384939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:40.397435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:40.408382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:40.410004 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54a17c52-f450-432c-ac6a-9f8fea51d4d9 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.433582 Oct 28 13:40:40.415761 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3187/6280] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:39 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:40.940540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:40.940540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:40.954147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:40.954678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:40.955941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:40.956250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:40.956796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:40.957237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:41.260835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:41.273458 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a222710-d589-49ff-868b-ae65136cd0bb tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.337722 Oct 28 13:40:41.275570 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3094/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:40 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:41.455957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:41.468453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:41.475829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:41.480265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:41.481728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:41.483825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:41.486659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:41.491226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:42.266702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:42.295360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:42.295360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:42.297537 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fbd79063-fce4-4364-ae24-9caf6bff7ce6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.853998 Oct 28 13:40:42.306362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:42.307598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:42.315774 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3188/6282] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:41 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:42.318373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:42.321855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:42.329523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:42.334393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:42.335308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:42.338158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:42.339458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:42.350544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:42.729348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:42.749955 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a807c98-9eeb-462d-92fa-093a67835556 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.444160 Oct 28 13:40:42.768679 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3095/6283] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:42 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:43.345982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:43.346522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:43.363661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:43.366610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:43.367187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:43.368178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:43.372756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:43.373661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:43.493505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cc835a92-59e0-4724-8e1a-e0a75f9f0096 req-9fa1b84b-2e4a-4a21-af0a-d06e5d4dfe5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2", "tag": "b4ab31bf-689f-4b52-b2e7-578963202a77"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:43.509252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cc835a92-59e0-4724-8e1a-e0a75f9f0096 req-9fa1b84b-2e4a-4a21-af0a-d06e5d4dfe5f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:43.509741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cc835a92-59e0-4724-8e1a-e0a75f9f0096 req-9fa1b84b-2e4a-4a21-af0a-d06e5d4dfe5f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:43.510276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cc835a92-59e0-4724-8e1a-e0a75f9f0096 req-9fa1b84b-2e4a-4a21-af0a-d06e5d4dfe5f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:43.547011 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cc835a92-59e0-4724-8e1a-e0a75f9f0096 req-9fa1b84b-2e4a-4a21-af0a-d06e5d4dfe5f service nova] Creating event network-changed:b4ab31bf-689f-4b52-b2e7-578963202a77 for instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 on n-h1-862876-2 Oct 28 13:40:43.557826 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cc835a92-59e0-4724-8e1a-e0a75f9f0096 req-9fa1b84b-2e4a-4a21-af0a-d06e5d4dfe5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068773 Oct 28 13:40:43.559561 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3096/6284] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:40:43.775017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:43.776237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:43.786163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:43.786853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:43.787396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:43.788222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:43.789145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:43.789860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:44.139149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:44.155026 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42e0775d-709f-4040-aa42-157cbd9c163a tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.384072 Oct 28 13:40:44.157216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3097/6285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:43 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:44.182964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:44.195943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:44.197411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:44.198603 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-91eb09ec-5dca-4a93-a128-c5f7f3fd91dd tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.858194 Oct 28 13:40:44.199212 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3189/6286] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:43 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:45.181195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:45.181848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:45.198820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:45.199825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:45.200445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:45.201402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:45.202673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:45.203460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:45.228751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:45.229381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:45.239459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:45.248260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:45.251118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:45.252301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:45.255736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:45.258161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:45.258817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:45.500371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:45.518131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:45.523212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:45.542882 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-288ee18f-8030-42bb-b09e-823b526668a1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.299717 Oct 28 13:40:45.542882 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3190/6287] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:45 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:45.549513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:45.560112 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0953eca1-ecfb-4f15-b750-435488e25643 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.382763 Oct 28 13:40:45.560982 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3098/6288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:45 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:46.557559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:46.558181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:46.573669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:46.574539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:46.575008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:46.575931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:46.576393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:46.577428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:46.587419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:46.588698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:46.601943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:46.603734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:46.604294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:46.605737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:46.606146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:46.606585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:46.818337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:46.832292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:46.833947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:46.840972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:46.842520 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8550ae68-6dc7-4aa9-9ca5-bdd4249e1bb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1739 microversion: 2.20 time: 0.289343 Oct 28 13:40:46.843714 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3191/6289] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:46 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:46.849722 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e08b1c26-6507-40ab-ab99-b98d37faab98 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.266312 Oct 28 13:40:46.850395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3099/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:46 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:46.944697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44e13014-262d-4aad-a803-68bf026c3abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] Calling method '.version_select at 0x7f27b86a0670>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:47.065251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44e13014-262d-4aad-a803-68bf026c3abd tempest-TestNetworkAdvancedServerOps-445380870 tempest-TestNetworkAdvancedServerOps-445380870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1734478620" status: 202 len: 0 microversion: 2.1 time: 0.124400 Oct 28 13:40:47.066200 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3192/6291] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 13:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1734478620 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:40:47.874000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:47.875259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:47.879816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:47.880485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:47.882224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:47.882920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:47.883512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:47.884376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:47.884994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:47.885578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:47.892739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:47.893239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:47.898266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:47.899648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:47.903196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:47.903196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:48.145519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:48.146022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:48.157042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76f2bd55-fca4-424c-a968-00aad993edb9 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.281487 Oct 28 13:40:48.157993 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3193/6292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:47 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:48.171884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:48.173919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:48.177907 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d72e3ceb-f7c2-4884-94d4-e49853cce77e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1721 microversion: 2.20 time: 0.310313 Oct 28 13:40:48.178569 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3100/6293] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:47 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1721 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:49.184065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:49.185375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:49.193719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:49.194328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:49.194862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:49.195795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:49.196749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:49.197568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:49.205700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:49.206334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:49.223945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:49.227973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:49.228799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:49.229580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:49.230066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:49.230504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:49.286291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:49.473381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:49.491889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:49.495287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:49.496831 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-28f457ad-27f4-4b40-87bd-ce4a784075b3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1721 microversion: 2.20 time: 0.296903 Oct 28 13:40:49.506947 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3101/6294] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:49 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:40:50.063569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:50.072629 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51a15e21-91d9-47b3-be8c-83126a66cdd6 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.892682 Oct 28 13:40:50.095445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3194/6295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:49 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:50.527680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:50.528416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:50.552703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:50.556145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:50.557713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:50.558475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:50.559696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:50.560321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:50.886596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:50.900962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:50.912187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:50.914047 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11186019-123a-4b3c-8390-1fa6d4e2c076 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1724 microversion: 2.20 time: 0.390809 Oct 28 13:40:50.926807 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3102/6296] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:50 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:50.959920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7b518aa-299c-4969-abbf-073cf8c65845"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:50.964715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:51.008647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:51.011567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:51.014953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:51.022690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:51.022690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:51.022690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:51.111660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:51.116413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:51.135565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:51.136422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:51.138268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:51.140216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:51.140698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:51.142758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:51.556323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:51.567094 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b07a3235-ae40-4a6c-9c13-cc800ca14e0e tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.468222 Oct 28 13:40:51.582831 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3103/6297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:51 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:51.587762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d4d33fd7-722d-4733-9f64-35ce155557a5 req-9085de07-a2c4-4194-8c2d-6080a29cf178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2", "name": "network-vif-plugged", "status": "completed", "tag": "b4ab31bf-689f-4b52-b2e7-578963202a77"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:51.597916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d4d33fd7-722d-4733-9f64-35ce155557a5 req-9085de07-a2c4-4194-8c2d-6080a29cf178 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:51.598485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d4d33fd7-722d-4733-9f64-35ce155557a5 req-9085de07-a2c4-4194-8c2d-6080a29cf178 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:51.599391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d4d33fd7-722d-4733-9f64-35ce155557a5 req-9085de07-a2c4-4194-8c2d-6080a29cf178 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:51.623556 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d4d33fd7-722d-4733-9f64-35ce155557a5 req-9085de07-a2c4-4194-8c2d-6080a29cf178 service nova] Creating event network-vif-plugged:b4ab31bf-689f-4b52-b2e7-578963202a77 for instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 on n-h1-862876-2 Oct 28 13:40:51.637832 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d4d33fd7-722d-4733-9f64-35ce155557a5 req-9085de07-a2c4-4194-8c2d-6080a29cf178 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053643 Oct 28 13:40:51.638446 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3104/6298] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:40:52.521144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:40:52.594896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:52.595605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:52.606960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:52.607541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:52.607897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:52.609186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:52.609646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:52.610071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:52.611118 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bd3c03c-1f81-48bc-9669-28af38a433eb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.664691 Oct 28 13:40:52.612448 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3195/6299] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Oct 28 13:40:50 2022] POST /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-volume_attachments => generated 188 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:40:52.843317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:52.844743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:52.850171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:52.850972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:52.852520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:52.853253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:52.853846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:52.854402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:52.871809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:52.882776 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b576b98-616a-4f74-89d0-f26e97485168 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1314 microversion: 2.1 time: 0.293257 Oct 28 13:40:52.883697 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3105/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:52 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:53.664958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ad6774b6-cfbb-43cf-a628-2cc5b06b938b req-8c43c002-4d97-498c-855d-01736af7d17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "name": "network-vif-unplugged", "status": "completed", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:53.679129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad6774b6-cfbb-43cf-a628-2cc5b06b938b req-8c43c002-4d97-498c-855d-01736af7d17b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:53.679703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad6774b6-cfbb-43cf-a628-2cc5b06b938b req-8c43c002-4d97-498c-855d-01736af7d17b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:53.680286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ad6774b6-cfbb-43cf-a628-2cc5b06b938b req-8c43c002-4d97-498c-855d-01736af7d17b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:53.693100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.server_external_events [req-ad6774b6-cfbb-43cf-a628-2cc5b06b938b req-8c43c002-4d97-498c-855d-01736af7d17b service nova] Unable to find a host for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2. Dropping event network-vif-unplugged {{(pid=127794) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 13:40:53.694133 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ad6774b6-cfbb-43cf-a628-2cc5b06b938b req-8c43c002-4d97-498c-855d-01736af7d17b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032991 Oct 28 13:40:53.695181 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3106/6301] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 13:40:53.743364 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e5d4768-c729-454b-8f6e-6250b5f9aa5a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-volume_attachments/f7b518aa-299c-4969-abbf-073cf8c65845" status: 202 len: 0 microversion: 2.20 time: 0.910648 Oct 28 13:40:53.745289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3196/6302] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Oct 28 13:40:52 2022] DELETE /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-volume_attachments/f7b518aa-299c-4969-abbf-073cf8c65845 => generated 0 bytes in 916 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:40:53.816575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:40:53.817402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:53.830296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:53.830856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:53.831301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:53.832013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:53.832471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:53.832893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:53.889965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127794) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 13:40:53.906403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:53.907224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:53.914169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:53.919600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:53.920211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:53.921749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:53.922386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:53.923585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:54.113744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:54.123156 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3e8fa722-0012-4f35-8ffc-18ab34f485f4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1497 microversion: 2.1 time: 0.221306 Oct 28 13:40:54.132743 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3197/6303] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:53 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:40:54.256462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6beab054-0a62-4b04-a74a-9b5d421e5fea tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "POST /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/action" status: 202 len: 0 microversion: 2.20 time: 0.443951 Oct 28 13:40:54.257345 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3107/6304] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Oct 28 13:40:53 2022] POST /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:40:54.265873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:54.267518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:54.275553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:54.280460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:54.281571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:54.283302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:54.284748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:54.285405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:54.475877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:54.485697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:54.487622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:54.489051 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4ad54ce1-2061-41cd-8b94-2a28f246bd4a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1672 microversion: 2.20 time: 0.227232 Oct 28 13:40:54.489864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3198/6305] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:54 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:55.444283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:55.444948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:55.455597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:55.456371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:55.457004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:55.458142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:55.461294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:55.461961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:55.521320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:55.523164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:55.527829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:40:55.537584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:55.540487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:55.541195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:55.542184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:55.543348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:55.545741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:55.914578 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e409b0c7-e0fa-480a-af7b-79a4199654e2 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 204 len: 0 microversion: 2.1 time: 0.474776 Oct 28 13:40:55.915452 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3108/6306] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:40:55 2022] DELETE /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:40:55.924303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:55.926079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:55.948974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:55.949489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:55.949929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:55.950971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:55.951480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:55.952533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:56.147587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:56.160625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:56.162229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:56.165900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ad4dd50-f190-42a9-af77-9c6be9617116 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1672 microversion: 2.20 time: 0.648709 Oct 28 13:40:56.169883 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3199/6307] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:55 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1672 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:56.343589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:56.367379 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c239a8d-9f0b-4634-b43d-1d3e904f823d tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1503 microversion: 2.1 time: 0.445658 Oct 28 13:40:56.369950 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3109/6308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:55 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1503 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:57.211290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:57.211290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:57.224283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:57.242459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:57.245246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:57.246383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:57.247074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:57.252989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:57.394086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:57.394879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:57.407121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:57.415925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:57.415925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:57.415925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:57.415925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:57.415925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:57.797108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:57.810310 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a13ada57-3259-4ea2-9d9e-1792eea89792 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1503 microversion: 2.1 time: 0.420537 Oct 28 13:40:57.811099 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3110/6309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:57 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1503 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:40:58.553935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:58.564423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:58.576892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:40:58.585621 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88ec9e02-110b-43a0-bf7f-c3b82ed5feb3 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1674 microversion: 2.20 time: 1.386649 Oct 28 13:40:58.586583 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3200/6310] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:57 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1674 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:40:58.838196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:58.839456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:58.851788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:58.852290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:58.852735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:58.853445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:58.853912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:58.854343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:59.626419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:40:59.627144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:40:59.646942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:59.647520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:59.648053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:40:59.648823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:40:59.649362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:40:59.649866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:00.055422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:00.068763 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5faf5d6b-1acf-4959-aa96-24e6771e95d4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1503 microversion: 2.1 time: 1.231599 Oct 28 13:41:00.070606 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3111/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:40:58 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1503 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:00.081153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-92530402-d5ec-4907-9e36-bf630fae5d53 req-716f3e5b-19e2-401b-a82f-44ed72d7783d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2", "name": "network-vif-deleted", "tag": "b4ab31bf-689f-4b52-b2e7-578963202a77"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:00.132160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-92530402-d5ec-4907-9e36-bf630fae5d53 req-716f3e5b-19e2-401b-a82f-44ed72d7783d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:00.134253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-92530402-d5ec-4907-9e36-bf630fae5d53 req-716f3e5b-19e2-401b-a82f-44ed72d7783d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:00.134253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-92530402-d5ec-4907-9e36-bf630fae5d53 req-716f3e5b-19e2-401b-a82f-44ed72d7783d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:00.190497 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-92530402-d5ec-4907-9e36-bf630fae5d53 req-716f3e5b-19e2-401b-a82f-44ed72d7783d service nova] Creating event network-vif-deleted:b4ab31bf-689f-4b52-b2e7-578963202a77 for instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 on n-h1-862876-2 Oct 28 13:41:00.219648 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-92530402-d5ec-4907-9e36-bf630fae5d53 req-716f3e5b-19e2-401b-a82f-44ed72d7783d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142683 Oct 28 13:41:00.221090 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3112/6312] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:00.495438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:00.507333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:00.509781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:00.511712 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5ff4e5bc-e82f-48bd-a04c-231f3f2b1a55 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.889690 Oct 28 13:41:00.513232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3201/6313] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:40:59 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:01.098868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:01.100387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:01.120647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:01.122594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:01.128861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:01.130079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:01.130572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:01.131023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:01.224908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:01.225413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:01.226124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:01.229686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lazy-loading 'fault' on Instance uuid 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:41:01.359976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc7be8d2c7fb4f2e9e3d6bd59cedca7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8843e45195f545f3b1b4c500b67a792b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:01.369225 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-40981e9f-6fcd-4c78-90af-71a911456db4 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 200 len: 1304 microversion: 2.1 time: 0.277061 Oct 28 13:41:01.391124 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3113/6314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:01 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:01.539018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:01.542918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:01.559008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:01.560966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:01.564547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:01.568899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:01.569391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:01.571264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:02.114073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:02.123653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:02.134962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:02.138536 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-35c2286d-1f27-405f-9d7d-2b7ab2111a07 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.604034 Oct 28 13:41:02.147314 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3202/6315] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:01 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:02.283540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bcc3c182-4851-41d9-9b16-4fcb84d1b895 req-2c36ccc4-9f8f-4350-8e19-220ba756d99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:02.309117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bcc3c182-4851-41d9-9b16-4fcb84d1b895 req-2c36ccc4-9f8f-4350-8e19-220ba756d99d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:02.323166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bcc3c182-4851-41d9-9b16-4fcb84d1b895 req-2c36ccc4-9f8f-4350-8e19-220ba756d99d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:02.330653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bcc3c182-4851-41d9-9b16-4fcb84d1b895 req-2c36ccc4-9f8f-4350-8e19-220ba756d99d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:02.380363 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bcc3c182-4851-41d9-9b16-4fcb84d1b895 req-2c36ccc4-9f8f-4350-8e19-220ba756d99d service nova] Creating event network-changed:71e2709c-2621-4715-abef-d0eb6e49342b for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 on n-h2-862876-2 Oct 28 13:41:02.400669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:02.401302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] [instance: 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:02.401677 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bcc3c182-4851-41d9-9b16-4fcb84d1b895 req-2c36ccc4-9f8f-4350-8e19-220ba756d99d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122836 Oct 28 13:41:02.404217 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3114/6316] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:02.439219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:02.439729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:02.440174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:02.440898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:02.441361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:02.441792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:02.512242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] HTTP exception thrown: Instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 could not be found. Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Request method failure captured: Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 HTTP/1.1 Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9uvXtCxI_uJWLWzLs4GvwKp5ew7ImBRt53pd6Muu2lc7k17-Iu1xjv8yRCVA41xTzDKezN5ddl_GbZjrVVs4hx6w9yMHvIMxjBoXBGTakRwi-RX806-rRFo1zf0QOGqr2UPIo7ifF0nW5cBdgDa898F_XHRJgUx2eFun5NZt5qGSpo Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 8843e45195f545f3b1b4c500b67a792b Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesActionsTest-1747544475 Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8843e45195f545f3b1b4c500b67a792b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8843e45195f545f3b1b4c500b67a792b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8843e45195f545f3b1b4c500b67a792b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8843e45195f545f3b1b4c500b67a792b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesActionsTest-1747544475 Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 8843e45195f545f3b1b4c500b67a792b Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesActionsTest-1747544475 Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesActionsTest-1747544475-project Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: dc7be8d2c7fb4f2e9e3d6bd59cedca7b Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesActionsTest-1747544475-project Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 could not be found. Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2'} Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 could not be found. Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 could not be found. Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:41:02.517261 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 could not be found. Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] Returning 404 to user: Instance 8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-302a9483-d7b0-4504-8ae6-1e67f9fec9f7 tempest-VolumesActionsTest-1747544475 tempest-VolumesActionsTest-1747544475-project] 10.222.0.25 "GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2" status: 404 len: 111 microversion: 2.1 time: 0.127118 Oct 28 13:41:02.521558 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3203/6317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:02 2022] GET /compute/v2.1/servers/8fe67fdf-21c0-4c8b-ac65-d3b3391a43f2 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:41:03.177360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:03.178348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:03.202016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:03.205883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:03.206828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:03.209818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:03.211868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:03.214641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:03.218203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:04.146581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:04.172307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:04.173886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:04.191532 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f8fa08b-9372-49f0-8f95-80b227b54d34 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 1.019629 Oct 28 13:41:04.192199 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3115/6318] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:03 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:05.222114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:05.223253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:05.227718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:05.252473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:05.252981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:05.253420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:05.254334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:05.254972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:05.255692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:05.977482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:05.993636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:05.999789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:06.009315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4c25e6b-f836-45c6-a429-72fb9c42a19d tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.788447 Oct 28 13:41:06.012087 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3204/6319] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:05 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:07.042997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:07.046830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:07.077794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:07.078738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:07.079298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:07.082629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:07.099286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:07.099836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:07.941405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:07.953576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:07.958179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:07.959838 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-884d324e-c7b6-42dd-aeb4-1236ecbb9406 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.920878 Oct 28 13:41:07.969381 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3116/6320] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:07 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:09.000365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:09.001057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:09.029053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:09.029656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:09.030230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:09.031148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:09.040622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:09.042825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:09.560080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:09.577626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:09.580025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:09.584900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-adf74e96-7baa-4e2e-9940-cc8eb2102aa5 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.591681 Oct 28 13:41:09.590072 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3205/6321] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:08 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:10.625309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:10.628126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:10.659729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:10.662952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:10.663422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:10.664258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:10.664776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:10.665216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:11.459981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cdffc98a-51cc-4680-9e6f-aadea0ba507d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'create', calling method: .version_select at 0x7f27b8549af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1962554895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRm905554bjtmy7zcjIWJTFVDT5eeobTKKqz4YUdqCmgQEU4QdqDe4MUSb8VXYNCa9O241yZ98vr2zhHYEZj065+fLRW1LW6ksbPJeVfq1oBZXJJxq45STTgsAvyceoPQ=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:11.558859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-cdffc98a-51cc-4680-9e6f-aadea0ba507d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for project e39d46af774948ebb07a73d9949d68a2. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:41:11.646161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-cdffc98a-51cc-4680-9e6f-aadea0ba507d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for user 6108739803264e209694b88240067369 and project e39d46af774948ebb07a73d9949d68a2. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:41:11.655480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:11.661993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:11.699032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:11.703527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:11.705572 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-16556694-9d00-4295-b91b-746d5fb003a2 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 1.089639 Oct 28 13:41:11.710016 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3117/6322] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:10 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:11.894421 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cdffc98a-51cc-4680-9e6f-aadea0ba507d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.440682 Oct 28 13:41:11.895490 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3206/6323] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:41:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:41:12.740055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:12.741393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:12.761145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:12.769263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:12.771773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:12.780108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:12.785534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:12.788695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:13.304848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:13.320107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:13.336018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:13.337920 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d106de50-9605-430e-b53e-0a1ce322445a tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.603215 Oct 28 13:41:13.341687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3118/6324] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:12 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:14.373142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:14.375562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:14.390914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:14.395002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:14.399120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:14.400043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:14.401970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:14.402784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:14.674927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:14.684631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:14.687138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:14.688361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3129efd3-9fb4-4343-95c7-960a589a0caf tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.323900 Oct 28 13:41:14.688944 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3207/6325] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:14 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:15.715805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:15.717454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:15.770565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:15.772792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:15.772792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:15.772792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:15.785081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:15.785569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:16.417726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:16.437096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:16.438928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:16.441187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8cca57c1-922a-4b3b-b68b-8fc3b4bebe01 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.731316 Oct 28 13:41:16.441976 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3119/6326] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:15 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:41:17.477979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:17.480367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:17.494691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:17.505526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:17.510095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:17.513714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:17.517803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:17.523421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:18.047297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:18.055935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:18.060383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:18.064415 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4259ece6-3ed4-4701-aa9c-8c681684be6e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.597835 Oct 28 13:41:18.066592 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3208/6327] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:17 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:18.741147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1445113141", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "2e545eb0-377d-4787-be74-a67ec2da52f7"}], "key_name": "tempest-TestNetworkBasicOps-1962554895", "security_groups": [{"name": "tempest-secgroup-smoke-1473752395"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:19.162297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:19.163818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:19.179959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:19.180657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:19.182467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:19.183491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:19.185710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:19.187100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:19.730496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:19.761430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:19.770061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:19.778885 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-76898b5c-6b8a-4f8f-a3e5-eab0ab584bbe tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.622411 Oct 28 13:41:19.782210 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3209/6328] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:19 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:20.810476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:20.815008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:20.835349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:20.839818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:20.843236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:20.843236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:20.843236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:20.843236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:21.243357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:21.255961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:21.257596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:21.258815 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ace5d18d-8728-4f9f-986a-6ad3838eda92 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.453550 Oct 28 13:41:21.259838 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3210/6329] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:20 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:41:22.293603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:22.296055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:22.298449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:22.323627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:22.324594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:22.334544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:22.341059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:22.341893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:22.342582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:22.413051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:22.806384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:22.841560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:22.848553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:22.849894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a4afbff-c519-4a6c-a5e0-be3e5c3ed2a7 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.558232 Oct 28 13:41:22.863121 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3211/6330] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:22 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:23.890118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:23.891253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:23.943294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:23.943294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:23.943294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:23.943294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:23.943294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:23.943294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:24.277173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:24.309307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:24.311435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:24.315635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-019b82bc-deb9-4b71-ba09-9f4d5362a6ce tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.430017 Oct 28 13:41:24.317659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3212/6331] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:23 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:41:25.345378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:25.346078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:25.356391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:25.356895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:25.359361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:25.375217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:25.375217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:25.375217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:26.251071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:26.264931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:26.269899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:26.274647 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d445a588-cae5-4d9b-bbb6-7c27b685bba4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.932973 Oct 28 13:41:26.276972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3213/6332] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:25 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:26.433213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=13 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:27.223184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] validate_networks() for [('2e545eb0-377d-4787-be74-a67ec2da52f7', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:41:27.324672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:27.326462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:27.350982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:27.353868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:27.356668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:27.357713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:27.358443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:27.366299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:27.687508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:27.697114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:27.698571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:27.699893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-984fc874-691f-4207-a721-ad81007d3675 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.390671 Oct 28 13:41:27.715479 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3214/6333] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:27 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:27.974631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:41:27.975172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:41:27.979019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:41:27.987896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:41:27.987896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:41:27.994695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:27.995236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:27.995680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:27.996420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:27.996892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:27.997323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:28.047882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for project e39d46af774948ebb07a73d9949d68a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:41:28.062420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for user 6108739803264e209694b88240067369 and project e39d46af774948ebb07a73d9949d68a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:41:28.099148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:41:28.105228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:41:28.369480 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b03e31f1-f23d-4bba-9090-27748cf80a81 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 9.629834 Oct 28 13:41:28.372976 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3120/6334] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:41:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 9639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:41:28.383903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c57bbb0-dc0b-493e-ba4e-962aa9bbd73c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:28.384514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c57bbb0-dc0b-493e-ba4e-962aa9bbd73c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:28.505242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c57bbb0-dc0b-493e-ba4e-962aa9bbd73c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:28.526642 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c57bbb0-dc0b-493e-ba4e-962aa9bbd73c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1249 microversion: 2.1 time: 0.145834 Oct 28 13:41:28.546476 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3215/6335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:28 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1249 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:28.727886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:28.729346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:28.739074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:28.739074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:28.739074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:28.739519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:28.739976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:28.740403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:28.991576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:29.004036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:29.005879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:29.007428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e4a06f73-5728-4c0f-a650-676451d905d6 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.283745 Oct 28 13:41:29.010442 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3121/6336] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:28 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:29.550395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e8499e2-4ef0-40ce-94b9-60cb54ebc7a2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:29.551747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e8499e2-4ef0-40ce-94b9-60cb54ebc7a2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:29.766405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6e8499e2-4ef0-40ce-94b9-60cb54ebc7a2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:29.780936 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e8499e2-4ef0-40ce-94b9-60cb54ebc7a2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1249 microversion: 2.1 time: 0.231163 Oct 28 13:41:29.781687 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3216/6337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:29 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1249 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:30.038046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:30.038698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:30.052177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:30.052702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:30.053152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:30.053880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:30.056648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:30.059087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:30.468689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:30.484669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:30.488155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:30.493399 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dbb9ba28-7790-42a6-a58c-872fd5bb7252 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.456832 Oct 28 13:41:30.495147 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3122/6338] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:30 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:30.809836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:30.810584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:30.821593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:30.823429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:30.823429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:30.823429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:30.823651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:30.824022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:31.112263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:31.112263 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d973bf03-ff12-4fa8-892e-c19c2857eb2a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1253 microversion: 2.1 time: 0.247902 Oct 28 13:41:31.112263 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3217/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:30 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1253 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:31.525175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:31.525175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:31.552628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:31.559268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:31.559268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:31.559268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:31.559268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:31.573026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:31.987436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:31.997042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:32.009454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:32.041138 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d801589-57ad-4e77-9027-9556371f2325 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.494385 Oct 28 13:41:32.044234 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3123/6340] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:31 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:32.125413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:32.126026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:32.134929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:32.143223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:32.143670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:32.144585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:32.145202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:32.145795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:32.286590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:32.295229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c6345332-d964-4928-8e7d-ed2a73b84e45 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1301 microversion: 2.1 time: 0.173466 Oct 28 13:41:32.313655 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3218/6341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:32 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1301 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:32.560283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-51b3b406-ddaa-4e1c-b1ac-4a8453d27be8 req-1ac90e71-0b52-47e0-bced-91c260e20d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "name": "network-vif-plugged", "status": "completed", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:32.575426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51b3b406-ddaa-4e1c-b1ac-4a8453d27be8 req-1ac90e71-0b52-47e0-bced-91c260e20d01 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:32.576157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51b3b406-ddaa-4e1c-b1ac-4a8453d27be8 req-1ac90e71-0b52-47e0-bced-91c260e20d01 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:32.577437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51b3b406-ddaa-4e1c-b1ac-4a8453d27be8 req-1ac90e71-0b52-47e0-bced-91c260e20d01 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:32.595391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-51b3b406-ddaa-4e1c-b1ac-4a8453d27be8 req-1ac90e71-0b52-47e0-bced-91c260e20d01 service nova] Creating event network-vif-plugged:71e2709c-2621-4715-abef-d0eb6e49342b for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 on n-h2-862876-2 Oct 28 13:41:32.602852 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-51b3b406-ddaa-4e1c-b1ac-4a8453d27be8 req-1ac90e71-0b52-47e0-bced-91c260e20d01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052008 Oct 28 13:41:32.604034 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3124/6342] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:33.073565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:33.074183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:33.090915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:33.091424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:33.091866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:33.098270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:33.098902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:33.099525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:33.318737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:33.321202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:33.337860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:33.343163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:33.343852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:33.346044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:33.347964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:33.349298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:33.638125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:33.649397 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b3b551a2-0eb6-4f8b-bfc0-a21d53249a16 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1307 microversion: 2.1 time: 0.334963 Oct 28 13:41:33.650009 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3125/6343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:33 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1307 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:33.794714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:33.804319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:33.815218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:33.816682 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-156b2289-59b7-4177-bf7b-b6afba01d562 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.747096 Oct 28 13:41:33.817868 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3219/6344] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:33 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:34.744971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:34.797566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:34.803008 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a56bf24-e6c5-449b-a3f4-4ee7bcff0ee9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1307 microversion: 2.1 time: 0.130383 Oct 28 13:41:34.803601 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3126/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:34 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:34.845092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:34.845790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:34.857422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:34.857877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:34.858463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:34.859214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:34.859677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:34.860112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:35.452028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:35.489253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:35.531203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:35.533198 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-564d3857-0ef0-4134-81e9-843348e3619f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.692497 Oct 28 13:41:35.537832 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3220/6346] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:34 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:41:35.839714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:35.842720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:35.871897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:35.878793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:35.887016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:35.887016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:35.887016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:35.887629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:36.234147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:36.245288 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a3eeea17-3fed-4c31-8065-80dae25a90dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.421718 Oct 28 13:41:36.246936 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3127/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:35 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:36.573920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:36.574638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:36.579220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:36.590357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:36.591299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:36.592370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:36.593609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:36.595901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:36.597192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:37.231478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:37.245714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:37.248216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:37.250374 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20faa977-e699-4abd-97ee-899641438fdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.685472 Oct 28 13:41:37.267578 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3221/6348] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:36 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:37.269975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:37.272902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:37.302147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:37.302674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:37.303188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:37.303922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:37.304391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:37.304826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:37.680016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:37.690296 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-009d4496-6e5d-47a3-b174-199295871973 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.424368 Oct 28 13:41:37.691565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3128/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:37 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:37.856035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-930b7318-1c9a-40fa-a9f1-38eacf76a392 req-33c76a26-15c9-4381-906b-e2eca860eabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75280777-757f-4944-8fea-ee74b7657c9e", "tag": "2beebb88-c099-4e9f-93ad-cccc0277a3ae"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:37.874013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-930b7318-1c9a-40fa-a9f1-38eacf76a392 req-33c76a26-15c9-4381-906b-e2eca860eabd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:37.876939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-930b7318-1c9a-40fa-a9f1-38eacf76a392 req-33c76a26-15c9-4381-906b-e2eca860eabd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:37.879536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-930b7318-1c9a-40fa-a9f1-38eacf76a392 req-33c76a26-15c9-4381-906b-e2eca860eabd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:37.927836 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-930b7318-1c9a-40fa-a9f1-38eacf76a392 req-33c76a26-15c9-4381-906b-e2eca860eabd service nova] Creating event network-changed:2beebb88-c099-4e9f-93ad-cccc0277a3ae for instance 75280777-757f-4944-8fea-ee74b7657c9e on n-h1-862876-2 Oct 28 13:41:37.938303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-930b7318-1c9a-40fa-a9f1-38eacf76a392 req-33c76a26-15c9-4381-906b-e2eca860eabd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086099 Oct 28 13:41:37.949958 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3222/6350] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:38.279340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:38.280524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:38.282727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:38.283611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:38.305334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:38.305838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:38.310173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:38.311007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:38.311997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:38.313114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:38.715447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:38.717061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:38.734962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:38.740102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:38.740808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:38.742045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:38.743044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:38.743875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:38.903171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:38.923326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:38.926784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:38.930597 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9ab5e954-8c70-4aa9-8bd6-7e46a7af3f05 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1730 microversion: 2.20 time: 0.653954 Oct 28 13:41:38.934553 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3129/6351] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:38 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1730 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:39.320053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:39.339297 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70d3df1f-5cd0-49b0-9deb-8a11ecb108cb tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.628910 Oct 28 13:41:39.343462 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3223/6352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:38 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:39.961830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:39.962586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:39.986496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:39.988056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:39.989062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:39.990066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:39.990720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:39.991427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:40.369118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:40.371882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:40.388867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:40.399967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:40.406065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:40.406784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:40.410948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:40.411627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:40.412360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:40.626419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:40.648485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:40.648485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:40.649254 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6d5ffcab-0cea-4622-b966-c9a849d7e791 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1717 microversion: 2.20 time: 0.691430 Oct 28 13:41:40.651207 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3130/6353] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:41:39 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1717 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:41:40.969751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:40.986025 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-747c3e4d-5825-4d31-89f5-f4c09d56a692 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.620992 Oct 28 13:41:41.004267 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3224/6354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:40 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:42.016686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:42.017387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:42.041398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:42.041901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:42.044805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:42.045764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:42.047296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:42.052790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:42.528620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:42.565128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8265d3e-e8e1-4f8a-982b-e8d1c3fe73e6 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.551051 Oct 28 13:41:42.565128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3131/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:42 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:43.591659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:43.591659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:43.606915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:43.609278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:43.609981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:43.611182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:43.613008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:43.614185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:43.884982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:43.896887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2551e9bc-26a1-493c-a024-8ed37a6b495e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.315899 Oct 28 13:41:43.898499 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3225/6356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:43 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:44.927646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:44.929579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:44.968523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:44.973296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:44.978131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:44.983891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:44.986029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:44.988294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:45.732608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:45.751608 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e99410d3-797b-4ca4-bf96-b3a3315a5316 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.820739 Oct 28 13:41:45.755615 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3132/6357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:44 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:45.769422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9ce4665a-c148-49a1-b34e-9d77035576ac req-af9ead63-d2a8-4549-bdc5-2c89f1af50f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75280777-757f-4944-8fea-ee74b7657c9e", "name": "network-vif-plugged", "status": "completed", "tag": "2beebb88-c099-4e9f-93ad-cccc0277a3ae"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:45.812068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9ce4665a-c148-49a1-b34e-9d77035576ac req-af9ead63-d2a8-4549-bdc5-2c89f1af50f9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:45.812887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9ce4665a-c148-49a1-b34e-9d77035576ac req-af9ead63-d2a8-4549-bdc5-2c89f1af50f9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:45.813502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9ce4665a-c148-49a1-b34e-9d77035576ac req-af9ead63-d2a8-4549-bdc5-2c89f1af50f9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:45.843759 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9ce4665a-c148-49a1-b34e-9d77035576ac req-af9ead63-d2a8-4549-bdc5-2c89f1af50f9 service nova] Creating event network-vif-plugged:2beebb88-c099-4e9f-93ad-cccc0277a3ae for instance 75280777-757f-4944-8fea-ee74b7657c9e on n-h1-862876-2 Oct 28 13:41:45.878524 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9ce4665a-c148-49a1-b34e-9d77035576ac req-af9ead63-d2a8-4549-bdc5-2c89f1af50f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112987 Oct 28 13:41:45.879653 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3226/6358] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:46.475555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:46.480628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:46.481903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:46.483409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:46.485897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:46.486629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:46.488427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:46.543659 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-034ee3c6-548f-4824-ac20-ee61bed76da7 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.688208 Oct 28 13:41:46.557457 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3133/6359] 10.222.0.25 () {58 vars in 1185 bytes} [Fri Oct 28 13:41:45 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:46.707504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-861280897", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "availability_zone": "nova:n-h2-862876-2", "networks": [{"uuid": "3932522e-5694-4e10-9eb2-cc2542438c7a"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:46.777756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:46.778022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:46.809188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:46.814556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:46.815178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:46.817220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:46.819685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:46.821422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:46.901518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] validate_networks() for [('3932522e-5694-4e10-9eb2-cc2542438c7a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:41:47.232416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:47.247669 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eb977ba7-89c2-40d3-b4b6-415f70fc9f73 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1375 microversion: 2.1 time: 0.474436 Oct 28 13:41:47.276841 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3134/6360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:46 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1375 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:41:47.731033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:41:47.734030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:47.750163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:47.766851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Getting quotas for project 68ea2b17d5cf4391b124b8cd7ac9ea1a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:41:47.780755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Getting quotas for user be48608bf29b4a3d987c12005e3df70c and project 68ea2b17d5cf4391b124b8cd7ac9ea1a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:41:47.795809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:41:47.799249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:41:48.000761 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c89657d3-907f-4054-8c61-4737e826d771 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292724 Oct 28 13:41:48.005430 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3227/6361] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:41:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:41:48.024633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f14ec190-b2da-4690-b904-cb345704112d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:48.025273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f14ec190-b2da-4690-b904-cb345704112d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:48.119578 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f14ec190-b2da-4690-b904-cb345704112d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1328 microversion: 2.1 time: 0.106161 Oct 28 13:41:48.120172 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3135/6362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:48 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:48.280085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:48.280729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:48.290159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:48.291621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:48.292560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:48.293711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:48.294287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:48.294837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:48.448897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:48.458219 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b51f71db-c8b5-47f9-a4b9-23b478f06d27 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1547 microversion: 2.1 time: 0.184591 Oct 28 13:41:48.470166 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3228/6363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:48 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1547 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:48.481955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:48.482579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:48.489791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:48.492482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:48.492482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:48.492482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:48.492482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:48.492482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:48.661153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:41:48.676639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-febd6622-e2fe-48d1-a500-89767048bed9 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1547 microversion: 2.1 time: 0.198725 Oct 28 13:41:48.691703 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3136/6364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:48 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1547 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:49.154295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0fffe324-2fda-4dac-a525-34439fdf7e21 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:49.156108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0fffe324-2fda-4dac-a525-34439fdf7e21 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:49.265086 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0fffe324-2fda-4dac-a525-34439fdf7e21 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1328 microversion: 2.1 time: 0.124056 Oct 28 13:41:49.267292 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3229/6365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:49 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1328 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:50.298482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:50.300416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:50.313279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:50.315423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:50.316199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:50.317925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:50.319379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:50.320786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:50.493211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-01877e8d-34dc-436a-a040-d939ce58372e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1415 microversion: 2.1 time: 0.202707 Oct 28 13:41:50.509225 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3137/6366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:50 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1415 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:51.519839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:51.520467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:51.540649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:51.543866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:51.543866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:51.543866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:51.543866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:51.543866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:51.750607 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-08be7df4-1436-44b7-a6a6-0abeaae78166 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1421 microversion: 2.1 time: 0.237974 Oct 28 13:41:51.752361 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3230/6367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:51 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1421 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:52.348843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c083e517-c76c-4949-8386-ff525fe25171 req-84207d05-ee25-4f62-a940-2885efdbe3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75280777-757f-4944-8fea-ee74b7657c9e", "tag": "2beebb88-c099-4e9f-93ad-cccc0277a3ae"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:52.360524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c083e517-c76c-4949-8386-ff525fe25171 req-84207d05-ee25-4f62-a940-2885efdbe3e3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:52.361237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c083e517-c76c-4949-8386-ff525fe25171 req-84207d05-ee25-4f62-a940-2885efdbe3e3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:52.361932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c083e517-c76c-4949-8386-ff525fe25171 req-84207d05-ee25-4f62-a940-2885efdbe3e3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:52.376163 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c083e517-c76c-4949-8386-ff525fe25171 req-84207d05-ee25-4f62-a940-2885efdbe3e3 service nova] Creating event network-changed:2beebb88-c099-4e9f-93ad-cccc0277a3ae for instance 75280777-757f-4944-8fea-ee74b7657c9e on n-h1-862876-2 Oct 28 13:41:52.386066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c083e517-c76c-4949-8386-ff525fe25171 req-84207d05-ee25-4f62-a940-2885efdbe3e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040156 Oct 28 13:41:52.389210 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3138/6368] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:52.777634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:52.787857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:52.802488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:52.803020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:52.803456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:52.811896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:52.812395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:52.812842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:52.815873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=87 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:53.198582 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-483d9cac-2318-49ed-86aa-e25d803e4763 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1463 microversion: 2.1 time: 0.425853 Oct 28 13:41:53.201546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3231/6369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:52 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1463 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:54.226446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:54.227862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:54.239064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:54.239574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:54.240030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:54.241453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:54.241930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:54.242370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:54.466944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c1638ab-7f6f-49d4-b277-c0a9a9c61102 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1463 microversion: 2.1 time: 0.245323 Oct 28 13:41:54.469368 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3139/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:54 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:54.765829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f28e8eba-7902-4b65-a053-0c0ff95037b1 req-d2251d00-14ab-4fc4-a1fc-767a82f64e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb15833-51e3-4628-b1bd-02b38c9a433a", "tag": "ac0b71e0-a353-46f7-8c73-9359259f2461"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:41:54.806315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f28e8eba-7902-4b65-a053-0c0ff95037b1 req-d2251d00-14ab-4fc4-a1fc-767a82f64e0f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:54.807066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f28e8eba-7902-4b65-a053-0c0ff95037b1 req-d2251d00-14ab-4fc4-a1fc-767a82f64e0f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:54.811811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f28e8eba-7902-4b65-a053-0c0ff95037b1 req-d2251d00-14ab-4fc4-a1fc-767a82f64e0f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:54.827733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f28e8eba-7902-4b65-a053-0c0ff95037b1 req-d2251d00-14ab-4fc4-a1fc-767a82f64e0f service nova] Creating event network-changed:ac0b71e0-a353-46f7-8c73-9359259f2461 for instance ecb15833-51e3-4628-b1bd-02b38c9a433a on n-h2-862876-2 Oct 28 13:41:54.865926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f28e8eba-7902-4b65-a053-0c0ff95037b1 req-d2251d00-14ab-4fc4-a1fc-767a82f64e0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107293 Oct 28 13:41:54.867987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3232/6371] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:41:55.494095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:55.494933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:55.514222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:55.514836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:55.515338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:55.516270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:55.516795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:55.517308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:55.540855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:55.654077 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d33686c5-0e1c-42f7-abba-a39a555dddcb tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1463 microversion: 2.1 time: 0.164076 Oct 28 13:41:55.655588 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3140/6372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:55 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:56.680768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:56.681628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:56.697298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:56.699240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:56.701315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:56.702352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:56.702871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:56.706226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:57.079823 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-589ea207-59b6-4a02-aea1-500fa9de5322 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1463 microversion: 2.1 time: 0.403327 Oct 28 13:41:57.080413 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3233/6373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:56 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1463 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:41:58.102583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:58.108692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:58.109276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:58.115321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:58.117467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:58.117981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:58.118426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:58.119197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:58.119666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:58.120102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:58.296187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e0f7f54-0bc5-4a8e-8849-5326f30aa806 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1463 microversion: 2.1 time: 0.195158 Oct 28 13:41:58.309367 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3141/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:58 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1463 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:41:59.323156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:41:59.323804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:41:59.327516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:59.328259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:41:59.333393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:59.333947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:59.334391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:59.335120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:41:59.335585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:41:59.336142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:41:59.475212 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61eed89d-29e6-49bd-be58-7b51def3a963 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1463 microversion: 2.1 time: 0.155731 Oct 28 13:41:59.475813 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3234/6375] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:41:59 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:00.204198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-94254cc4-6ff3-4d44-b91e-d003da85c482 req-ac9525d5-35c1-4b22-8e9c-f5040e3d2093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb15833-51e3-4628-b1bd-02b38c9a433a", "name": "network-vif-plugged", "status": "completed", "tag": "ac0b71e0-a353-46f7-8c73-9359259f2461"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:00.216100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-94254cc4-6ff3-4d44-b91e-d003da85c482 req-ac9525d5-35c1-4b22-8e9c-f5040e3d2093 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:00.216782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-94254cc4-6ff3-4d44-b91e-d003da85c482 req-ac9525d5-35c1-4b22-8e9c-f5040e3d2093 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:00.217759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-94254cc4-6ff3-4d44-b91e-d003da85c482 req-ac9525d5-35c1-4b22-8e9c-f5040e3d2093 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:00.237746 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-94254cc4-6ff3-4d44-b91e-d003da85c482 req-ac9525d5-35c1-4b22-8e9c-f5040e3d2093 service nova] Creating event network-vif-plugged:ac0b71e0-a353-46f7-8c73-9359259f2461 for instance ecb15833-51e3-4628-b1bd-02b38c9a433a on n-h2-862876-2 Oct 28 13:42:00.243037 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-94254cc4-6ff3-4d44-b91e-d003da85c482 req-ac9525d5-35c1-4b22-8e9c-f5040e3d2093 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043234 Oct 28 13:42:00.243907 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3142/6376] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:42:00.500895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:00.502115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:00.511593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:00.512351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:00.512954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:00.513651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:00.514305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:00.514727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:00.670708 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b9ee722-3abf-4f25-8521-9a73ba77f504 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1463 microversion: 2.1 time: 0.176624 Oct 28 13:42:00.686058 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3235/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:00 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1463 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:01.697878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:01.698595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:01.706322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:01.706850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:01.707301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:01.708046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:01.708514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:01.708952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:01.854117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2b3e0c53-2058-4e57-bb74-3364135479fd tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1649 microversion: 2.1 time: 0.162331 Oct 28 13:42:01.854819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3143/6378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:01 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1649 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:01.887768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:01.889782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:01.900566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:01.901428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:01.902152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:01.902887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:01.903345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:01.903766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:02.048596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bffd752e-c481-4cf0-a763-0a5311470f97 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1649 microversion: 2.1 time: 0.164256 Oct 28 13:42:02.049191 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3236/6379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:01 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1649 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:42:02.074405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:02.075578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:02.082707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:02.083294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:02.083737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:02.084446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:02.085064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:02.085495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:02.265799 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-65ff569d-3c11-4ef5-b8d2-968da4b51bd3 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1649 microversion: 2.1 time: 0.195603 Oct 28 13:42:02.266395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3144/6380] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:02 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1649 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:02.393608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-282734442", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "availability_zone": "nova:n-h1-862876-2", "networks": [{"uuid": "3932522e-5694-4e10-9eb2-cc2542438c7a"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:02.464730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] validate_networks() for [('3932522e-5694-4e10-9eb2-cc2542438c7a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:42:02.842971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:42:02.849511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:42:02.849511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:42:02.849511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:42:02.849511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:42:02.859507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:02.860368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:02.861153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:02.862210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:02.862867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:02.863648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:02.886924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Getting quotas for project 68ea2b17d5cf4391b124b8cd7ac9ea1a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:42:02.892323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Getting quotas for user be48608bf29b4a3d987c12005e3df70c and project 68ea2b17d5cf4391b124b8cd7ac9ea1a. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:42:02.908854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:42:02.911403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:42:03.093538 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0c5c7875-78ba-4dfb-88c3-acfd55366ad6 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707581 Oct 28 13:42:03.095264 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3237/6381] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:42:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:42:03.109051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-208b0969-6a51-4376-81bd-7d5c9394e98b tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:03.110558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-208b0969-6a51-4376-81bd-7d5c9394e98b tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:03.179370 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-208b0969-6a51-4376-81bd-7d5c9394e98b tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1328 microversion: 2.1 time: 0.075651 Oct 28 13:42:03.179370 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3145/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:03 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1328 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:04.202078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:04.202697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:04.211063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:04.211831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:04.212669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:04.213376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:04.213836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:04.214268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:04.292191 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3cbd1ae3-b416-4683-9db6-5a53195dc396 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1345 microversion: 2.1 time: 0.094131 Oct 28 13:42:04.292878 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3238/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:04 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:05.317867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:05.318516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:05.327802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:05.328463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:05.329055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:05.329873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:05.330430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:05.331172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:05.419785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f9dc58f-439b-4c45-a9e2-866a227f176d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1415 microversion: 2.1 time: 0.105874 Oct 28 13:42:05.420564 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3146/6384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:05 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1415 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:06.451155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:06.452459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:06.462928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:06.463645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:06.464267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:06.465169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:06.466074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:06.466669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:06.729033 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7cdde16-49b8-47b9-ae39-e75f5915d860 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.283630 Oct 28 13:42:06.742928 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3239/6385] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:06 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:07.756142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:07.757604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:07.761204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=48 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:07.766444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:07.767094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:07.767584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:07.768298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:07.768768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:07.769204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:07.866286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ab326f60-9bfe-4d91-b7ff-c5b9c66844ca req-6a611e6b-dedc-4ca5-ae6a-c177ba5fb16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b663ead0-f599-4df7-b1a6-80726e847918", "tag": "768aa64d-43f5-4489-823b-1c91d1b8d468"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:07.878925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ab326f60-9bfe-4d91-b7ff-c5b9c66844ca req-6a611e6b-dedc-4ca5-ae6a-c177ba5fb16b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:07.879716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ab326f60-9bfe-4d91-b7ff-c5b9c66844ca req-6a611e6b-dedc-4ca5-ae6a-c177ba5fb16b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:07.880337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ab326f60-9bfe-4d91-b7ff-c5b9c66844ca req-6a611e6b-dedc-4ca5-ae6a-c177ba5fb16b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:07.896848 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ab326f60-9bfe-4d91-b7ff-c5b9c66844ca req-6a611e6b-dedc-4ca5-ae6a-c177ba5fb16b service nova] Creating event network-changed:768aa64d-43f5-4489-823b-1c91d1b8d468 for instance b663ead0-f599-4df7-b1a6-80726e847918 on n-h1-862876-2 Oct 28 13:42:07.906044 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ab326f60-9bfe-4d91-b7ff-c5b9c66844ca req-6a611e6b-dedc-4ca5-ae6a-c177ba5fb16b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042949 Oct 28 13:42:07.907305 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3240/6386] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:42:08.000771 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e47da111-0943-4f32-bde5-a2efcc38449d tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.248482 Oct 28 13:42:08.014972 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3147/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:07 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:09.025874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:09.026644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:09.028600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:09.034435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:09.034949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:09.035560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:09.036255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:09.036708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:09.037128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:09.186777 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a06918c5-7f6d-4f7a-b4d6-f09f1abc23d8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.164850 Oct 28 13:42:09.187502 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3241/6388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:09 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:10.212993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:10.214853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:10.281536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:10.286074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:10.286734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:10.289176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:10.292601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:10.293867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:10.448745 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0833fe0d-7fad-4b7b-b713-9e6998567d27 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.240210 Oct 28 13:42:10.449928 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3148/6389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:10 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:11.474107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:11.479514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:11.489788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:11.490601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:11.491276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:11.496552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:11.497495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:11.497949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:11.681575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac449bb7-48db-4f98-b808-d60fd0685ab8 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.211598 Oct 28 13:42:11.683168 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3242/6390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:11 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:12.298300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:12.301967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:12.309085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.311253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.311253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.311253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.311757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.312194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.368312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b46d4c5b-5b8b-4029-bf37-d8e307407529 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e/action" status: 200 len: 24577 microversion: 2.1 time: 0.075197 Oct 28 13:42:12.369601 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3149/6391] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:42:12 2022] POST /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e/action => generated 24577 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:42:12.687482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:12.690229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:12.697206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.697672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.698120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.698839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.699632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.700059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.705537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:12.706413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:12.713408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.713895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.714357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.715098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.715552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.715976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.732323 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff537367-b067-4ded-9878-24391efc72ec tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049242 Oct 28 13:42:12.733009 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3243/6392] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Oct 28 13:42:12 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:12.808800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:12.809976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:12.817447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.817942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.818379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.819543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:12.820121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:12.820488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:12.849890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:42:12.866586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e545e7ca-feac-45c5-bac7-a30f354cc986 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.164548 Oct 28 13:42:12.867687 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3150/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:12 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:42:12.881178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:12.904717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:13.893511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:13.894294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:13.897091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:13.903511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:13.904108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:13.905227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:13.905976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:13.906475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:13.906961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:14.040183 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97627dc3-03d4-4417-ae62-694d999c8dfa tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.151056 Oct 28 13:42:14.041078 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3151/6394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:13 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:42:14.496596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d299b2f7-ebd6-4340-bb73-06be982e3ea6 req-3386aaee-8ffd-4006-9530-f0c6aa9cb2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b663ead0-f599-4df7-b1a6-80726e847918", "name": "network-vif-plugged", "status": "completed", "tag": "768aa64d-43f5-4489-823b-1c91d1b8d468"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:14.503604 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-545993ad-ab57-485e-9d61-1940a81fdbdb tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 204 len: 0 microversion: 2.20 time: 1.698450 Oct 28 13:42:14.504507 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3244/6395] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:42:12 2022] DELETE /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 0 bytes in 1700 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 13:42:14.512022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d299b2f7-ebd6-4340-bb73-06be982e3ea6 req-3386aaee-8ffd-4006-9530-f0c6aa9cb2ef service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:14.512425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d299b2f7-ebd6-4340-bb73-06be982e3ea6 req-3386aaee-8ffd-4006-9530-f0c6aa9cb2ef service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:14.512865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d299b2f7-ebd6-4340-bb73-06be982e3ea6 req-3386aaee-8ffd-4006-9530-f0c6aa9cb2ef service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:14.519857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:14.520639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:14.524546 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d299b2f7-ebd6-4340-bb73-06be982e3ea6 req-3386aaee-8ffd-4006-9530-f0c6aa9cb2ef service nova] Creating event network-vif-plugged:768aa64d-43f5-4489-823b-1c91d1b8d468 for instance b663ead0-f599-4df7-b1a6-80726e847918 on n-h1-862876-2 Oct 28 13:42:14.526707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:14.527288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:14.527839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:14.528997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:14.529938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:14.530442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:14.545992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d299b2f7-ebd6-4340-bb73-06be982e3ea6 req-3386aaee-8ffd-4006-9530-f0c6aa9cb2ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037100 Oct 28 13:42:14.547344 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3152/6396] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:42:14.817802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:14.827352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:14.828811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:14.830012 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11025e1d-3712-4a47-8311-7028a825a395 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.315191 Oct 28 13:42:14.830602 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3245/6397] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:42:14 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:42:15.077783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:15.078525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:15.085234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:15.085969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:15.086573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:15.087482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:15.088194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:15.088766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:15.261763 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91be14fc-5007-4a58-83a8-3a1386f56666 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1463 microversion: 2.1 time: 0.194266 Oct 28 13:42:15.262496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3153/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:15 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1463 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:15.864289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:15.864826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:15.871834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:15.872322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:15.872755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:15.873475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:15.873927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:15.874345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.158468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:16.173552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:16.175808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:16.177378 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9fe0b80-1af3-4950-a6d4-9adaf852703b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1723 microversion: 2.20 time: 0.317309 Oct 28 13:42:16.180151 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3246/6399] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:42:15 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:42:16.287951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:16.289309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:16.297370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.303816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.303816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.303816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.303816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.303816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.454774 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4f66f0af-a806-426b-8182-975aec586b17 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1649 microversion: 2.1 time: 0.170926 Oct 28 13:42:16.466767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3154/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:16 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1649 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:16.483605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:16.484250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:16.491356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.493089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.493089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.493779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.494445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.495252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.756578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70b385ae-1c01-452c-9c9a-26685b918523 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1649 microversion: 2.1 time: 0.277342 Oct 28 13:42:16.757732 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3247/6401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:16 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1649 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:16.779966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:16.781032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:16.787616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.788379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.789043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.789963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.790634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.791321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.933430 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e7953080-e61b-4b9d-a419-705f13c1d6cc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1649 microversion: 2.1 time: 0.156861 Oct 28 13:42:16.934891 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3155/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:16 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1649 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:16.959546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:16.960167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:16.968925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.969572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.970734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.971562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:16.972097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:16.972793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:16.975820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:17.046297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:42:17.208098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:17.209077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:17.218780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:17.221320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:17.221798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:17.222557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:17.223060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:17.223492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:17.320167 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ec94dcd3-44c5-4d66-91b4-f4578516a031 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 204 len: 0 microversion: 2.1 time: 0.365209 Oct 28 13:42:17.320764 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3248/6403] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:42:16 2022] DELETE /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:42:17.330174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:17.333725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:17.373291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:17.378448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:17.384633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:17.385722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:17.386352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:17.386975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:17.440198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:17.460015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:17.461493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:17.471968 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75c303c4-d700-4cf1-9e51-366de718877b tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1656 microversion: 2.20 time: 0.270109 Oct 28 13:42:17.499513 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3156/6404] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:42:17 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1656 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 13:42:17.505125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2eb51350-75f4-4e58-b9ef-cfd2149e21ca req-8f2c4255-38ac-4572-bf09-a9a8db991fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9ca08e-c2f8-4409-916c-114c1f94c0e2", "name": "network-vif-deleted", "tag": "71e2709c-2621-4715-abef-d0eb6e49342b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:17.540670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2eb51350-75f4-4e58-b9ef-cfd2149e21ca req-8f2c4255-38ac-4572-bf09-a9a8db991fbc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:17.543369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2eb51350-75f4-4e58-b9ef-cfd2149e21ca req-8f2c4255-38ac-4572-bf09-a9a8db991fbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:17.544062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2eb51350-75f4-4e58-b9ef-cfd2149e21ca req-8f2c4255-38ac-4572-bf09-a9a8db991fbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:17.587334 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2eb51350-75f4-4e58-b9ef-cfd2149e21ca req-8f2c4255-38ac-4572-bf09-a9a8db991fbc service nova] Creating event network-vif-deleted:71e2709c-2621-4715-abef-d0eb6e49342b for instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 on n-h2-862876-2 Oct 28 13:42:17.602875 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2eb51350-75f4-4e58-b9ef-cfd2149e21ca req-8f2c4255-38ac-4572-bf09-a9a8db991fbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097643 Oct 28 13:42:17.603265 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3157/6405] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:42:17.723852 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-91b78efd-117b-4ad7-b7b9-689ebc9adf7a tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1655 microversion: 2.1 time: 0.397447 Oct 28 13:42:17.741863 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3249/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:17 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1655 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:18.534408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:18.542207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:18.554586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:18.555347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:18.556126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:18.557052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:18.557816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:18.561301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:18.602826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:18.603763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:18.604410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:18.605113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lazy-loading 'fault' on Instance uuid ce9ca08e-c2f8-4409-916c-114c1f94c0e2 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:42:18.660408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:18.669681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:18.672899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccf717948682481a87e008d912d4848c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a580b333d8b245b1a69b2b246b73abcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:18.674305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59e7533e-4714-46ce-b5c6-3921da57c8bc tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 200 len: 1372 microversion: 2.20 time: 0.162693 Oct 28 13:42:18.675087 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3158/6407] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:42:18 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 13:42:18.748927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:18.749559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:18.764904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:18.765964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:18.766865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:18.767803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:18.768476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:18.769144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:19.071324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7563a274-19e2-4b81-ae64-b72f41a6fa7e tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1655 microversion: 2.1 time: 0.324523 Oct 28 13:42:19.078970 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3250/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:18 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1655 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:19.623928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f6c96f85-dd7d-4e6a-8733-37ba56c417ac req-4435b135-23aa-4e88-b2d0-515352c05268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b663ead0-f599-4df7-b1a6-80726e847918", "name": "network-vif-deleted", "tag": "768aa64d-43f5-4489-823b-1c91d1b8d468"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:19.634989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6c96f85-dd7d-4e6a-8733-37ba56c417ac req-4435b135-23aa-4e88-b2d0-515352c05268 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:19.637959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6c96f85-dd7d-4e6a-8733-37ba56c417ac req-4435b135-23aa-4e88-b2d0-515352c05268 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:19.637959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6c96f85-dd7d-4e6a-8733-37ba56c417ac req-4435b135-23aa-4e88-b2d0-515352c05268 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:19.649729 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f6c96f85-dd7d-4e6a-8733-37ba56c417ac req-4435b135-23aa-4e88-b2d0-515352c05268 service nova] Creating event network-vif-deleted:768aa64d-43f5-4489-823b-1c91d1b8d468 for instance b663ead0-f599-4df7-b1a6-80726e847918 on n-h1-862876-2 Oct 28 13:42:19.655293 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f6c96f85-dd7d-4e6a-8733-37ba56c417ac req-4435b135-23aa-4e88-b2d0-515352c05268 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035781 Oct 28 13:42:19.656466 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3159/6409] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:42:19.702465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:19.703143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:19.709504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:19.709993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:19.710433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:19.711166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:19.711624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:19.712046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:19.726573 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] HTTP exception thrown: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Request method failure captured: Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 HTTP/1.1 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9qZEMKoF6702qsjBLIKNc48PZGPG6E3Ufyw4fHZc1CSB3DgbKxtbIW9NUXosXKhYiokqw9TNZggF0WTEnLpvdLdUPNWAvervFJM9ef1DvWjqrVDxBTxYqVyktIx5dErlLNcWX4a00kiR1E_Gi0AY66SX8fCSUyFggW8cVlNo93GBHc Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a580b333d8b245b1a69b2b246b73abcc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ccf717948682481a87e008d912d4848c Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ce9ca08e-c2f8-4409-916c-114c1f94c0e2'} Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:19.728305 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Returning 404 to user: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3c85aff-ff2a-4903-93e9-863b37ab8887 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 404 len: 111 microversion: 2.20 time: 0.032011 Oct 28 13:42:19.741472 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3251/6410] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:42:19 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:42:19.746540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c2f616a7-867a-4203-a2a6-4b7e4b6c3be4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '.version_select at 0x7f27b93c5c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:19.751859 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2f616a7-867a-4203-a2a6-4b7e4b6c3be4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [8e9a6bd9-dc6c-4f2b-8c2d-cf48bf23457e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 13:42:20.100862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:20.101526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:20.109095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:20.109591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:20.110117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:20.110891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:20.111367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:20.111788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:20.145927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:20.146408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:20.146871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:20.147351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lazy-loading 'fault' on Instance uuid b663ead0-f599-4df7-b1a6-80726e847918 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:42:20.220572 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5962a3db-d00e-4a77-969d-475333e2d01c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 200 len: 1453 microversion: 2.1 time: 0.121442 Oct 28 13:42:20.220572 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3252/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:20 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:42:20.761241 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2f616a7-867a-4203-a2a6-4b7e4b6c3be4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [8e9a6bd9-dc6c-4f2b-8c2d-cf48bf23457e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42254. Oct 28 13:42:20.939586 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c2f616a7-867a-4203-a2a6-4b7e4b6c3be4 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952149381" status: 204 len: 0 microversion: 2.20 time: 1.203842 Oct 28 13:42:20.940489 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3160/6412] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Oct 28 13:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952149381 => generated 0 bytes in 1206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 13:42:21.260925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:21.261649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: b663ead0-f599-4df7-b1a6-80726e847918] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:21.269824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:21.270386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:21.271094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:21.272701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:21.280045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:21.281563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:21.298678 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] HTTP exception thrown: Instance b663ead0-f599-4df7-b1a6-80726e847918 could not be found. Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Request method failure captured: Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 HTTP/1.1 Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9wZO-1WkVZALeXigoV7if6KnabX8W9B9TC1vkc-Lg8e2Terl8B1FXXCn34PknKr4eXIEa8olmUp97DWnDjV6LxsNf2N-rjYAbewwWxUr0N1GE6uYaC-QVto3Pvnc4z2_MMFqowbgOw7QtqZkTCMY1XI-cb1FluTQHfAZrzke0Knz9E Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 68ea2b17d5cf4391b124b8cd7ac9ea1a Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestServerMultinode-63955555 Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/68ea2b17d5cf4391b124b8cd7ac9ea1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/68ea2b17d5cf4391b124b8cd7ac9ea1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_68ea2b17d5cf4391b124b8cd7ac9ea1a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/68ea2b17d5cf4391b124b8cd7ac9ea1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestServerMultinode-63955555 Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 68ea2b17d5cf4391b124b8cd7ac9ea1a Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestServerMultinode-63955555 Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestServerMultinode-63955555-project-admin Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: be48608bf29b4a3d987c12005e3df70c Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestServerMultinode-63955555-project-admin Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b663ead0-f599-4df7-b1a6-80726e847918 could not be found. Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b663ead0-f599-4df7-b1a6-80726e847918'} Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b663ead0-f599-4df7-b1a6-80726e847918 could not be found. Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b663ead0-f599-4df7-b1a6-80726e847918 could not be found. Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:21.308997 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b663ead0-f599-4df7-b1a6-80726e847918 could not be found. Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Returning 404 to user: Instance b663ead0-f599-4df7-b1a6-80726e847918 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17a49a75-6fd8-4e85-a354-ebf2f61c1dfc tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918" status: 404 len: 111 microversion: 2.1 time: 0.069078 Oct 28 13:42:21.314288 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3253/6413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:21 2022] GET /compute/v2.1/servers/b663ead0-f599-4df7-b1a6-80726e847918 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:42:21.320349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:21.321131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:21.331488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:21.333739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:21.334205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:21.335009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:21.335495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:21.335937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:21.357177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=100 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:21.366256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:42:21.947799 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c21b254-207d-48a2-bfd1-117063679182 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 204 len: 0 microversion: 2.1 time: 0.630105 Oct 28 13:42:21.952101 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3161/6414] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:42:21 2022] DELETE /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:42:21.966144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:21.967537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:21.981537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:21.982382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:21.983681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:21.985147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:21.985843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:21.986294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:22.156532 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6226c27f-1636-47aa-8937-60e04bbe6563 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1655 microversion: 2.1 time: 0.195872 Oct 28 13:42:22.157874 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3254/6415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:21 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:23.180777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:23.182107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:23.207511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:23.208257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:23.214143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:23.215200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:23.215834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:23.216421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:23.465235 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-735b92f0-1f36-4d1b-87d5-2d512244c53c tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1655 microversion: 2.1 time: 0.288492 Oct 28 13:42:23.466875 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3162/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:23 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1655 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:24.035516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9a6d84dd-9486-4e23-9b1d-d3cca09645b2 req-fbc9a9b6-5826-4f8d-9b18-5b9bab54dce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb15833-51e3-4628-b1bd-02b38c9a433a", "name": "network-vif-deleted", "tag": "ac0b71e0-a353-46f7-8c73-9359259f2461"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:24.065874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9a6d84dd-9486-4e23-9b1d-d3cca09645b2 req-fbc9a9b6-5826-4f8d-9b18-5b9bab54dce7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:24.066374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9a6d84dd-9486-4e23-9b1d-d3cca09645b2 req-fbc9a9b6-5826-4f8d-9b18-5b9bab54dce7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:24.078931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9a6d84dd-9486-4e23-9b1d-d3cca09645b2 req-fbc9a9b6-5826-4f8d-9b18-5b9bab54dce7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:24.097441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9a6d84dd-9486-4e23-9b1d-d3cca09645b2 req-fbc9a9b6-5826-4f8d-9b18-5b9bab54dce7 service nova] Creating event network-vif-deleted:ac0b71e0-a353-46f7-8c73-9359259f2461 for instance ecb15833-51e3-4628-b1bd-02b38c9a433a on n-h2-862876-2 Oct 28 13:42:24.106805 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9a6d84dd-9486-4e23-9b1d-d3cca09645b2 req-fbc9a9b6-5826-4f8d-9b18-5b9bab54dce7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075577 Oct 28 13:42:24.108715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3255/6417] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:42:24.492401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:24.493238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:24.510527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:24.512890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:24.515598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:24.516509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:24.517136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:24.517748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:24.558387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:24.559094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:24.559537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:24.562412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lazy-loading 'fault' on Instance uuid ecb15833-51e3-4628-b1bd-02b38c9a433a {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:42:24.609784 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fdd55b7b-d1a7-44ac-bbe4-018d51a56238 tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 200 len: 1453 microversion: 2.1 time: 0.121396 Oct 28 13:42:24.610384 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3163/6418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:24 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:25.495061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:25.495668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:25.503218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:25.503715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:25.504152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:25.505033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:25.505493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:25.505923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:25.531317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] HTTP exception thrown: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Request method failure captured: Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 HTTP/1.1 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9qZEMKoF6702qsjBLIKNc48PZGPG6E3Ufyw4fHZc1CSB3DgbKxtbIW9NUXosXKhYiokqw9TNZggF0WTEnLpvdLdUPNWAvervFJM9ef1DvWjqrVDxBTxYqVyktIx5dErlLNcWX4a00kiR1E_Gi0AY66SX8fCSUyFggW8cVlNo93GBHc Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a580b333d8b245b1a69b2b246b73abcc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ccf717948682481a87e008d912d4848c Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ce9ca08e-c2f8-4409-916c-114c1f94c0e2'} Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:42:25.533314 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.537339 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.539539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Returning 404 to user: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:42:25.540639 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed40d2c0-8540-41a3-b4bb-cc867d51ac46 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 404 len: 111 microversion: 2.20 time: 0.058829 Oct 28 13:42:25.544759 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3256/6419] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:42:25 2022] DELETE /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:42:25.557210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:25.557210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: ce9ca08e-c2f8-4409-916c-114c1f94c0e2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:25.562725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:25.563384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:25.563948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:25.564757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:25.565312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:25.565929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:25.581043 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] HTTP exception thrown: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Request method failure captured: Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 HTTP/1.1 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9qZEMKoF6702qsjBLIKNc48PZGPG6E3Ufyw4fHZc1CSB3DgbKxtbIW9NUXosXKhYiokqw9TNZggF0WTEnLpvdLdUPNWAvervFJM9ef1DvWjqrVDxBTxYqVyktIx5dErlLNcWX4a00kiR1E_Gi0AY66SX8fCSUyFggW8cVlNo93GBHc Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a580b333d8b245b1a69b2b246b73abcc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ccf717948682481a87e008d912d4848c Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'ce9ca08e-c2f8-4409-916c-114c1f94c0e2'} Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.582956 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Returning 404 to user: Instance ce9ca08e-c2f8-4409-916c-114c1f94c0e2 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d62be76-c635-4c46-a7ea-9c05eb5a68e1 tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2" status: 404 len: 111 microversion: 2.20 time: 0.036591 Oct 28 13:42:25.589796 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3164/6420] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:42:25 2022] GET /compute/v2.1/servers/ce9ca08e-c2f8-4409-916c-114c1f94c0e2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:42:25.635074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:25.635825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] [instance: ecb15833-51e3-4628-b1bd-02b38c9a433a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:25.642922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:25.643855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:25.644595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:25.645391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:25.645928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:25.646423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:25.667370 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] HTTP exception thrown: Instance ecb15833-51e3-4628-b1bd-02b38c9a433a could not be found. Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Request method failure captured: Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a HTTP/1.1 Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9wZO-1WkVZALeXigoV7if6KnabX8W9B9TC1vkc-Lg8e2Terl8B1FXXCn34PknKr4eXIEa8olmUp97DWnDjV6LxsNf2N-rjYAbewwWxUr0N1GE6uYaC-QVto3Pvnc4z2_MMFqowbgOw7QtqZkTCMY1XI-cb1FluTQHfAZrzke0Knz9E Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 68ea2b17d5cf4391b124b8cd7ac9ea1a Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestServerMultinode-63955555 Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/68ea2b17d5cf4391b124b8cd7ac9ea1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/68ea2b17d5cf4391b124b8cd7ac9ea1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_68ea2b17d5cf4391b124b8cd7ac9ea1a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/68ea2b17d5cf4391b124b8cd7ac9ea1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestServerMultinode-63955555 Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 68ea2b17d5cf4391b124b8cd7ac9ea1a Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestServerMultinode-63955555 Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestServerMultinode-63955555-project-admin Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: be48608bf29b4a3d987c12005e3df70c Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestServerMultinode-63955555-project-admin Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance ecb15833-51e3-4628-b1bd-02b38c9a433a could not be found. Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'ecb15833-51e3-4628-b1bd-02b38c9a433a'} Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb15833-51e3-4628-b1bd-02b38c9a433a could not be found. Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb15833-51e3-4628-b1bd-02b38c9a433a could not be found. Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:25.669430 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb15833-51e3-4628-b1bd-02b38c9a433a could not be found. Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] Returning 404 to user: Instance ecb15833-51e3-4628-b1bd-02b38c9a433a could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7bc12293-601b-493b-8a21-2b42524149ad tempest-TestServerMultinode-63955555 tempest-TestServerMultinode-63955555-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a" status: 404 len: 111 microversion: 2.1 time: 0.042663 Oct 28 13:42:25.674787 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3257/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:25 2022] GET /compute/v2.1/servers/ecb15833-51e3-4628-b1bd-02b38c9a433a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:42:30.214245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-72811697-8b5b-4613-a2f6-3f6622fa94e5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'create', calling method: .version_select at 0x7f27b945d700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1478976533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ+2J+J47TNm3Brb2HtCyByUDO+XOdQz7aC9V26yL9GCPgTYPQXIcskxI2wndz/BtCMutBhDrKsLGyd0JcHQISSBGJVlCJFwKTWVmZQn3cvQb2MDsjLQodgso2oG5keSA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:30.241220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-72811697-8b5b-4613-a2f6-3f6622fa94e5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for project e39d46af774948ebb07a73d9949d68a2. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:42:30.250671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-72811697-8b5b-4613-a2f6-3f6622fa94e5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for user 6108739803264e209694b88240067369 and project e39d46af774948ebb07a73d9949d68a2. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:42:30.448005 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-72811697-8b5b-4613-a2f6-3f6622fa94e5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.238063 Oct 28 13:42:30.449867 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3165/6422] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:42:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:42:32.689445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:32.690795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:32.712788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:32.713682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:32.714348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:32.715352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:32.716125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:32.716813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:32.745170 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] HTTP exception thrown: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Request method failure captured: Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 HTTP/1.1 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9qZEMKoF6702qsjBLIKNc48PZGPG6E3Ufyw4fHZc1CSB3DgbKxtbIW9NUXosXKhYiokqw9TNZggF0WTEnLpvdLdUPNWAvervFJM9ef1DvWjqrVDxBTxYqVyktIx5dErlLNcWX4a00kiR1E_Gi0AY66SX8fCSUyFggW8cVlNo93GBHc Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a580b333d8b245b1a69b2b246b73abcc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: ccf717948682481a87e008d912d4848c Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bd5181f8-b838-41a3-a5ae-bad3451e6388'} Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:42:32.749511 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Returning 404 to user: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e315308-891c-4826-93f8-ea631bbc5a5f tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 404 len: 111 microversion: 2.20 time: 0.075144 Oct 28 13:42:32.762995 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3258/6423] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Oct 28 13:42:32 2022] DELETE /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:42:32.770724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:32.782957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] [instance: bd5181f8-b838-41a3-a5ae-bad3451e6388] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:32.797777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:32.798838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:32.799535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:32.801591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:32.807576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:32.808333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:32.837238 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] HTTP exception thrown: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Request method failure captured: Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 HTTP/1.1 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9qZEMKoF6702qsjBLIKNc48PZGPG6E3Ufyw4fHZc1CSB3DgbKxtbIW9NUXosXKhYiokqw9TNZggF0WTEnLpvdLdUPNWAvervFJM9ef1DvWjqrVDxBTxYqVyktIx5dErlLNcWX4a00kiR1E_Gi0AY66SX8fCSUyFggW8cVlNo93GBHc Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a580b333d8b245b1a69b2b246b73abcc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a580b333d8b245b1a69b2b246b73abcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: a580b333d8b245b1a69b2b246b73abcc Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-19543332 Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: ccf717948682481a87e008d912d4848c Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-AttachVolumeShelveTestJSON-19543332-project Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'bd5181f8-b838-41a3-a5ae-bad3451e6388'} Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.841116 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. Oct 28 13:42:32.845611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:42:32.850902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] Returning 404 to user: Instance bd5181f8-b838-41a3-a5ae-bad3451e6388 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:42:32.852112 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5cf51f47-f239-41c9-a1c5-71022da8458e tempest-AttachVolumeShelveTestJSON-19543332 tempest-AttachVolumeShelveTestJSON-19543332-project] 10.222.0.25 "GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388" status: 404 len: 111 microversion: 2.20 time: 0.085358 Oct 28 13:42:32.853876 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3166/6424] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Oct 28 13:42:32 2022] GET /compute/v2.1/servers/bd5181f8-b838-41a3-a5ae-bad3451e6388 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 13:42:36.827491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-317982629", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "08dda40f-9509-4b72-b34c-bea710ac05c6"}], "key_name": "tempest-TestNetworkBasicOps-1478976533", "security_groups": [{"name": "tempest-secgroup-smoke-1418614395"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:37.639512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] validate_networks() for [('08dda40f-9509-4b72-b34c-bea710ac05c6', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:42:38.893309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:42:38.899056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:42:38.899624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:42:38.900055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:42:38.900478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:42:38.917044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:38.917544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:38.917989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:38.918725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:38.919216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:38.919651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:38.962778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for project e39d46af774948ebb07a73d9949d68a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:42:38.980663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for user 6108739803264e209694b88240067369 and project e39d46af774948ebb07a73d9949d68a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:42:39.021540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:42:39.024396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:42:39.240922 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e08ce5aa-e77e-483f-8319-e4ece7d888c1 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.417293 Oct 28 13:42:39.243155 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3259/6425] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:42:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:42:39.258048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ee995e2-f953-4fce-bf18-8460ffa48dd4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:39.258668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ee995e2-f953-4fce-bf18-8460ffa48dd4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:39.765990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ee995e2-f953-4fce-bf18-8460ffa48dd4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:39.776695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ee995e2-f953-4fce-bf18-8460ffa48dd4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1248 microversion: 2.1 time: 0.525903 Oct 28 13:42:39.777781 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3167/6426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:39 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1248 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:42:40.806868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4b354287-fa43-4009-ae52-102f59945a42 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:40.807744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4b354287-fa43-4009-ae52-102f59945a42 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:40.941205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4b354287-fa43-4009-ae52-102f59945a42 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:40.949817 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4b354287-fa43-4009-ae52-102f59945a42 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1248 microversion: 2.1 time: 0.147776 Oct 28 13:42:40.972235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3260/6427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:40 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1248 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:42.004352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:42.005581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:42.013545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:42.027583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:42.031409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:42.035354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:42.035354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:42.035354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:42.035354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:42.156254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:42.172470 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba224ef8-b579-4acd-8cb6-c2f6e05f935e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1300 microversion: 2.1 time: 0.179248 Oct 28 13:42:42.175971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3168/6428] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:41 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:43.200015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:43.200741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:43.204308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:43.209457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:43.210014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:43.210512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:43.211302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:43.211839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:43.212360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:43.360612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:43.372106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5df789cc-15b2-41cc-a7ef-236885d0317b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1318 microversion: 2.1 time: 0.173204 Oct 28 13:42:43.372106 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3261/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:43 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:44.399483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:44.400227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:44.409991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:44.415557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:44.415557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:44.415557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:44.415557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:44.415557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:44.605005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:44.614293 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-682d285a-6a36-433c-b0da-1d21ecdb822a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1374 microversion: 2.1 time: 0.222171 Oct 28 13:42:44.615234 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3169/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:44 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:45.648903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:45.649532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:45.665717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:45.676505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:45.676505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:45.676505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:45.676505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:45.676505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:45.851350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:45.856979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8d5c3057-9b9b-4870-86e5-f20d9788f6ce req-7506c747-c47b-43a3-86b1-968350205388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188d8367-b176-4812-aeba-ac40e3ce5b7f", "tag": "ba3d8488-0697-40ac-9328-63705d39d508"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:45.869903 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fed808f7-9cd4-4174-af31-9c54b6bf0833 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1374 microversion: 2.1 time: 0.232963 Oct 28 13:42:45.874950 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3262/6431] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:45 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1374 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:45.887725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8d5c3057-9b9b-4870-86e5-f20d9788f6ce req-7506c747-c47b-43a3-86b1-968350205388 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:45.888094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8d5c3057-9b9b-4870-86e5-f20d9788f6ce req-7506c747-c47b-43a3-86b1-968350205388 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:45.889276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8d5c3057-9b9b-4870-86e5-f20d9788f6ce req-7506c747-c47b-43a3-86b1-968350205388 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:45.909784 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8d5c3057-9b9b-4870-86e5-f20d9788f6ce req-7506c747-c47b-43a3-86b1-968350205388 service nova] Creating event network-changed:ba3d8488-0697-40ac-9328-63705d39d508 for instance 188d8367-b176-4812-aeba-ac40e3ce5b7f on n-h2-862876-2 Oct 28 13:42:45.915959 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8d5c3057-9b9b-4870-86e5-f20d9788f6ce req-7506c747-c47b-43a3-86b1-968350205388 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063521 Oct 28 13:42:45.916838 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3170/6432] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:42:46.899690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:46.900575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:46.910143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:46.910583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:46.911079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:46.911775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:46.912236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:46.912686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:47.075414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:47.088521 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cb6ac855-9c5e-4d14-8a78-d7195fc1b003 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1374 microversion: 2.1 time: 0.191879 Oct 28 13:42:47.088521 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3263/6433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:46 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:48.117651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:48.119335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:48.127904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:48.141318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:48.141318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:48.141318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:48.141318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:48.141318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:48.329535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:48.356129 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aac38528-b710-482a-b5fc-c2f355eba2e3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1374 microversion: 2.1 time: 0.247580 Oct 28 13:42:48.358013 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3171/6434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:48 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1374 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:49.381080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:49.382255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:49.386002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:49.390784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:49.391276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:49.391713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:49.392449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:49.392958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:49.393388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:49.396223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:49.542722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:49.551274 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-433dd3dc-8798-43d2-a821-b0ff67840947 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1374 microversion: 2.1 time: 0.175435 Oct 28 13:42:49.551888 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3264/6435] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:49 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:50.375236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0eaa9981-2162-4554-83ee-7cd1add4ce28 req-a1599379-c9c8-4960-84c2-3ad56e37875b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188d8367-b176-4812-aeba-ac40e3ce5b7f", "name": "network-vif-plugged", "status": "completed", "tag": "ba3d8488-0697-40ac-9328-63705d39d508"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:42:50.383253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:50.393309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0eaa9981-2162-4554-83ee-7cd1add4ce28 req-a1599379-c9c8-4960-84c2-3ad56e37875b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:50.393788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0eaa9981-2162-4554-83ee-7cd1add4ce28 req-a1599379-c9c8-4960-84c2-3ad56e37875b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:50.394250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0eaa9981-2162-4554-83ee-7cd1add4ce28 req-a1599379-c9c8-4960-84c2-3ad56e37875b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:50.414535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0eaa9981-2162-4554-83ee-7cd1add4ce28 req-a1599379-c9c8-4960-84c2-3ad56e37875b service nova] Creating event network-vif-plugged:ba3d8488-0697-40ac-9328-63705d39d508 for instance 188d8367-b176-4812-aeba-ac40e3ce5b7f on n-h2-862876-2 Oct 28 13:42:50.421532 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0eaa9981-2162-4554-83ee-7cd1add4ce28 req-a1599379-c9c8-4960-84c2-3ad56e37875b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051796 Oct 28 13:42:50.422141 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3172/6436] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:42:50.580185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:50.581101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:50.590004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:50.590492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:50.590955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:50.596119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:50.597069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:50.597512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:50.754292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:50.762829 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-81818b09-2346-4c88-adda-8d2f4b687a94 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1374 microversion: 2.1 time: 0.191867 Oct 28 13:42:50.763415 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3265/6437] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:50 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:51.790895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:51.791605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:51.804689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:51.805790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:51.806229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:51.807267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:51.807873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:51.808466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:51.812983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:51.964936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:51.977104 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9cc036be-c0fd-49ec-8e43-21960f9179f3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1374 microversion: 2.1 time: 0.190874 Oct 28 13:42:51.977717 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3173/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:51 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:53.003889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:53.004516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:53.008141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:42:53.012876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:53.013302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:53.013750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:53.014443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:53.014929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:53.015361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:53.175424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:53.183727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3bfda958-282a-4d70-938c-d56140343d66 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1546 microversion: 2.1 time: 0.184441 Oct 28 13:42:53.197428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3266/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:52 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:42:53.206728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:42:53.207473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:42:53.215258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:53.215750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:53.216186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:53.216912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:42:53.217366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:42:53.217793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:42:53.399485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:42:53.412007 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5ce8b072-eca2-4f01-80ce-3e7e917b6ddc tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1546 microversion: 2.1 time: 0.209137 Oct 28 13:42:53.424139 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3174/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:42:53 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1546 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:17.655707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:17.656289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:17.660475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=11 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:43:17.664804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:17.665372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:17.665870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:17.666892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:17.667559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:17.668060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:17.696875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:43:18.236177 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14084cd5-9dae-4172-ab24-85f5fa2bf8a0 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "DELETE /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 204 len: 0 microversion: 2.1 time: 0.588745 Oct 28 13:43:18.237053 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3267/6441] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:43:17 2022] DELETE /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:43:18.247935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:18.249445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:18.255108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=13 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:43:18.261968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:18.262575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:18.263174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:18.264812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:18.265442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:18.266152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:18.533147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:18.542780 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1756fa77-a2ca-4a59-b9ff-f8cdc10231e2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1552 microversion: 2.1 time: 0.300129 Oct 28 13:43:18.544230 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3175/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:18 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1552 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:19.568525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:19.569282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:19.586937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:19.587499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:19.588004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:19.590591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:19.592342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:19.593599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:19.844428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:19.852715 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dad7a034-41a2-49be-a307-439609e771dd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1552 microversion: 2.1 time: 0.288762 Oct 28 13:43:19.853524 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3268/6443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:19 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1552 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:20.230468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-efdea752-18a2-4059-8b6c-9719879f37fd req-db494b70-4b69-466b-a654-e7ff323831a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188d8367-b176-4812-aeba-ac40e3ce5b7f", "name": "network-vif-deleted", "tag": "ba3d8488-0697-40ac-9328-63705d39d508"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:20.242261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-efdea752-18a2-4059-8b6c-9719879f37fd req-db494b70-4b69-466b-a654-e7ff323831a5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:20.242766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-efdea752-18a2-4059-8b6c-9719879f37fd req-db494b70-4b69-466b-a654-e7ff323831a5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:20.243219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-efdea752-18a2-4059-8b6c-9719879f37fd req-db494b70-4b69-466b-a654-e7ff323831a5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:20.255096 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-efdea752-18a2-4059-8b6c-9719879f37fd req-db494b70-4b69-466b-a654-e7ff323831a5 service nova] Creating event network-vif-deleted:ba3d8488-0697-40ac-9328-63705d39d508 for instance 188d8367-b176-4812-aeba-ac40e3ce5b7f on n-h2-862876-2 Oct 28 13:43:20.261288 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-efdea752-18a2-4059-8b6c-9719879f37fd req-db494b70-4b69-466b-a654-e7ff323831a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038961 Oct 28 13:43:20.261880 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3176/6444] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:43:20.875595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:20.876207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:20.883544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:20.884040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:20.884501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:20.885226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:20.885732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:20.886152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:20.922975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:20.923465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:20.923900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:20.924351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lazy-loading 'fault' on Instance uuid 188d8367-b176-4812-aeba-ac40e3ce5b7f {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:43:20.974284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:20.982725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f58b3390-b339-4fbb-b010-79c9a9b33d10 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 200 len: 1338 microversion: 2.1 time: 0.111070 Oct 28 13:43:20.984400 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3269/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:20 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:22.011925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:22.013085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 188d8367-b176-4812-aeba-ac40e3ce5b7f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:22.019834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:22.020477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:22.021002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:22.021784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:22.022319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:22.022843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:22.040621 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] HTTP exception thrown: Instance 188d8367-b176-4812-aeba-ac40e3ce5b7f could not be found. Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Request method failure captured: Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f HTTP/1.1 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9vjA_XuGwlykY-7PVOsAIGcKE8a6uW9hNL1lMi3OMmOaFt9G_i239VtToBpI3S78TlWW3p2rDj8CvBv8Kuy5IwewJAhhAGSnuV6ubKasCdw2IBTz_XBwmK-L6AMfwshJcGW_1tH8JCFYKbSTyB9pWtEFXMib3IZ3jCBbwAsqexMDXw Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e39d46af774948ebb07a73d9949d68a2 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e39d46af774948ebb07a73d9949d68a2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e39d46af774948ebb07a73d9949d68a2 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestNetworkBasicOps-2120348570-project Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6108739803264e209694b88240067369 Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestNetworkBasicOps-2120348570-project Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 188d8367-b176-4812-aeba-ac40e3ce5b7f could not be found. Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '188d8367-b176-4812-aeba-ac40e3ce5b7f'} Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188d8367-b176-4812-aeba-ac40e3ce5b7f could not be found. Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188d8367-b176-4812-aeba-ac40e3ce5b7f could not be found. Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:43:22.042578 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188d8367-b176-4812-aeba-ac40e3ce5b7f could not be found. Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:43:22.047871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Returning 404 to user: Instance 188d8367-b176-4812-aeba-ac40e3ce5b7f could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:43:22.049134 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b938e54c-8765-475b-a21f-9a3af37b1453 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f" status: 404 len: 111 microversion: 2.1 time: 0.046692 Oct 28 13:43:22.049715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3177/6446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:22 2022] GET /compute/v2.1/servers/188d8367-b176-4812-aeba-ac40e3ce5b7f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:43:22.672255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3dfca99-4c94-4c8f-9b2c-6ed7d97ebf9a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '.version_select at 0x7f27b8505f70>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:22.678790 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f3dfca99-4c94-4c8f-9b2c-6ed7d97ebf9a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [3c257920-cedb-449a-8120-c1bf2d78bda3] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 13:43:23.688491 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [None req-f3dfca99-4c94-4c8f-9b2c-6ed7d97ebf9a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [3c257920-cedb-449a-8120-c1bf2d78bda3] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43792. Oct 28 13:43:23.785456 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3dfca99-4c94-4c8f-9b2c-6ed7d97ebf9a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1478976533" status: 202 len: 0 microversion: 2.1 time: 1.117429 Oct 28 13:43:23.794435 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3270/6447] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Oct 28 13:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1478976533 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:43:26.438080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:26.439233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:26.445613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c308cb2d-a0d8-4f60-a475-5af7b3c754cd req-9439cd1d-b699-4c18-bd21-fee49ecca29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75280777-757f-4944-8fea-ee74b7657c9e", "tag": "2beebb88-c099-4e9f-93ad-cccc0277a3ae"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:26.447461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:26.453198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:26.453667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:26.454420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:26.454920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:26.455357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:26.463751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c308cb2d-a0d8-4f60-a475-5af7b3c754cd req-9439cd1d-b699-4c18-bd21-fee49ecca29d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:26.465892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c308cb2d-a0d8-4f60-a475-5af7b3c754cd req-9439cd1d-b699-4c18-bd21-fee49ecca29d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:26.467428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c308cb2d-a0d8-4f60-a475-5af7b3c754cd req-9439cd1d-b699-4c18-bd21-fee49ecca29d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:26.492694 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c308cb2d-a0d8-4f60-a475-5af7b3c754cd req-9439cd1d-b699-4c18-bd21-fee49ecca29d service nova] Creating event network-changed:2beebb88-c099-4e9f-93ad-cccc0277a3ae for instance 75280777-757f-4944-8fea-ee74b7657c9e on n-h1-862876-2 Oct 28 13:43:26.510994 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c308cb2d-a0d8-4f60-a475-5af7b3c754cd req-9439cd1d-b699-4c18-bd21-fee49ecca29d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068936 Oct 28 13:43:26.511924 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3271/6448] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:43:26.524648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:43:26.960302 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3405d3f-e1aa-4e83-849d-ba29f370c17f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "DELETE /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 204 len: 0 microversion: 2.1 time: 0.531772 Oct 28 13:43:26.963144 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3178/6449] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:43:26 2022] DELETE /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:43:26.972221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:26.973035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:26.994428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:26.994428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:26.994428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:26.994428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:26.994428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:26.994428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:27.148140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:27.159242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-342d193b-5faf-4c7d-8f16-abd7ca3a9dfd tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1672 microversion: 2.1 time: 0.191974 Oct 28 13:43:27.160749 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3272/6450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:26 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:28.184199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:28.184990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:28.192737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:28.193311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:28.193882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:28.195264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:28.195957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:28.196588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:28.438928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:28.448418 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d161330f-834f-42a2-ac13-26dcdca734b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1672 microversion: 2.1 time: 0.269309 Oct 28 13:43:28.448995 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3179/6451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:28 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:29.152565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-682a8a04-8a84-41e7-a550-ba1b4de57d10 req-2be42eea-cb12-4d78-bd5e-2d24af44f2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75280777-757f-4944-8fea-ee74b7657c9e", "name": "network-vif-deleted", "tag": "2beebb88-c099-4e9f-93ad-cccc0277a3ae"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:29.175236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-682a8a04-8a84-41e7-a550-ba1b4de57d10 req-2be42eea-cb12-4d78-bd5e-2d24af44f2f1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:29.176134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-682a8a04-8a84-41e7-a550-ba1b4de57d10 req-2be42eea-cb12-4d78-bd5e-2d24af44f2f1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:29.176792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-682a8a04-8a84-41e7-a550-ba1b4de57d10 req-2be42eea-cb12-4d78-bd5e-2d24af44f2f1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:29.190300 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-682a8a04-8a84-41e7-a550-ba1b4de57d10 req-2be42eea-cb12-4d78-bd5e-2d24af44f2f1 service nova] Creating event network-vif-deleted:2beebb88-c099-4e9f-93ad-cccc0277a3ae for instance 75280777-757f-4944-8fea-ee74b7657c9e on n-h1-862876-2 Oct 28 13:43:29.198064 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-682a8a04-8a84-41e7-a550-ba1b4de57d10 req-2be42eea-cb12-4d78-bd5e-2d24af44f2f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049199 Oct 28 13:43:29.199034 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3273/6452] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:43:29.485493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:29.486715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:29.499959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:29.500828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:29.501452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:29.503871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:29.504336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:29.506370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:29.679115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:29.709145 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f1e6a902-f6b0-4249-992b-5200bba08f6d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 200 len: 1334 microversion: 2.1 time: 0.223637 Oct 28 13:43:29.731093 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3180/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:29 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 1334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:30.743349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:30.745122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 75280777-757f-4944-8fea-ee74b7657c9e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:30.767418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:30.767943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:30.768390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:30.769322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:30.770259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:30.770690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:30.785744 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] HTTP exception thrown: Instance 75280777-757f-4944-8fea-ee74b7657c9e could not be found. Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Request method failure captured: Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e HTTP/1.1 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9vjA_XuGwlykY-7PVOsAIGcKE8a6uW9hNL1lMi3OMmOaFt9G_i239VtToBpI3S78TlWW3p2rDj8CvBv8Kuy5IwewJAhhAGSnuV6ubKasCdw2IBTz_XBwmK-L6AMfwshJcGW_1tH8JCFYKbSTyB9pWtEFXMib3IZ3jCBbwAsqexMDXw Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: e39d46af774948ebb07a73d9949d68a2 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e39d46af774948ebb07a73d9949d68a2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: e39d46af774948ebb07a73d9949d68a2 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestNetworkBasicOps-2120348570-project Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 6108739803264e209694b88240067369 Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestNetworkBasicOps-2120348570-project Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 75280777-757f-4944-8fea-ee74b7657c9e could not be found. Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '75280777-757f-4944-8fea-ee74b7657c9e'} Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75280777-757f-4944-8fea-ee74b7657c9e could not be found. Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75280777-757f-4944-8fea-ee74b7657c9e could not be found. Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:43:30.787447 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75280777-757f-4944-8fea-ee74b7657c9e could not be found. Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Returning 404 to user: Instance 75280777-757f-4944-8fea-ee74b7657c9e could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5db4a415-c706-4414-96c6-50994b2b105c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e" status: 404 len: 111 microversion: 2.1 time: 0.050863 Oct 28 13:43:30.795426 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3274/6454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:30 2022] GET /compute/v2.1/servers/75280777-757f-4944-8fea-ee74b7657c9e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:43:31.058454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f9fc63d-206f-44aa-b78f-68813ec1008e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '.version_select at 0x7f27bdb05550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:31.185677 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f9fc63d-206f-44aa-b78f-68813ec1008e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1962554895" status: 202 len: 0 microversion: 2.1 time: 0.132414 Oct 28 13:43:31.186500 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3181/6455] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Oct 28 13:43:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1962554895 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:43:42.381560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-144846146", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:42.400094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:43:42.401694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:43:42.505249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:43:43.323036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:43:43.323584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:43:43.324243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:43:43.324776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:43:43.325298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:43:43.340711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:43.345255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:43.345255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:43.345255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:43.345898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:43.346516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:43.433262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Getting quotas for project b60e6feb125346279c2f12a83fb6d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:43:43.440139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Getting quotas for user 075282e6a29141dba0b97225ce770d5f and project b60e6feb125346279c2f12a83fb6d93c. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:43:43.463117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:43:43.467898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:43:43.646013 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d6e15257-21f5-42b8-8598-4ec73cf36245 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268293 Oct 28 13:43:43.657811 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3275/6456] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:43:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:43:43.659084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a15d9f71-39bb-447d-8063-2ebd464ad466 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:43.659981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a15d9f71-39bb-447d-8063-2ebd464ad466 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:43.664126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:43:43.672291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:43:44.073028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a15d9f71-39bb-447d-8063-2ebd464ad466 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:44.098599 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a15d9f71-39bb-447d-8063-2ebd464ad466 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1214 microversion: 2.1 time: 0.442785 Oct 28 13:43:44.101414 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3182/6457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:43 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1214 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:43:45.126892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-837db872-e6fb-425a-b74c-02b047f957a6 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:45.128500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-837db872-e6fb-425a-b74c-02b047f957a6 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:45.201161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-837db872-e6fb-425a-b74c-02b047f957a6 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:45.208940 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-837db872-e6fb-425a-b74c-02b047f957a6 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1214 microversion: 2.1 time: 0.086843 Oct 28 13:43:45.211000 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3276/6458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:45 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:46.239851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:46.241313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:46.254851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:46.254851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:46.254851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:46.254851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:46.254851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:46.255560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:46.412659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:46.436030 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4d41eba3-36b6-4e72-8689-a62c7b467796 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1218 microversion: 2.1 time: 0.207209 Oct 28 13:43:46.439487 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3183/6459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:46 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:47.462407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:47.463813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:47.482027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:47.482972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:47.484232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:47.485217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:47.490192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:47.491082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:47.764997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2ee4cae-3a81-4ca5-a15e-66bc404058f8 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'create', calling method: .version_select at 0x7f27b957f3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-360261052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0NFeTF/Oe03onn3/rJZepKMZvy3V7/Ra4exqpolA1I0hi7ZSxcdvFs1hZj2L2Kg1gHdDHb///YWFa7oUU2xk3lLgQM7k35IC+LBhqLsYnHAak9kfPonfMt2nuhmr/FcA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:47.816784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b2ee4cae-3a81-4ca5-a15e-66bc404058f8 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for project e39d46af774948ebb07a73d9949d68a2. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:43:47.836728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:47.850520 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d4f1ef8-35af-4290-adcf-07d0514ffaa9 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1274 microversion: 2.1 time: 0.392771 Oct 28 13:43:47.862458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-b2ee4cae-3a81-4ca5-a15e-66bc404058f8 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for user 6108739803264e209694b88240067369 and project e39d46af774948ebb07a73d9949d68a2. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:43:47.862739 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3277/6460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:47 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1274 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:47.957114 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b2ee4cae-3a81-4ca5-a15e-66bc404058f8 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.196178 Oct 28 13:43:47.963336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3184/6461] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:43:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:43:48.883035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:48.883650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:48.913741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:48.914267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:48.914709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:48.915455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:48.915911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:48.917993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:49.080825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:49.100313 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea4fad86-56d1-4223-b2b5-51a452aac496 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1272 microversion: 2.1 time: 0.214625 Oct 28 13:43:49.101381 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3278/6462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:48 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:50.136662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:50.137699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:50.153997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:50.154852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:50.155502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:50.157134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:50.157824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:50.158414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:50.561611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:50.571742 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d599a4bf-38dd-4814-a6e3-8dd010529bf4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1314 microversion: 2.1 time: 0.443749 Oct 28 13:43:50.572341 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3185/6463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:50 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:51.321422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-9205a48d-a24b-4b66-8f88-56aa73e87d35 req-2f05063d-d77e-4d2b-880b-c7fd7dbcde8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0dfb862-f662-466e-8f3e-50c317fa5ee2", "tag": "6bedeee0-dc7a-4de3-a012-3713ab2328c7"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:51.346416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9205a48d-a24b-4b66-8f88-56aa73e87d35 req-2f05063d-d77e-4d2b-880b-c7fd7dbcde8f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:51.347239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9205a48d-a24b-4b66-8f88-56aa73e87d35 req-2f05063d-d77e-4d2b-880b-c7fd7dbcde8f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:51.350622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-9205a48d-a24b-4b66-8f88-56aa73e87d35 req-2f05063d-d77e-4d2b-880b-c7fd7dbcde8f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:51.399231 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-9205a48d-a24b-4b66-8f88-56aa73e87d35 req-2f05063d-d77e-4d2b-880b-c7fd7dbcde8f service nova] Creating event network-changed:6bedeee0-dc7a-4de3-a012-3713ab2328c7 for instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 on n-h1-862876-2 Oct 28 13:43:51.420031 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-9205a48d-a24b-4b66-8f88-56aa73e87d35 req-2f05063d-d77e-4d2b-880b-c7fd7dbcde8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104938 Oct 28 13:43:51.421929 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3279/6464] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:43:51.598366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:51.599077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:51.608274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:51.609823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:51.610431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:51.611554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:51.612164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:51.613497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:51.896860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:51.909817 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a765692b-dbd0-4336-b5ed-3917efb358e3 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1314 microversion: 2.1 time: 0.315195 Oct 28 13:43:51.911894 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3186/6465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:51 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:52.351667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-357346042", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "2a79daee-6517-4aac-943a-598883499b38"}], "key_name": "tempest-TestNetworkBasicOps-360261052", "security_groups": [{"name": "tempest-secgroup-smoke-1607552643"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:52.543441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] validate_networks() for [('2a79daee-6517-4aac-943a-598883499b38', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:43:52.935474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:52.938942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:52.948367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:52.949267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:52.950568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:52.951604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:52.952432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:52.953664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:53.113517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:43:53.113934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:43:53.114759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:43:53.115582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:43:53.116134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:43:53.129833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:53.135978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:53.137894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:53.138838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:53.143835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:53.144978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:53.174801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for project e39d46af774948ebb07a73d9949d68a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:43:53.181739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Getting quotas for user 6108739803264e209694b88240067369 and project e39d46af774948ebb07a73d9949d68a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:43:53.208091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:43:53.210983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:43:53.322796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:53.339932 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc977d14-8744-423e-baf2-8b9eafcbeb2a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1314 microversion: 2.1 time: 0.408280 Oct 28 13:43:53.343817 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3187/6466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:52 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:53.383291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84108e1b-b0f2-4e2e-a84f-9eaf6b0e9ff3 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.035980 Oct 28 13:43:53.385503 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3280/6467] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:43:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:43:53.398716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80bbd24e-2f53-4222-bb5c-28daa211d07a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:53.400214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-80bbd24e-2f53-4222-bb5c-28daa211d07a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:53.486624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-80bbd24e-2f53-4222-bb5c-28daa211d07a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:53.494288 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-80bbd24e-2f53-4222-bb5c-28daa211d07a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1247 microversion: 2.1 time: 0.100945 Oct 28 13:43:53.495088 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3188/6468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:53 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1247 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:43:54.367343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:54.368013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:54.384331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:54.388861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:54.388861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:54.388861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:54.388861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:54.388861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:54.518300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:54.529677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:54.529677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:54.535404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:54.536344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:54.537286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:54.537900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:54.538991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:54.629472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:54.678248 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-841ea7c4-2c70-4752-996a-627348eba26d tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1251 microversion: 2.1 time: 0.157433 Oct 28 13:43:54.678248 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3189/6469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:54 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1251 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:43:54.678575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:54.693446 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-023f19f1-704d-468e-ba64-2afe919a27d4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1314 microversion: 2.1 time: 0.327155 Oct 28 13:43:54.693446 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3281/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:54 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:55.700797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:55.701424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:55.714878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:55.716528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:55.731111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:55.738300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:55.738795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:55.739344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:55.740058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:55.741739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:55.742670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:55.743165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:55.743597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:55.746822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:55.747301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:55.747733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:55.961310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:55.970992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74aa08b5-1ad8-41ea-a50c-7ae4bf95b94e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1299 microversion: 2.1 time: 0.274067 Oct 28 13:43:55.975963 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3190/6471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:55 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:56.272065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:56.278615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de525cd3-b726-4e76-8ac3-ad032016051d tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1314 microversion: 2.1 time: 0.569393 Oct 28 13:43:56.296441 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3282/6472] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:55 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:43:57.010668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:57.014271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:57.068220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:57.068859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:57.069317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:57.073564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:57.075360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:57.083654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:57.309050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:57.309561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:57.321585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:57.325083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:57.325759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:57.328574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:57.331093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:57.337823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:57.394500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:57.424204 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42c0bd3e-efe7-40ef-bd3f-2e80801b43ac tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1305 microversion: 2.1 time: 0.418719 Oct 28 13:43:57.449013 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3191/6473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:57 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1305 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:58.046141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:58.059566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b48f0de-3666-49ef-a858-aac1a15f33fa tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1314 microversion: 2.1 time: 0.757694 Oct 28 13:43:58.065656 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3283/6474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:57 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:58.454159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:58.455575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:58.474311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:58.474859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:58.476284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:58.477061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:58.478184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:58.478658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:58.492091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-92a0b37c-42dd-4051-ad47-0b839c634b55 req-60b5ed2b-ff12-4385-8793-9214f54588eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dfb862-f662-466e-8f3e-50c317fa5ee2", "name": "network-vif-plugged", "status": "completed", "tag": "6bedeee0-dc7a-4de3-a012-3713ab2328c7"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:43:58.515511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-92a0b37c-42dd-4051-ad47-0b839c634b55 req-60b5ed2b-ff12-4385-8793-9214f54588eb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:58.515988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-92a0b37c-42dd-4051-ad47-0b839c634b55 req-60b5ed2b-ff12-4385-8793-9214f54588eb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:58.518329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-92a0b37c-42dd-4051-ad47-0b839c634b55 req-60b5ed2b-ff12-4385-8793-9214f54588eb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:58.552487 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-92a0b37c-42dd-4051-ad47-0b839c634b55 req-60b5ed2b-ff12-4385-8793-9214f54588eb service nova] Creating event network-vif-plugged:6bedeee0-dc7a-4de3-a012-3713ab2328c7 for instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 on n-h1-862876-2 Oct 28 13:43:58.560349 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-92a0b37c-42dd-4051-ad47-0b839c634b55 req-60b5ed2b-ff12-4385-8793-9214f54588eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072312 Oct 28 13:43:58.563954 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3284/6475] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:43:58.799159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:58.811642 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bc9caa99-2dc5-4e5a-9862-2d31d0381b13 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.362158 Oct 28 13:43:58.820382 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3192/6476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:58 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:43:59.087704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:59.088713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:59.101038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:59.103069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:59.104672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:59.105449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:59.106108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:59.108330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:59.400588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:43:59.412146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a0afcaa-5cf9-46dc-b4af-ce00a7affc4b tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1314 microversion: 2.1 time: 0.329657 Oct 28 13:43:59.414207 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3285/6477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:59 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:43:59.839370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:43:59.840603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:43:59.853544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:59.854425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:59.855940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:43:59.857413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:43:59.859110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:43:59.862891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:00.142589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:00.173665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e96159f-22cb-4b23-a654-f08e0a1624b2 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.337523 Oct 28 13:44:00.180140 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3193/6478] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:43:59 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:44:00.441429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:00.442080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:00.454815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:00.455289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:00.455730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:00.456450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:00.459052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:00.462675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:00.762020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:00.787251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f21ab4d-4948-42d1-9a66-67580d47a37a tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1464 microversion: 2.1 time: 0.350879 Oct 28 13:44:00.788414 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3286/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:00 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:00.855175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:00.855175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:00.874962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:00.875713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:00.876978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:00.878227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:00.879457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:00.881440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:00.961011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:44:01.149466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-68d55dd7-d456-4c46-aec6-433b8ca4ddd1 req-69077ab8-3531-4a5a-bd04-18164f341d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d624f2b-6cd9-4064-8323-8f4a4eabb73f", "tag": "d13f8597-e37e-4690-b82c-97ec14204bcf"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:01.163393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68d55dd7-d456-4c46-aec6-433b8ca4ddd1 req-69077ab8-3531-4a5a-bd04-18164f341d97 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:01.164240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68d55dd7-d456-4c46-aec6-433b8ca4ddd1 req-69077ab8-3531-4a5a-bd04-18164f341d97 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:01.164751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68d55dd7-d456-4c46-aec6-433b8ca4ddd1 req-69077ab8-3531-4a5a-bd04-18164f341d97 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:01.179922 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-68d55dd7-d456-4c46-aec6-433b8ca4ddd1 req-69077ab8-3531-4a5a-bd04-18164f341d97 service nova] Creating event network-changed:d13f8597-e37e-4690-b82c-97ec14204bcf for instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f on n-h2-862876-2 Oct 28 13:44:01.192656 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-68d55dd7-d456-4c46-aec6-433b8ca4ddd1 req-69077ab8-3531-4a5a-bd04-18164f341d97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327161 Oct 28 13:44:01.201474 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3287/6480] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:44:01.211587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:01.212644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:01.225127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:01.225769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:01.226351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:01.227485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:01.229493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:01.230345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:01.419163 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6f4e589-10aa-47d4-8226-dd6aab8a0787 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 204 len: 0 microversion: 2.1 time: 0.568911 Oct 28 13:44:01.425652 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3194/6481] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:44:00 2022] DELETE /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:44:01.431885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:01.432622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:01.443004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:01.443277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:01.443900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:01.445439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:01.446339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:01.449152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:01.607276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:01.622702 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-da23b7af-a89c-43b7-8693-194aa33e3009 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.418597 Oct 28 13:44:01.624251 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3288/6482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:01 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:01.690252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:01.704570 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a5061ba-9abb-49a4-9fb5-8787737baef4 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1470 microversion: 2.1 time: 0.279061 Oct 28 13:44:01.705455 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3195/6483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:01 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:44:02.669066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:02.673451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:02.696082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:02.697161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:02.697774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:02.698676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:02.701986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:02.702473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:02.734477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:02.735343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:02.752214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:02.752731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:02.753182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:02.756039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:02.756544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:02.757007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:03.048481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:03.061881 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76a55205-4b2f-4e45-a309-94da9a0d9032 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1470 microversion: 2.1 time: 0.327929 Oct 28 13:44:03.062709 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3196/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:02 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1470 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:03.107334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:03.132300 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-caab2fb6-7e7d-41c5-8b36-31548cedc82c tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.484071 Oct 28 13:44:03.133802 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3289/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:02 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:44:03.945340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e24a13a8-fccd-45d8-bdba-46177ae19a69 req-c8392f34-8ebf-4929-9ed9-17d892f40249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dfb862-f662-466e-8f3e-50c317fa5ee2", "name": "network-vif-deleted", "tag": "6bedeee0-dc7a-4de3-a012-3713ab2328c7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:03.959077 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 13:44:03.960865 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:44:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 28 13:44:03.965871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:03.976029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e24a13a8-fccd-45d8-bdba-46177ae19a69 req-c8392f34-8ebf-4929-9ed9-17d892f40249 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:03.976776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e24a13a8-fccd-45d8-bdba-46177ae19a69 req-c8392f34-8ebf-4929-9ed9-17d892f40249 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:03.977417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e24a13a8-fccd-45d8-bdba-46177ae19a69 req-c8392f34-8ebf-4929-9ed9-17d892f40249 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:03.993561 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e24a13a8-fccd-45d8-bdba-46177ae19a69 req-c8392f34-8ebf-4929-9ed9-17d892f40249 service nova] Creating event network-vif-deleted:6bedeee0-dc7a-4de3-a012-3713ab2328c7 for instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 on n-h1-862876-2 Oct 28 13:44:04.000709 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e24a13a8-fccd-45d8-bdba-46177ae19a69 req-c8392f34-8ebf-4929-9ed9-17d892f40249 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061885 Oct 28 13:44:04.003271 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3197/6486] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:04.088511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:04.089971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:04.096624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:04.097697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=14 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:04.102889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:04.104315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:04.107735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:04.109366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:04.111379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:04.112064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:04.158375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:04.159179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:04.173430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:04.173935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:04.174636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:04.177140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:04.177801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:04.182723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:04.295735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075282e6a29141dba0b97225ce770d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e6feb125346279c2f12a83fb6d93c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:04.308409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4955d735-e4da-4245-b9fc-30177cf8df14 tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 200 len: 1428 microversion: 2.1 time: 0.226660 Oct 28 13:44:04.325093 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3290/6487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:04 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 1428 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:04.467639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:04.478236 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a629d109-15b2-482c-b772-430e48079d8e tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.324346 Oct 28 13:44:04.478884 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3198/6488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:04 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:05.337604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:05.338971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] [instance: b0dfb862-f662-466e-8f3e-50c317fa5ee2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:05.347681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:05.348518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:05.349524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:05.350468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:05.351226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:05.351875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:05.371832 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] HTTP exception thrown: Instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 could not be found. Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Request method failure captured: Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 HTTP/1.1 Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9yK-VDuITyeC2QzsYGpMrGrarQkOIrHUa8cJE-6YnujbjttIG2g0YOrQbxb-4bR3wM8iIJ90Z1C1sUrXqgsFhjTuHHo0XKt1Qfp69oy64EYzKzfMaDzlJSV_r-W9HaiLLeXgzeT4LoTlh_OV53H02ShFia4_PZgsTUVt-qGoE1CpaA Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b60e6feb125346279c2f12a83fb6d93c Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-VolumesNegativeTest-1597808841 Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b60e6feb125346279c2f12a83fb6d93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b60e6feb125346279c2f12a83fb6d93c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b60e6feb125346279c2f12a83fb6d93c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b60e6feb125346279c2f12a83fb6d93c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-VolumesNegativeTest-1597808841 Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b60e6feb125346279c2f12a83fb6d93c Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-VolumesNegativeTest-1597808841 Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-VolumesNegativeTest-1597808841-project Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 075282e6a29141dba0b97225ce770d5f Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-VolumesNegativeTest-1597808841-project Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 could not be found. Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b0dfb862-f662-466e-8f3e-50c317fa5ee2'} Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 could not be found. Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 could not be found. Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:44:05.375681 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 could not be found. Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] Returning 404 to user: Instance b0dfb862-f662-466e-8f3e-50c317fa5ee2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-793e4415-27c0-4af2-8b1d-fd19316e94eb tempest-VolumesNegativeTest-1597808841 tempest-VolumesNegativeTest-1597808841-project] 10.222.0.25 "GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2" status: 404 len: 111 microversion: 2.1 time: 0.051078 Oct 28 13:44:05.394445 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3291/6489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:05 2022] GET /compute/v2.1/servers/b0dfb862-f662-466e-8f3e-50c317fa5ee2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:44:05.504536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:05.505988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:05.514391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:05.515798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:05.516446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:05.517308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:05.517931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:05.518552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:06.151030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:06.162037 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4022487e-ac7a-425a-8b1a-62cae2073925 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.662549 Oct 28 13:44:06.174982 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3199/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:05 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:07.186188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:07.187506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:07.193169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2cebb50a-3d10-40e4-9ae2-3ac051059308 req-5ca09a2d-f59d-41d1-a285-3c62523bb708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d624f2b-6cd9-4064-8323-8f4a4eabb73f", "name": "network-vif-plugged", "status": "completed", "tag": "d13f8597-e37e-4690-b82c-97ec14204bcf"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:07.195571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:07.196465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:07.197245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:07.198122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:07.198758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:07.199366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:07.213544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2cebb50a-3d10-40e4-9ae2-3ac051059308 req-5ca09a2d-f59d-41d1-a285-3c62523bb708 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:07.214244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2cebb50a-3d10-40e4-9ae2-3ac051059308 req-5ca09a2d-f59d-41d1-a285-3c62523bb708 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:07.214906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2cebb50a-3d10-40e4-9ae2-3ac051059308 req-5ca09a2d-f59d-41d1-a285-3c62523bb708 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:07.232636 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2cebb50a-3d10-40e4-9ae2-3ac051059308 req-5ca09a2d-f59d-41d1-a285-3c62523bb708 service nova] Creating event network-vif-plugged:d13f8597-e37e-4690-b82c-97ec14204bcf for instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f on n-h2-862876-2 Oct 28 13:44:07.238638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2cebb50a-3d10-40e4-9ae2-3ac051059308 req-5ca09a2d-f59d-41d1-a285-3c62523bb708 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323416 Oct 28 13:44:07.248040 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3292/6491] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:07.269943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:07.728799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:07.749314 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-427eebc4-bd3a-4df5-9a57-85c6b9e506b4 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.565524 Oct 28 13:44:07.750418 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3200/6492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:07 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:44:08.777300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:08.779793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:08.791143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:08.792034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:08.792716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:08.796273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:08.797073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:08.801090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:09.203922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:09.214698 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-26d6b333-621d-4cb0-9ed2-29f959bea331 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1373 microversion: 2.1 time: 0.442722 Oct 28 13:44:09.215862 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3293/6493] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:08 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1373 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:10.248226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:10.248856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:10.274278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:10.274278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:10.274278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:10.279804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:10.280158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:10.280661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:10.480016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:10.497424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ea2b06e-f726-4b3d-a4cb-99cf96a5123a tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1545 microversion: 2.1 time: 0.263450 Oct 28 13:44:10.500671 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3201/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:10 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1545 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:10.523287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:10.526222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:10.556092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:10.556593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:10.557208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:10.558422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:10.559250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:10.559854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:10.967466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:10.975747 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2ecf87c-07ee-4f25-9fc1-87a26b35f491 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1545 microversion: 2.1 time: 0.456613 Oct 28 13:44:10.982912 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3294/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:10 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1545 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:12.185288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-33d4e25f-a368-4236-9353-77e681783f3c tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2147431315", "availability_zone": "foo_zone"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:12.191952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.aggregate [None req-33d4e25f-a368-4236-9353-77e681783f3c tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Generated uuid f1a805ab-b889-486d-8d7d-5340a894e12f for aggregate {{(pid=127794) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 13:44:12.362130 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-33d4e25f-a368-4236-9353-77e681783f3c tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.308625 Oct 28 13:44:12.364785 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3202/6496] 10.222.0.25 () {60 vars in 1164 bytes} [Fri Oct 28 13:44:12 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:12.377142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3478391-9ac8-4fba-8ea3-bacb67f91c73 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:12.477006 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3478391-9ac8-4fba-8ea3-bacb67f91c73 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.103973 Oct 28 13:44:12.485762 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3295/6497] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:44:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:12.491383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:12.495692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:12.496398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:12.502500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:12.505631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:12.506833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:12.507503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:12.562818 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-15b2d21c-2b8d-4238-aa55-9de3f42f1d1a tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.076565 Oct 28 13:44:12.564183 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3203/6498] 10.222.0.25 () {58 vars in 1176 bytes} [Fri Oct 28 13:44:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:12.576503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf7a6892-1e1b-4792-b170-3b7bffb9def3 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:12.592203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf7a6892-1e1b-4792-b170-3b7bffb9def3 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.020310 Oct 28 13:44:12.595370 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3296/6499] 10.222.0.25 () {58 vars in 1143 bytes} [Fri Oct 28 13:44:12 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:12.617971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-932b8ac7-9b02-47b4-991e-3ee200b68fd5 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862876-2"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:12.632227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-932b8ac7-9b02-47b4-991e-3ee200b68fd5 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:12.633148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-932b8ac7-9b02-47b4-991e-3ee200b68fd5 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:12.633915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-932b8ac7-9b02-47b4-991e-3ee200b68fd5 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:13.257853 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-932b8ac7-9b02-47b4-991e-3ee200b68fd5 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.654241 Oct 28 13:44:13.259381 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3204/6500] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:44:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:44:13.272183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ffee973-4153-441a-847a-37caa8219e73 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:13.276072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:13.284791 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ffee973-4153-441a-847a-37caa8219e73 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.017022 Oct 28 13:44:13.292815 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3297/6501] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:44:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:13.299428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bfa4e2e-17ca-4617-a76a-097c27e329d4 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1062058656", "availability_zone": "foo_zone"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:13.442698 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bfa4e2e-17ca-4617-a76a-097c27e329d4 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.148423 Oct 28 13:44:13.443634 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3205/6502] 10.222.0.25 () {60 vars in 1173 bytes} [Fri Oct 28 13:44:13 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:13.458569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fab5225b-67b7-4532-bfad-0af181ff17b9 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:13.570250 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fab5225b-67b7-4532-bfad-0af181ff17b9 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.118270 Oct 28 13:44:13.570978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3298/6503] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:44:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:44:13.585327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e8c173b6-933a-4905-81b7-7b332dc27ba3 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:13.611648 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e8c173b6-933a-4905-81b7-7b332dc27ba3 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.028432 Oct 28 13:44:13.612286 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3206/6504] 10.222.0.25 () {58 vars in 1152 bytes} [Fri Oct 28 13:44:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:13.637249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6a57337-5f9e-43ea-b2b1-fda0fb2f2b66 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862876-2"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:13.660051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6a57337-5f9e-43ea-b2b1-fda0fb2f2b66 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:13.676445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6a57337-5f9e-43ea-b2b1-fda0fb2f2b66 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:13.676445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6a57337-5f9e-43ea-b2b1-fda0fb2f2b66 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:13.676445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=87 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:14.081612 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6a57337-5f9e-43ea-b2b1-fda0fb2f2b66 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.449618 Oct 28 13:44:14.084656 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3299/6505] 10.222.0.25 () {60 vars in 1194 bytes} [Fri Oct 28 13:44:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:14.098211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ff28655-a920-4c13-b59a-ad808cda4125 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:14.131985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:14.231707 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ff28655-a920-4c13-b59a-ad808cda4125 tempest-TestAggregatesBasicOps-1590578155 tempest-TestAggregatesBasicOps-1590578155-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.138466 Oct 28 13:44:14.235006 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3207/6506] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Oct 28 13:44:14 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 13:44:14.792128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6b935eed-36ef-4cf8-8b6a-92797fd33abe req-bbc9defd-d356-4ef8-ae56-e4b2a6c7310e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d624f2b-6cd9-4064-8323-8f4a4eabb73f", "tag": "d13f8597-e37e-4690-b82c-97ec14204bcf"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:14.813014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6b935eed-36ef-4cf8-8b6a-92797fd33abe req-bbc9defd-d356-4ef8-ae56-e4b2a6c7310e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:14.815394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6b935eed-36ef-4cf8-8b6a-92797fd33abe req-bbc9defd-d356-4ef8-ae56-e4b2a6c7310e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:14.817749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6b935eed-36ef-4cf8-8b6a-92797fd33abe req-bbc9defd-d356-4ef8-ae56-e4b2a6c7310e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:14.848718 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6b935eed-36ef-4cf8-8b6a-92797fd33abe req-bbc9defd-d356-4ef8-ae56-e4b2a6c7310e service nova] Creating event network-changed:d13f8597-e37e-4690-b82c-97ec14204bcf for instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f on n-h2-862876-2 Oct 28 13:44:14.870384 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6b935eed-36ef-4cf8-8b6a-92797fd33abe req-bbc9defd-d356-4ef8-ae56-e4b2a6c7310e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085306 Oct 28 13:44:14.873867 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3300/6507] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:33.511953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:33.514121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:33.519194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:33.521711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:33.544559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:33.545075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:33.546597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:33.546832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:33.547304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:33.547741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:33.602498 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-641d9b98-70b3-4bb9-83e6-ee7abad3b990 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f/action" status: 200 len: 24532 microversion: 2.1 time: 0.092209 Oct 28 13:44:33.612916 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3208/6508] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:44:33 2022] POST /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f/action => generated 24532 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:44:34.223849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:34.224619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=5 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:34.354415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1029564770", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "64acc83e-f8c0-4acb-8feb-ab5f2ba5a836"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:34.417765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] validate_networks() for [('64acc83e-f8c0-4acb-8feb-ab5f2ba5a836', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:44:34.934073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:44:34.934643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:44:34.935159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:44:34.935693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:44:34.936117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:44:34.945159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:34.945679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:34.946320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:34.947286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:34.947747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:34.948176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:34.965898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Getting quotas for project 804f0aee616a4deca24339c858d7a85f. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:44:34.972178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Getting quotas for user a0f915ccad61434caf6a1da2b7300e7c and project 804f0aee616a4deca24339c858d7a85f. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:44:34.985327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:44:34.987951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:44:35.112681 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5a308a81-3ef3-4918-aca7-79d969c95fba tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894347 Oct 28 13:44:35.113451 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3301/6509] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:44:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:44:35.126464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f6b5491-002c-4901-b09c-7d8826dbc5de tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:35.127799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f6b5491-002c-4901-b09c-7d8826dbc5de tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:35.224733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1f6b5491-002c-4901-b09c-7d8826dbc5de tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:35.235076 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f6b5491-002c-4901-b09c-7d8826dbc5de tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1215 microversion: 2.1 time: 0.113782 Oct 28 13:44:35.236948 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3209/6510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:35 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:36.260690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:36.261303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:36.270420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:36.271047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:36.271503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:36.272209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:36.272714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:36.273087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:36.337678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:36.346005 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-afc269b7-2419-4bb9-9f0f-2aa4015fad5f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1219 microversion: 2.1 time: 0.089243 Oct 28 13:44:36.346597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3302/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:36 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:37.369664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:37.370563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:37.381393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:37.382309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:37.384027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:37.385177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:37.385888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:37.386577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:37.481665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:37.491801 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96a7454c-6c58-4056-b520-8f7f5b6abdfb tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1267 microversion: 2.1 time: 0.126191 Oct 28 13:44:37.492675 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3210/6512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:37 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:38.516169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:38.517011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:38.525960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:38.526714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:38.527218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:38.529172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:38.529172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:38.529172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:38.602624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:38.611258 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea8104e8-a520-435b-9be3-ee0a9def54d3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1273 microversion: 2.1 time: 0.099965 Oct 28 13:44:38.611860 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3303/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:38 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:39.635346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:39.635957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:39.642932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:39.643433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:39.643871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:39.644563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:39.645010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:39.645432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:39.912930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:39.920617 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec38da62-b26d-4e63-a453-ba277233a74b tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.289565 Oct 28 13:44:39.921869 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3211/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:39 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:40.081187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:40.083566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:40.090467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:40.090997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:40.091432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:40.092120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:40.092577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:40.093529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:40.145682 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b604c274-fd4e-421e-b34d-20281504c101 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "POST /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f/action" status: 200 len: 32597 microversion: 2.1 time: 0.068083 Oct 28 13:44:40.146399 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3304/6515] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:44:40 2022] POST /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f/action => generated 32597 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 13:44:40.681309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e46bc0c4-ac16-4b04-a5c2-72977a6a17c7 req-27f0b07c-81cf-43fc-984d-61267dbbab06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f156abc0-6a8b-4119-8757-976c3c2ae1e0", "tag": "fd1e3444-3711-4b7d-9a96-7a2a3aa5ba2c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:40.692839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e46bc0c4-ac16-4b04-a5c2-72977a6a17c7 req-27f0b07c-81cf-43fc-984d-61267dbbab06 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:40.693328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e46bc0c4-ac16-4b04-a5c2-72977a6a17c7 req-27f0b07c-81cf-43fc-984d-61267dbbab06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:40.693847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e46bc0c4-ac16-4b04-a5c2-72977a6a17c7 req-27f0b07c-81cf-43fc-984d-61267dbbab06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:40.709890 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e46bc0c4-ac16-4b04-a5c2-72977a6a17c7 req-27f0b07c-81cf-43fc-984d-61267dbbab06 service nova] Creating event network-changed:fd1e3444-3711-4b7d-9a96-7a2a3aa5ba2c for instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 on n-h1-862876-2 Oct 28 13:44:40.715343 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e46bc0c4-ac16-4b04-a5c2-72977a6a17c7 req-27f0b07c-81cf-43fc-984d-61267dbbab06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037513 Oct 28 13:44:40.716072 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3212/6516] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:40.945483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:40.946682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:40.955140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:40.956036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:40.956705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:40.957647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:40.958350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:40.959053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:41.124111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:41.132545 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef79c569-2b2c-4536-9a80-6e88f36b90af tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.191731 Oct 28 13:44:41.133132 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3305/6517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:40 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:42.074119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:42.077752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:42.102899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:42.105200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:42.105200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:42.105200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:42.111156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:42.111924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:42.160724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:42.161510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:42.171417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:44:42.198295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:42.198828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:42.199280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:42.200004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:42.205705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:42.206311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:42.412332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:42.421363 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-abf9743a-572a-4cc8-bf8f-935ebfa22e8e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.267991 Oct 28 13:44:42.423910 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3306/6518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:42 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:42.618271 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9dd304e6-8335-4921-a3e1-abb2e966dab5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 204 len: 0 microversion: 2.1 time: 0.553963 Oct 28 13:44:42.619781 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3213/6519] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:44:42 2022] DELETE /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:44:42.627906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:42.629476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:42.636746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:42.637502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:42.638110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:42.639151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:42.640452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:42.641047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:42.730848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-61b7ad7b-4883-4cc4-808a-55940a33e029 req-22740751-52e5-4a30-85fd-03da1bff485e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d624f2b-6cd9-4064-8323-8f4a4eabb73f", "tag": "d13f8597-e37e-4690-b82c-97ec14204bcf"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:42.742095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-61b7ad7b-4883-4cc4-808a-55940a33e029 req-22740751-52e5-4a30-85fd-03da1bff485e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:42.742721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-61b7ad7b-4883-4cc4-808a-55940a33e029 req-22740751-52e5-4a30-85fd-03da1bff485e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:42.743290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-61b7ad7b-4883-4cc4-808a-55940a33e029 req-22740751-52e5-4a30-85fd-03da1bff485e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:42.762522 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-61b7ad7b-4883-4cc4-808a-55940a33e029 req-22740751-52e5-4a30-85fd-03da1bff485e service nova] Creating event network-changed:d13f8597-e37e-4690-b82c-97ec14204bcf for instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f on n-h2-862876-2 Oct 28 13:44:42.768754 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-61b7ad7b-4883-4cc4-808a-55940a33e029 req-22740751-52e5-4a30-85fd-03da1bff485e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042315 Oct 28 13:44:42.769458 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3214/6520] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:44:42.805966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:42.815295 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b792118-d516-42a6-8f0c-6605455908b5 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1669 microversion: 2.1 time: 0.191629 Oct 28 13:44:42.816830 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3307/6521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:42 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:43.446820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:43.447537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:43.453876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:43.454368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:43.454829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:43.455532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:43.455987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:43.456410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:43.641672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:43.650897 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2860d9b9-c06a-4401-8a1b-c9a7db0f7ce3 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.208952 Oct 28 13:44:43.651473 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3215/6522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:43 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:43.840744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:43.841726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:43.848954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:43.849743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:43.850411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:43.851242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:43.851775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:43.852263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:44.502192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:44.511055 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-14d711f2-bb20-4997-ac9f-90d0ca66096f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1669 microversion: 2.1 time: 0.674491 Oct 28 13:44:44.513055 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3308/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:43 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1669 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:44.677091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:44.677091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:44.689218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:44.689865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:44.690405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:44.691353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:44.699471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:44.701141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:44.945006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:44.954139 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-939e12e5-4fb6-423d-b7c1-43d9c504ff00 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.281932 Oct 28 13:44:44.954733 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3216/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:44 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:45.159502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-aabd9092-883b-4f35-b58d-4e43d15022aa req-e5af8bae-1d73-48d9-a049-8e2cc4f081b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d624f2b-6cd9-4064-8323-8f4a4eabb73f", "name": "network-vif-deleted", "tag": "d13f8597-e37e-4690-b82c-97ec14204bcf"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:45.171918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:45.173160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:45.181315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-aabd9092-883b-4f35-b58d-4e43d15022aa req-e5af8bae-1d73-48d9-a049-8e2cc4f081b9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:45.182382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-aabd9092-883b-4f35-b58d-4e43d15022aa req-e5af8bae-1d73-48d9-a049-8e2cc4f081b9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:45.182940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-aabd9092-883b-4f35-b58d-4e43d15022aa req-e5af8bae-1d73-48d9-a049-8e2cc4f081b9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:45.194824 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-aabd9092-883b-4f35-b58d-4e43d15022aa req-e5af8bae-1d73-48d9-a049-8e2cc4f081b9 service nova] Creating event network-vif-deleted:d13f8597-e37e-4690-b82c-97ec14204bcf for instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f on n-h2-862876-2 Oct 28 13:44:45.199954 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-aabd9092-883b-4f35-b58d-4e43d15022aa req-e5af8bae-1d73-48d9-a049-8e2cc4f081b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045219 Oct 28 13:44:45.200648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3309/6525] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:45.552656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:45.553294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:45.555419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:45.563700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:45.564559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:45.565267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:45.566253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:45.567333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:45.567976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:45.617724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:45.618294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:45.618828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:45.619362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lazy-loading 'fault' on Instance uuid 7d624f2b-6cd9-4064-8323-8f4a4eabb73f {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:44:45.673038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6108739803264e209694b88240067369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39d46af774948ebb07a73d9949d68a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:45.681153 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1715ecea-38be-4deb-9c11-d0a98b875241 tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 200 len: 1337 microversion: 2.1 time: 0.143393 Oct 28 13:44:45.681862 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3217/6526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:45 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 1337 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:45.978283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:45.979017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:45.986707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:45.987473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:45.988087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:45.988945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:45.989558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:45.990140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:46.278566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:46.290868 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d898168-cdc9-4c31-b763-85109a4eba07 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.316791 Oct 28 13:44:46.294956 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3310/6527] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:45 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:46.704642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:46.705226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] [instance: 7d624f2b-6cd9-4064-8323-8f4a4eabb73f] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:46.712420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:46.713135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:46.713576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:46.714282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:46.714790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:46.715200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:46.729850 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] HTTP exception thrown: Instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f could not be found. Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Request method failure captured: Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f HTTP/1.1 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9vjA_XuGwlykY-7PVOsAIGcKE8a6uW9hNL1lMi3OMmOaFt9G_i239VtToBpI3S78TlWW3p2rDj8CvBv8Kuy5IwewJAhhAGSnuV6ubKasCdw2IBTz_XBwmK-L6AMfwshJcGW_1tH8JCFYKbSTyB9pWtEFXMib3IZ3jCBbwAsqexMDXw Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e39d46af774948ebb07a73d9949d68a2 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e39d46af774948ebb07a73d9949d68a2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e39d46af774948ebb07a73d9949d68a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e39d46af774948ebb07a73d9949d68a2 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestNetworkBasicOps-2120348570 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestNetworkBasicOps-2120348570-project Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6108739803264e209694b88240067369 Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestNetworkBasicOps-2120348570-project Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f could not be found. Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7d624f2b-6cd9-4064-8323-8f4a4eabb73f'} Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f could not be found. Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f could not be found. Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:44:46.731570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f could not be found. Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Returning 404 to user: Instance 7d624f2b-6cd9-4064-8323-8f4a4eabb73f could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bec45571-27a3-4151-8900-5613a613b76b tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f" status: 404 len: 111 microversion: 2.1 time: 0.032458 Oct 28 13:44:46.737146 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3218/6528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:46 2022] GET /compute/v2.1/servers/7d624f2b-6cd9-4064-8323-8f4a4eabb73f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:44:47.121286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ce07673-dc12-4942-b28e-54303b163f1f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] Calling method '.version_select at 0x7f27b844c940>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:47.224623 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ce07673-dc12-4942-b28e-54303b163f1f tempest-TestNetworkBasicOps-2120348570 tempest-TestNetworkBasicOps-2120348570-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-360261052" status: 202 len: 0 microversion: 2.1 time: 0.107353 Oct 28 13:44:47.225486 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3311/6529] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Oct 28 13:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-360261052 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:44:47.320235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:47.321091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:47.332357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:47.332999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:47.333661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:47.336953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:47.336953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:47.336953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:47.640097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:47.651509 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9fea26c-16f4-4993-a67a-f55fbf028aa9 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.336629 Oct 28 13:44:47.653635 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3219/6530] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:47 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:48.494237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-da2e409f-45e3-4e70-9893-ba57bfae1ff4 req-321a2140-537d-4449-b755-c4342f8d11d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f156abc0-6a8b-4119-8757-976c3c2ae1e0", "name": "network-vif-plugged", "status": "completed", "tag": "fd1e3444-3711-4b7d-9a96-7a2a3aa5ba2c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:48.494237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-da2e409f-45e3-4e70-9893-ba57bfae1ff4 req-321a2140-537d-4449-b755-c4342f8d11d4 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:48.494237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-da2e409f-45e3-4e70-9893-ba57bfae1ff4 req-321a2140-537d-4449-b755-c4342f8d11d4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:48.494237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-da2e409f-45e3-4e70-9893-ba57bfae1ff4 req-321a2140-537d-4449-b755-c4342f8d11d4 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:48.494237 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-da2e409f-45e3-4e70-9893-ba57bfae1ff4 req-321a2140-537d-4449-b755-c4342f8d11d4 service nova] Creating event network-vif-plugged:fd1e3444-3711-4b7d-9a96-7a2a3aa5ba2c for instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 on n-h1-862876-2 Oct 28 13:44:48.494237 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-da2e409f-45e3-4e70-9893-ba57bfae1ff4 req-321a2140-537d-4449-b755-c4342f8d11d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043133 Oct 28 13:44:48.494237 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3312/6531] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:44:48.677639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:48.680266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:48.692980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:48.693486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:48.693950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:48.694726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:48.695219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:48.695660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:49.013913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:49.025905 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1eb7b225-ae3b-4326-9d68-f607bcb57394 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1315 microversion: 2.1 time: 0.352377 Oct 28 13:44:49.026494 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3220/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:48 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:50.051554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:50.053152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:50.061025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.061562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.062002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:50.062984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.066893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.066893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:50.334376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:50.343137 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6a9dda19-bd62-4180-b637-9351176d8717 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1501 microversion: 2.1 time: 0.297103 Oct 28 13:44:50.355239 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3313/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:50 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:50.368612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:50.369350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:50.380210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.381647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.382113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:50.383496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.388946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.388946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:50.556140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:50.566668 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c8affac-435b-4913-bfcf-5d7f159c5b47 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1501 microversion: 2.1 time: 0.201212 Oct 28 13:44:50.566668 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3221/6534] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:50 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:50.589982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:50.590642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:50.597706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.598556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.599163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:50.604098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.605192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.605854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:50.649170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lazy-loading 'flavor' on Instance uuid f156abc0-6a8b-4119-8757-976c3c2ae1e0 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:44:50.958543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d5a1ed2-8427-48f8-ac19-3f9b4ef9f16e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action" status: 202 len: 0 microversion: 2.1 time: 0.372407 Oct 28 13:44:50.959251 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3314/6535] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:44:50 2022] POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 13:44:50.969477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:50.970198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:50.977002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.977830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.978965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:50.979966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:50.980807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:50.984852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:51.274480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:51.283452 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c7b2ed1-7ea4-4142-9545-65f92af06a50 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1509 microversion: 2.1 time: 0.319177 Oct 28 13:44:51.295079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3222/6536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:50 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:44:52.309875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:52.310823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:52.317210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:52.317713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:52.318146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:52.318879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:52.319330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:52.319752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:52.505904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:52.514219 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e9118654-11f7-43b1-bc53-2b58f34a7323 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1492 microversion: 2.1 time: 0.209581 Oct 28 13:44:52.515969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3315/6537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:52 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1492 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:52.546903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:52.547678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:52.554848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:52.555335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:52.555960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:52.556667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:52.557450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:52.557888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:52.813598 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08c01395-e6b0-43ee-81a9-da049183a048 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action" status: 202 len: 0 microversion: 2.1 time: 0.270739 Oct 28 13:44:52.814877 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3223/6538] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:44:52 2022] POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:44:52.831807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:52.832782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:52.843870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:52.844369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:52.844998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:52.845889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:52.847055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:52.847661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:53.068617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:53.077474 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7ac3f5d3-dfeb-40fb-b177-712512d7c49c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1498 microversion: 2.1 time: 0.256556 Oct 28 13:44:53.081164 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3316/6539] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:52 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:54.103624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:54.104551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:54.111289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:54.111774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:54.112220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:54.113092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:54.113913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:54.114353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:54.297133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:54.301157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:54.306000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb8ef88a-9046-4061-b2f5-e3f7954e819c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1498 microversion: 2.1 time: 0.208193 Oct 28 13:44:54.306611 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3224/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:54 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1498 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:55.332579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:55.333207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:55.341306 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:55.341806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:55.342329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:55.343103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:55.343562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:55.343986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:55.560920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:55.569295 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00b9a6ae-5978-4ca5-917a-c7d43080581c tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1501 microversion: 2.1 time: 0.243626 Oct 28 13:44:55.569886 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3317/6541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:55 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:55.593675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:55.594319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:55.602531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:55.611154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:55.611154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:55.611154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:55.611154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:55.611154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:55.650433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lazy-loading 'flavor' on Instance uuid f156abc0-6a8b-4119-8757-976c3c2ae1e0 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:44:56.079160 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3b0e444-dde5-43d3-b7fc-6004feba2950 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action" status: 202 len: 0 microversion: 2.1 time: 0.489897 Oct 28 13:44:56.080015 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3225/6542] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:44:55 2022] POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:44:56.089397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:56.090307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:56.110357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:56.110357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:56.110357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:56.110357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:56.110357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:56.110357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:56.352256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:56.366249 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8c11d71-0444-4717-bc06-7dc1c8e2d93f tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1509 microversion: 2.1 time: 0.281724 Oct 28 13:44:56.379243 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3318/6543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:56 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:57.391352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:57.392065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:57.398902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:57.399413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:57.399837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:57.400533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:57.400996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:57.401428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:57.539546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:57.548696 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b4afee8f-b730-41b1-9ea5-b9709f57e974 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1492 microversion: 2.1 time: 0.162733 Oct 28 13:44:57.551050 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3226/6544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:57 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1492 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:57.579153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:44:57.579679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:57.586556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:57.587080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:57.588188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:57.588349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:57.588689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:57.589114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:57.592889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:44:57.866786 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-311318f3-7d46-4322-85c3-ac7576018e44 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action" status: 202 len: 0 microversion: 2.1 time: 0.291451 Oct 28 13:44:57.867359 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3319/6545] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:44:57 2022] POST /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:44:57.876439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:57.877315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:57.883639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:57.884126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:57.884564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:57.885268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:57.885720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:57.886140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:58.137597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:58.139927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-42b8b65b-ce80-4b87-81b1-128262985e54 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1498 microversion: 2.1 time: 0.268430 Oct 28 13:44:58.140496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3227/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:57 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1498 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:44:59.165054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:44:59.165759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:44:59.174591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:59.177630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:59.177630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:59.177630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:44:59.177630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:44:59.177630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:44:59.384534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:44:59.392417 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d43c966-a181-4c35-b676-41e3d48ab9ee tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1498 microversion: 2.1 time: 0.233382 Oct 28 13:44:59.392983 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3320/6547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:44:59 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:45:00.416813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:45:00.417578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:45:00.424570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:00.425066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:00.425501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:00.426256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:00.426719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:00.427161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:00.585461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:45:00.594323 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fcc800ad-a280-4c2e-9b0f-40fa2fd0d0ae tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1501 microversion: 2.1 time: 0.181925 Oct 28 13:45:00.611764 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3228/6548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:45:00 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:45:00.628708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:45:00.629291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:45:00.636924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:00.637418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:00.637863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:00.638573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:00.640596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:00.641050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:00.674301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:45:00.983355 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ce5a970-019a-4d06-861c-e505c40cef02 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 204 len: 0 microversion: 2.1 time: 0.367253 Oct 28 13:45:00.984375 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3321/6549] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:45:00 2022] DELETE /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:45:00.993694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:45:00.994455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:45:01.001670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:01.002410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:01.002955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:01.003950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:01.004475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:01.004990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:01.360643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:45:01.374342 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aa0ff1c8-2954-44ec-bd5a-2784b56fd76d tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1507 microversion: 2.1 time: 0.379851 Oct 28 13:45:01.374342 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3229/6550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:45:00 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:45:02.396337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:45:02.396764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:45:02.408823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:02.409479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:02.409934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:02.410672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:02.411155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:02.411933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:02.601339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:45:02.610267 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4deed42b-1a67-4169-aba2-2d1052b4c36e tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1507 microversion: 2.1 time: 0.218886 Oct 28 13:45:02.610888 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3322/6551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:45:02 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:45:03.419619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0205ec6b-a9e5-4cc4-b8ea-bfe71e426347 req-f572e9ab-ec8b-48c6-8cea-1d21718ca9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f156abc0-6a8b-4119-8757-976c3c2ae1e0", "name": "network-vif-deleted", "tag": "fd1e3444-3711-4b7d-9a96-7a2a3aa5ba2c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:45:03.430833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0205ec6b-a9e5-4cc4-b8ea-bfe71e426347 req-f572e9ab-ec8b-48c6-8cea-1d21718ca9f2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:03.431557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0205ec6b-a9e5-4cc4-b8ea-bfe71e426347 req-f572e9ab-ec8b-48c6-8cea-1d21718ca9f2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:03.432167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0205ec6b-a9e5-4cc4-b8ea-bfe71e426347 req-f572e9ab-ec8b-48c6-8cea-1d21718ca9f2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:03.445678 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0205ec6b-a9e5-4cc4-b8ea-bfe71e426347 req-f572e9ab-ec8b-48c6-8cea-1d21718ca9f2 service nova] Creating event network-vif-deleted:fd1e3444-3711-4b7d-9a96-7a2a3aa5ba2c for instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 on n-h1-862876-2 Oct 28 13:45:03.451433 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0205ec6b-a9e5-4cc4-b8ea-bfe71e426347 req-f572e9ab-ec8b-48c6-8cea-1d21718ca9f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035565 Oct 28 13:45:03.452695 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3230/6552] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:45:03.634489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:45:03.635701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:45:03.642294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:03.642804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:03.643408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:03.644280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:03.644738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:03.645163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:03.715897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f915ccad61434caf6a1da2b7300e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804f0aee616a4deca24339c858d7a85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:45:03.727234 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4d3e8698-baed-48d0-9dcf-facd6d3076b6 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 200 len: 1300 microversion: 2.1 time: 0.092136 Oct 28 13:45:03.728099 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3323/6553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:45:03 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:45:04.752684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:45:04.753526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] [instance: f156abc0-6a8b-4119-8757-976c3c2ae1e0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:45:04.761116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:04.761750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:04.762299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:04.763148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:45:04.764061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:45:04.764608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:45:04.780676 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] HTTP exception thrown: Instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 could not be found. Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Request method failure captured: Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 HTTP/1.1 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW9y_K_o4aQQItpkQMlZiP-1OvCpmJiHde4he4eiY9DtE5rdCTKWzPVho37KqTrAdORLMuMuthV4OB2kMx39ej8s3MWmsAXhOSjXw5pQx1TTa7u6h74C388AEZFNurOJpCFKsLMnjEjOudLcnTf3hH2KpqlkqDpTtj9LKnxKp50wnVh4 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 804f0aee616a4deca24339c858d7a85f Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestServerAdvancedOps-1818776587 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/804f0aee616a4deca24339c858d7a85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/804f0aee616a4deca24339c858d7a85f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_804f0aee616a4deca24339c858d7a85f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/804f0aee616a4deca24339c858d7a85f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestServerAdvancedOps-1818776587 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 804f0aee616a4deca24339c858d7a85f Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestServerAdvancedOps-1818776587 Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestServerAdvancedOps-1818776587-project Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: a0f915ccad61434caf6a1da2b7300e7c Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestServerAdvancedOps-1818776587-project Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 could not be found. Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'f156abc0-6a8b-4119-8757-976c3c2ae1e0'} Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 could not be found. Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 could not be found. Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:45:04.782453 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:45:04.789282 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:45:04.789282 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:45:04.789282 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:45:04.789282 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:45:04.789282 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:45:04.789282 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 could not be found. Oct 28 13:45:04.789282 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:45:04.791064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] Returning 404 to user: Instance f156abc0-6a8b-4119-8757-976c3c2ae1e0 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:45:04.792128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-70c8918a-f53f-4b6b-a717-804338ad4ef4 tempest-TestServerAdvancedOps-1818776587 tempest-TestServerAdvancedOps-1818776587-project] 10.222.0.25 "GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0" status: 404 len: 111 microversion: 2.1 time: 0.044802 Oct 28 13:45:04.793740 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3231/6554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:45:04 2022] GET /compute/v2.1/servers/f156abc0-6a8b-4119-8757-976c3c2ae1e0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:47:47.303236 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 13:47:47.304168 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 13:47:47.305070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:47:47.305834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:47:47.307229 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:47:47.310488 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:47:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Oct 28 13:47:47.310488 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:47:47.310488 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:47:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Oct 28 13:47:47.310488 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:47:47.310488 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:47:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Oct 28 13:47:47.315794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-123304d0-a0c9-447e-9666-470d7992e8ae tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Action: 'create', calling method: .version_select at 0x7f27b81795e0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1052865430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOumg340pLJV4sXs+VxtU6N0738Z/THHON/pu+g/FItjDsZWFOqw77O+H4wt/MBUA09APmqpfgWlsxpGIPaR7WX2xJb2JUtTWFSEHlRPM5Ij3cUIxppNdztjY9bG6svkQ=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:47:47.336227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-123304d0-a0c9-447e-9666-470d7992e8ae tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Getting quotas for project df516545a14845ff878763aa7139b5a6. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:47:47.341382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-123304d0-a0c9-447e-9666-470d7992e8ae tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Getting quotas for user e4c7a313d97842588f266f6c160ebb21 and project df516545a14845ff878763aa7139b5a6. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:47:47.424998 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-123304d0-a0c9-447e-9666-470d7992e8ae tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.123567 Oct 28 13:47:47.425536 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3324/6555] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:47:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:47:49.940004 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 13:47:49.941198 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 13:47:49.941860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:47:49.942589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:47:49.943805 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:47:49.943999 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:47:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 13:47:49.945220 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:47:49.945343 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:47:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 13:47:49.946460 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:47:49.946604 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:47:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 13:47:49.951410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1519886188", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "882f7ccf-608f-44c9-855f-2e28a85316d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1052865430", "security_groups": [{"name": "tempest-secgroup-smoke-203660932"}], "networks": [{"uuid": "8c898f37-8668-45b5-a1ac-19a91ee5e668"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:47:50.254932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] validate_networks() for [('8c898f37-8668-45b5-a1ac-19a91ee5e668', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:47:50.789262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:47:50.789688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:47:50.790160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:47:50.790689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:47:50.791551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:47:50.801407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:50.801988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:50.802430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:50.803200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:50.803664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:50.804104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:50.826121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Getting quotas for project df516545a14845ff878763aa7139b5a6. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:47:50.831511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Getting quotas for user e4c7a313d97842588f266f6c160ebb21 and project df516545a14845ff878763aa7139b5a6. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:47:50.891714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:47:50.895065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='882f7ccf-608f-44c9-855f-2e28a85316d6',volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:47:50.953934 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47904. Oct 28 13:47:50.956079 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47902. Oct 28 13:47:51.365707 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eca6a0dd-830c-4271-8a13-bb1e2b349dd1 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.427662 Oct 28 13:47:51.366464 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3232/6556] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:47:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:47:51.378205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d2742e2-0143-4cb4-a8f4-a1f67bb19a12 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:51.378844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9d2742e2-0143-4cb4-a8f4-a1f67bb19a12 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:51.395548 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47914. Oct 28 13:47:51.399959 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 47916. Oct 28 13:47:51.525153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9d2742e2-0143-4cb4-a8f4-a1f67bb19a12 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:51.532958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d2742e2-0143-4cb4-a8f4-a1f67bb19a12 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1099 microversion: 2.1 time: 0.159132 Oct 28 13:47:51.534081 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3325/6557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:51 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1099 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:47:52.557457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62cae2b3-9764-438d-8fed-e476f08ff277 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:52.558216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-62cae2b3-9764-438d-8fed-e476f08ff277 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:52.613077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-62cae2b3-9764-438d-8fed-e476f08ff277 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:52.620305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62cae2b3-9764-438d-8fed-e476f08ff277 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1099 microversion: 2.1 time: 0.067593 Oct 28 13:47:52.620953 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3233/6558] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:52 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1099 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:47:53.643007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:53.643540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:53.654338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:53.654856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:53.655813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:53.656504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:53.656960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:53.657385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:53.723459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:53.731492 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-725c0047-8858-494e-9cb3-c0a90fd552b6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1197 microversion: 2.1 time: 0.092491 Oct 28 13:47:53.732077 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3326/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:53 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:47:54.754480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:54.755987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:54.766022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:54.766661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:54.767384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:54.768564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:54.769314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:54.770007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:55.026636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:55.035032 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a2dd3cf-0989-4375-b7a7-c2305f6a1c6f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1282 microversion: 2.1 time: 0.285072 Oct 28 13:47:55.036105 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3234/6560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:54 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:47:56.034828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1a7f4f4c-5cd5-4103-87ee-62cb6995d43d req-1fe93e73-52f5-4fa5-91f3-cd3bc9625fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b40ad4a-85b9-4312-bce1-08fcb29c8903", "tag": "2a5a0340-39eb-472d-a674-540a19e2b625"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:47:56.053278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a7f4f4c-5cd5-4103-87ee-62cb6995d43d req-1fe93e73-52f5-4fa5-91f3-cd3bc9625fbc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:56.054029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a7f4f4c-5cd5-4103-87ee-62cb6995d43d req-1fe93e73-52f5-4fa5-91f3-cd3bc9625fbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:56.054766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a7f4f4c-5cd5-4103-87ee-62cb6995d43d req-1fe93e73-52f5-4fa5-91f3-cd3bc9625fbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:56.065347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:56.068334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:56.080843 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1a7f4f4c-5cd5-4103-87ee-62cb6995d43d req-1fe93e73-52f5-4fa5-91f3-cd3bc9625fbc service nova] Creating event network-changed:2a5a0340-39eb-472d-a674-540a19e2b625 for instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 on n-h1-862876-2 Oct 28 13:47:56.086944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:56.087751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:56.088449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:56.089465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:56.090100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:56.091594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:56.092470 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1a7f4f4c-5cd5-4103-87ee-62cb6995d43d req-1fe93e73-52f5-4fa5-91f3-cd3bc9625fbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370306 Oct 28 13:47:56.094098 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3327/6561] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:47:56.348511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:56.361222 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-786bedb6-dadf-4c54-be48-6274727b19d4 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1282 microversion: 2.1 time: 0.304674 Oct 28 13:47:56.365408 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3235/6562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:56 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1282 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:47:57.393557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:57.394776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:57.401100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:57.401712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:57.402332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:57.403146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:57.403665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:57.406774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:57.569588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:57.577958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d995dc5c-c6cf-4729-9372-b10bcd8afc75 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1282 microversion: 2.1 time: 0.189515 Oct 28 13:47:57.578476 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3328/6563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:57 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1282 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:47:58.601708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:58.602318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:58.609965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:58.610450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:58.610915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:58.611603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:58.612206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:58.612679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:58.749951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:58.758340 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-90ee59f4-5afa-4239-b063-de98d7a02d9e tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1282 microversion: 2.1 time: 0.160707 Oct 28 13:47:58.759051 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3236/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:58 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:47:59.781677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:47:59.782327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:47:59.789448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:59.789939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:59.790382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:59.791362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:47:59.791875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:47:59.792301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:47:59.925602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:47:59.933205 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d0c0dce-b356-49a2-bdde-a3dfdba2b148 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1282 microversion: 2.1 time: 0.155730 Oct 28 13:47:59.933784 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3329/6565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:47:59 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:00.956989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:00.957762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:00.960528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:00.965434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:00.965920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:00.966360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:00.967079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:00.967612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:00.971931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:01.100988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:01.109990 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2d50ab35-5f16-431f-b77c-9ae0f78df2fc tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.157122 Oct 28 13:48:01.111174 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3237/6566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:00 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:02.133355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:02.133966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:02.136834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:02.141826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:02.142365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:02.142840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:02.143536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:02.143991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:02.144418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:02.285832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:02.293785 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ad776aa-2d1e-431d-bafe-06e09f0bb645 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.164456 Oct 28 13:48:02.294353 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3330/6567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:02 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:03.317134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:03.317755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:03.320886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:03.325777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:03.326254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:03.326694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:03.327462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:03.331159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:03.331159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:03.471491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:03.479696 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ecd70f6e-fdf8-4092-a9dc-798eb6ba948c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.166445 Oct 28 13:48:03.480470 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3238/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:03 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:04.501492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:04.502110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:04.509024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:04.509504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:04.509955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:04.510637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:04.511120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:04.511565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:04.641335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:04.648966 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-59d56ba4-5780-4ecf-8ac2-bdc3ec9d5db3 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.151456 Oct 28 13:48:04.649538 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3331/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:04 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:05.671542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:05.672744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:05.679625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:05.680107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:05.680543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:05.681239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:05.681696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:05.682122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:05.818317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:05.826702 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e39757a-7c03-4060-add1-0343564fae8f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.159141 Oct 28 13:48:05.827415 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3239/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:05 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:06.849850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:06.849850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:06.856634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:06.857111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:06.857542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:06.858233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:06.858681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:06.859144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:07.011631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:07.019877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4edfff1c-1d1c-4250-b443-7989f034648f tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.174735 Oct 28 13:48:07.020688 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3332/6571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:06 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:08.042998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:08.043626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:08.050404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:08.050938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:08.051381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:08.052082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:08.052541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:08.052969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:08.187058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:08.194901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9324e525-1dd9-4410-b57b-44627f86f784 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.156137 Oct 28 13:48:08.195707 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3240/6572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:08 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:09.124042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-959e592d-3a3a-4bd1-948b-84e4721978f3 req-35c7786e-3533-40d7-bc43-abffc7c9e7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b40ad4a-85b9-4312-bce1-08fcb29c8903", "name": "network-vif-plugged", "status": "completed", "tag": "2a5a0340-39eb-472d-a674-540a19e2b625"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:09.134342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-959e592d-3a3a-4bd1-948b-84e4721978f3 req-35c7786e-3533-40d7-bc43-abffc7c9e7e8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:09.135014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-959e592d-3a3a-4bd1-948b-84e4721978f3 req-35c7786e-3533-40d7-bc43-abffc7c9e7e8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:09.135619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-959e592d-3a3a-4bd1-948b-84e4721978f3 req-35c7786e-3533-40d7-bc43-abffc7c9e7e8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:09.147614 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-959e592d-3a3a-4bd1-948b-84e4721978f3 req-35c7786e-3533-40d7-bc43-abffc7c9e7e8 service nova] Creating event network-vif-plugged:2a5a0340-39eb-472d-a674-540a19e2b625 for instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 on n-h1-862876-2 Oct 28 13:48:09.152696 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-959e592d-3a3a-4bd1-948b-84e4721978f3 req-35c7786e-3533-40d7-bc43-abffc7c9e7e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032350 Oct 28 13:48:09.153305 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3333/6573] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:48:09.217686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:09.219431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:09.227023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:09.227668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:09.228064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:09.228942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:09.229403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:09.229838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:09.417992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:09.426139 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d612f2bf-6b70-4905-8012-c1f0714e7a27 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1270 microversion: 2.1 time: 0.212482 Oct 28 13:48:09.427505 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3241/6574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:09 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:10.454604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:10.455383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:10.461548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:10.462230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:10.462465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:10.463232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:10.463680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:10.464105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:10.606488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:10.616343 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5a7190b5-9a5a-4d96-88ab-f7c360b6a6fa tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1458 microversion: 2.1 time: 0.167251 Oct 28 13:48:10.616918 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3334/6575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:10 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1458 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:10.638334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:10.638994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:10.647132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:10.647627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:10.648098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:10.648802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:10.649316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:10.649740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:10.783954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:10.791959 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bce97c5-65a2-4998-a862-a990e5a8be62 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1458 microversion: 2.1 time: 0.157180 Oct 28 13:48:10.792536 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3242/6576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:10 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:11.911637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf1462d5-e31d-43c0-b4f8-f2716e25391a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Action: 'create', calling method: .version_select at 0x7f27b8179820>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-981724514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6LyJam44WUpOSRpJeKIPQJPHWs5XFyjC3Eu2Jstz3lPQCGZJ/Lg7sdxpCaAgPK02TW+u+KaKXAohAEYLM0jxAISJztx2n5o9GeIKQIJSkDFMoD5WQ9DAGg4hKA8kqB/A=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:11.928709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bf1462d5-e31d-43c0-b4f8-f2716e25391a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Getting quotas for project f8f48199777a4915bc3fbcea74ee38dc. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:48:11.934937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-bf1462d5-e31d-43c0-b4f8-f2716e25391a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Getting quotas for user 6072db7830ce4f0fa4fbc0e048786325 and project f8f48199777a4915bc3fbcea74ee38dc. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:48:12.025612 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf1462d5-e31d-43c0-b4f8-f2716e25391a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.282575 Oct 28 13:48:12.032240 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3335/6577] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:48:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:48:13.460404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e55b2196-0384-44e2-8783-08a1ed8f1ccb req-d648eda6-cbb8-4f8b-9e22-ab205ba2fde0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b40ad4a-85b9-4312-bce1-08fcb29c8903", "tag": "2a5a0340-39eb-472d-a674-540a19e2b625"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:13.481381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e55b2196-0384-44e2-8783-08a1ed8f1ccb req-d648eda6-cbb8-4f8b-9e22-ab205ba2fde0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:13.482858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e55b2196-0384-44e2-8783-08a1ed8f1ccb req-d648eda6-cbb8-4f8b-9e22-ab205ba2fde0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:13.485098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e55b2196-0384-44e2-8783-08a1ed8f1ccb req-d648eda6-cbb8-4f8b-9e22-ab205ba2fde0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:13.511244 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e55b2196-0384-44e2-8783-08a1ed8f1ccb req-d648eda6-cbb8-4f8b-9e22-ab205ba2fde0 service nova] Creating event network-changed:2a5a0340-39eb-472d-a674-540a19e2b625 for instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 on n-h1-862876-2 Oct 28 13:48:13.520535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e55b2196-0384-44e2-8783-08a1ed8f1ccb req-d648eda6-cbb8-4f8b-9e22-ab205ba2fde0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064738 Oct 28 13:48:13.521846 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3243/6578] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:48:15.572504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b9a04c4d-ce4b-4708-9684-c7a56852531e req-c86e604d-188c-4d4e-9b90-80e3738ad04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b40ad4a-85b9-4312-bce1-08fcb29c8903", "tag": "2a5a0340-39eb-472d-a674-540a19e2b625"}, {"name": "network-changed", "server_uuid": "3b40ad4a-85b9-4312-bce1-08fcb29c8903", "tag": "2a5a0340-39eb-472d-a674-540a19e2b625"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:15.590726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b9a04c4d-ce4b-4708-9684-c7a56852531e req-c86e604d-188c-4d4e-9b90-80e3738ad04b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:15.591258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b9a04c4d-ce4b-4708-9684-c7a56852531e req-c86e604d-188c-4d4e-9b90-80e3738ad04b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:15.618645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b9a04c4d-ce4b-4708-9684-c7a56852531e req-c86e604d-188c-4d4e-9b90-80e3738ad04b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:15.618645 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b9a04c4d-ce4b-4708-9684-c7a56852531e req-c86e604d-188c-4d4e-9b90-80e3738ad04b service nova] Creating event network-changed:2a5a0340-39eb-472d-a674-540a19e2b625 for instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 on n-h1-862876-2 Oct 28 13:48:15.618645 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b9a04c4d-ce4b-4708-9684-c7a56852531e req-c86e604d-188c-4d4e-9b90-80e3738ad04b service nova] Creating event network-changed:2a5a0340-39eb-472d-a674-540a19e2b625 for instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 on n-h1-862876-2 Oct 28 13:48:15.618645 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b9a04c4d-ce4b-4708-9684-c7a56852531e req-c86e604d-188c-4d4e-9b90-80e3738ad04b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045599 Oct 28 13:48:15.618645 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3336/6579] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:48:19.933706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1033768560-access_point-835956212", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "86fef9ee-6588-4e11-9cb9-d4d465bb4076"}], "key_name": "tempest-TestSecurityGroupsBasicOps-981724514", "security_groups": [{"name": "tempest-secgroup_access--1696008229"}, {"name": "tempest-secgroup_general--35414048"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:20.090366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] validate_networks() for [('86fef9ee-6588-4e11-9cb9-d4d465bb4076', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:48:20.279320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:20.481048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:48:20.481477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:48:20.481964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:48:20.482383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:48:20.482831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:48:20.492240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:20.492732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:20.493165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:20.493917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:20.494516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:20.495052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:20.501029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=59 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:20.513670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Getting quotas for project f8f48199777a4915bc3fbcea74ee38dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:48:20.519636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Getting quotas for user 6072db7830ce4f0fa4fbc0e048786325 and project f8f48199777a4915bc3fbcea74ee38dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:48:20.537254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:48:20.539418 n-d-862876-2 devstack@n-api.service[127794]: WARNING nova.utils [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1033768560-access_point-835956212 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1033768560-ac Oct 28 13:48:20.540260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:48:20.667254 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00a5af61-1946-46bb-9c8d-bfd6a6a776cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.738656 Oct 28 13:48:20.667996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3244/6580] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:48:19 2022] POST /compute/v2.1/servers => generated 456 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:48:20.681847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bfd98f00-db92-4234-9814-bf778afb1b8c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:20.682894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bfd98f00-db92-4234-9814-bf778afb1b8c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:20.757629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bfd98f00-db92-4234-9814-bf778afb1b8c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:20.767488 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bfd98f00-db92-4234-9814-bf778afb1b8c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1293 microversion: 2.1 time: 0.089388 Oct 28 13:48:20.768056 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3337/6581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:20 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:21.791430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-455f8432-4140-4388-8780-6bebf4d8e243 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:21.792325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-455f8432-4140-4388-8780-6bebf4d8e243 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:21.852814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-455f8432-4140-4388-8780-6bebf4d8e243 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:21.860042 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-455f8432-4140-4388-8780-6bebf4d8e243 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1293 microversion: 2.1 time: 0.073720 Oct 28 13:48:21.860659 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3245/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:21 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1293 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:22.882939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:22.883470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:22.885633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:22.891176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:22.891667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:22.892109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:22.892864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:22.893338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:22.893762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:22.896465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=49 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:22.957239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:22.965242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1118779-0f85-4fd4-8de7-56d69e1ca86f tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1345 microversion: 2.1 time: 0.086492 Oct 28 13:48:22.965816 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3338/6583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:22 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:23.989417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:23.990034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:23.997979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:23.998479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:23.998995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:23.999702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:24.000335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:24.000775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:24.158812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:24.166976 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0ec309eb-1e7a-4a0f-bf8d-6505b441a0d8 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.181781 Oct 28 13:48:24.167560 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3246/6584] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:23 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:24.810998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1a927dd3-2c6e-47e8-bc2f-ef2898964e12 req-ddd2f1cc-0e35-4820-88b6-8d781a8508c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417cdee3-907d-4445-8a05-d1a5ac2fbe17", "tag": "871a5408-52b2-4491-9c0e-de72bfeea288"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:24.822503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a927dd3-2c6e-47e8-bc2f-ef2898964e12 req-ddd2f1cc-0e35-4820-88b6-8d781a8508c3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:24.823002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a927dd3-2c6e-47e8-bc2f-ef2898964e12 req-ddd2f1cc-0e35-4820-88b6-8d781a8508c3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:24.823431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a927dd3-2c6e-47e8-bc2f-ef2898964e12 req-ddd2f1cc-0e35-4820-88b6-8d781a8508c3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:24.836745 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1a927dd3-2c6e-47e8-bc2f-ef2898964e12 req-ddd2f1cc-0e35-4820-88b6-8d781a8508c3 service nova] Creating event network-changed:871a5408-52b2-4491-9c0e-de72bfeea288 for instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 on n-h2-862876-2 Oct 28 13:48:24.840138 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1a927dd3-2c6e-47e8-bc2f-ef2898964e12 req-ddd2f1cc-0e35-4820-88b6-8d781a8508c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033521 Oct 28 13:48:24.840958 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3339/6585] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:48:25.190006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:25.190721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:25.197533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:25.198023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:25.198473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:25.199201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:25.199658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:25.200087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:25.341502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:25.349885 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9d25f7b9-8654-4b0d-83d3-ef03b9a9e4de tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.164204 Oct 28 13:48:25.350397 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3247/6586] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:25 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:26.374521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:26.375263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:26.382457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:26.382989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:26.383434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:26.384125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:26.384584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:26.385012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:26.524539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:26.533279 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dbcff26b-9df1-49c1-8fcd-55066031b897 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.163238 Oct 28 13:48:26.537616 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3340/6587] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:26 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:27.557184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:27.557845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:27.565236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:27.565743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:27.566184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:27.566910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:27.567362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:27.567785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:27.718780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:27.726738 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9370474d-e391-460c-b63c-c8868a0eb70a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.173429 Oct 28 13:48:27.727336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3248/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:27 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:28.750227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:28.750870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:28.758943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:28.759434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:28.759872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:28.760562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:28.761013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:28.761440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:28.919627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:28.927254 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-96d9730d-3fb6-4f3f-8c3d-341a67f3b7cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.180955 Oct 28 13:48:28.927845 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3341/6589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:28 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:29.950370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:29.950952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:29.957868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:29.958439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:29.958824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:29.959534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:29.959997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:29.960486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:30.427443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:30.448724 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3533cd77-39c3-4862-ac16-18ede8452cc1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.488799 Oct 28 13:48:30.448724 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3249/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:29 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:31.458226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:31.458782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:31.462758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:31.466435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:31.466971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:31.467404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:31.468265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:31.468720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:31.469224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:31.624802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:31.628012 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7023ef73-b4b8-42d9-b5b2-f1b814befdc0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.174349 Oct 28 13:48:31.628601 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3342/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:31 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:31.654775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cfda258c-9df2-495c-be9d-0da07d29c25b req-1847f299-15bb-42b6-be31-536d681eb824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417cdee3-907d-4445-8a05-d1a5ac2fbe17", "name": "network-vif-plugged", "status": "completed", "tag": "871a5408-52b2-4491-9c0e-de72bfeea288"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:31.661889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:31.670052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cfda258c-9df2-495c-be9d-0da07d29c25b req-1847f299-15bb-42b6-be31-536d681eb824 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:31.670539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cfda258c-9df2-495c-be9d-0da07d29c25b req-1847f299-15bb-42b6-be31-536d681eb824 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:31.671006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cfda258c-9df2-495c-be9d-0da07d29c25b req-1847f299-15bb-42b6-be31-536d681eb824 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:31.682983 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cfda258c-9df2-495c-be9d-0da07d29c25b req-1847f299-15bb-42b6-be31-536d681eb824 service nova] Creating event network-vif-plugged:871a5408-52b2-4491-9c0e-de72bfeea288 for instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 on n-h2-862876-2 Oct 28 13:48:31.688216 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cfda258c-9df2-495c-be9d-0da07d29c25b req-1847f299-15bb-42b6-be31-536d681eb824 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Oct 28 13:48:31.688830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3250/6592] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:48:32.651602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:32.652214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:32.659557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:32.660039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:32.660470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:32.661144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:32.661595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:32.662013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:32.807183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:32.814930 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b97e7b23-f200-4c59-8941-f2c59ad94c94 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1469 microversion: 2.1 time: 0.167289 Oct 28 13:48:32.815855 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3343/6593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:32 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:33.836946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:48:33.841989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:33.842697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:33.849759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:33.850411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:33.850687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:33.851411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:33.851971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:33.852303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:33.990344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:33.998171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b053d78d-09f6-404e-963a-ed44052efbd4 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1640 microversion: 2.1 time: 0.162177 Oct 28 13:48:33.998771 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3251/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:33 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1640 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:34.020097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:34.020701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:34.027660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:34.028095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:34.028526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:34.029203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:34.029650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:34.030071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:34.169837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:48:34.178143 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-076bffd9-dd94-4490-bcde-f6501ffe92d5 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1640 microversion: 2.1 time: 0.161937 Oct 28 13:48:34.178715 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3344/6595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:34 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1640 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:34.199497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:48:34.200157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:48:34.206100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:34.206583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:34.207058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:34.207745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:34.208201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:34.208626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:34.534921 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6b9fc8f7-7903-43a1-b18e-b8edac9ddf56 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1791 microversion: 2.1 time: 0.338418 Oct 28 13:48:34.535545 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3252/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:48:34 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1791 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:48:36.887908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b8301a02-a733-49da-8ca8-809d8b65f13a req-d9935d8b-a6a8-4491-9705-1e2c2e750465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417cdee3-907d-4445-8a05-d1a5ac2fbe17", "tag": "871a5408-52b2-4491-9c0e-de72bfeea288"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:48:36.899031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b8301a02-a733-49da-8ca8-809d8b65f13a req-d9935d8b-a6a8-4491-9705-1e2c2e750465 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:48:36.899246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b8301a02-a733-49da-8ca8-809d8b65f13a req-d9935d8b-a6a8-4491-9705-1e2c2e750465 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:48:36.899667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b8301a02-a733-49da-8ca8-809d8b65f13a req-d9935d8b-a6a8-4491-9705-1e2c2e750465 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:48:36.911727 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b8301a02-a733-49da-8ca8-809d8b65f13a req-d9935d8b-a6a8-4491-9705-1e2c2e750465 service nova] Creating event network-changed:871a5408-52b2-4491-9c0e-de72bfeea288 for instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 on n-h2-862876-2 Oct 28 13:48:36.917122 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b8301a02-a733-49da-8ca8-809d8b65f13a req-d9935d8b-a6a8-4491-9705-1e2c2e750465 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033005 Oct 28 13:48:36.917893 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3345/6597] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:49:12.570404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1452583398", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "d31fc6bb-8fd7-4824-9e69-1c661268f464"}], "key_name": "tempest-TestSecurityGroupsBasicOps-981724514", "security_groups": []}, "os:scheduler_hints": {"different_host": ["417cdee3-907d-4445-8a05-d1a5ac2fbe17"]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:12.581392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:12.582067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=39 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:12.636884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] validate_networks() for [('d31fc6bb-8fd7-4824-9e69-1c661268f464', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:49:13.041099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:49:13.041509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:49:13.041985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:49:13.042394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:49:13.043109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:49:13.052132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:13.052618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:13.053057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:13.053790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:13.054255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:13.054687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:13.071904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Getting quotas for project f8f48199777a4915bc3fbcea74ee38dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:49:13.077760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Getting quotas for user 6072db7830ce4f0fa4fbc0e048786325 and project f8f48199777a4915bc3fbcea74ee38dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:49:13.093862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:49:13.096397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:49:13.191658 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-392808d6-2a90-46b0-8da1-ef1cf6b774e1 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.625054 Oct 28 13:49:13.192577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3253/6598] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:49:12 2022] POST /compute/v2.1/servers => generated 361 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:49:13.202454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=15 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:13.204519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=39 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:13.208993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1c44e341-a5ee-4784-ab1a-944e0d4da9b3 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:13.209764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1c44e341-a5ee-4784-ab1a-944e0d4da9b3 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:13.272832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1c44e341-a5ee-4784-ab1a-944e0d4da9b3 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:13.280421 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1c44e341-a5ee-4784-ab1a-944e0d4da9b3 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1241 microversion: 2.1 time: 0.080286 Oct 28 13:49:13.281010 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3346/6599] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:13 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:49:14.306201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:14.306939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:14.313524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:14.314082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:14.314585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:14.315492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:14.315948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:14.316501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:14.386252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:14.408230 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1bb8e1ce-75ef-48fb-9bc7-fd929257ae62 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1245 microversion: 2.1 time: 0.095465 Oct 28 13:49:14.408230 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3254/6600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:14 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:15.422481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:15.423244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:15.431179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:15.431977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:15.432514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:15.434434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:15.435466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:15.435914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:15.503353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:15.511483 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61b7f220-5fad-45e8-988f-7f941ae06725 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1301 microversion: 2.1 time: 0.093745 Oct 28 13:49:15.517073 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3347/6601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:15 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:16.535435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:16.536158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:16.545842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:16.547251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:16.548552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:16.549571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:16.550132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:16.551268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:16.635519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:16.643211 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4d56cbe0-881b-459f-b74f-49d099eba507 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.111801 Oct 28 13:49:16.653543 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3255/6602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:16 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:17.122423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-13267f6c-3a0a-4eb3-aa28-63f00aba4f09 req-cf374f18-ad3d-4db0-aa64-28ec6a8b7c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d4103a5-9264-41a1-9b1a-5ea98916a60a", "tag": "48c52bba-183f-4c21-b37a-d3edbd9871c2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:17.132946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-13267f6c-3a0a-4eb3-aa28-63f00aba4f09 req-cf374f18-ad3d-4db0-aa64-28ec6a8b7c51 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:17.135014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-13267f6c-3a0a-4eb3-aa28-63f00aba4f09 req-cf374f18-ad3d-4db0-aa64-28ec6a8b7c51 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:17.135014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-13267f6c-3a0a-4eb3-aa28-63f00aba4f09 req-cf374f18-ad3d-4db0-aa64-28ec6a8b7c51 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:17.147191 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-13267f6c-3a0a-4eb3-aa28-63f00aba4f09 req-cf374f18-ad3d-4db0-aa64-28ec6a8b7c51 service nova] Creating event network-changed:48c52bba-183f-4c21-b37a-d3edbd9871c2 for instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a on n-h1-862876-2 Oct 28 13:49:17.152497 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-13267f6c-3a0a-4eb3-aa28-63f00aba4f09 req-cf374f18-ad3d-4db0-aa64-28ec6a8b7c51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033706 Oct 28 13:49:17.153255 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3348/6603] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:49:17.666940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:17.672057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:17.675122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:17.677164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:17.677164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:17.677164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:17.678084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:17.678529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:17.937742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:17.945581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b15d99f9-9db9-4f49-92ab-1edcfe2857e9 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.282738 Oct 28 13:49:17.946160 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3256/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:17 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:18.972383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:18.973132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:18.979319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:18.979811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:18.980248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:18.980945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:18.981405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:18.981833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:19.061893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:19.063289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:19.070151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:19.070850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:19.071795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:19.073047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:19.073603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:19.073973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:19.074176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:19.084303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8e229990-b222-4d3f-88d4-f1769613d2cf tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.117121 Oct 28 13:49:19.092183 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3349/6605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:18 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:19.104286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:49:19.168014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ef54d856-04b5-4cf3-babc-583b5af25d9a req-8938efea-cc7b-4a64-a879-63d5b4f2d5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b40ad4a-85b9-4312-bce1-08fcb29c8903", "tag": "2a5a0340-39eb-472d-a674-540a19e2b625"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:19.177444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ef54d856-04b5-4cf3-babc-583b5af25d9a req-8938efea-cc7b-4a64-a879-63d5b4f2d5f6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:19.177994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ef54d856-04b5-4cf3-babc-583b5af25d9a req-8938efea-cc7b-4a64-a879-63d5b4f2d5f6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:19.178514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ef54d856-04b5-4cf3-babc-583b5af25d9a req-8938efea-cc7b-4a64-a879-63d5b4f2d5f6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:19.190303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ef54d856-04b5-4cf3-babc-583b5af25d9a req-8938efea-cc7b-4a64-a879-63d5b4f2d5f6 service nova] Creating event network-changed:2a5a0340-39eb-472d-a674-540a19e2b625 for instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 on n-h1-862876-2 Oct 28 13:49:19.195403 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ef54d856-04b5-4cf3-babc-583b5af25d9a req-8938efea-cc7b-4a64-a879-63d5b4f2d5f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031852 Oct 28 13:49:19.196169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3350/6606] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:49:19.423307 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8d4613b4-3875-462f-81c5-b84cea214c37 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 204 len: 0 microversion: 2.1 time: 0.365093 Oct 28 13:49:19.423913 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3257/6607] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:49:19 2022] DELETE /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 13:49:19.432964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:19.433675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:19.440778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:19.441273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:19.441707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:19.442419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:19.442905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:19.443337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:19.581592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:19.589578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-16d08e6a-b628-47e5-9363-0cab1e57ebe6 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1583 microversion: 2.1 time: 0.160757 Oct 28 13:49:19.590088 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3351/6608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:19 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1583 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:20.108012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:20.108743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:20.115771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:20.116257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:20.116696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:20.117386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:20.117842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:20.118297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:20.203327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:20.211116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b304443-fd9d-4ab0-bc1e-df86f127e531 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.108014 Oct 28 13:49:20.211726 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3258/6609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:20 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:20.615650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:20.616163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:20.622490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:20.628876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:20.628876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:20.628876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:20.628876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:20.628876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:20.761926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:20.770124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-72c32dbc-ba37-45c4-85a6-bfb3d34a6ba0 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1583 microversion: 2.1 time: 0.159956 Oct 28 13:49:20.770708 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3352/6610] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:20 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1583 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:21.235005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:21.235622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:21.242833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:21.243552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:21.245385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:21.246256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:21.246723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:21.247214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:21.338112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:21.347789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2cbf6db6-94c7-4bcb-adf4-8ccc7d5d8012 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.117954 Oct 28 13:49:21.348323 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3259/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:21 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:21.794672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:21.795541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:21.801554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:21.802048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:21.802489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:21.803216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:21.803803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:21.804233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:21.852277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-028995cb-979f-4738-a5e7-3573a55f415f req-13bb532c-39d4-40c3-847d-280cfa93ef69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b40ad4a-85b9-4312-bce1-08fcb29c8903", "name": "network-vif-deleted", "tag": "2a5a0340-39eb-472d-a674-540a19e2b625"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:21.863145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-028995cb-979f-4738-a5e7-3573a55f415f req-13bb532c-39d4-40c3-847d-280cfa93ef69 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:21.863671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-028995cb-979f-4738-a5e7-3573a55f415f req-13bb532c-39d4-40c3-847d-280cfa93ef69 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:21.864090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-028995cb-979f-4738-a5e7-3573a55f415f req-13bb532c-39d4-40c3-847d-280cfa93ef69 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:21.870137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:21.876109 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-028995cb-979f-4738-a5e7-3573a55f415f req-13bb532c-39d4-40c3-847d-280cfa93ef69 service nova] Creating event network-vif-deleted:2a5a0340-39eb-472d-a674-540a19e2b625 for instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 on n-h1-862876-2 Oct 28 13:49:21.878556 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5f0be67-b74f-46bc-833a-540c6fd67936 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1397 microversion: 2.1 time: 0.088597 Oct 28 13:49:21.891545 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3260/6612] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:21 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1397 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:49:21.892021 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-028995cb-979f-4738-a5e7-3573a55f415f req-13bb532c-39d4-40c3-847d-280cfa93ef69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099485 Oct 28 13:49:21.892021 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3353/6613] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:49:22.372080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:22.372701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:22.379819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:22.380306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:22.380737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:22.381430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:22.381880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:22.382300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:22.464816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:22.473118 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95118641-73ba-4078-9941-f4a34442da99 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.104906 Oct 28 13:49:22.473689 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3261/6614] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:22 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:22.904483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:22.905110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:22.911480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:22.911968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:22.912408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:22.913099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:22.913556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:22.913982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:22.983648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:22.991538 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dcd29929-3b3e-4812-9334-55f4382b7844 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1230 microversion: 2.1 time: 0.092430 Oct 28 13:49:22.992319 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3354/6615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:22 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:23.449590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:23.450567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:23.496385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:23.497744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:23.504052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:23.505839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:23.506509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:23.507077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:23.508030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:23.508610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:23.509155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:23.525377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e449fec4-6145-41e8-bb72-a48aced3b883 req-75ce2f39-df88-4899-8886-763c0a533a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4103a5-9264-41a1-9b1a-5ea98916a60a", "name": "network-vif-plugged", "status": "completed", "tag": "48c52bba-183f-4c21-b37a-d3edbd9871c2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:23.536208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e449fec4-6145-41e8-bb72-a48aced3b883 req-75ce2f39-df88-4899-8886-763c0a533a9b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:23.536635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e449fec4-6145-41e8-bb72-a48aced3b883 req-75ce2f39-df88-4899-8886-763c0a533a9b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:23.537072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e449fec4-6145-41e8-bb72-a48aced3b883 req-75ce2f39-df88-4899-8886-763c0a533a9b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:23.568151 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e449fec4-6145-41e8-bb72-a48aced3b883 req-75ce2f39-df88-4899-8886-763c0a533a9b service nova] Creating event network-vif-plugged:48c52bba-183f-4c21-b37a-d3edbd9871c2 for instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a on n-h1-862876-2 Oct 28 13:49:23.579733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e449fec4-6145-41e8-bb72-a48aced3b883 req-75ce2f39-df88-4899-8886-763c0a533a9b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135381 Oct 28 13:49:23.581767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3262/6616] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:49:23.612518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:23.622569 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40163a2c-2ef2-4ede-902c-7fab06c48a2c tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.130036 Oct 28 13:49:23.625632 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3355/6617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:23 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:49:24.018779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:24.019511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:24.026373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:24.026814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:24.033578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:24.033578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:24.033578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:24.033578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:24.102029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:24.110524 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-88f2a30c-56c3-4641-8b28-369c4915ad3c tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1230 microversion: 2.1 time: 0.099603 Oct 28 13:49:24.111128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3263/6618] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:24 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:24.648662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:24.649255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:24.657284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:24.657767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:24.658204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:24.658927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:24.659459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:24.659888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:24.746424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:24.755364 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6bd08813-2cfe-49cb-9b88-eb1dc71bb416 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1299 microversion: 2.1 time: 0.110638 Oct 28 13:49:24.755951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3356/6619] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:24 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:25.133869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:25.134597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:25.142534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:25.143055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:25.143637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:25.144344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:25.144797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:25.145429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:25.210872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:25.219210 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ec614dc7-e24a-47d7-9dca-4a609cd67077 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1230 microversion: 2.1 time: 0.089305 Oct 28 13:49:25.219792 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3264/6620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:25 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:25.780195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:25.780734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:25.787631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:25.788112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:25.788540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:25.789223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:25.789676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:25.790098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:25.876068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:25.884049 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b0abc958-887f-464f-b9f8-3613bcd2ba77 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1471 microversion: 2.1 time: 0.108988 Oct 28 13:49:25.884674 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3357/6621] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:25 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1471 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:25.908285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:25.908912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:25.915194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:25.915693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:25.916140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:25.916867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:25.917331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:25.918023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.008124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:26.016930 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b23b382-33cb-4fb8-91f5-6e85abd47dcd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1471 microversion: 2.1 time: 0.112700 Oct 28 13:49:26.017504 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3265/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:25 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1471 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:26.038883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:26.039239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:26.045476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.045964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.046604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.047333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.047795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.048232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.136371 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-05c0d1f8-66e6-4982-a4cd-5fcde3452d38 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1622 microversion: 2.1 time: 0.101624 Oct 28 13:49:26.137008 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3358/6623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:26 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1622 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:26.158542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:26.159187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:26.165982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.166467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.166940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.167632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.168404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.168829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.242493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:26.243172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:26.249865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.250354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.250873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.251501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.251953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.252478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.284923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.285638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.286071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.286737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lazy-loading 'fault' on Instance uuid 3b40ad4a-85b9-4312-bce1-08fcb29c8903 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:49:26.321844 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e4864ce-5da9-4761-8a46-571d1eaef704 tempest-TestSecurityGroupsBasicOps-1072580791 tempest-TestSecurityGroupsBasicOps-1072580791-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1909 microversion: 2.1 time: 0.166314 Oct 28 13:49:26.322425 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3266/6624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:26 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1909 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:26.330704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:26.339970 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10cb1509-2915-4d58-874a-39b75550c113 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1235 microversion: 2.1 time: 0.102138 Oct 28 13:49:26.340546 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3359/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:26 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:49:26.386302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:26.386785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:26.392756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.393241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.393678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.394365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.394857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.395286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.422643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:49:26.566211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:26.732141 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f021033d-658d-445d-9ad3-82243ee6c2cd tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 204 len: 0 microversion: 2.1 time: 0.349283 Oct 28 13:49:26.733446 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3267/6626] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:49:26 2022] DELETE /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:49:26.742084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:26.742725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:26.748924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.749415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.750016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.750703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:26.751191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:26.751614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:26.836713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:26.844991 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-756e157f-b566-490a-95af-b8eba71ad51d tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1477 microversion: 2.1 time: 0.106933 Oct 28 13:49:26.845567 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3360/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:26 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1477 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:27.364183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:27.364890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:27.372050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:27.372533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:27.372971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:27.373660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:27.374115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:27.374541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:27.405458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:27.406453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:27.407091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:27.407540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lazy-loading 'fault' on Instance uuid 3b40ad4a-85b9-4312-bce1-08fcb29c8903 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:49:27.449564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c7a313d97842588f266f6c160ebb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df516545a14845ff878763aa7139b5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:27.457274 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-631c5dcd-e617-474d-8a84-dc13f08c8759 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 200 len: 1235 microversion: 2.1 time: 0.097353 Oct 28 13:49:27.457837 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3268/6628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:27 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:27.868547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:27.869155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:27.876671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:27.877155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:27.877594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:27.878278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:27.878779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:27.879183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:27.963318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:27.972148 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0d98d40-4133-4fd8-9f10-1f3475cc7b9b tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1477 microversion: 2.1 time: 0.107526 Oct 28 13:49:27.972957 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3361/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:27 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1477 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:28.465672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9f0595a8-f313-49ad-9ffb-90a672126385 req-a0f42f1c-7103-4790-94df-0c1d4f19de8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4103a5-9264-41a1-9b1a-5ea98916a60a", "name": "network-vif-deleted", "tag": "48c52bba-183f-4c21-b37a-d3edbd9871c2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:28.479117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9f0595a8-f313-49ad-9ffb-90a672126385 req-a0f42f1c-7103-4790-94df-0c1d4f19de8a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:28.479730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:28.479843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9f0595a8-f313-49ad-9ffb-90a672126385 req-a0f42f1c-7103-4790-94df-0c1d4f19de8a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:28.480355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] [instance: 3b40ad4a-85b9-4312-bce1-08fcb29c8903] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:28.480460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9f0595a8-f313-49ad-9ffb-90a672126385 req-a0f42f1c-7103-4790-94df-0c1d4f19de8a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:28.487427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:28.488200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:28.488820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:28.489746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:28.490206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:28.490906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:28.493920 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9f0595a8-f313-49ad-9ffb-90a672126385 req-a0f42f1c-7103-4790-94df-0c1d4f19de8a service nova] Creating event network-vif-deleted:48c52bba-183f-4c21-b37a-d3edbd9871c2 for instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a on n-h1-862876-2 Oct 28 13:49:28.499207 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9f0595a8-f313-49ad-9ffb-90a672126385 req-a0f42f1c-7103-4790-94df-0c1d4f19de8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037283 Oct 28 13:49:28.503046 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3269/6630] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:49:28.506612 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] HTTP exception thrown: Instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 could not be found. Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Request method failure captured: Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 HTTP/1.1 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW9znLRTPqNUx_HnZMGr-vJ8qpNjurzgaCFcq--uuTVUZVijgwi9XlqSpC6qcdW1BP-Q69pxukDQGWNE_D5j2WV1P1E8-QUQNsvt9sGkla0U6eszVEhcAqVXQmgtIbGeFXmfSql-RWenVwyVv-ujtK_nv28tbNZbo3wmJ5YYnN6Tb_mo Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: df516545a14845ff878763aa7139b5a6 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBackupRestore-1713655137 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df516545a14845ff878763aa7139b5a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df516545a14845ff878763aa7139b5a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df516545a14845ff878763aa7139b5a6", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df516545a14845ff878763aa7139b5a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBackupRestore-1713655137 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: df516545a14845ff878763aa7139b5a6 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1713655137 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBackupRestore-1713655137-project Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: e4c7a313d97842588f266f6c160ebb21 Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBackupRestore-1713655137-project Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 could not be found. Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '3b40ad4a-85b9-4312-bce1-08fcb29c8903'} Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 could not be found. Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 could not be found. Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:49:28.508335 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 could not be found. Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Returning 404 to user: Instance 3b40ad4a-85b9-4312-bce1-08fcb29c8903 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66306e5f-b330-4524-8218-dd9e5353e1c5 tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903" status: 404 len: 111 microversion: 2.1 time: 0.033894 Oct 28 13:49:28.511904 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3362/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:28 2022] GET /compute/v2.1/servers/3b40ad4a-85b9-4312-bce1-08fcb29c8903 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:49:28.776434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfa91b03-c6ed-4c6b-affa-4f829fd0021a tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] Calling method '.version_select at 0x7f27b87403a0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:28.857806 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfa91b03-c6ed-4c6b-affa-4f829fd0021a tempest-TestVolumeBackupRestore-1713655137 tempest-TestVolumeBackupRestore-1713655137-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1052865430" status: 202 len: 0 microversion: 2.1 time: 0.085585 Oct 28 13:49:28.858392 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3270/6632] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Oct 28 13:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1052865430 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:49:28.997627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:28.998526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:29.009996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:29.010932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:29.011481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:29.012488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:29.012959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:29.013395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:29.048051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:29.048595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:29.049083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:29.049945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lazy-loading 'fault' on Instance uuid 6d4103a5-9264-41a1-9b1a-5ea98916a60a {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:49:29.092118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:29.101429 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e2a77bbf-090b-47f4-aa17-4aad10b104cc tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 200 len: 1331 microversion: 2.1 time: 0.109079 Oct 28 13:49:29.102407 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3363/6633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:28 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:49:30.129640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:30.130796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 6d4103a5-9264-41a1-9b1a-5ea98916a60a] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:30.138513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:30.139167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:30.139770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:30.141112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:30.141756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:30.149053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:30.156860 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] HTTP exception thrown: Instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a could not be found. Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Request method failure captured: Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a HTTP/1.1 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW92a-R8RAQe0S_WORyVaaPjSz5BXQc2Qd8aBJ11pSjsLgg6phkg6svmWu9UpOVCitJ_rWfejQ5GPngc_2UeETb2xgrqzPShlWn_hTAyA09nAb1ycvYq9VUB7BbE4SYsykPdQDgIfd5xsVUDHyZWXiuga_p2bU1BrPEOemVQFX_ehQkY Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f8f48199777a4915bc3fbcea74ee38dc Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1033768560 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f48199777a4915bc3fbcea74ee38dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f48199777a4915bc3fbcea74ee38dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f8f48199777a4915bc3fbcea74ee38dc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f8f48199777a4915bc3fbcea74ee38dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1033768560 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f8f48199777a4915bc3fbcea74ee38dc Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1033768560 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestSecurityGroupsBasicOps-1033768560-project Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6072db7830ce4f0fa4fbc0e048786325 Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1033768560-project Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a could not be found. Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6d4103a5-9264-41a1-9b1a-5ea98916a60a'} Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a could not be found. Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a could not be found. Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:30.158639 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a could not be found. Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Returning 404 to user: Instance 6d4103a5-9264-41a1-9b1a-5ea98916a60a could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:49:30.162670 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f351598c-dab2-4f72-8fb7-4682d661508a tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a" status: 404 len: 111 microversion: 2.1 time: 0.037384 Oct 28 13:49:30.164444 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3271/6634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:30 2022] GET /compute/v2.1/servers/6d4103a5-9264-41a1-9b1a-5ea98916a60a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 13:49:35.739392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5c502dd0-5ea1-4899-bed1-b62ccdf69bc0 req-2edf6be3-cf34-46b8-a83c-9910aa75d8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417cdee3-907d-4445-8a05-d1a5ac2fbe17", "tag": "871a5408-52b2-4491-9c0e-de72bfeea288"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:35.748963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:35.750046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:35.758842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:35.759550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:35.759988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:35.760691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:35.762890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5c502dd0-5ea1-4899-bed1-b62ccdf69bc0 req-2edf6be3-cf34-46b8-a83c-9910aa75d8dc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:35.763528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:35.764160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5c502dd0-5ea1-4899-bed1-b62ccdf69bc0 req-2edf6be3-cf34-46b8-a83c-9910aa75d8dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:35.764585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5c502dd0-5ea1-4899-bed1-b62ccdf69bc0 req-2edf6be3-cf34-46b8-a83c-9910aa75d8dc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:35.765769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:35.784389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5c502dd0-5ea1-4899-bed1-b62ccdf69bc0 req-2edf6be3-cf34-46b8-a83c-9910aa75d8dc service nova] Creating event network-changed:871a5408-52b2-4491-9c0e-de72bfeea288 for instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 on n-h2-862876-2 Oct 28 13:49:35.797102 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5c502dd0-5ea1-4899-bed1-b62ccdf69bc0 req-2edf6be3-cf34-46b8-a83c-9910aa75d8dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063641 Oct 28 13:49:35.803641 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3272/6635] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:49:35.810767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:49:35.850897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:36.182757 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-59a30941-29d5-4b3b-87c3-25e457a4d3a0 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 204 len: 0 microversion: 2.1 time: 0.451380 Oct 28 13:49:36.186636 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3364/6636] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:49:35 2022] DELETE /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:49:36.202681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:36.202681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:36.221283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:36.221948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:36.237067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:36.238109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:36.238775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:36.240834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:36.524619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:36.532711 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a40a620-e990-44d2-9a4d-1f306a756bf7 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1764 microversion: 2.1 time: 0.341008 Oct 28 13:49:36.547759 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3273/6637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:36 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1764 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:37.572588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:37.573298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:37.580624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:37.581120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:37.581561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:37.582268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:37.582733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:37.584014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:38.215930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:38.229070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-18759f5c-55f0-46f4-8374-300962852084 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1764 microversion: 2.1 time: 0.660682 Oct 28 13:49:38.229768 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3365/6638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:37 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1764 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:38.654227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bf888a9c-df6d-4bb4-8509-6887f9603d90 req-f56d390c-b9ce-4d13-bdb3-4ecc6a4be2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417cdee3-907d-4445-8a05-d1a5ac2fbe17", "name": "network-vif-deleted", "tag": "871a5408-52b2-4491-9c0e-de72bfeea288"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:49:38.667781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bf888a9c-df6d-4bb4-8509-6887f9603d90 req-f56d390c-b9ce-4d13-bdb3-4ecc6a4be2bc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:38.668391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bf888a9c-df6d-4bb4-8509-6887f9603d90 req-f56d390c-b9ce-4d13-bdb3-4ecc6a4be2bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:38.669023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bf888a9c-df6d-4bb4-8509-6887f9603d90 req-f56d390c-b9ce-4d13-bdb3-4ecc6a4be2bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:38.688374 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bf888a9c-df6d-4bb4-8509-6887f9603d90 req-f56d390c-b9ce-4d13-bdb3-4ecc6a4be2bc service nova] Creating event network-vif-deleted:871a5408-52b2-4491-9c0e-de72bfeea288 for instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 on n-h2-862876-2 Oct 28 13:49:38.694975 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bf888a9c-df6d-4bb4-8509-6887f9603d90 req-f56d390c-b9ce-4d13-bdb3-4ecc6a4be2bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045082 Oct 28 13:49:38.695666 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3274/6639] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:49:39.255686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:39.267014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:39.278523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:39.279291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:39.279739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:39.281412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:39.282135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:39.282707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:39.320486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:39.320963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:39.321447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:39.321890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lazy-loading 'fault' on Instance uuid 417cdee3-907d-4445-8a05-d1a5ac2fbe17 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:49:39.365762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6072db7830ce4f0fa4fbc0e048786325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f48199777a4915bc3fbcea74ee38dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:49:39.373638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-537d2d5c-0814-43c7-a9c3-2afb59d03aea tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 200 len: 1383 microversion: 2.1 time: 0.123240 Oct 28 13:49:39.374440 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3366/6640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:39 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 1383 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:49:40.398532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:40.400123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] [instance: 417cdee3-907d-4445-8a05-d1a5ac2fbe17] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:49:40.409308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:40.410579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:40.411264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:40.412197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:49:40.412860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:49:40.413530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:49:40.431854 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] HTTP exception thrown: Instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 could not be found. Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Request method failure captured: Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 HTTP/1.1 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW92a-R8RAQe0S_WORyVaaPjSz5BXQc2Qd8aBJ11pSjsLgg6phkg6svmWu9UpOVCitJ_rWfejQ5GPngc_2UeETb2xgrqzPShlWn_hTAyA09nAb1ycvYq9VUB7BbE4SYsykPdQDgIfd5xsVUDHyZWXiuga_p2bU1BrPEOemVQFX_ehQkY Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f8f48199777a4915bc3fbcea74ee38dc Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1033768560 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f48199777a4915bc3fbcea74ee38dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8f48199777a4915bc3fbcea74ee38dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f8f48199777a4915bc3fbcea74ee38dc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f8f48199777a4915bc3fbcea74ee38dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1033768560 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f8f48199777a4915bc3fbcea74ee38dc Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1033768560 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestSecurityGroupsBasicOps-1033768560-project Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 6072db7830ce4f0fa4fbc0e048786325 Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1033768560-project Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 could not be found. Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '417cdee3-907d-4445-8a05-d1a5ac2fbe17'} Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 could not be found. Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 could not be found. Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:40.433949 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 could not be found. Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:49:40.438262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Returning 404 to user: Instance 417cdee3-907d-4445-8a05-d1a5ac2fbe17 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:49:40.439310 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f98c76d-6c2a-4360-9dba-f96114cd6377 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17" status: 404 len: 111 microversion: 2.1 time: 0.045044 Oct 28 13:49:40.440293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3275/6641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:49:40 2022] GET /compute/v2.1/servers/417cdee3-907d-4445-8a05-d1a5ac2fbe17 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:49:44.960325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51829605-8076-4795-8f18-a723f9d22ba6 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] Calling method '.version_select at 0x7f27b8140550>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:49:44.969514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:49:45.123222 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51829605-8076-4795-8f18-a723f9d22ba6 tempest-TestSecurityGroupsBasicOps-1033768560 tempest-TestSecurityGroupsBasicOps-1033768560-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-981724514" status: 202 len: 0 microversion: 2.1 time: 0.166656 Oct 28 13:49:45.129974 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3367/6642] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 13:49:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-981724514 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:50:01.016128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:01.016892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:01.194644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-84c668a1-8a8e-45e0-bd33-34d15f3c49b9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Action: 'create', calling method: .version_select at 0x7f27b8aeeca0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1471887162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIFbpanb3QsSzwV1lwCO81d8BrqdSUuIGSVfJIsArAQa4K9/Qvve03ll1TNmI+51G/i9BLWJHIyKmivVpeVA7FyYqnc84pISBa0nTFhvyYKgE8/lQqUNeECs7d443gZUg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:50:01.216266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-84c668a1-8a8e-45e0-bd33-34d15f3c49b9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Getting quotas for project 6646beff70ea458584c0817fa91dc27b. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:50:01.218966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-84c668a1-8a8e-45e0-bd33-34d15f3c49b9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Getting quotas for user 94122d12002a49e8a98e0d4780706bd5 and project 6646beff70ea458584c0817fa91dc27b. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:50:01.280434 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-84c668a1-8a8e-45e0-bd33-34d15f3c49b9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.269985 Oct 28 13:50:01.281049 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3276/6643] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 13:50:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:50:03.841148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1601099011", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1471887162", "security_groups": [{"name": "tempest-secgroup-smoke-161309561"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "0a0cf9cc-cb24-4f26-bced-d9d0e72bbb68"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:50:03.850992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:03.954341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] validate_networks() for [('0a0cf9cc-cb24-4f26-bced-d9d0e72bbb68', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:50:04.428330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Getting quotas for project 6646beff70ea458584c0817fa91dc27b. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:50:04.433575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Getting quotas for user 94122d12002a49e8a98e0d4780706bd5 and project 6646beff70ea458584c0817fa91dc27b. Resources: dict_keys(['metadata_items']) {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:50:04.446261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:50:04.446736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:50:04.447236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:50:04.447638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:50:04.448045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:50:04.458686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:04.459544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:04.460307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:04.461581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:04.462401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:04.463288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:04.489696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Getting quotas for project 6646beff70ea458584c0817fa91dc27b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:50:04.497711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Getting quotas for user 94122d12002a49e8a98e0d4780706bd5 and project 6646beff70ea458584c0817fa91dc27b. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:50:04.518499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:50:04.522939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:50:04.684630 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2083039b-3640-4b7c-942b-fd7dc0c13f90 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.848145 Oct 28 13:50:04.685495 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3368/6644] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:50:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:50:04.698092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e07cf29f-bfec-44fb-ac5e-8278f3aab2cc tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:04.699220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e07cf29f-bfec-44fb-ac5e-8278f3aab2cc tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:04.770006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e07cf29f-bfec-44fb-ac5e-8278f3aab2cc tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:04.778251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e07cf29f-bfec-44fb-ac5e-8278f3aab2cc tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1303 microversion: 2.1 time: 0.085261 Oct 28 13:50:04.786131 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3277/6645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:04 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:05.803235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:05.804378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:05.812113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:05.812768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:05.813205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:05.813947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:05.814397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:05.814850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:05.881777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:05.890900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc88fb18-5af7-494b-9ad4-fe495fdd962a tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1307 microversion: 2.1 time: 0.092029 Oct 28 13:50:05.891484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3369/6646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:05 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:50:06.913576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:06.914374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:06.922531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:06.926040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:06.926040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:06.926040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:06.926040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:06.926040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:07.002099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:07.009973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b26c64ad-2b2e-4352-ac02-84f4cae7c38d tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1363 microversion: 2.1 time: 0.100379 Oct 28 13:50:07.010552 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3278/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:06 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1363 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:08.032983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:08.033499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:08.040200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:08.040681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:08.041107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:08.042531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:08.043051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:08.043482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:08.180140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:08.188662 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3a5f9ee8-3282-44f9-97ca-6a9c55d39420 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1428 microversion: 2.1 time: 0.159592 Oct 28 13:50:08.189293 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3370/6648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:08 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:08.545371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-55ba7e4d-3fcc-410c-b811-bc3eba728e64 req-57cda691-76fc-43a7-9d95-2068728c01fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b6fc36-8c70-4756-afab-a1082c801964", "tag": "ed454992-dfd5-4677-8219-57e38734bcd3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:50:08.559389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-55ba7e4d-3fcc-410c-b811-bc3eba728e64 req-57cda691-76fc-43a7-9d95-2068728c01fb service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:08.559949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-55ba7e4d-3fcc-410c-b811-bc3eba728e64 req-57cda691-76fc-43a7-9d95-2068728c01fb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:08.560487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-55ba7e4d-3fcc-410c-b811-bc3eba728e64 req-57cda691-76fc-43a7-9d95-2068728c01fb service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:08.571702 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-55ba7e4d-3fcc-410c-b811-bc3eba728e64 req-57cda691-76fc-43a7-9d95-2068728c01fb service nova] Creating event network-changed:ed454992-dfd5-4677-8219-57e38734bcd3 for instance 65b6fc36-8c70-4756-afab-a1082c801964 on n-h1-862876-2 Oct 28 13:50:08.576950 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-55ba7e4d-3fcc-410c-b811-bc3eba728e64 req-57cda691-76fc-43a7-9d95-2068728c01fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037502 Oct 28 13:50:08.578049 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3279/6649] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:50:09.211340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:09.211949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:09.219304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:09.219786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:09.220215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:09.220903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:09.221351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:09.221769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:09.360431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:09.368194 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d3e42a27-ec9e-4600-9faa-8a3b61686fe2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1428 microversion: 2.1 time: 0.160707 Oct 28 13:50:09.368852 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3371/6650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:09 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:10.454699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:10.538818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:10.548879 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d81a6e70-5fec-479c-8b4c-00e0c861e375 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1428 microversion: 2.1 time: 0.158935 Oct 28 13:50:10.548879 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3280/6651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:10 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:11.570614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:11.571221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:11.578574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:11.579115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:11.579557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:11.580254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:11.580713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:11.581139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:11.716032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:11.724557 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cbb1bcf0-60ee-444e-b343-7a23751a6f8f tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1428 microversion: 2.1 time: 0.158971 Oct 28 13:50:11.726484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3372/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:11 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:12.747805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:12.748422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:12.755910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:12.756393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:12.756830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:12.757539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:12.757995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:12.758417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:12.891801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:12.899494 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a48e479d-cf01-4a27-a12f-da2b301eb3fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1428 microversion: 2.1 time: 0.155600 Oct 28 13:50:12.900094 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3281/6653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:12 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1428 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:50:13.648790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5e46bec2-a71d-4707-8949-4cf514e409cf req-e2829e16-d08a-4f81-b3be-6324f035a08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b6fc36-8c70-4756-afab-a1082c801964", "name": "network-vif-plugged", "status": "completed", "tag": "ed454992-dfd5-4677-8219-57e38734bcd3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:50:13.659622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5e46bec2-a71d-4707-8949-4cf514e409cf req-e2829e16-d08a-4f81-b3be-6324f035a08b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:13.660086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5e46bec2-a71d-4707-8949-4cf514e409cf req-e2829e16-d08a-4f81-b3be-6324f035a08b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:13.660507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5e46bec2-a71d-4707-8949-4cf514e409cf req-e2829e16-d08a-4f81-b3be-6324f035a08b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:13.671374 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5e46bec2-a71d-4707-8949-4cf514e409cf req-e2829e16-d08a-4f81-b3be-6324f035a08b service nova] Creating event network-vif-plugged:ed454992-dfd5-4677-8219-57e38734bcd3 for instance 65b6fc36-8c70-4756-afab-a1082c801964 on n-h1-862876-2 Oct 28 13:50:13.676485 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5e46bec2-a71d-4707-8949-4cf514e409cf req-e2829e16-d08a-4f81-b3be-6324f035a08b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Oct 28 13:50:13.677121 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3373/6654] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:50:13.922177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:13.922860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:13.929836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:13.930270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:13.930712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:13.931444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:13.931910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:13.932338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:14.064848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:14.072580 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c18bb4f4-beb2-48f0-b316-967b97803981 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1428 microversion: 2.1 time: 0.154574 Oct 28 13:50:14.073174 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3282/6655] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:13 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1428 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:15.093056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:15.094509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:15.099335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:15.100028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:15.106039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:15.106513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:15.107006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:15.107681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:15.108131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:15.108549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:15.243221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:15.251494 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a590f2a4-a6b6-40e1-b286-088ee825f009 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1608 microversion: 2.1 time: 0.159397 Oct 28 13:50:15.252076 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3374/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:15 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1608 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:15.274103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:15.274720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:15.276710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:15.282378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:15.282941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:15.283381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:15.284070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:15.284526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:15.284953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:15.416283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:15.424330 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77bc99d1-80d1-4974-a112-7a268a280aa2 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1608 microversion: 2.1 time: 0.154173 Oct 28 13:50:15.424906 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3283/6657] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:15 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1608 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:15.446673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:15.447578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:15.454162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:15.454653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:15.455121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:15.455814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:15.456271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:15.456702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:15.587045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:50:15.594862 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9517ad81-ed43-448c-9cb9-701884477442 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1608 microversion: 2.1 time: 0.151975 Oct 28 13:50:15.595443 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3375/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:50:15 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1608 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:50:17.920420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9e54431a-79e8-4aaa-bc39-716b838d74c5 req-62e4244b-5fa8-4070-bac2-7dd9cf3e337f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b6fc36-8c70-4756-afab-a1082c801964", "tag": "ed454992-dfd5-4677-8219-57e38734bcd3"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:50:17.931774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9e54431a-79e8-4aaa-bc39-716b838d74c5 req-62e4244b-5fa8-4070-bac2-7dd9cf3e337f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:17.932394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9e54431a-79e8-4aaa-bc39-716b838d74c5 req-62e4244b-5fa8-4070-bac2-7dd9cf3e337f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:17.932896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9e54431a-79e8-4aaa-bc39-716b838d74c5 req-62e4244b-5fa8-4070-bac2-7dd9cf3e337f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:17.945020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9e54431a-79e8-4aaa-bc39-716b838d74c5 req-62e4244b-5fa8-4070-bac2-7dd9cf3e337f service nova] Creating event network-changed:ed454992-dfd5-4677-8219-57e38734bcd3 for instance 65b6fc36-8c70-4756-afab-a1082c801964 on n-h1-862876-2 Oct 28 13:50:17.950617 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9e54431a-79e8-4aaa-bc39-716b838d74c5 req-62e4244b-5fa8-4070-bac2-7dd9cf3e337f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034119 Oct 28 13:50:17.951396 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3284/6659] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:50:53.842029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:50:53.842524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:50:53.844978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:53.845631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=40 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:50:53.850409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:53.850933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:53.851369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:53.852049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:50:53.852614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:50:53.853048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:50:53.876675 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e71542ba-8e02-4199-8a86-30ac63d949a9 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.038819 Oct 28 13:50:53.877342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3376/6660] 10.222.0.25 () {58 vars in 1293 bytes} [Fri Oct 28 13:50:53 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964/os-server-password => generated 116 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:54:57.306752 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 13:54:57.307552 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 13:54:57.308217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:54:57.308977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=34 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:54:57.309915 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:54:57.310078 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 (ip 10.222.0.25) !!! Oct 28 13:54:57.311302 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 13:54:57.311455 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 (ip 10.222.0.25) !!! Oct 28 13:54:57.312867 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:54:57.312971 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 (ip 10.222.0.25) !!! Oct 28 13:54:57.324407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:54:57.325006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:54:57.338353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:54:57.338353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:54:57.338353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:54:57.338353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:54:57.338353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:54:57.338353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:54:57.363878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:54:57.686232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab59264d-6a21-468d-ba51-562b73f0499b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "DELETE /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 204 len: 0 microversion: 2.1 time: 0.380977 Oct 28 13:54:57.688027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3285/6661] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:54:57 2022] DELETE /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:54:57.695170 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 13:54:57.695987 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 13:54:57.696747 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:54:57.696892 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 (ip 10.222.0.25) !!! Oct 28 13:54:57.698913 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:54:57.699023 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 (ip 10.222.0.25) !!! Oct 28 13:54:57.701583 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 13:54:57.701702 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 (ip 10.222.0.25) !!! Oct 28 13:54:57.709079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:54:57.709681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:54:57.723349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:54:57.723921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:54:57.724357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:54:57.725041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:54:57.725488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:54:57.725911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:54:57.945085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:54:57.953670 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bfbe4e87-eb30-4624-afe1-333e61c0334b tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1733 microversion: 2.1 time: 0.262182 Oct 28 13:54:57.954237 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3377/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:54:57 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1733 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:54:58.977963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:54:58.978685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:54:58.989334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:54:58.989825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:54:58.990262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:54:58.991009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:54:58.991468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:54:58.991897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:54:59.008689 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49212. Oct 28 13:54:59.013326 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49214. Oct 28 13:54:59.219136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:54:59.227050 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b34f9dcf-b3b7-43f3-b7fd-854c743025da tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1733 microversion: 2.1 time: 0.253290 Oct 28 13:54:59.227638 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3286/6663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:54:58 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:00.224551 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49232. Oct 28 13:55:00.226353 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49230. Oct 28 13:55:00.253351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:00.253351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:00.258778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:00.259385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:00.260387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:00.261400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:00.262120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:00.262661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:00.300550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b8578acc-059c-4a9e-a01e-fc9c3cf700dd req-df720ed5-56b6-4b69-9323-7f26f122ab37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b6fc36-8c70-4756-afab-a1082c801964", "name": "network-vif-deleted", "tag": "ed454992-dfd5-4677-8219-57e38734bcd3"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:55:00.316672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b8578acc-059c-4a9e-a01e-fc9c3cf700dd req-df720ed5-56b6-4b69-9323-7f26f122ab37 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:00.316672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b8578acc-059c-4a9e-a01e-fc9c3cf700dd req-df720ed5-56b6-4b69-9323-7f26f122ab37 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:00.316672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b8578acc-059c-4a9e-a01e-fc9c3cf700dd req-df720ed5-56b6-4b69-9323-7f26f122ab37 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:00.333640 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b8578acc-059c-4a9e-a01e-fc9c3cf700dd req-df720ed5-56b6-4b69-9323-7f26f122ab37 service nova] Creating event network-vif-deleted:ed454992-dfd5-4677-8219-57e38734bcd3 for instance 65b6fc36-8c70-4756-afab-a1082c801964 on n-h1-862876-2 Oct 28 13:55:00.340169 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b8578acc-059c-4a9e-a01e-fc9c3cf700dd req-df720ed5-56b6-4b69-9323-7f26f122ab37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127825 Oct 28 13:55:00.342500 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3378/6664] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:55:00.362124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94122d12002a49e8a98e0d4780706bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6646beff70ea458584c0817fa91dc27b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:00.374653 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b2e0b352-6436-4945-b93e-5077aa26bcbf tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 200 len: 1666 microversion: 2.1 time: 0.128659 Oct 28 13:55:00.388075 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3287/6665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:00 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 1666 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:55:01.447914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:01.448632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:01.454877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:01.455363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:01.455805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:01.456492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:01.456951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:01.457374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:01.745802 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] HTTP exception thrown: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Request method failure captured: Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 HTTP/1.1 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW94CxdUTKmkAAwVs1qLwoJM9kPfwegbRgkwcW9whl5NfGJxrbgDhg6NBhmZML-7Nzzx1mrGHYUSPDCs-tgTsytjDvK2KhXa1s3NOsA8dSWOf6vMO6M3LSsE5BB5bM5F6-z1URqjIVDQE4sfdVGlqn3LUZZMNo9rVy-hGL4b5ql7cGp8 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6646beff70ea458584c0817fa91dc27b Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestServerBasicOps-765675878 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6646beff70ea458584c0817fa91dc27b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestServerBasicOps-765675878 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6646beff70ea458584c0817fa91dc27b Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestServerBasicOps-765675878 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestServerBasicOps-765675878-project Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 94122d12002a49e8a98e0d4780706bd5 Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestServerBasicOps-765675878-project Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '65b6fc36-8c70-4756-afab-a1082c801964'} Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:55:01.749269 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Returning 404 to user: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-861670cc-f77c-47fd-bfac-20d54849b255 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 404 len: 111 microversion: 2.1 time: 0.355559 Oct 28 13:55:01.752776 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3379/6666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:01 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 111 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:55:02.283111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:02.283623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:02.291542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:02.292105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:02.292555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:02.293248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:02.293738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:02.294167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:02.308719 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] HTTP exception thrown: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Request method failure captured: Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 HTTP/1.1 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW94CxdUTKmkAAwVs1qLwoJM9kPfwegbRgkwcW9whl5NfGJxrbgDhg6NBhmZML-7Nzzx1mrGHYUSPDCs-tgTsytjDvK2KhXa1s3NOsA8dSWOf6vMO6M3LSsE5BB5bM5F6-z1URqjIVDQE4sfdVGlqn3LUZZMNo9rVy-hGL4b5ql7cGp8 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 6646beff70ea458584c0817fa91dc27b Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestServerBasicOps-765675878 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6646beff70ea458584c0817fa91dc27b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestServerBasicOps-765675878 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 6646beff70ea458584c0817fa91dc27b Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestServerBasicOps-765675878 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestServerBasicOps-765675878-project Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 94122d12002a49e8a98e0d4780706bd5 Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestServerBasicOps-765675878-project Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '65b6fc36-8c70-4756-afab-a1082c801964'} Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:55:02.310392 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Returning 404 to user: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a66475e-1303-44ce-b50a-fce0b026c685 tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "DELETE /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 404 len: 111 microversion: 2.1 time: 0.032813 Oct 28 13:55:02.314215 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3288/6667] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:55:02 2022] DELETE /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:55:02.320640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:02.321255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] [instance: 65b6fc36-8c70-4756-afab-a1082c801964] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:02.328544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:02.329032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:02.329479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:02.330169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:02.330660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:02.331176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:02.344907 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] HTTP exception thrown: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Request method failure captured: Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 HTTP/1.1 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW94CxdUTKmkAAwVs1qLwoJM9kPfwegbRgkwcW9whl5NfGJxrbgDhg6NBhmZML-7Nzzx1mrGHYUSPDCs-tgTsytjDvK2KhXa1s3NOsA8dSWOf6vMO6M3LSsE5BB5bM5F6-z1URqjIVDQE4sfdVGlqn3LUZZMNo9rVy-hGL4b5ql7cGp8 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 6646beff70ea458584c0817fa91dc27b Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestServerBasicOps-765675878 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6646beff70ea458584c0817fa91dc27b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6646beff70ea458584c0817fa91dc27b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestServerBasicOps-765675878 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 6646beff70ea458584c0817fa91dc27b Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestServerBasicOps-765675878 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestServerBasicOps-765675878-project Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 94122d12002a49e8a98e0d4780706bd5 Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestServerBasicOps-765675878-project Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '65b6fc36-8c70-4756-afab-a1082c801964'} Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:55:02.346479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Returning 404 to user: Instance 65b6fc36-8c70-4756-afab-a1082c801964 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6e39c49f-75d8-4717-81b5-b9efdf7a93fd tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964" status: 404 len: 111 microversion: 2.1 time: 0.031350 Oct 28 13:55:02.349984 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3380/6668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:02 2022] GET /compute/v2.1/servers/65b6fc36-8c70-4756-afab-a1082c801964 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:55:02.580445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9619c52-6643-409e-937b-508b3c22ddce tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] Calling method '.version_select at 0x7f27b940aa60>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:02.673446 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9619c52-6643-409e-937b-508b3c22ddce tempest-TestServerBasicOps-765675878 tempest-TestServerBasicOps-765675878-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1471887162" status: 202 len: 0 microversion: 2.1 time: 0.096780 Oct 28 13:55:02.677019 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3289/6669] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Oct 28 13:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1471887162 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 13:55:39.665253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-633292896", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "93ad87f3-cf71-424d-a2c3-32b905746a4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:55:39.675974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:55:39.676627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:55:39.728886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:55:40.230253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:55:40.230253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:55:40.230965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:55:40.230965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:55:40.231282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:55:40.240606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:40.241090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:40.241529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:40.242254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:40.242711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:40.243159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:40.262969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:55:40.268881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:55:40.327633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:55:40.329727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93ad87f3-cf71-424d-a2c3-32b905746a4e',volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:55:40.772731 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5a188111-562b-4c9e-8e9d-7c44c8aec1ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111314 Oct 28 13:55:40.781041 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3381/6670] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:55:40.786755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98bf8e01-765a-4aba-bf65-c38ffea9820f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:40.787540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-98bf8e01-765a-4aba-bf65-c38ffea9820f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:40.789600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:55:40.790261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:55:40.846255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-98bf8e01-765a-4aba-bf65-c38ffea9820f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:40.853466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-98bf8e01-765a-4aba-bf65-c38ffea9820f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1056 microversion: 2.1 time: 0.071140 Oct 28 13:55:40.854045 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3290/6671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:40 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1056 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:41.877338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-245cad15-773b-4cd5-84ee-bb710ff06ef0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:41.877957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-245cad15-773b-4cd5-84ee-bb710ff06ef0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:41.931033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-245cad15-773b-4cd5-84ee-bb710ff06ef0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:41.940020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-245cad15-773b-4cd5-84ee-bb710ff06ef0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1056 microversion: 2.1 time: 0.067479 Oct 28 13:55:41.941282 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3382/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:41 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1056 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:42.967728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-586b7199-692b-4d7c-acc7-0190391a73c2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:42.968334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-586b7199-692b-4d7c-acc7-0190391a73c2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:43.026912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-586b7199-692b-4d7c-acc7-0190391a73c2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:43.034227 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-586b7199-692b-4d7c-acc7-0190391a73c2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1056 microversion: 2.1 time: 0.070383 Oct 28 13:55:43.034813 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3291/6673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:42 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1056 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:44.059314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:44.059931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:44.068486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:44.068978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:44.069413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:44.070197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:44.070704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:44.071160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:44.135020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:44.143861 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd6e3a84-b772-4558-b49d-0e7f2bd5d7d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1106 microversion: 2.1 time: 0.090229 Oct 28 13:55:44.144439 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3383/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:44 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:45.165728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:45.166427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:45.176771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:45.177282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:45.177720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:45.178431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:45.178922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:45.179353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:45.248450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:45.259659 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4a8d1e29-b07d-4db3-884e-0bc50fcbaefa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1172 microversion: 2.1 time: 0.097913 Oct 28 13:55:45.260478 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3292/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:45 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1172 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:46.289721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:46.290491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:46.298127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:46.298770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:46.299594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:46.300467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:46.301029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:46.301559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:46.582158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:46.592346 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d86997d1-a91e-4a3f-8f09-4f2f4cb4e197 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1214 microversion: 2.1 time: 0.306733 Oct 28 13:55:46.593441 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3384/6676] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:46 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:55:47.124472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-42be3c7f-f97c-411b-8ca8-0cc88673ccc6 req-8c197eda-9293-4033-8ede-08eb63d49c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de14cf45-1964-46fa-b465-9a24ed6b4869", "tag": "dc685aaf-33ff-44da-8bc8-30f4bd86fcc6"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:55:47.137482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-42be3c7f-f97c-411b-8ca8-0cc88673ccc6 req-8c197eda-9293-4033-8ede-08eb63d49c70 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:47.138314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-42be3c7f-f97c-411b-8ca8-0cc88673ccc6 req-8c197eda-9293-4033-8ede-08eb63d49c70 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:47.138849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-42be3c7f-f97c-411b-8ca8-0cc88673ccc6 req-8c197eda-9293-4033-8ede-08eb63d49c70 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:47.150379 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-42be3c7f-f97c-411b-8ca8-0cc88673ccc6 req-8c197eda-9293-4033-8ede-08eb63d49c70 service nova] Creating event network-changed:dc685aaf-33ff-44da-8bc8-30f4bd86fcc6 for instance de14cf45-1964-46fa-b465-9a24ed6b4869 on n-h2-862876-2 Oct 28 13:55:47.156240 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-42be3c7f-f97c-411b-8ca8-0cc88673ccc6 req-8c197eda-9293-4033-8ede-08eb63d49c70 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036336 Oct 28 13:55:47.156948 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3293/6677] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:55:47.615743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:47.617006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:47.623718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:47.624434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:47.624898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:47.625872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:47.626343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:47.626828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:47.857331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:47.866124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae23a246-8b8e-4b12-a080-9a982fc863d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1214 microversion: 2.1 time: 0.254531 Oct 28 13:55:47.866704 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3385/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:47 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:48.890664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:48.891315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:48.897484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:48.897977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:48.898424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:48.899149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:48.899609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:48.900045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:49.033083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:49.040902 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3203db23-e3c0-4830-90f6-bf85ba77b9fd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1214 microversion: 2.1 time: 0.155951 Oct 28 13:55:49.041485 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3294/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:48 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:50.063718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:50.064335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:50.071223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:50.071637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:50.072082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:50.072773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:50.073234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:50.073662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:50.208589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:50.217067 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe871591-4949-45b5-9db5-3fe03283bc4f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1214 microversion: 2.1 time: 0.157314 Oct 28 13:55:50.217637 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3386/6680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:50 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:51.239461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:51.240081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:51.247888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:51.248387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:51.248889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:51.249635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:51.250127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:51.250579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:51.383622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:51.391332 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52a74cc3-eb3b-40f0-bd7f-7b2ba5666091 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.155695 Oct 28 13:55:51.391901 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3295/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:51 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:52.414365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:52.415027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:52.416839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:55:52.418342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:55:52.423616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:52.429646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:52.429646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:52.429646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:52.429646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:52.429646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:52.553315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:52.561674 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f3d3db8-b5f4-4c91-b50f-bf6b832a5b8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.151127 Oct 28 13:55:52.562249 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3387/6682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:52 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:53.583615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:53.584349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:53.587164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:55:53.592581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:53.592999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:53.593434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:53.594171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:53.594631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:53.595083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:53.722232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:53.729998 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a37de048-00ba-440b-a3e4-a64c22272531 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.150441 Oct 28 13:55:53.730570 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3296/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:53 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:54.753178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:54.753808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:54.760667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:54.761149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:54.761585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:54.762267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:54.762722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:54.763170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:54.894283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:54.901965 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d81b21f9-62fd-4569-9cee-55baaba964ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.152682 Oct 28 13:55:54.902540 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3388/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:54 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:55.925952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:55.926709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:55.933617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:55.934168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:55.934673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:55.935454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:55.935980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:55.936473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:56.077504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:56.085187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-60ebb414-bc59-43b1-bda2-c53162705aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.163402 Oct 28 13:55:56.085760 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3297/6685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:55 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:57.108944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:57.109588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:57.116450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:57.116937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:57.117377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:57.118070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:57.118530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:57.118997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:57.245739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:57.253412 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-243f6c92-60eb-4cff-a8c2-933ea73a5551 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.148888 Oct 28 13:55:57.253926 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3389/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:57 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:58.275966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:58.276599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:58.283395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:58.283881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:58.284317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:58.285013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:58.285478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:58.285907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:58.425357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:58.433640 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff05f159-5e81-4f08-b3cb-6185709751b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.161581 Oct 28 13:55:58.434555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3298/6687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:58 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:55:59.457454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:55:59.458177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:55:59.465618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:59.467207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:59.467207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:59.467942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:55:59.468219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:55:59.468656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:55:59.601995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:55:59.610296 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c90b40f-33f6-4020-bf73-8eef5bd45cfd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.156929 Oct 28 13:55:59.610895 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3390/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:55:59 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:00.632610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:00.633236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:00.639443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:00.650880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:00.650880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:00.650880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:00.650880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:00.650880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:00.768835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:00.776603 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-db355731-8730-4ed4-ba60-bc42f39eea6b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.147869 Oct 28 13:56:00.777182 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3299/6689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:00 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:01.518776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e14f5df6-e614-403a-9cc0-3c4b51915ebb req-b9ae16c0-6201-45e0-baef-c7d9796ec4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de14cf45-1964-46fa-b465-9a24ed6b4869", "name": "network-vif-plugged", "status": "completed", "tag": "dc685aaf-33ff-44da-8bc8-30f4bd86fcc6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:56:01.529164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e14f5df6-e614-403a-9cc0-3c4b51915ebb req-b9ae16c0-6201-45e0-baef-c7d9796ec4cf service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:01.529652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e14f5df6-e614-403a-9cc0-3c4b51915ebb req-b9ae16c0-6201-45e0-baef-c7d9796ec4cf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:01.530088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e14f5df6-e614-403a-9cc0-3c4b51915ebb req-b9ae16c0-6201-45e0-baef-c7d9796ec4cf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:01.542313 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e14f5df6-e614-403a-9cc0-3c4b51915ebb req-b9ae16c0-6201-45e0-baef-c7d9796ec4cf service nova] Creating event network-vif-plugged:dc685aaf-33ff-44da-8bc8-30f4bd86fcc6 for instance de14cf45-1964-46fa-b465-9a24ed6b4869 on n-h2-862876-2 Oct 28 13:56:01.547617 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e14f5df6-e614-403a-9cc0-3c4b51915ebb req-b9ae16c0-6201-45e0-baef-c7d9796ec4cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161084 Oct 28 13:56:01.548222 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3391/6690] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:56:01.799295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:01.800096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:01.807139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:01.807631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:01.808076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:01.808785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:01.809237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:01.809697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:01.941609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:01.949320 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4221b64f-79d1-4bad-9f1f-f815e0f67645 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1202 microversion: 2.1 time: 0.154091 Oct 28 13:56:01.949908 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3300/6691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:01 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:02.973912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:02.974611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:02.981876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:02.982361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:02.982826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:02.983514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:02.983966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:02.984385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.115430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:03.123183 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f3e1b0c-d6a7-4152-9f0a-35d1dbf78536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1389 microversion: 2.1 time: 0.153769 Oct 28 13:56:03.123745 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3392/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:02 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:03.145352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:03.145968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:03.152791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.153277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.153720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.154412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.154897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.155327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.280544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:03.288762 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dfa53997-1dd7-4ca0-b4f0-3a6ea804f2ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1389 microversion: 2.1 time: 0.147334 Oct 28 13:56:03.289339 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3301/6693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:03 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:03.310906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:03.311521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:03.317376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.317860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.318298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.319027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.319488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.319913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.450265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:03.458155 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f5b8247-7e05-4769-b6d1-2f549b6e63cc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1389 microversion: 2.1 time: 0.151139 Oct 28 13:56:03.458734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3393/6694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:03 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:03.480067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:03.480571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:03.487338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.487767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.488205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.488904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.489363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.489789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.513855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:56:03.706668 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4919eb2-838c-4963-8b6e-9527a1d29d8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 204 len: 0 microversion: 2.1 time: 0.230206 Oct 28 13:56:03.707297 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3302/6695] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:56:03 2022] DELETE /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:56:03.715519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:03.718255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:03.722773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.723271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.723711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.724437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:03.724895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:03.725327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:03.854475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:03.862215 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5fdde192-e291-442c-9be3-9ad68637c872 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1395 microversion: 2.1 time: 0.150633 Oct 28 13:56:03.862798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3394/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:03 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1395 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:04.886190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:04.886843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:04.893658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:04.894143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:04.894577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:04.895295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:04.895748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:04.896167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:05.027486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:05.035898 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d4455337-e527-4882-b652-23666dbd17c5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1395 microversion: 2.1 time: 0.154062 Oct 28 13:56:05.036475 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3303/6697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:04 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:05.723495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1f96bd28-2ac5-475a-b48e-379a482f35e4 req-0186209a-9a4c-4ee5-81ae-e0d723509e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de14cf45-1964-46fa-b465-9a24ed6b4869", "name": "network-vif-deleted", "tag": "dc685aaf-33ff-44da-8bc8-30f4bd86fcc6"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:56:05.733949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1f96bd28-2ac5-475a-b48e-379a482f35e4 req-0186209a-9a4c-4ee5-81ae-e0d723509e42 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:05.734425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1f96bd28-2ac5-475a-b48e-379a482f35e4 req-0186209a-9a4c-4ee5-81ae-e0d723509e42 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:05.734955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1f96bd28-2ac5-475a-b48e-379a482f35e4 req-0186209a-9a4c-4ee5-81ae-e0d723509e42 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:05.746943 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1f96bd28-2ac5-475a-b48e-379a482f35e4 req-0186209a-9a4c-4ee5-81ae-e0d723509e42 service nova] Creating event network-vif-deleted:dc685aaf-33ff-44da-8bc8-30f4bd86fcc6 for instance de14cf45-1964-46fa-b465-9a24ed6b4869 on n-h2-862876-2 Oct 28 13:56:05.752782 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1f96bd28-2ac5-475a-b48e-379a482f35e4 req-0186209a-9a4c-4ee5-81ae-e0d723509e42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032907 Oct 28 13:56:05.753478 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3395/6698] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:56:06.059340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:06.059876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:06.067518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:06.068017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:06.068461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:06.069166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:06.069629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:06.070060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:06.134228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:06.142006 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e603ab3-058a-4c81-b2f0-27821657074e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1187 microversion: 2.1 time: 0.086601 Oct 28 13:56:06.142586 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3304/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:06 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:07.166713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:07.167382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:07.173531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:07.174020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:07.174464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:07.175438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:07.175899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:07.176327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:07.239117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:07.247229 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a56fe84b-cc46-4dc1-a9b0-8a07bafe3f1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1187 microversion: 2.1 time: 0.085699 Oct 28 13:56:07.262768 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3396/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:07 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:08.271161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:08.271794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:08.278999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:08.279502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:08.279975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:08.280686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:08.281151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:08.281623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:08.347397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:08.356206 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-446243fb-0234-4b62-a88b-c3969ea829bf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1187 microversion: 2.1 time: 0.089121 Oct 28 13:56:08.357399 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3305/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:08 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:09.380770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:09.381387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:09.388530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:09.389025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:09.389469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:09.390168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:09.390634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:09.391736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:09.452828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:09.461491 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ee503f2-1ef5-4329-93a9-1714064416f7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1187 microversion: 2.1 time: 0.084745 Oct 28 13:56:09.462070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3397/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:09 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:10.484443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:10.484970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:10.491837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:10.492328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:10.492774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:10.493477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:10.493940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:10.494373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:10.526564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:10.527083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:10.527554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:10.528011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid de14cf45-1964-46fa-b465-9a24ed6b4869 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:56:10.574233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:10.577902 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd39237c-4117-43ac-b9d2-3b70c3944474 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 200 len: 1192 microversion: 2.1 time: 0.097492 Oct 28 13:56:10.579806 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3306/6703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:10 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:11.606084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:11.606707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: de14cf45-1964-46fa-b465-9a24ed6b4869] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:11.610191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:56:11.615009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:11.615499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:11.616030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:11.616674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:11.617133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:11.617560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:11.620100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=85 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:56:11.631697 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance de14cf45-1964-46fa-b465-9a24ed6b4869 could not be found. Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 HTTP/1.1 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance de14cf45-1964-46fa-b465-9a24ed6b4869 could not be found. Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'de14cf45-1964-46fa-b465-9a24ed6b4869'} Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de14cf45-1964-46fa-b465-9a24ed6b4869 could not be found. Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de14cf45-1964-46fa-b465-9a24ed6b4869 could not be found. Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:56:11.633400 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de14cf45-1964-46fa-b465-9a24ed6b4869 could not be found. Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance de14cf45-1964-46fa-b465-9a24ed6b4869 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-614818e5-9fbc-4600-8efa-88939f335d98 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869" status: 404 len: 111 microversion: 2.1 time: 0.033825 Oct 28 13:56:11.642166 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3398/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:11 2022] GET /compute/v2.1/servers/de14cf45-1964-46fa-b465-9a24ed6b4869 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:56:18.388701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2084681220", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3096ca2d-e9ea-424c-8211-13b6e19f5306", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:56:18.400434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:56:18.449516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:56:18.864886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:56:18.865315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:56:18.865790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:56:18.866204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:56:18.866639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:56:18.876154 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:18.876639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:18.877078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:18.877803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:18.878260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:18.878690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:18.885341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:56:18.895777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:56:18.900973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:56:18.957535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:56:18.959663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3096ca2d-e9ea-424c-8211-13b6e19f5306',volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:56:19.280153 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c1d6868-a5aa-4e9d-8d3b-3737acf8a892 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895502 Oct 28 13:56:19.280932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3307/6705] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:56:19.292781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2f09416-b52f-4317-86cb-7fc10c1b0cbc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:19.295856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2f09416-b52f-4317-86cb-7fc10c1b0cbc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:19.355313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2f09416-b52f-4317-86cb-7fc10c1b0cbc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:19.363447 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2f09416-b52f-4317-86cb-7fc10c1b0cbc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1057 microversion: 2.1 time: 0.074908 Oct 28 13:56:19.364798 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3399/6706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:19 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:20.386796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:20.387330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:20.394127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:20.394725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:20.395190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:20.395881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:20.396343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:20.396805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:20.462489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:20.470821 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e896c680-1462-49ad-aedf-a2331b5ed0de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1107 microversion: 2.1 time: 0.088878 Oct 28 13:56:20.471428 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3308/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:20 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1107 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:21.493426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:21.494132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:21.503952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:21.503952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:21.503952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:21.503952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:21.503952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:21.504373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:21.576195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:21.585134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb15589d-9652-488d-97f8-0172dc4e58d3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1173 microversion: 2.1 time: 0.095610 Oct 28 13:56:21.585732 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3400/6708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:21 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1173 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:22.608007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:22.608784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:22.616439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:22.617184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:22.617723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:22.618527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:22.619113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:22.619759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:22.761693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:22.770230 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92ce43af-3595-4205-ba35-74400d359d95 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1215 microversion: 2.1 time: 0.166133 Oct 28 13:56:22.770838 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3309/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:22 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:22.972929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3e6dd501-a81e-443b-b6fc-221edb15c597 req-77039ead-40ce-4769-b664-2dd6cdefe4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb8a692-458f-40e9-a43d-f51e7e151972", "tag": "f2e10cb6-b220-46fe-b1fc-03c2c43dece9"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:56:22.987128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3e6dd501-a81e-443b-b6fc-221edb15c597 req-77039ead-40ce-4769-b664-2dd6cdefe4c6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:22.987128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3e6dd501-a81e-443b-b6fc-221edb15c597 req-77039ead-40ce-4769-b664-2dd6cdefe4c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:22.987128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3e6dd501-a81e-443b-b6fc-221edb15c597 req-77039ead-40ce-4769-b664-2dd6cdefe4c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:22.999746 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3e6dd501-a81e-443b-b6fc-221edb15c597 req-77039ead-40ce-4769-b664-2dd6cdefe4c6 service nova] Creating event network-changed:f2e10cb6-b220-46fe-b1fc-03c2c43dece9 for instance 1eb8a692-458f-40e9-a43d-f51e7e151972 on n-h1-862876-2 Oct 28 13:56:23.011900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3e6dd501-a81e-443b-b6fc-221edb15c597 req-77039ead-40ce-4769-b664-2dd6cdefe4c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037716 Oct 28 13:56:23.011900 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3401/6710] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:56:23.793193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:23.793817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:23.801883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:23.802307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:23.802760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:23.803484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:23.803942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:23.804364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:23.933968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:23.942392 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-17e90420-2aa5-4e22-8d84-b05b351d38b7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1215 microversion: 2.1 time: 0.153164 Oct 28 13:56:23.942997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3310/6711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:23 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:24.966916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:24.967616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:24.974358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:24.974887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:24.975323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:24.976009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:24.976462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:24.976885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:25.108379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:25.117243 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad87b992-5321-49e6-b34f-fb463ffc720e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1215 microversion: 2.1 time: 0.155388 Oct 28 13:56:25.117832 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3402/6712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:24 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:26.139798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:26.140415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:26.147549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:26.148035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:26.148470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:26.149170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:26.149685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:26.150168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:26.289168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:26.296886 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-580b904f-fc0a-4453-a5a0-43a14af6e771 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1215 microversion: 2.1 time: 0.160988 Oct 28 13:56:26.297481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3311/6713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:26 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:27.320925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:27.321555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:27.328801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:27.329312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:27.329784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:27.331239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:27.331705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:27.332141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:27.461127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:27.468832 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8810b24-cb79-4d98-ac2a-ed3bccccf93d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.152094 Oct 28 13:56:27.469409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3403/6714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:27 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:28.491383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:28.491993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:28.498691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:28.499203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:28.499635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:28.500310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:28.500762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:28.501184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:28.629186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:28.636849 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11668cfc-2a43-453d-8d7a-c0dd64650787 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.149342 Oct 28 13:56:28.637418 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3312/6715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:28 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:29.660141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:29.660690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:29.663566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:56:29.668346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:29.668835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:29.669274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:29.669966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:29.670428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:29.670880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:29.799718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:29.807692 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e19bc8be-ac08-449b-a749-3c2c39eef67d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.152070 Oct 28 13:56:29.808263 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3404/6716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:29 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:30.829272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:30.829887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:30.832670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:56:30.833381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:56:30.838122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:30.838599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:30.839066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:30.839750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:30.840200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:30.840627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:30.970864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:30.978650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7534dc58-8f01-4e20-96a0-b758c98a0780 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.153259 Oct 28 13:56:30.979255 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3313/6717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:30 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:32.001693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:32.002311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:32.008314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:32.008807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:32.009250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:32.009943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:32.010406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:32.010862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:32.137300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:32.145650 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-43f5663c-3f04-4a9f-ad23-0794f9be3d9d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.148182 Oct 28 13:56:32.146222 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3405/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:31 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:33.168245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:33.168857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:33.176535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:33.177024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:33.177461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:33.178153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:33.178604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:33.179057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:33.305808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:33.313695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5b4cf78-7936-4578-86ef-6eb9b222c45b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.149446 Oct 28 13:56:33.314268 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3314/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:33 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:34.336357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:34.336976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:34.343850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:34.344342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:34.344779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:34.345471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:34.345935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:34.346367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:34.477083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:34.484752 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4070f320-a8f4-4619-a152-d689ed542da1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.152357 Oct 28 13:56:34.485331 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3406/6720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:34 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:35.507828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:35.508460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:35.515336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:35.515828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:35.516270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:35.516970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:35.517431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:35.517855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:35.653346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:35.661749 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41d38b0d-0d02-4a8d-b73b-8c8f0f49743f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.157987 Oct 28 13:56:35.662315 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3315/6721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:35 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:36.684943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:36.685616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:36.693117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:36.693606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:36.694048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:36.694736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:36.695217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:36.695645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:36.821841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:36.829557 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3f5006ad-138e-4735-9c42-122e9ff09eac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.148539 Oct 28 13:56:36.830129 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3407/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:36 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:37.603633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b057b6c6-7a8d-4bed-8070-08b411e5ec69 req-fcdecfc7-4f27-4429-aeec-38d5cbb8ccf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb8a692-458f-40e9-a43d-f51e7e151972", "name": "network-vif-plugged", "status": "completed", "tag": "f2e10cb6-b220-46fe-b1fc-03c2c43dece9"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:56:37.614642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b057b6c6-7a8d-4bed-8070-08b411e5ec69 req-fcdecfc7-4f27-4429-aeec-38d5cbb8ccf9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:37.615261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b057b6c6-7a8d-4bed-8070-08b411e5ec69 req-fcdecfc7-4f27-4429-aeec-38d5cbb8ccf9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:37.615697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b057b6c6-7a8d-4bed-8070-08b411e5ec69 req-fcdecfc7-4f27-4429-aeec-38d5cbb8ccf9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:37.626964 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b057b6c6-7a8d-4bed-8070-08b411e5ec69 req-fcdecfc7-4f27-4429-aeec-38d5cbb8ccf9 service nova] Creating event network-vif-plugged:f2e10cb6-b220-46fe-b1fc-03c2c43dece9 for instance 1eb8a692-458f-40e9-a43d-f51e7e151972 on n-h1-862876-2 Oct 28 13:56:37.632470 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b057b6c6-7a8d-4bed-8070-08b411e5ec69 req-fcdecfc7-4f27-4429-aeec-38d5cbb8ccf9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033238 Oct 28 13:56:37.633079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3316/6723] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:56:37.852272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:37.852789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:37.860189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:37.860674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:37.864898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:37.864898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:37.864898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:37.864898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:37.991472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:37.999063 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff0b4221-33fe-4f5c-8fe5-90a100e240f1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1203 microversion: 2.1 time: 0.150804 Oct 28 13:56:37.999642 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3408/6724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:37 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:39.024194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:39.025082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:39.031262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.031755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.032198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.032895 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.033360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.033822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.166771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:39.174458 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d94a18e3-3edb-488a-a3e4-9f93e28198c8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1390 microversion: 2.1 time: 0.156014 Oct 28 13:56:39.175310 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3317/6725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:39 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:39.196841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:39.197488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:39.204238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.204729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.205173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.206524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.207016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.207453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.337415 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:39.345278 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb7c0698-8c81-4a8d-87b2-46ebd8805eb7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1390 microversion: 2.1 time: 0.152259 Oct 28 13:56:39.345864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3409/6726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:39 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:39.367253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:39.367870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:39.373700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.374177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.374639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.375348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.375799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.376271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.506263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:39.513941 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6b3e7da3-8972-4b6a-8450-046f47fceddf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1390 microversion: 2.1 time: 0.150541 Oct 28 13:56:39.514515 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3318/6727] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:39 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:39.536349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:39.536789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:39.542837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.543333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.543776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.544558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.544928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.545360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.569235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:56:39.848729 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-899b1bb9-d893-44fe-b311-6a0c6433ab38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 204 len: 0 microversion: 2.1 time: 0.316541 Oct 28 13:56:39.849267 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3410/6728] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:56:39 2022] DELETE /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:56:39.858226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:39.858877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:39.864976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.865842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.866289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.867126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:39.867583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:39.868007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:39.997185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:40.005353 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96ea5df1-dace-4acd-b5e3-752b1a70e32d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1396 microversion: 2.1 time: 0.151065 Oct 28 13:56:40.005926 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3319/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:39 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1396 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:41.029214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:41.029925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:41.036674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:41.037163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:41.037602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:41.038298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:41.038814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:41.039245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:41.165339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:41.173203 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-84f6c6bc-88af-4bae-aa31-9d6566d7a552 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1396 microversion: 2.1 time: 0.148280 Oct 28 13:56:41.173786 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3411/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:41 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1396 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:41.821643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-35cb77fc-5ff8-4c66-8a20-58f2470100d6 req-280b4f89-d74c-4802-97b6-9fd730d63b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb8a692-458f-40e9-a43d-f51e7e151972", "name": "network-vif-deleted", "tag": "f2e10cb6-b220-46fe-b1fc-03c2c43dece9"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:56:41.827560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-35cb77fc-5ff8-4c66-8a20-58f2470100d6 req-280b4f89-d74c-4802-97b6-9fd730d63b50 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:41.828045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-35cb77fc-5ff8-4c66-8a20-58f2470100d6 req-280b4f89-d74c-4802-97b6-9fd730d63b50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:41.828475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-35cb77fc-5ff8-4c66-8a20-58f2470100d6 req-280b4f89-d74c-4802-97b6-9fd730d63b50 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:41.841149 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-35cb77fc-5ff8-4c66-8a20-58f2470100d6 req-280b4f89-d74c-4802-97b6-9fd730d63b50 service nova] Creating event network-vif-deleted:f2e10cb6-b220-46fe-b1fc-03c2c43dece9 for instance 1eb8a692-458f-40e9-a43d-f51e7e151972 on n-h1-862876-2 Oct 28 13:56:41.847448 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-35cb77fc-5ff8-4c66-8a20-58f2470100d6 req-280b4f89-d74c-4802-97b6-9fd730d63b50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034388 Oct 28 13:56:41.848295 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3320/6731] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:56:42.197113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:42.197726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:42.204669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:42.205152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:42.206211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:42.206940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:42.207411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:42.207819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:42.269055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:42.278173 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0e8745ad-0c61-4f22-bbad-e83989c92a2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1188 microversion: 2.1 time: 0.084922 Oct 28 13:56:42.278780 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3412/6732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:42 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:43.303841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:43.304552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:43.310772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:43.311269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:43.311708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:43.312404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:43.312859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:43.313288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:43.378203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:43.386240 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f07b255-7ed9-481c-beff-862eca7549de tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1188 microversion: 2.1 time: 0.088306 Oct 28 13:56:43.387041 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3321/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:43 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:44.409723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:44.410340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:44.417328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:44.417836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:44.418263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:44.418988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:44.419455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:44.419883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:44.481130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:44.489500 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27ccaa5d-73a8-4b4a-a6ec-1123091397ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1188 microversion: 2.1 time: 0.084245 Oct 28 13:56:44.490077 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3413/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:44 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:45.512131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:45.512644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:45.519619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:45.520111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:45.520555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:45.521252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:45.521712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:45.522146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:45.586225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:45.594169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-865f104c-76a3-44b1-a939-3e6890dddb7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1188 microversion: 2.1 time: 0.086057 Oct 28 13:56:45.594738 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3322/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:45 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:46.617050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:46.617674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:46.625150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:46.625639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:46.626082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:46.626802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:46.627262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:46.628218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:46.662332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:46.662846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:46.663322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:46.663848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid 1eb8a692-458f-40e9-a43d-f51e7e151972 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:56:46.708459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:56:46.716452 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3825ad3e-b783-437c-80a2-a10cce85b8fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 200 len: 1193 microversion: 2.1 time: 0.103491 Oct 28 13:56:46.717247 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3414/6736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:46 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 1193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:56:47.740512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:56:47.741132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 1eb8a692-458f-40e9-a43d-f51e7e151972] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:56:47.747906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:47.748392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:47.748829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:47.749517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:56:47.749977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:56:47.750399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:56:47.764103 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 1eb8a692-458f-40e9-a43d-f51e7e151972 could not be found. Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 HTTP/1.1 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 1eb8a692-458f-40e9-a43d-f51e7e151972 could not be found. Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '1eb8a692-458f-40e9-a43d-f51e7e151972'} Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb8a692-458f-40e9-a43d-f51e7e151972 could not be found. Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb8a692-458f-40e9-a43d-f51e7e151972 could not be found. Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:56:47.769451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb8a692-458f-40e9-a43d-f51e7e151972 could not be found. Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 1eb8a692-458f-40e9-a43d-f51e7e151972 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52f5570d-c1f8-4116-a6ca-e7392413b558 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972" status: 404 len: 111 microversion: 2.1 time: 0.030591 Oct 28 13:56:47.774126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3323/6737] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:56:47 2022] GET /compute/v2.1/servers/1eb8a692-458f-40e9-a43d-f51e7e151972 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:57:14.874976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1499153885", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3599b2bf-7fb3-49f8-b618-1b1eda3c004e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:57:14.885300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:14.885958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:14.973421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:57:15.637224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:57:15.637672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:57:15.638145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:57:15.638552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:57:15.638983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:57:15.648912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:15.649394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:15.649829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:15.650542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:15.651041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:15.651462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:15.667567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:57:15.672849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:57:15.685311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:57:15.687416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3599b2bf-7fb3-49f8-b618-1b1eda3c004e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:57:15.867614 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4c7be3b-f3f9-40fe-a58f-db8fbcb04070 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996455 Oct 28 13:57:15.868195 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3415/6738] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:57:15.880402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f1397f16-8b23-4404-9f5a-053c9f88fcc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:15.881059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f1397f16-8b23-4404-9f5a-053c9f88fcc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:15.884013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:15.885697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=85 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:15.936742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f1397f16-8b23-4404-9f5a-053c9f88fcc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:15.944746 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f1397f16-8b23-4404-9f5a-053c9f88fcc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1057 microversion: 2.1 time: 0.068832 Oct 28 13:57:15.946605 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3324/6739] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:15 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1057 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:16.968525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:16.969053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:16.976221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:16.976704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:16.977135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:16.977822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:16.978278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:16.978699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:17.041976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:17.049833 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f511023-2595-48a5-80f0-4012046cda1b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1061 microversion: 2.1 time: 0.086353 Oct 28 13:57:17.050388 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3416/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:16 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1061 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:18.073263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:18.074409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:18.083810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:18.084747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:18.085202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:18.085916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:18.086384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:18.086846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:18.154150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:18.161912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3cc825fa-49b9-4d4d-8145-21116bbcf536 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1127 microversion: 2.1 time: 0.092589 Oct 28 13:57:18.163386 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3325/6741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:18 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1127 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:19.187413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:19.188186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:19.195242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:19.195944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:19.196389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:19.197093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:19.197590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:19.198022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:19.416441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:19.424586 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4eda9406-c956-4467-8886-d57be2f37632 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.241282 Oct 28 13:57:19.425315 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3417/6742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:19 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:19.667608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8b2cfcaa-4d8d-4058-aa3f-7442a000a425 req-eab0c8eb-f1cd-4dcd-9ba6-ca1b94f21da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c88ee4b-43aa-4943-928f-4e3511baac59", "tag": "ef5ac014-79fb-49d4-8675-42b4d78b9953"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:57:19.680020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8b2cfcaa-4d8d-4058-aa3f-7442a000a425 req-eab0c8eb-f1cd-4dcd-9ba6-ca1b94f21da0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:19.682614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8b2cfcaa-4d8d-4058-aa3f-7442a000a425 req-eab0c8eb-f1cd-4dcd-9ba6-ca1b94f21da0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:19.682614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8b2cfcaa-4d8d-4058-aa3f-7442a000a425 req-eab0c8eb-f1cd-4dcd-9ba6-ca1b94f21da0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:19.700131 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8b2cfcaa-4d8d-4058-aa3f-7442a000a425 req-eab0c8eb-f1cd-4dcd-9ba6-ca1b94f21da0 service nova] Creating event network-changed:ef5ac014-79fb-49d4-8675-42b4d78b9953 for instance 6c88ee4b-43aa-4943-928f-4e3511baac59 on n-h1-862876-2 Oct 28 13:57:19.709719 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8b2cfcaa-4d8d-4058-aa3f-7442a000a425 req-eab0c8eb-f1cd-4dcd-9ba6-ca1b94f21da0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046887 Oct 28 13:57:19.710963 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3326/6743] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:57:20.449678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:20.450280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:20.457307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:20.457799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:20.458237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:20.458987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:20.459447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:20.470961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:20.594679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:20.602563 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0eb95429-a130-4a95-85ff-99fea8051ed0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.156816 Oct 28 13:57:20.603163 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3418/6744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:20 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:21.626908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:21.627653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:21.633977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:21.634477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:21.634946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:21.635650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:21.636112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:21.636541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:21.772337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:21.780526 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-455feb25-74c9-4815-8404-f286c835bf38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.158675 Oct 28 13:57:21.781126 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3327/6745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:21 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:22.805909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:22.806555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:22.814003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:22.814496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:22.814977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:22.815658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:22.816119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:22.816548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:22.957519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:22.965188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2ae5894-884b-4a40-9eb0-1d552791a23b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.164881 Oct 28 13:57:22.965762 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3419/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:22 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:23.987786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:23.988407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:23.995350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:23.996730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:23.996730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:23.996975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:23.997419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:23.997844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:24.134634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:24.142625 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-22f4379d-8d2b-410d-ac49-19f26bc4e4a2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.158730 Oct 28 13:57:24.143220 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3328/6747] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:23 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:25.166090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:25.166630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:25.174378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:25.174886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:25.175321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:25.176270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:25.176722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:25.177146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:25.312073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:25.323297 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed5df77e-c5aa-48d4-af38-a76ca550c899 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.162092 Oct 28 13:57:25.323891 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3420/6748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:25 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:26.346230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:26.346789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:26.349617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:26.355552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:26.356055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:26.356502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:26.357208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:26.357675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:26.358108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:26.496187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:26.506529 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f49b877-ec88-4851-9575-830240aefdb6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.162810 Oct 28 13:57:26.507153 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3329/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:26 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:27.530520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:27.531177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:27.534101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:27.534772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:27.539754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:27.540248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:27.542426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:27.542426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:27.542426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:27.542426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:27.689777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:27.697784 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-37bd2370-cd5e-42f7-b3bf-4cdcf8a1c4cd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.171465 Oct 28 13:57:27.698381 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3421/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:27 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:28.719911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:28.720557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:28.727561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:28.728050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:28.728493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:28.729191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:28.729653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:28.730086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:28.864191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:28.872567 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86843ece-5519-4f59-8e87-f25549133aab tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.156641 Oct 28 13:57:28.873151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3330/6751] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:28 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:29.895840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:29.896381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:29.904357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:29.904846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:29.905283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:29.905974 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:29.906430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:29.906881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:30.050418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:30.059075 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b8694ac-cb6a-4b1f-b08f-c19fac5ca473 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.167577 Oct 28 13:57:30.059663 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3422/6752] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:29 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:31.084634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:31.085255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:31.092366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:31.092864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:31.093309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:31.094007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:31.094470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:31.094936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:31.236677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:31.244902 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fcf52c3c-0f8f-4d3e-9e05-f068b9c4cad7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.164369 Oct 28 13:57:31.245519 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3331/6753] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:31 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:32.271756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:32.272352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:32.279131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:32.279628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:32.280077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:32.280775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:32.281239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:32.281669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:32.426731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:32.434700 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20fe026c-0bb7-415c-8356-1cb10bfa5516 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.168916 Oct 28 13:57:32.435307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3423/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:32 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:33.459512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:33.461087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:33.468194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:33.468685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:33.469155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:33.469851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:33.470345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:33.470794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:33.601443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:33.610846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bb59120e-78a0-410f-bdb6-8eb4f3e93768 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.157413 Oct 28 13:57:33.611497 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3332/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:33 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:34.633544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:34.634190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:34.641754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:34.642249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:34.643113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:34.643783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:34.644247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:34.644678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:34.779228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:34.786963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d02bcce-0dbd-4157-86f9-439180aaa9fb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.157382 Oct 28 13:57:34.790651 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3424/6756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:34 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:35.810117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:35.810663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:35.817633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:35.818124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:35.818589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:35.819314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:35.819777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:35.820207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:35.958553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:35.966357 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd8c8cb9-862f-403a-8b1a-c53c53604270 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.160290 Oct 28 13:57:35.966964 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3333/6757] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:35 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:36.989111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:36.989722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:36.997516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:36.998016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:36.998688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:36.999780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:37.000290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:37.000720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:37.133835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:37.142268 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5da5ffc5-31ba-45f2-8255-bcc92a6e2f35 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.157082 Oct 28 13:57:37.142955 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3425/6758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:36 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:38.165568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:38.166245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:38.173163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:38.173651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:38.174090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:38.174815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:38.175279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:38.175711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:38.305928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:38.313664 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7890661-1ec2-4980-80ea-fcb3ad05176f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.152024 Oct 28 13:57:38.314236 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3334/6759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:38 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:39.337135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:39.337864 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:39.346022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:39.346532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:39.346999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:39.347720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:39.348255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:39.348682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:39.484365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:39.492042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b977228-26ef-403a-9229-2788d07239e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.159006 Oct 28 13:57:39.492618 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3426/6760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:39 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:40.514174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:40.514879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:40.522080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:40.522654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:40.523187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:40.523954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:40.524484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:40.525007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:40.659891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:40.675565 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eeea6c85-61f7-4042-9981-ed9b6655e52f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.157882 Oct 28 13:57:40.675565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3335/6761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:40 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:41.691241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:41.691851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:41.698803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:41.699314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:41.699744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:41.700442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:41.700904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:41.701335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:41.832483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:41.840124 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36fc92be-491e-4cfe-8799-7c937457580c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.152798 Oct 28 13:57:41.840710 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3427/6762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:41 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:57:42.863908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:42.864445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:42.871134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:42.871612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:42.872045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:42.872726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:42.873177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:42.873595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:43.006035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:43.013716 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-37b81e1e-5d6e-4914-9cb3-623c2a85f269 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.153850 Oct 28 13:57:43.014293 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3336/6763] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:42 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:44.036730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:44.037350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:44.044165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:44.044660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:44.045106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:44.045799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:44.046294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:44.046726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:44.186046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:44.193834 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b3aa45a-a9c6-46b3-952b-5713cafa4e18 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.161011 Oct 28 13:57:44.194421 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3428/6764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:44 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:45.216318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:45.216955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:45.224611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:45.225164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:45.226343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:45.226453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:45.226965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:45.227387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:45.359049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:45.367095 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d1626b73-a79e-4ba5-a173-8b9de2cae27c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.154570 Oct 28 13:57:45.367704 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3337/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:45 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:46.389578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:46.390228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:46.393056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:46.398365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:46.398897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:46.399343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:46.400078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:46.400540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:46.401018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:46.403963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=81 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:46.537871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:46.546993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-68878ecf-f8f6-4b2d-8ab8-da3dec09e1ea tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.160712 Oct 28 13:57:46.547592 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3429/6766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:46 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:57:47.570104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:47.570767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:47.578889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:47.579382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:47.579817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:47.580518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:47.580975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:47.581395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:47.584807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=75 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:47.732629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:47.743066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6d0e6d79-a4ba-41b7-bea1-03dd5f9cda0d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1169 microversion: 2.1 time: 0.176906 Oct 28 13:57:47.743733 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3338/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:47 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:48.768558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:48.769173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:48.776212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:48.781865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:48.781865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:48.781865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:48.781865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:48.781865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:48.910469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:48.918180 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a8b42b1a-e119-40e3-b575-4db03262bbf5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1215 microversion: 2.1 time: 0.153597 Oct 28 13:57:48.918777 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3430/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:48 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:49.941421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:49.942073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:49.944848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=33 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:57:49.949574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:49.950062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:49.950503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:49.951219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:49.951681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:49.952107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:50.080754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:50.088418 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7cfb7d2-d7cb-4c27-a4db-5d078d9c038a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.150918 Oct 28 13:57:50.089023 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3339/6769] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:49 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:51.111252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:51.111862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:51.119030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:51.119514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:51.119950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:51.120636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:51.121091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:51.121515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:51.254347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:51.262018 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2052133-64dc-47d3-b9ff-de782e0e1a8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.154671 Oct 28 13:57:51.262590 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3431/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:51 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:52.284964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:52.285581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:52.292394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:52.292886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:52.293326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:52.294026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:52.294489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:52.294949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:52.425784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:52.433729 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8008f3c6-4920-451f-b64c-2e45d21fbf29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.153280 Oct 28 13:57:52.434298 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3340/6771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:52 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:53.457204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:53.458423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:53.465423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:53.468113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:53.468113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:53.468113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:53.468113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:53.468113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:53.596782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:53.604526 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2af98e6d-b5bf-42f8-898b-dac72b83dc05 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.151726 Oct 28 13:57:53.605045 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3432/6772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:53 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:54.627388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:54.628015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:54.634905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:54.635402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:54.635848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:54.636550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:54.637015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:54.637446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:54.769063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:54.776779 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-276ee5d4-b917-470f-b667-78354b8ec07d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.153818 Oct 28 13:57:54.777342 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3341/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:54 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:55.800009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:55.800533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:55.807628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:55.808116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:55.808553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:55.809236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:55.809690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:55.810119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:55.945373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:55.953168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bdb9aa61-df92-4c4a-b8eb-2efe7f78fbc5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.157824 Oct 28 13:57:55.953751 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3433/6774] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:55 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:56.975975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:56.977297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:56.984483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:56.984977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:56.985419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:56.986138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:56.986603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:56.987086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:57.116418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:57.124176 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3fcf623f-072f-41aa-b79d-e17eea2ca87a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.152384 Oct 28 13:57:57.124749 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3342/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:56 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:58.147645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:58.148272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:58.154958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:58.155452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:58.155896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:58.156594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:58.157054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:58.157483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:58.285923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:58.293642 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06f27756-a712-4c1a-be59-def7f4894abe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.150379 Oct 28 13:57:58.294254 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3434/6776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:58 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:59.317131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:57:59.317753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:57:59.323796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:59.331408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:59.331408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:59.331408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:59.331408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:59.331408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:59.458835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:57:59.465574 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d425fe07-13a8-40d0-960a-6c9092bf345e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.153170 Oct 28 13:57:59.466158 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3343/6777] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:57:59 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:57:59.881629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e402e00b-97e9-4e97-884b-d1d1b5e845cc req-fc444c4c-d92c-4388-afb3-6677f49b41b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c88ee4b-43aa-4943-928f-4e3511baac59", "name": "network-vif-plugged", "status": "completed", "tag": "ef5ac014-79fb-49d4-8675-42b4d78b9953"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:57:59.892122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e402e00b-97e9-4e97-884b-d1d1b5e845cc req-fc444c4c-d92c-4388-afb3-6677f49b41b9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:57:59.892609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e402e00b-97e9-4e97-884b-d1d1b5e845cc req-fc444c4c-d92c-4388-afb3-6677f49b41b9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:57:59.893640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e402e00b-97e9-4e97-884b-d1d1b5e845cc req-fc444c4c-d92c-4388-afb3-6677f49b41b9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:57:59.904632 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e402e00b-97e9-4e97-884b-d1d1b5e845cc req-fc444c4c-d92c-4388-afb3-6677f49b41b9 service nova] Creating event network-vif-plugged:ef5ac014-79fb-49d4-8675-42b4d78b9953 for instance 6c88ee4b-43aa-4943-928f-4e3511baac59 on n-h1-862876-2 Oct 28 13:57:59.909919 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e402e00b-97e9-4e97-884b-d1d1b5e845cc req-fc444c4c-d92c-4388-afb3-6677f49b41b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Oct 28 13:57:59.910460 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3435/6778] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:58:00.490433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:00.491088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:00.497996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:00.498484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:00.498956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:00.499648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:00.500104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:00.500531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:00.626955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:00.635100 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-442256f2-f608-433f-8013-c57026d67dcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1203 microversion: 2.1 time: 0.149521 Oct 28 13:58:00.635667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3344/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:00 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:01.659541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:01.660268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:01.666327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:01.669551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:01.669551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:01.669551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:01.669551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:01.669551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:01.799556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:01.807672 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d236aaf-1f1d-4774-bf25-219bbb590a28 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1390 microversion: 2.1 time: 0.154019 Oct 28 13:58:01.808252 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3436/6780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:01 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:01.829991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:01.831190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:01.837836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:01.838317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:01.838838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:01.839521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:01.839976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:01.840399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:01.969679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:01.978297 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b81bf38-4bc8-4b57-86d2-318ff8a51200 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1390 microversion: 2.1 time: 0.152295 Oct 28 13:58:01.978921 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3345/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:01 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:01.999761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:02.000408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:02.006342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:02.006854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:02.007295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:02.007982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:02.008441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:02.008868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:02.135682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:02.144042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66696465-212c-47ae-8e1a-20a5aa234759 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1390 microversion: 2.1 time: 0.148230 Oct 28 13:58:02.144636 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3437/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:01 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1390 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:02.223352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:02.223885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:02.229779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:02.230266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:02.230705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:02.231416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:02.231876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:02.232303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:02.259489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:58:02.499637 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f72244b3-addb-41bc-b31f-5b5648dbfb0b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 204 len: 0 microversion: 2.1 time: 0.279824 Oct 28 13:58:02.500266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3346/6783] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:58:02 2022] DELETE /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:58:02.509025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:02.510550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:02.515728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:02.516222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:02.516679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:02.517359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:02.517869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:02.518630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:02.652227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:02.661868 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5cc1db72-7d42-46d6-8fe4-4fa7abc66d8a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1396 microversion: 2.1 time: 0.155679 Oct 28 13:58:02.663927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3438/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:02 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:03.692123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:03.692848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:03.699605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:03.700081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:03.700514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:03.701196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:03.701650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:03.702096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:03.830102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:03.837863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b9bc29d1-d95f-4926-a836-d78abc1840ae tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1396 microversion: 2.1 time: 0.150189 Oct 28 13:58:03.838430 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3347/6785] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:03 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1396 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:04.523822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3b438e63-87c0-4f8c-b89e-8e2af17e1009 req-827b4257-b89c-474d-9eb9-8cd3f86edf12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c88ee4b-43aa-4943-928f-4e3511baac59", "name": "network-vif-deleted", "tag": "ef5ac014-79fb-49d4-8675-42b4d78b9953"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:58:04.539407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3b438e63-87c0-4f8c-b89e-8e2af17e1009 req-827b4257-b89c-474d-9eb9-8cd3f86edf12 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:04.539901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3b438e63-87c0-4f8c-b89e-8e2af17e1009 req-827b4257-b89c-474d-9eb9-8cd3f86edf12 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:04.540337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3b438e63-87c0-4f8c-b89e-8e2af17e1009 req-827b4257-b89c-474d-9eb9-8cd3f86edf12 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:04.553909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3b438e63-87c0-4f8c-b89e-8e2af17e1009 req-827b4257-b89c-474d-9eb9-8cd3f86edf12 service nova] Creating event network-vif-deleted:ef5ac014-79fb-49d4-8675-42b4d78b9953 for instance 6c88ee4b-43aa-4943-928f-4e3511baac59 on n-h1-862876-2 Oct 28 13:58:04.559406 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3b438e63-87c0-4f8c-b89e-8e2af17e1009 req-827b4257-b89c-474d-9eb9-8cd3f86edf12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039163 Oct 28 13:58:04.560025 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3439/6786] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:58:04.861205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:04.861873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:04.868671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:04.869151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:04.869584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:04.870273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:04.870728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:04.871167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:04.932806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:04.941130 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-afd4a4ea-4478-4757-aabb-6542b5d0ccbe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1188 microversion: 2.1 time: 0.083877 Oct 28 13:58:04.941638 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3348/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:04 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:05.965428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:05.966240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:05.973157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:05.973635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:05.974071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:05.974781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:05.975240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:05.975662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:06.041403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:06.049970 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-690bd509-3e62-4b84-9491-35bf8986ed80 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1188 microversion: 2.1 time: 0.088976 Oct 28 13:58:06.050550 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3440/6788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:05 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:07.073276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:07.073939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:07.081538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:07.082034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:07.082475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:07.083247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:07.083711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:07.084146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:07.151200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:07.159630 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6fda02e0-dc00-4fbf-9201-8524aa6e31d5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1188 microversion: 2.1 time: 0.090458 Oct 28 13:58:07.160241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3349/6789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:07 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:08.182686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:08.183342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:08.190873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:08.191373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:08.191817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:08.192521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:08.192987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:08.193420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:08.257916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:08.265909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e69825c-79d7-467d-8fb1-8fd1fd50f695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1188 microversion: 2.1 time: 0.087132 Oct 28 13:58:08.266505 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3441/6790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:08 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:09.291697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:09.291697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:09.297484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:09.297970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:09.298403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:09.299711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:09.300423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:09.301192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:09.335282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:09.335768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:09.336200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:09.336658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid 6c88ee4b-43aa-4943-928f-4e3511baac59 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 13:58:09.382346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:09.390236 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fe60a9b4-396f-4843-a67f-23f2c9cbcff8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 200 len: 1193 microversion: 2.1 time: 0.104601 Oct 28 13:58:09.390988 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3350/6791] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:09 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 1193 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:10.413112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:10.413666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:10.420555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:10.421043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:10.421483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:10.422175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:10.422638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:10.423093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:10.436758 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 HTTP/1.1 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6c88ee4b-43aa-4943-928f-4e3511baac59'} Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:58:10.438451 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a77bb994-24b4-4bab-83db-ab49d95be018 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 404 len: 111 microversion: 2.1 time: 0.030770 Oct 28 13:58:10.443304 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3442/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:10 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:58:12.580597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:12.581081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:12.588321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:12.588820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:12.589261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:12.589977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:12.590438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:12.590896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:12.606276 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 HTTP/1.1 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6c88ee4b-43aa-4943-928f-4e3511baac59'} Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:58:12.608018 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4970de67-3210-4f89-a0ce-506f440eaf4b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 404 len: 111 microversion: 2.1 time: 0.032802 Oct 28 13:58:12.612629 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3351/6793] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:58:12 2022] DELETE /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:58:12.618985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:12.619610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 6c88ee4b-43aa-4943-928f-4e3511baac59] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:12.626833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:12.627368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:12.627810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:12.628514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:12.628976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:12.629405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:12.644256 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 HTTP/1.1 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6c88ee4b-43aa-4943-928f-4e3511baac59'} Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 13:58:12.645771 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 6c88ee4b-43aa-4943-928f-4e3511baac59 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3925779-62c8-465a-92df-6da75a3644d8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59" status: 404 len: 111 microversion: 2.1 time: 0.032107 Oct 28 13:58:12.649904 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3443/6794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:12 2022] GET /compute/v2.1/servers/6c88ee4b-43aa-4943-928f-4e3511baac59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 13:58:39.048978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-119004815", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fa08aed8-920d-4ec3-a043-273e132a8e11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:58:39.060734 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 13:58:39.061521 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 13:58:39.061633 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 13:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 13:58:39.062864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:58:39.063774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:58:39.115465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:58:39.487556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:58:39.487977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:58:39.488447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:58:39.488854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:58:39.489265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:58:39.498540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:39.499057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:39.499493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:39.500244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:39.500694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:39.501129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:39.521761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:58:39.526903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:58:39.584912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:58:39.587229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa08aed8-920d-4ec3-a043-273e132a8e11',volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:58:39.962522 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ca582ed-79f5-46ab-96b3-096179f1080a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917603 Oct 28 13:58:39.963316 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3352/6795] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 13:58:39.974424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d1d4f6a7-fdbd-49d8-a3b2-0c4dcdd05052 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:39.975063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d1d4f6a7-fdbd-49d8-a3b2-0c4dcdd05052 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:39.979385 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 13:58:39.979539 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 13:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 (ip 10.222.0.25) !!! Oct 28 13:58:39.981030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=29 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:58:39.981888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=73 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:58:40.038831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1d4f6a7-fdbd-49d8-a3b2-0c4dcdd05052 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:40.046924 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d1d4f6a7-fdbd-49d8-a3b2-0c4dcdd05052 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1070 microversion: 2.1 time: 0.076382 Oct 28 13:58:40.047490 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3444/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:39 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1070 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:41.071837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:41.072429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:41.078527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:41.079046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:41.079482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:41.080205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:41.080892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:41.081318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:41.143806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:41.151599 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de142896-6f0a-4f05-a259-3012b4468bbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1120 microversion: 2.1 time: 0.085673 Oct 28 13:58:41.152169 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3353/6797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:41 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1120 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:42.173671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:42.174286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:42.181693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:42.182206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:42.182647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:42.183420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:42.183893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:42.184303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:42.267907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:42.276704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-743dd0d6-0cd9-4e84-b7f2-667e5b6ec758 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1186 microversion: 2.1 time: 0.107126 Oct 28 13:58:42.277239 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3445/6798] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:42 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:43.299999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:43.300704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:43.308105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:43.308597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:43.309042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:43.309750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:43.310216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:43.310654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:43.458465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:43.467783 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-09d066dd-4245-4662-8804-6e2616015b69 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1228 microversion: 2.1 time: 0.171684 Oct 28 13:58:43.468843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3354/6799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:43 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1228 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:43.668775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2e3c6771-909e-40c1-a5bc-892a816117d1 req-8cba01a7-68f2-4362-b444-ac8683b673e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7979df36-83e3-4752-9d34-5259c8aa2e74", "tag": "72599437-d3d8-4f68-a724-52dc278ab11b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:58:43.683187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2e3c6771-909e-40c1-a5bc-892a816117d1 req-8cba01a7-68f2-4362-b444-ac8683b673e9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:43.683673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2e3c6771-909e-40c1-a5bc-892a816117d1 req-8cba01a7-68f2-4362-b444-ac8683b673e9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:43.684841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2e3c6771-909e-40c1-a5bc-892a816117d1 req-8cba01a7-68f2-4362-b444-ac8683b673e9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:43.699413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2e3c6771-909e-40c1-a5bc-892a816117d1 req-8cba01a7-68f2-4362-b444-ac8683b673e9 service nova] Creating event network-changed:72599437-d3d8-4f68-a724-52dc278ab11b for instance 7979df36-83e3-4752-9d34-5259c8aa2e74 on n-h1-862876-2 Oct 28 13:58:43.706020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2e3c6771-909e-40c1-a5bc-892a816117d1 req-8cba01a7-68f2-4362-b444-ac8683b673e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040444 Oct 28 13:58:43.707021 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3446/6800] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:58:44.491331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:44.497722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:44.498984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:44.499483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:44.499930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:44.500628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:44.501093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:44.501523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:44.633875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:44.641700 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-84cfa267-2767-4915-b5ea-5706835654fe tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1228 microversion: 2.1 time: 0.154369 Oct 28 13:58:44.642276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3355/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:44 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:58:45.665939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:45.666636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:45.673677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:45.674161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:45.674599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:45.675305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:45.675760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:45.676184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:45.806299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:45.814303 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-92a22191-9ea0-4257-a491-65b0d7dd96ee tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1228 microversion: 2.1 time: 0.153202 Oct 28 13:58:45.815025 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3447/6802] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:45 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:46.837786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:46.838378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:46.845372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:46.845855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:46.846288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:46.847006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:46.847463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:46.847883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:46.979023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:46.987224 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4213b803-06f1-4b55-9a3a-713426bc82e7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1228 microversion: 2.1 time: 0.153507 Oct 28 13:58:46.987810 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3356/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:46 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:48.009943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:48.010568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:48.017473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:48.017969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:48.018470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:48.019247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:48.019770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:48.020273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:48.150818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:48.158479 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7e55dbfb-b89f-49f1-92e0-55d58ec86b3c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.153161 Oct 28 13:58:48.159094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3448/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:48 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:49.182508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:49.183146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:49.189876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:49.190359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:49.190818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:49.191506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:49.191962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:49.192387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:49.323944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:49.332243 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74749cf7-0474-4e38-ab16-29efbd9c7689 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.154133 Oct 28 13:58:49.332825 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3357/6805] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:49 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:50.356872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:50.357443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:50.360381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:58:50.365297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:50.365799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:50.366247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:50.366982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:50.367453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:50.367884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:50.496899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:50.504687 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e6378b65-8836-4922-8fe2-b040b5824d55 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.151891 Oct 28 13:58:50.505273 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3449/6806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:50 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:51.527607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:51.528233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:51.530105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:58:51.530935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:58:51.536726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:51.537214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:51.537655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:51.538365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:51.538854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:51.539285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:51.669880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:51.677850 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31d442e5-3281-494e-9336-dfdce3a6d28f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.154125 Oct 28 13:58:51.678437 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3358/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:51 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:52.701751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:52.702376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:52.709316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:52.709802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:52.710243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:52.710973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:52.711449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:52.711885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:52.842900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:52.850552 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1554129-b12a-41fa-92b0-7c1f31045eef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.152842 Oct 28 13:58:52.851182 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3450/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:52 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:53.873776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:53.874330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:53.881031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:53.881509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:53.881936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:53.882613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:53.883655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:53.884075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:54.014519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:54.022270 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91b88bf2-739f-4af6-9145-099775f37df5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.152422 Oct 28 13:58:54.022863 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3359/6809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:53 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:55.044898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:55.045561 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:55.052767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:55.053266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:55.053711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:55.054403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:55.054902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:55.055336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:55.182993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:55.190906 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-403129f6-56a5-422a-9a3d-a5945364bfdf tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.150030 Oct 28 13:58:55.191694 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3451/6810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:55 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:56.215306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:56.216537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:56.222606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:56.223352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:56.223592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:56.224252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:56.224708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:56.225132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:56.359878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:56.367808 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c6c40c9d-fbd7-4c13-afcd-a20e000a8ddc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.158069 Oct 28 13:58:56.368382 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3360/6811] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:56 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:57.389463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:57.390083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:57.396985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:57.397473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:57.397913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:57.399143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:57.399607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:57.400035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:57.529813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:57.537963 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1db9af09-87c9-4098-92f3-dcd2b997cb41 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.152349 Oct 28 13:58:57.538675 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3452/6812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:57 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:58.141142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a99a05f8-462a-4102-a370-1d8a6ce38cdc req-ed7c2bce-87c7-442c-9b96-c0e00440edd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7979df36-83e3-4752-9d34-5259c8aa2e74", "name": "network-vif-plugged", "status": "completed", "tag": "72599437-d3d8-4f68-a724-52dc278ab11b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:58:58.152166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a99a05f8-462a-4102-a370-1d8a6ce38cdc req-ed7c2bce-87c7-442c-9b96-c0e00440edd3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:58.152668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a99a05f8-462a-4102-a370-1d8a6ce38cdc req-ed7c2bce-87c7-442c-9b96-c0e00440edd3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:58.153122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a99a05f8-462a-4102-a370-1d8a6ce38cdc req-ed7c2bce-87c7-442c-9b96-c0e00440edd3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:58.164143 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a99a05f8-462a-4102-a370-1d8a6ce38cdc req-ed7c2bce-87c7-442c-9b96-c0e00440edd3 service nova] Creating event network-vif-plugged:72599437-d3d8-4f68-a724-52dc278ab11b for instance 7979df36-83e3-4752-9d34-5259c8aa2e74 on n-h1-862876-2 Oct 28 13:58:58.169319 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a99a05f8-462a-4102-a370-1d8a6ce38cdc req-ed7c2bce-87c7-442c-9b96-c0e00440edd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031825 Oct 28 13:58:58.169917 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3361/6813] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:58:58.561982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:58.562659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:58.569500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:58.569986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:58.570418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:58.571127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:58.571583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:58.572010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:58.698727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:58.706539 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c92861c3-7055-4072-8c7e-f69925617cfa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1216 microversion: 2.1 time: 0.148515 Oct 28 13:58:58.707289 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3453/6814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:58 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:59.730502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:59.731271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:59.737419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:59.737909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:59.738353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:59.739084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:59.739554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:59.739984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:59.869094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:58:59.876829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d0e9a97-18d5-4859-a31c-55c75ee7fcfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1403 microversion: 2.1 time: 0.151514 Oct 28 13:58:59.877404 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3362/6815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:59 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:58:59.899279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:58:59.900013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:58:59.906725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:59.907235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:59.907670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:58:59.908357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:58:59.908812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:58:59.909234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:00.341139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:00.348915 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b2a820db-28c4-41ba-be61-554694ec7b57 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1403 microversion: 2.1 time: 0.453575 Oct 28 13:59:00.349487 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3454/6816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:58:59 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1403 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:00.372270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-384585006"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:59:00.374575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:00.380497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:00.380980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:00.381419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:00.382101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:00.382557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:00.383013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:00.472666 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.compute.api [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Attempting to quiesce instance before volume snapshot. Oct 28 13:59:00.534704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.compute.api [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 28 13:59:00.787929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Creating snapshot from volume fa08aed8-920d-4ec3-a043-273e132a8e11. {{(pid=127794) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 28 13:59:02.317415 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c2f1974-e6ea-496e-b813-23f51b51cff1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74/action" status: 202 len: 0 microversion: 2.1 time: 1.949683 Oct 28 13:59:02.318712 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3363/6817] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 13:59:00 2022] POST /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74/action => generated 0 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 13:59:03.475502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1138474023", "imageRef": "73df79b4-a557-45b8-bb5d-a30111db2bbc", "flavorRef": "452", "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:59:03.532243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 13:59:03.897103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 13:59:03.897522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 13:59:03.897993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 13:59:03.898398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 13:59:03.898831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 13:59:03.908254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:03.908735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:03.909169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:03.909887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:03.910339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:03.910787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:03.927018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 13:59:03.932551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 13:59:03.944413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 13:59:03.947653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8feff899-9ff8-409d-97ed-cc9b6b99bed7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 13:59:04.076324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c579dfba-fe50-4e8d-ab42-cfcca7d63f7b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604719 Oct 28 13:59:04.076991 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3455/6818] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 13:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 13:59:04.089509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-14b05f46-df90-46f4-8d48-ab065a25dce3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:04.090231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-14b05f46-df90-46f4-8d48-ab065a25dce3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:04.148408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-14b05f46-df90-46f4-8d48-ab065a25dce3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:04.155856 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-14b05f46-df90-46f4-8d48-ab065a25dce3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1230 microversion: 2.1 time: 0.071513 Oct 28 13:59:04.156433 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3364/6819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:04 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1230 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:05.179566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:05.180276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:05.186354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:05.186888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:05.187330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:05.188079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:05.188543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:05.188971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:05.250354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:05.258136 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8b5e3ee-c1ac-4f89-9e50-008841a2324c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1234 microversion: 2.1 time: 0.083666 Oct 28 13:59:05.259251 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3456/6820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:05 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1234 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:06.281310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:06.281940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:06.289563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:06.290602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:06.291161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:06.292111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:06.292656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:06.293170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:06.357441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:06.365944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-265bc188-d86b-4d3a-aabe-fb46ca2f0a83 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1300 microversion: 2.1 time: 0.088589 Oct 28 13:59:06.366542 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3365/6821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:06 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:07.398480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:07.400126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:07.407826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:07.408442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:07.409002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:07.410031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:07.410588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:07.411137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:07.613222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:07.621291 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-280fab37-2f72-4b4f-a1fd-56d91ae250db tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.226811 Oct 28 13:59:07.621879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3457/6822] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:07 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:59:07.818380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a3cf64f8-02ef-447a-a463-d094832c0018 req-35206508-e208-4415-8499-f9d364ca5598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0", "tag": "0f59833c-2210-4b1f-b5b6-5ba743813efa"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:59:07.833101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a3cf64f8-02ef-447a-a463-d094832c0018 req-35206508-e208-4415-8499-f9d364ca5598 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:07.834185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a3cf64f8-02ef-447a-a463-d094832c0018 req-35206508-e208-4415-8499-f9d364ca5598 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:07.834660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a3cf64f8-02ef-447a-a463-d094832c0018 req-35206508-e208-4415-8499-f9d364ca5598 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:07.848999 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a3cf64f8-02ef-447a-a463-d094832c0018 req-35206508-e208-4415-8499-f9d364ca5598 service nova] Creating event network-changed:0f59833c-2210-4b1f-b5b6-5ba743813efa for instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 on n-h2-862876-2 Oct 28 13:59:07.854541 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a3cf64f8-02ef-447a-a463-d094832c0018 req-35206508-e208-4415-8499-f9d364ca5598 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040192 Oct 28 13:59:07.855412 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3366/6823] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 13:59:08.644493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:08.645116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:08.653114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:08.653608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:08.654215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:08.655119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:08.655590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:08.656024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:08.789607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:08.798401 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-af0ae787-5650-4c83-b079-93f1923d7aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.157847 Oct 28 13:59:08.799244 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3458/6824] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:08 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:59:09.822786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:09.823623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:09.825633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:09.830579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:09.831157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:09.831613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:09.832329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:09.832807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:09.833288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:09.836083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:09.970621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:09.980141 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6c38a92-dba1-4085-b063-84ead80a9f44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.162382 Oct 28 13:59:09.980731 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3367/6825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:09 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:11.003777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:11.004399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:11.007146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:11.012837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:11.013333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:11.013779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:11.014481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:11.014977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:11.015420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:11.158042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:11.166051 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ec67e5e-9647-489c-8f01-22c44f9b235e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.166267 Oct 28 13:59:11.169307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3459/6826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:10 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:12.191337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:12.191960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:12.199252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:12.199758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:12.200201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:12.200893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:12.201356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:12.201786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:12.334048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:12.342543 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c4178a5-7c1e-4704-b7a7-6b8f9f3a7625 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.155563 Oct 28 13:59:12.343162 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3368/6827] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:12 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:13.366467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:13.367990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:13.375674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:13.376171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:13.376613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:13.377320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:13.377777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:13.378209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:13.380965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=83 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:13.525958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:13.533718 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1df36c62-4a18-495a-917f-b4848ad069ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.171462 Oct 28 13:59:13.534304 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3460/6828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:13 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:14.558470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:14.559174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:14.561851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:14.566557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:14.567093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:14.567544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:14.568245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:14.568763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:14.569149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:14.706331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:14.714090 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-581e84d2-97f6-48b7-938d-2f479ce77f34 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.160027 Oct 28 13:59:14.714668 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3369/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:14 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:15.737444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:15.738065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:15.740716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:15.741932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:15.747815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:15.750652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:15.750652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:15.750652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:15.750652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:15.750652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:15.893378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:15.901421 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2303cb48-e643-4d38-9d45-439141c6177c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.167884 Oct 28 13:59:15.902131 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3461/6830] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:15 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:16.924924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:16.925484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:16.932960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:16.933537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:16.933997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:16.934716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:16.935222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:16.935661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:17.087484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:17.095552 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8e39fb3-3327-4f02-a1e2-d0a441d6a7bd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.174591 Oct 28 13:59:17.096128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3370/6831] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:16 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:59:18.120842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:18.121458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:18.129175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:18.129697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:18.130168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:18.131006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:18.131532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:18.131970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:18.275400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:18.284232 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6838396f-743a-4875-a004-7d0f8e9a9863 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.167309 Oct 28 13:59:18.285386 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3462/6832] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:18 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:19.309723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:19.311242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:19.318141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:19.318642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:19.319118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:19.319826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:19.320297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:19.320738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:19.470972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:19.478733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11fa2577-13d9-4d87-b283-eac1d067be8e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.175353 Oct 28 13:59:19.479350 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3371/6833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:19 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:20.502148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:20.502795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:20.510343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:20.510343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:20.510854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:20.511656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:20.512171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:20.512730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:20.658621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:20.666365 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-217cb803-ee0d-4714-bd14-d97ae08b1413 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.168757 Oct 28 13:59:20.666962 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3463/6834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:20 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:21.689829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:21.690466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:21.697245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:21.697751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:21.698206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:21.698942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:21.699420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:21.699899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:21.832904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:21.840581 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-53081b33-9395-4911-8f91-f524702ac177 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.154753 Oct 28 13:59:21.841140 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3372/6835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:21 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:22.864517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:22.865049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:22.872068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:22.872553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:22.872991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:22.873681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:22.874184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:22.874606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:23.010826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:23.018518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-507a1bfa-9ba5-45a1-98b3-3334a60c1170 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.158642 Oct 28 13:59:23.019283 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3464/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:22 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:24.041644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:24.042273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:24.049911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:24.050402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:24.050914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:24.051621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:24.052088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:24.052766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:24.186521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:24.194331 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bc45d602-3885-49b3-97ca-fa6fcdc0073f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.156737 Oct 28 13:59:24.202190 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3373/6837] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:24 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:25.217101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:25.217709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:25.224535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:25.225016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:25.225449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:25.226129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:25.226626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:25.227071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:25.359511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:25.368144 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49bd702c-9a2c-49b1-bf05-137d7309f445 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.154986 Oct 28 13:59:25.368735 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3465/6838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:25 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:59:26.399973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:26.400596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:26.407605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:26.408097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:26.408606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:26.409302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:26.409769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:26.410206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:26.541320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:26.549869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b12f7a41-c490-438b-b238-5525f905838a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.153124 Oct 28 13:59:26.550457 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3374/6839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:26 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:27.573545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:27.574169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:27.581755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:27.582245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:27.582690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:27.583409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:27.583873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:27.584309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:27.715294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:27.723028 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b37f1f24-6d19-4f48-8716-35055456b469 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.153455 Oct 28 13:59:27.723607 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3466/6840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:27 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:28.750803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:28.751437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:28.758430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:28.758962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:28.759414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:28.760117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:28.760588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:28.761027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:28.902609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:28.910933 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77ea9fd4-a94b-44b2-8c88-e3eec62df5d7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.164126 Oct 28 13:59:28.911533 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3375/6841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:28 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:29.933827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:29.934446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:29.941320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:29.941809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:29.942276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:29.943006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:29.943469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:29.943900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:30.082105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:30.089833 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d28a9f48-b616-406a-a2ea-55c0ceda72cb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.160022 Oct 28 13:59:30.090431 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3467/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:29 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:31.113119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:31.114255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:31.120750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:31.121251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:31.121695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:31.122396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:31.122930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:31.123371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:31.265609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:31.273394 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1bd3e725-cd22-4e24-87ba-be7fca7ef044 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.164417 Oct 28 13:59:31.273971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3376/6843] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:31 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:32.297443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:32.298105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:32.304922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:32.308854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:32.308854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:32.308854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:32.308854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:32.308854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:32.439732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:32.448236 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-813732b7-b55e-4269-bf66-b66d24e79ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.155126 Oct 28 13:59:32.448821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3468/6844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:32 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:33.472697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:33.473320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:33.480696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:33.487219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:33.487219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:33.487219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:33.487219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:33.487219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:33.620367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:33.628500 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-55e98417-161c-4d06-b9d6-ba92b1950aeb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.159658 Oct 28 13:59:33.629076 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3377/6845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:33 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:34.651893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:34.652591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:34.659419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:34.659969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:34.660397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:34.661115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:34.662079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:34.662500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:34.796326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:34.804199 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4001ed1-18a7-4baa-a495-c5490a962a7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.156356 Oct 28 13:59:34.804764 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3469/6846] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:34 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:35.826888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:35.827411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:35.834418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:35.834955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:35.835408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:35.836110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:35.836578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:35.837017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:35.966663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:35.974951 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3b7d5810-0bd7-44ce-8e56-743f91b77028 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.152124 Oct 28 13:59:35.976040 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3378/6847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:35 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:36.998705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:36.999289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:37.006060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:37.012137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:37.012137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:37.012137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:37.012137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:37.012137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:37.138961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:37.146725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a02cd42-668c-4d15-b4d7-8cea50d5b9d0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.152002 Oct 28 13:59:37.147321 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3470/6848] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:36 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:38.169923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:38.170582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:38.177574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:38.178334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:38.178807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:38.179518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:38.179986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:38.180421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:38.310176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:38.318402 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e8b23553-0ec9-43b2-9180-991d9e8699bb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.152414 Oct 28 13:59:38.319085 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3379/6849] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:38 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:39.343294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:39.343910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:39.351150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:39.351665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:39.352670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:39.353370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:39.353896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:39.354327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:39.483923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:39.491662 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-98056b0c-b90d-4935-8643-8e9a368513c0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.152292 Oct 28 13:59:39.492241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3471/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:39 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:40.515207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:40.515836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:40.518531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=26 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:40.523315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:40.530332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:40.530332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:40.530332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:40.530332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:40.530332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:40.660478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:40.674137 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50703cdf-9825-4ade-a5c2-ed0f75ce924b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.158203 Oct 28 13:59:40.674137 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3380/6851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:40 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:41.693051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:41.693698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:41.696951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=26 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:41.701731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:41.702224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:41.702732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:41.703452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:41.703910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:41.704341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:41.842011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:41.850251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0d501dac-586a-4813-846b-95acf3d7f885 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.161154 Oct 28 13:59:41.851109 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3472/6852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:41 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:42.873597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:42.874303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:42.881469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:42.881981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:42.882438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:42.883194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:42.883671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:42.884114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:42.887208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=84 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:43.019736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:43.028370 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2ae3c421-4392-4492-9cc8-256e9b7fb663 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.158840 Oct 28 13:59:43.029050 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3381/6853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:42 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 13:59:44.052452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:44.053220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:44.060941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:44.061430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:44.061877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:44.062581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:44.063073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:44.063506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:44.066070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=78 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 13:59:44.197513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:44.205221 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-17eb39fc-802e-4fe5-bf84-bab622eac682 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.156880 Oct 28 13:59:44.209363 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3473/6854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:44 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:45.229378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:45.230006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:45.237250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:45.237752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:45.238209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:45.238945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:45.239418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:45.239858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:45.378928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:45.387566 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1f7b313-75de-4af4-b49d-01a8043ab078 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1342 microversion: 2.1 time: 0.162681 Oct 28 13:59:45.388158 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3382/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:45 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:46.410310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:46.410991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:46.417945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:46.418436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:46.418908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:46.419605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:46.420079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:46.420495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:46.553783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:46.562011 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6bd719cc-63af-4137-9f33-d3430846eb89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.155659 Oct 28 13:59:46.565997 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3474/6856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:46 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:47.585152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:47.585785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:47.593298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:47.593854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:47.594310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:47.595043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:47.595519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:47.595961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:47.728312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:47.736130 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1a6fbd1c-1ceb-4ca2-89e3-0d04aa73127e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.154901 Oct 28 13:59:47.736715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3383/6857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:47 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:48.759603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:48.760152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:48.767213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:48.767829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:48.768304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:48.768989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:48.769452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:48.769868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:48.898927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:48.907796 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5a9a254-9b3a-46c0-beed-011b7f830e67 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.152304 Oct 28 13:59:48.908485 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3475/6858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:48 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:49.932038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:49.933171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:49.939599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:49.940099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:49.940552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:49.941256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:49.941725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:49.942165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:50.067819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:50.075507 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0a4e76e3-c830-4012-a68a-d78c8d63cbef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.148198 Oct 28 13:59:50.076444 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3384/6859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:49 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:51.098199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:51.098860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:51.106490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:51.107018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:51.107460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:51.108153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:51.108615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:51.109046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:51.245706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:51.253409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de3af3b2-2632-4b73-9b5f-b13f0d811f7a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.159195 Oct 28 13:59:51.253984 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3476/6860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:51 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:52.277082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:52.277731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:52.284836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:52.285330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:52.285776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:52.286470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:52.286976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:52.287412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:52.418286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:52.426099 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd0052d0-c9a3-4576-a2c3-130cf665cb5e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.153623 Oct 28 13:59:52.426699 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3385/6861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:52 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:53.450424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:53.451559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:53.458510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:53.459026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:53.459470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:53.460175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:53.460628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:53.461048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:53.591570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:53.599384 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cbe9fd72-c698-4b1d-83e4-be471e556db6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.153639 Oct 28 13:59:53.599966 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3477/6862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:53 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:54.622823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:54.623373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:54.630293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:54.630821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:54.631349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:54.632040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:54.632507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:54.632939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:54.765709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:54.773459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0bfd061-dbd0-4bb2-8adb-4aa4ab19cb74 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.155345 Oct 28 13:59:54.774153 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3386/6863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:54 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:55.797066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:55.797606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:55.804739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:55.805219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:55.805660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:55.806339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:55.806825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:55.807249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:55.937546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:55.945508 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-63889b8c-647e-4e61-b37f-fea960a91292 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.152528 Oct 28 13:59:55.946097 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3478/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:55 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:56.594863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a3fdae13-91d6-4b91-b09c-e6a09b7dde34 req-9596780c-6497-4c9c-a9b7-7b4477bc7313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0", "name": "network-vif-plugged", "status": "completed", "tag": "0f59833c-2210-4b1f-b5b6-5ba743813efa"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 13:59:56.606068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a3fdae13-91d6-4b91-b09c-e6a09b7dde34 req-9596780c-6497-4c9c-a9b7-7b4477bc7313 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:56.607697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a3fdae13-91d6-4b91-b09c-e6a09b7dde34 req-9596780c-6497-4c9c-a9b7-7b4477bc7313 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:56.607697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a3fdae13-91d6-4b91-b09c-e6a09b7dde34 req-9596780c-6497-4c9c-a9b7-7b4477bc7313 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:56.618058 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a3fdae13-91d6-4b91-b09c-e6a09b7dde34 req-9596780c-6497-4c9c-a9b7-7b4477bc7313 service nova] Creating event network-vif-plugged:0f59833c-2210-4b1f-b5b6-5ba743813efa for instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 on n-h2-862876-2 Oct 28 13:59:56.623169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a3fdae13-91d6-4b91-b09c-e6a09b7dde34 req-9596780c-6497-4c9c-a9b7-7b4477bc7313 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032272 Oct 28 13:59:56.623761 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3387/6865] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 13:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 13:59:56.969491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:56.970111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:56.977143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:56.977631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:56.978070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:56.978786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:56.979253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:56.980299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:57.118423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:57.127032 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe6750e3-0fcc-483a-9a5e-fff949628216 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1376 microversion: 2.1 time: 0.161588 Oct 28 13:59:57.127620 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3479/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:56 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:58.151111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:58.152402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:58.158773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:58.159288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:58.159748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:58.160449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:58.160927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:58.161366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:58.299848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:58.305290 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2fb0169c-ba49-48ba-8ff7-0280fa933a20 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1563 microversion: 2.1 time: 0.159456 Oct 28 13:59:58.305901 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3388/6867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:58 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:58.328244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:58.328860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:58.335785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:58.336287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:58.336760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:58.337445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:58.337926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:58.338625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:58.540513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:58.549105 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f3c8646-a49a-46f3-8397-a6bb3ef52a49 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1563 microversion: 2.1 time: 0.224745 Oct 28 13:59:58.549706 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3480/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:58 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 13:59:58.629952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:58.630490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:58.637097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:58.637582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:58.638027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:58.638717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:58.639295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:58.639728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:58.668973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 13:59:59.024725 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95e6252a-ee58-4ec4-af23-9a5d879c8dac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 204 len: 0 microversion: 2.1 time: 0.398310 Oct 28 13:59:59.025318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3389/6869] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 13:59:58 2022] DELETE /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 13:59:59.034263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 13:59:59.035010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 13:59:59.041034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:59.041525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:59.041968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:59.042664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 13:59:59.043154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 13:59:59.043584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 13:59:59.172754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 13:59:59.180887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-45fc047d-bab8-4ee7-9743-73f11ccf3d2d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1569 microversion: 2.1 time: 0.150558 Oct 28 13:59:59.181468 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3481/6870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 13:59:59 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:00.205912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:00.206630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:00.213595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:00.214091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:00.214537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:00.215266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:00.215732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:00.216167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:00.401828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:00.409664 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e7e15e7-cb4a-41b3-87e1-22ee6bfcbc1f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1569 microversion: 2.1 time: 0.207989 Oct 28 14:00:00.412723 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3390/6871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:00 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:01.131947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0a66cf63-3dec-4a82-ab61-54545ae21c19 req-318339be-1587-43ca-add5-6654f8e88ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0", "name": "network-vif-deleted", "tag": "0f59833c-2210-4b1f-b5b6-5ba743813efa"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:00:01.142242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0a66cf63-3dec-4a82-ab61-54545ae21c19 req-318339be-1587-43ca-add5-6654f8e88ce5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:01.149546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0a66cf63-3dec-4a82-ab61-54545ae21c19 req-318339be-1587-43ca-add5-6654f8e88ce5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:01.149546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0a66cf63-3dec-4a82-ab61-54545ae21c19 req-318339be-1587-43ca-add5-6654f8e88ce5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:01.156527 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0a66cf63-3dec-4a82-ab61-54545ae21c19 req-318339be-1587-43ca-add5-6654f8e88ce5 service nova] Creating event network-vif-deleted:0f59833c-2210-4b1f-b5b6-5ba743813efa for instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 on n-h2-862876-2 Oct 28 14:00:01.161994 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0a66cf63-3dec-4a82-ab61-54545ae21c19 req-318339be-1587-43ca-add5-6654f8e88ce5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109814 Oct 28 14:00:01.162687 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3482/6872] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:00:01.433860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:01.435144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:01.442284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:01.442825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:01.443286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:01.444005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:01.444479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:01.444924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:01.507868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:01.515848 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-51535ac6-2e48-47e4-a776-10fb63e89598 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1361 microversion: 2.1 time: 0.086523 Oct 28 14:00:01.516427 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3391/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:01 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1361 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:02.541163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:02.542067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:02.548635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:02.550052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:02.550885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:02.554025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:02.554025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:02.554025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:02.620495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:02.629130 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2eda8202-0128-4756-9876-13922cb265e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1361 microversion: 2.1 time: 0.093316 Oct 28 14:00:02.630265 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3483/6874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:02 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:00:03.653248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:03.653885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:03.661452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:03.663239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:03.663239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:03.663602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:03.664093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:03.664539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:03.733967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:03.741973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ce5372f3-2901-4293-aee4-ebcae3c682e9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1361 microversion: 2.1 time: 0.092959 Oct 28 14:00:03.742557 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3392/6875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:03 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1361 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:04.766130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:04.766664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:04.773710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:04.774196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:04.774626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:04.775346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:04.775874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:04.776363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:04.841102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:04.849486 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f334f45-e8c7-4ef7-927c-846bd10ebbc8 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1361 microversion: 2.1 time: 0.087563 Oct 28 14:00:04.850061 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3484/6876] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:04 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:05.871960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:05.872596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:05.879649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:05.880213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:05.880613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:05.881349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:05.881821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:05.882261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:05.915885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:05.916308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:05.916771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:05.917291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:00:05.960240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:05.968371 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfb9559f-c2d4-445c-9749-2f4fd57ff31b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 200 len: 1366 microversion: 2.1 time: 0.100451 Oct 28 14:00:05.968955 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3393/6877] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:05 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:00:06.991001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:06.991615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:06.998653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:06.999298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:06.999745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:07.000453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:07.000900 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:07.001328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:07.014875 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 HTTP/1.1 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0'} Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:07.016571 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-78b8a005-c714-43f6-86bd-fc5902e1e692 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 404 len: 111 microversion: 2.1 time: 0.031270 Oct 28 14:00:07.021240 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3485/6878] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:06 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:00:11.405050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:11.405606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:11.408607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:11.413523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:11.414032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:11.414488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:11.415258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:11.415760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:11.416201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:11.441570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:00:11.563435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:11.755755 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d433100a-5dc3-40b6-bcce-fcec9f94fa89 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 204 len: 0 microversion: 2.1 time: 0.354296 Oct 28 14:00:11.756276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3394/6879] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:00:11 2022] DELETE /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:00:11.764287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:11.764925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:11.767850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=28 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:11.772639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:11.773122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:11.773562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:11.774248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:11.774704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:11.775150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:11.909574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:11.917894 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f3e08a1d-91fe-4b94-8373-1c9ce0724cb5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1409 microversion: 2.1 time: 0.157454 Oct 28 14:00:11.918480 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3486/6880] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:11 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:12.942200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:12.943046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:12.950530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:12.951059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:12.951508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:12.952220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:12.952691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:12.953128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:13.138735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:13.146468 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c67f4df1-1454-4604-b4cd-3f08cfd1182c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1409 microversion: 2.1 time: 0.208798 Oct 28 14:00:13.147079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3395/6881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:12 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1409 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:13.774338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d19e5574-ec7b-4b5e-91c5-3d798ce3062e req-0459903e-baf7-4151-af80-37fff5e6c6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7979df36-83e3-4752-9d34-5259c8aa2e74", "name": "network-vif-deleted", "tag": "72599437-d3d8-4f68-a724-52dc278ab11b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:00:13.785443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d19e5574-ec7b-4b5e-91c5-3d798ce3062e req-0459903e-baf7-4151-af80-37fff5e6c6c7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:13.785945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d19e5574-ec7b-4b5e-91c5-3d798ce3062e req-0459903e-baf7-4151-af80-37fff5e6c6c7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:13.786374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d19e5574-ec7b-4b5e-91c5-3d798ce3062e req-0459903e-baf7-4151-af80-37fff5e6c6c7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:13.798172 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d19e5574-ec7b-4b5e-91c5-3d798ce3062e req-0459903e-baf7-4151-af80-37fff5e6c6c7 service nova] Creating event network-vif-deleted:72599437-d3d8-4f68-a724-52dc278ab11b for instance 7979df36-83e3-4752-9d34-5259c8aa2e74 on n-h1-862876-2 Oct 28 14:00:13.803778 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d19e5574-ec7b-4b5e-91c5-3d798ce3062e req-0459903e-baf7-4151-af80-37fff5e6c6c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032961 Oct 28 14:00:13.804404 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3487/6882] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:00:14.168916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:14.169603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:14.177142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:14.177657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:14.178111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:14.179130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:14.179604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:14.180045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:14.247750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:14.255614 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0ba779a5-14dd-436a-862f-02b0da49a498 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1201 microversion: 2.1 time: 0.090654 Oct 28 14:00:14.256192 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3396/6883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:14 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:15.279748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:15.280455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:15.287609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:15.288178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:15.288622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:15.289330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:15.289853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:15.290288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:15.293199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=78 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:15.400264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:15.409147 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f423e66b-a162-475b-912c-1fce09b77ec9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1201 microversion: 2.1 time: 0.134651 Oct 28 14:00:15.409753 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3488/6884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:15 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1201 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:16.433515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:16.434157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:16.440998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:16.441499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:16.441945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:16.442647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:16.443137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:16.443569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:16.505215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:16.513019 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f38da7fb-b115-4477-895c-f281bb1e8456 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1201 microversion: 2.1 time: 0.084328 Oct 28 14:00:16.513594 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3397/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:16 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:17.536356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:17.537705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:17.544620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:17.545285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:17.545609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:17.546296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:17.546780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:17.547249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:17.613696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:17.622273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28ae1ac8-b874-402a-bb76-dfda1e5302af tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1201 microversion: 2.1 time: 0.089904 Oct 28 14:00:17.622956 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3489/6886] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:17 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:18.645178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:18.645817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:18.653579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:18.656465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:18.656465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:18.656465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:18.656465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:18.656465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:18.687889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:18.688716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:18.689175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:18.689638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid 7979df36-83e3-4752-9d34-5259c8aa2e74 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:00:18.731899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:18.739846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f05aaa6-3ac6-4fed-846d-d19e46e22fbd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 200 len: 1206 microversion: 2.1 time: 0.098592 Oct 28 14:00:18.740421 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3398/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:18 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 1206 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:19.763554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:19.763980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:19.771081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:19.771521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:19.771959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:19.772652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:19.773106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:19.773529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:19.787806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 HTTP/1.1 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7979df36-83e3-4752-9d34-5259c8aa2e74'} Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:19.789496 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5393ace0-9f67-402e-b146-69ccac4c570a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 404 len: 111 microversion: 2.1 time: 0.032163 Oct 28 14:00:19.794121 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3490/6888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:19 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:00:21.935262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:21.935826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:21.943688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:21.944200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:21.944651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:21.945374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:21.945849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:21.946292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:21.960553 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 HTTP/1.1 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0'} Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:00:21.962293 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c8176a4-dfb6-4a81-9742-675aefbd7e38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 404 len: 111 microversion: 2.1 time: 0.032444 Oct 28 14:00:21.967330 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3399/6889] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:00:21 2022] DELETE /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:00:21.973260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:21.973885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:21.983117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:21.983610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:21.984052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:21.984760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:21.985226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:21.985694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:22.000123 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 HTTP/1.1 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0'} Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:22.001401 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1a4628f1-a0d1-459e-b2c8-1479aa6e1667 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0" status: 404 len: 111 microversion: 2.1 time: 0.033524 Oct 28 14:00:22.006427 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3491/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:21 2022] GET /compute/v2.1/servers/bba4ec2e-6d75-4ea9-a9fa-b5d4e15c32d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 14:00:22.788347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:22.788866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:22.795438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:22.795894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:22.796352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:22.797054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:22.797528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:22.797969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:22.812590 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 HTTP/1.1 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7979df36-83e3-4752-9d34-5259c8aa2e74'} Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:00:22.814140 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4dc6e4c9-0532-4a71-b7e2-dbd5f0714a4d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 404 len: 111 microversion: 2.1 time: 0.031101 Oct 28 14:00:22.818511 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3400/6891] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:00:22 2022] DELETE /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:00:22.824410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:22.825021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 7979df36-83e3-4752-9d34-5259c8aa2e74] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:22.835737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:22.838814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:22.838814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:22.838814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:22.838814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:22.838814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:22.851673 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 HTTP/1.1 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '7979df36-83e3-4752-9d34-5259c8aa2e74'} Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:00:22.853174 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 7979df36-83e3-4752-9d34-5259c8aa2e74 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8f4f96c-2a03-43d8-b862-ffce5292fc62 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74" status: 404 len: 111 microversion: 2.1 time: 0.034177 Oct 28 14:00:22.858421 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3492/6892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:22 2022] GET /compute/v2.1/servers/7979df36-83e3-4752-9d34-5259c8aa2e74 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 14:00:22.932281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59ef1d41-0a82-4708-968d-1eb8175a8084 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: .version_select at 0x7f27b85675e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-400975334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDAfci71RPmO+jNR2c51v2t3gGDVY12qW8bNN1X9UgSQTXr5kNa6CK4xhM3kn7sv/vbdYsIYvUcqvoTXR08U226t85r5vIGiLTjBo0qzqzEmZDURPXQqgnX0ANRoTg9xA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:00:22.949631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-59ef1d41-0a82-4708-968d-1eb8175a8084 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:00:22.954893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-59ef1d41-0a82-4708-968d-1eb8175a8084 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:00:23.048568 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59ef1d41-0a82-4708-968d-1eb8175a8084 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.120291 Oct 28 14:00:23.049100 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3401/6893] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:00:22 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:00:46.296724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1150625176", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-400975334", "security_groups": [{"name": "tempest-secgroup-smoke-2111737435"}], "block_device_mapping_v2": [{"uuid": "573792c8-42a3-43b3-8352-ec1fbf165c8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:00:46.307433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=13 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:46.308239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=17 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:46.491393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:00:46.899652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:00:46.900189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:00:46.900660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:00:46.901094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:00:46.901504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:00:46.910103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:46.910583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:46.911053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:46.912404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:46.912836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:46.913255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:46.929662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:00:46.935002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:00:46.992409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:00:46.994662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='573792c8-42a3-43b3-8352-ec1fbf165c8a',volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:00:47.435340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2e0738a-76a9-4470-85a4-027ab3a120e4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.142411 Oct 28 14:00:47.436003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3493/6894] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:00:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:00:47.445696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=30 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:47.446491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:47.447437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:47.451327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a086c62e-48a6-4a01-be08-001bc7424e5b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:47.451969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a086c62e-48a6-4a01-be08-001bc7424e5b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:47.598114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a086c62e-48a6-4a01-be08-001bc7424e5b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:47.605391 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a086c62e-48a6-4a01-be08-001bc7424e5b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1094 microversion: 2.1 time: 0.162220 Oct 28 14:00:47.605998 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3402/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:47 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1094 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:48.630301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:48.630853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:48.637514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:48.638007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:48.638449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:48.639166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:48.639621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:48.644481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:48.708220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:48.716588 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c545dd5-f85d-4396-aee7-fbf67a7290d9 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1136 microversion: 2.1 time: 0.091167 Oct 28 14:00:48.717226 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3494/6896] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:48 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:49.739812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:49.740448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:49.751995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:49.752520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:49.752964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:49.753684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:49.754159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:49.754609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:49.822259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:49.832106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-23e32f13-5ef2-4790-8668-e6874ce70f9a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1210 microversion: 2.1 time: 0.096598 Oct 28 14:00:49.832601 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3403/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:49 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:50.855281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:50.855903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:50.863334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:50.863837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:50.864280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:50.864992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:50.865457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:50.865992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:51.142397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:51.150292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51951c26-7ec8-4d62-bef8-74680a99e0b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1278 microversion: 2.1 time: 0.299066 Oct 28 14:00:51.151130 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3495/6898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:50 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1278 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:51.691753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-fedd6b45-8d97-4557-bbaf-966931cb6945 req-226ebab0-fd01-4f77-b515-576434ec4543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6661b69-7630-4257-b942-1d96041d36d4", "tag": "49786eaa-1314-4d81-a15a-5c70252d5fde"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:00:51.706085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fedd6b45-8d97-4557-bbaf-966931cb6945 req-226ebab0-fd01-4f77-b515-576434ec4543 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:51.707440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fedd6b45-8d97-4557-bbaf-966931cb6945 req-226ebab0-fd01-4f77-b515-576434ec4543 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:51.707573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fedd6b45-8d97-4557-bbaf-966931cb6945 req-226ebab0-fd01-4f77-b515-576434ec4543 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:51.719872 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fedd6b45-8d97-4557-bbaf-966931cb6945 req-226ebab0-fd01-4f77-b515-576434ec4543 service nova] Creating event network-changed:49786eaa-1314-4d81-a15a-5c70252d5fde for instance b6661b69-7630-4257-b942-1d96041d36d4 on n-h2-862876-2 Oct 28 14:00:51.724986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-fedd6b45-8d97-4557-bbaf-966931cb6945 req-226ebab0-fd01-4f77-b515-576434ec4543 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037131 Oct 28 14:00:51.731316 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3404/6899] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:00:52.173810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:52.174435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:52.182534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:52.183095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:52.183537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:52.184245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:52.184778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:52.185214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:52.419780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:52.427906 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2f3da00-395d-4a07-96d4-672450d4a3ce tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1278 microversion: 2.1 time: 0.258059 Oct 28 14:00:52.429060 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3496/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:52 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:53.452445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:53.453314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:53.460267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:53.460806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:53.461261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:53.461969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:53.462440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:53.462923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:53.597396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:53.605929 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-af8039dd-a083-4562-844a-1b88b2a68dd6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1278 microversion: 2.1 time: 0.158526 Oct 28 14:00:53.606504 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3405/6901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:53 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:54.629859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:54.630476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:54.637353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:54.637841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:54.638282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:54.638997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:54.639463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:54.639892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:54.771497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:54.779859 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-957e1ad2-5590-4e78-a00e-f470bc386f4a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1278 microversion: 2.1 time: 0.153955 Oct 28 14:00:54.780442 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3497/6902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:54 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:55.803768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:55.804558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:55.811346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:55.811843 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:55.812287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:55.812981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:55.813445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:55.813883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:55.943862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:55.952140 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-872608ca-340a-41de-a233-c418a2af09e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.152474 Oct 28 14:00:55.952716 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3406/6903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:55 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:56.975685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:56.976506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:56.979419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:56.980085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:56.985346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:56.985768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:56.986207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:56.986965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:56.987520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:56.992840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:57.121178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:57.129277 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2854a952-1bc3-46cc-8028-57bacbbea6e2 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.157735 Oct 28 14:00:57.129846 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3498/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:56 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:58.152769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:58.153420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:58.156229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:00:58.161061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:58.161566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:58.162018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:58.162725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:58.163214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:58.163661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:58.302502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:58.311057 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f650948f-9fdc-490c-8953-87f29e1e671a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.162157 Oct 28 14:00:58.311639 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3407/6905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:58 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:00:59.332781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:00:59.333412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:00:59.340345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:59.343079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:59.343079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:59.343079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:00:59.343079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:00:59.343079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:00:59.476117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:00:59.483848 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f308597b-ff65-435c-9752-8b5d939bfdcc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.155039 Oct 28 14:00:59.484434 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3499/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:00:59 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:00.506545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:00.507216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:00.514085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:00.517785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:00.517785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:00.517785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:00.517785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:00.517785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:00.646523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:00.654788 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c620609a-131d-42ac-aa1b-9c9f601592b4 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.152140 Oct 28 14:01:00.655368 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3408/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:00 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:01.677667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:01.678275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:01.684708 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:01.685191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:01.685629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:01.686312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:01.686783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:01.687371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:01.819820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:01.828166 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db8cfaab-2204-416f-a5e9-9ed9613efe02 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.154573 Oct 28 14:01:01.828735 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3500/6908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:01 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:02.851793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:02.853095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:02.860429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:02.861044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:02.861596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:02.862386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:02.862935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:02.863378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:03.000297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:03.008943 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee852c20-c192-4e6c-bd96-f4675c807108 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.160321 Oct 28 14:01:03.008943 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3409/6909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:02 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:01:04.031687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:04.032308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:04.039175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:04.039662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:04.040100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:04.040789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:04.041248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:04.041694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:04.173959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:04.181890 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f73fc324-d3c2-4ded-9a2a-6f06ee2ccb56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.154087 Oct 28 14:01:04.183010 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3501/6910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:04 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:05.204846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:05.205465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:05.212628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:05.213114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:05.214059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:05.214773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:05.215228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:05.215663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:05.257831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6b8577ae-eccd-4da5-8b73-7902622d113d req-5d2cbf2e-aabd-421c-8a5d-39b75ce422da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6661b69-7630-4257-b942-1d96041d36d4", "name": "network-vif-plugged", "status": "completed", "tag": "49786eaa-1314-4d81-a15a-5c70252d5fde"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:01:05.268084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6b8577ae-eccd-4da5-8b73-7902622d113d req-5d2cbf2e-aabd-421c-8a5d-39b75ce422da service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:05.268578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6b8577ae-eccd-4da5-8b73-7902622d113d req-5d2cbf2e-aabd-421c-8a5d-39b75ce422da service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:05.269018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6b8577ae-eccd-4da5-8b73-7902622d113d req-5d2cbf2e-aabd-421c-8a5d-39b75ce422da service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:05.283478 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6b8577ae-eccd-4da5-8b73-7902622d113d req-5d2cbf2e-aabd-421c-8a5d-39b75ce422da service nova] Creating event network-vif-plugged:49786eaa-1314-4d81-a15a-5c70252d5fde for instance b6661b69-7630-4257-b942-1d96041d36d4 on n-h2-862876-2 Oct 28 14:01:05.288869 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6b8577ae-eccd-4da5-8b73-7902622d113d req-5d2cbf2e-aabd-421c-8a5d-39b75ce422da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091897 Oct 28 14:01:05.289620 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3410/6911] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:01:05.353787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:05.361806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23a562f9-3789-4bce-8e69-b7f29fde3d38 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.160905 Oct 28 14:01:05.362396 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3502/6912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:05 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:06.385669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:06.386376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:06.392911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:06.393329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:06.400482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:06.400482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:06.400482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:06.400482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:06.531371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:06.539264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1513ab7-dd3a-49a3-83a3-868eeef1940f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1266 microversion: 2.1 time: 0.158680 Oct 28 14:01:06.539843 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3411/6913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:06 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:07.563583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:07.564225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:07.571414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:07.571932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:07.572368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:07.573061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:07.573523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:07.573951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:07.718247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:07.726103 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea1f3c0b-366a-4df7-a987-38e0c78d1695 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1453 microversion: 2.1 time: 0.167289 Oct 28 14:01:07.726674 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3503/6914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:07 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:07.749001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:01:07.749630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:01:07.756533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:07.757033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:07.757506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:07.758210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:07.758680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:07.759191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:07.889113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:01:07.896957 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-24eb1ab2-e1f3-4ec8-a9c9-f0b3b2e55ab6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1453 microversion: 2.1 time: 0.152538 Oct 28 14:01:07.897533 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3412/6915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:01:07 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:01:10.359922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-929cf04c-1bc1-40a8-abd4-670870de9cf4 req-a42d59be-a146-49af-a743-faf7d3f91441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6661b69-7630-4257-b942-1d96041d36d4", "tag": "49786eaa-1314-4d81-a15a-5c70252d5fde"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:01:10.369402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-929cf04c-1bc1-40a8-abd4-670870de9cf4 req-a42d59be-a146-49af-a743-faf7d3f91441 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:01:10.369896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-929cf04c-1bc1-40a8-abd4-670870de9cf4 req-a42d59be-a146-49af-a743-faf7d3f91441 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:01:10.370332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-929cf04c-1bc1-40a8-abd4-670870de9cf4 req-a42d59be-a146-49af-a743-faf7d3f91441 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:01:10.381971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-929cf04c-1bc1-40a8-abd4-670870de9cf4 req-a42d59be-a146-49af-a743-faf7d3f91441 service nova] Creating event network-changed:49786eaa-1314-4d81-a15a-5c70252d5fde for instance b6661b69-7630-4257-b942-1d96041d36d4 on n-h2-862876-2 Oct 28 14:01:10.387336 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-929cf04c-1bc1-40a8-abd4-670870de9cf4 req-a42d59be-a146-49af-a743-faf7d3f91441 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079978 Oct 28 14:01:10.388547 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3504/6916] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:03:36.533840 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:03:36.534412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=24 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:03:36.535203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=52 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:03:36.536284 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:03:36.536410 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 (ip 10.222.0.25) !!! Oct 28 14:03:36.538159 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:03:36.538328 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 (ip 10.222.0.25) !!! Oct 28 14:03:36.549035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:36.549543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:36.563790 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:36.564295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:36.564739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:36.565435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:36.565902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:36.566338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:36.593809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:03:36.898411 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c21e856b-c7eb-445b-8935-aeb676b76f36 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 204 len: 0 microversion: 2.1 time: 0.367014 Oct 28 14:03:36.899280 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3413/6917] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:03:36 2022] DELETE /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:03:36.905757 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:03:36.906568 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:03:36.907259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:03:36.911680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=64 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:03:36.911680 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:03:36.911680 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 (ip 10.222.0.25) !!! Oct 28 14:03:36.912282 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:03:36.912422 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 (ip 10.222.0.25) !!! Oct 28 14:03:36.927807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:36.928506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:36.938117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:36.942812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:36.942812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:36.942812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:36.942812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:36.942812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:37.077383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:37.085926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-881d0fc7-300d-48fb-b01d-26043284ce08 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1578 microversion: 2.1 time: 0.182086 Oct 28 14:03:37.089593 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3505/6918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:36 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:38.110403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:38.111669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:38.121807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:38.122309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:38.122807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:38.123525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:38.123996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:38.124437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:38.131335 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 50882. Oct 28 14:03:38.263269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:38.271065 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e85cfffb-e2f8-4fb3-9b88-a018241b1803 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1578 microversion: 2.1 time: 0.164902 Oct 28 14:03:38.271639 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3414/6919] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:38 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:39.302000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:39.302641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:39.320280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:39.321759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:39.322297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:39.322968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:39.323490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:39.323963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:39.374067 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 50896. Oct 28 14:03:39.383056 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 50898. Oct 28 14:03:39.392856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cf5c777c-603e-4d98-8a64-7e7b4068df15 req-539f3906-081d-4094-bf39-19744e58e768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6661b69-7630-4257-b942-1d96041d36d4", "name": "network-vif-deleted", "tag": "49786eaa-1314-4d81-a15a-5c70252d5fde"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:03:39.409754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf5c777c-603e-4d98-8a64-7e7b4068df15 req-539f3906-081d-4094-bf39-19744e58e768 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:39.411279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf5c777c-603e-4d98-8a64-7e7b4068df15 req-539f3906-081d-4094-bf39-19744e58e768 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:39.412019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cf5c777c-603e-4d98-8a64-7e7b4068df15 req-539f3906-081d-4094-bf39-19744e58e768 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:39.425707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:39.434048 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fc3d3a86-7659-4ea1-a8a5-c81918e9532c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1510 microversion: 2.1 time: 0.138632 Oct 28 14:03:39.434646 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3506/6920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:39 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1510 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:39.435261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cf5c777c-603e-4d98-8a64-7e7b4068df15 req-539f3906-081d-4094-bf39-19744e58e768 service nova] Creating event network-vif-deleted:49786eaa-1314-4d81-a15a-5c70252d5fde for instance b6661b69-7630-4257-b942-1d96041d36d4 on n-h2-862876-2 Oct 28 14:03:39.442703 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cf5c777c-603e-4d98-8a64-7e7b4068df15 req-539f3906-081d-4094-bf39-19744e58e768 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141851 Oct 28 14:03:39.446921 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3415/6921] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:03:40.457855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:40.458478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:40.467607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:40.468685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:40.468685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:40.469232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:40.469696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:40.470129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:40.541693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:40.550777 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-796e19cd-f69e-4d37-991e-5289f22c07ba tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1225 microversion: 2.1 time: 0.096909 Oct 28 14:03:40.551390 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3507/6922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:40 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:03:41.574011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:41.574738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:41.581931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:41.582432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:41.582920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:41.583729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:41.584205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:41.584651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:41.650634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:41.658775 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-67d8731c-c7ec-4444-a617-c2e4738d33b1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1225 microversion: 2.1 time: 0.088948 Oct 28 14:03:41.659339 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3416/6923] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:41 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:42.681791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:42.682420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:42.692273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:42.692775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:42.693218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:42.693934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:42.694398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:42.694865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:42.762518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:42.771952 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54a625ce-a271-42e9-bf58-1c4db4577936 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1225 microversion: 2.1 time: 0.094278 Oct 28 14:03:42.772582 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3508/6924] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:42 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:43.795124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:43.795762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:43.802779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:43.803296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:43.803751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:43.804461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:43.804934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:43.805665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:43.836553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:43.837050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:43.837505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:43.837965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid b6661b69-7630-4257-b942-1d96041d36d4 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:03:43.880897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:43.888952 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da4d31e6-ff1c-44f8-aeae-ad9c71736826 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 200 len: 1230 microversion: 2.1 time: 0.097890 Oct 28 14:03:43.889531 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3417/6925] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:43 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:44.912683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:44.913298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:44.922370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:44.922890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:44.923418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:44.924737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:44.925212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:44.925644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:44.939393 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 HTTP/1.1 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b6661b69-7630-4257-b942-1d96041d36d4'} Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:03:44.941087 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f06b0d8e-17a3-41d8-85fc-7b43197a5770 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 404 len: 111 microversion: 2.1 time: 0.033679 Oct 28 14:03:44.949782 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3509/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:44 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:03:44.990194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1242631040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-400975334", "security_groups": [{"name": "tempest-secgroup-smoke-2111737435"}], "block_device_mapping_v2": [{"uuid": "573792c8-42a3-43b3-8352-ec1fbf165c8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:03:45.105542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:03:45.561922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:03:45.562399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:03:45.562937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:03:45.563373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:03:45.563808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:03:45.574976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:45.575481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:45.575938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:45.576687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:45.577163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:45.577610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:45.597581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:03:45.602893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:03:45.661611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:03:45.663880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='573792c8-42a3-43b3-8352-ec1fbf165c8a',volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:03:46.088286 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a09f102-63e3-464d-919e-8200d7fb5e47 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.102449 Oct 28 14:03:46.089234 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3418/6927] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:03:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:03:46.100307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8bd35de5-b663-4f75-abd4-dc4ccf791dfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:46.100929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8bd35de5-b663-4f75-abd4-dc4ccf791dfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:46.160171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8bd35de5-b663-4f75-abd4-dc4ccf791dfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:46.170588 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8bd35de5-b663-4f75-abd4-dc4ccf791dfc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1094 microversion: 2.1 time: 0.074365 Oct 28 14:03:46.171194 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3510/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:46 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:47.194808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:47.195489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:47.201572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:47.202072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:47.202518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:47.203269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:47.203721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:47.204280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:47.266403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:47.274278 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b1ff875c-d02a-46c0-a1c2-7bbda03b4b85 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1144 microversion: 2.1 time: 0.084349 Oct 28 14:03:47.282521 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3419/6929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:47 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:48.297487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:48.298281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:48.305538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:48.306110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:48.306884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:48.307653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:48.308187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:48.308618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:48.383369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:48.393128 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c7abf624-9c0c-4676-966b-111f69f251dd tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1210 microversion: 2.1 time: 0.099573 Oct 28 14:03:48.393712 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3511/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:48 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:49.417611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:49.418516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:49.426728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:49.427458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:49.428063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:49.428946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:49.429640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:49.430136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:49.585468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:49.594295 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-563c5f51-ce14-4a9c-b309-6cfabcc1414a tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1278 microversion: 2.1 time: 0.180593 Oct 28 14:03:49.595667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3420/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:49 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:50.054903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e19626ca-7f66-43fd-9c93-055ce508b19c req-3ad4f417-15c9-4b5d-9dd1-e9a78288f70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc8acb4-1c81-474d-a807-d45ac16038f1", "tag": "e6d65b5b-a0b6-4135-a10f-2205b568807c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:03:50.065488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e19626ca-7f66-43fd-9c93-055ce508b19c req-3ad4f417-15c9-4b5d-9dd1-e9a78288f70e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:50.071766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e19626ca-7f66-43fd-9c93-055ce508b19c req-3ad4f417-15c9-4b5d-9dd1-e9a78288f70e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:50.071766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e19626ca-7f66-43fd-9c93-055ce508b19c req-3ad4f417-15c9-4b5d-9dd1-e9a78288f70e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:50.078908 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e19626ca-7f66-43fd-9c93-055ce508b19c req-3ad4f417-15c9-4b5d-9dd1-e9a78288f70e service nova] Creating event network-changed:e6d65b5b-a0b6-4135-a10f-2205b568807c for instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 on n-h1-862876-2 Oct 28 14:03:50.085663 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e19626ca-7f66-43fd-9c93-055ce508b19c req-3ad4f417-15c9-4b5d-9dd1-e9a78288f70e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037431 Oct 28 14:03:50.086281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3512/6932] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:03:50.617955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:50.618624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:50.625897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:50.626430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:50.627101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:50.627829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:50.628298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:50.628734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:50.785544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:50.794024 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8513d809-75d9-441c-884f-ff8e064c7252 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1278 microversion: 2.1 time: 0.180244 Oct 28 14:03:50.794936 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3421/6933] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:50 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:51.818457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:51.819094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:51.826191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:51.826687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:51.827159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:51.827891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:51.828360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:51.828791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:51.961254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:51.969088 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a98d6c72-d354-4d4a-a339-2bc4af8ae343 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1278 microversion: 2.1 time: 0.155558 Oct 28 14:03:51.969791 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3513/6934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:51 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:52.992980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:52.993620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:53.000521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:53.001031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:53.002140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:53.002876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:53.003354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:53.003798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:53.145771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:53.153486 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfe82d8e-1b7e-46e3-a55a-66c02406520f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1278 microversion: 2.1 time: 0.164438 Oct 28 14:03:53.154083 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3422/6935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:52 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:54.180383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:54.181010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:54.188180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:54.189304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:54.189742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:54.190590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:54.192047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:54.193945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:54.327826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:54.335496 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6b88872a-0535-47a0-884e-e7ad34002489 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.162914 Oct 28 14:03:54.336088 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3514/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:54 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:55.357411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:55.358045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:55.364860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:55.365384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:55.365839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:55.366540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:55.367035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:55.367477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:55.496607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:55.504850 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63d433b8-bbcf-4bf0-a00d-b597386330d1 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.151330 Oct 28 14:03:55.505421 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3423/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:55 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:56.528592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:56.529158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:56.532064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:03:56.537667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:56.538162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:56.538699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:56.539350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:56.541737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:56.541737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:56.677614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:56.685626 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5b499a36-7203-42b0-a356-6866729289ec tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.161081 Oct 28 14:03:56.686204 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3515/6938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:56 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:57.707441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:57.708073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:57.711302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:03:57.711996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:03:57.717735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:57.718244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:57.718697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:57.719445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:57.720413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:57.720888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:57.871794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:57.879187 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f1c6803f-8b56-4fe3-a2d0-95cd0195967d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.175393 Oct 28 14:03:57.880205 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3424/6939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:57 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:03:58.902217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:03:58.902868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:03:58.909788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:58.910276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:58.910713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:58.911434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:03:58.911894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:03:58.912323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:03:59.042580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:03:59.051049 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-635a908a-fa7d-4891-a63a-baa8484187f5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.152705 Oct 28 14:03:59.051625 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3516/6940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:03:58 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:00.073518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:04:00.074150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:04:00.081317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:00.081818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:00.082271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:00.083007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:00.083481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:00.083949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:00.212210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:04:00.220246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0cc76cb7-bfd2-42bd-86d9-879e5aec186b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.150526 Oct 28 14:04:00.220822 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3425/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:04:00 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:01.244293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:04:01.244914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:04:01.252389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:01.252901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:01.253539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:01.254372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:01.255287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:01.255522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:01.390935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:04:01.399358 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0a58f78-468a-418e-b60e-7bdc32b6ed25 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.158990 Oct 28 14:04:01.399939 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3517/6942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:04:01 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:02.421755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:04:02.422420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:04:02.429833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:02.430331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:02.430807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:02.431773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:02.432246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:02.432687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:02.563106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:04:02.570944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d83f9f69-3e08-41d7-a4e4-52f0610f4984 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.153040 Oct 28 14:04:02.571523 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3426/6943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:04:02 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:03.593503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:04:03.594112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:04:03.600971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:03.601466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:03.601905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:03.602593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:03.603081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:03.603553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:03.739287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:04:03.743625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ff5d0a78-e02c-4f42-bac4-521754f50b28 req-22d850c1-b466-453b-b363-67a525a77254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc8acb4-1c81-474d-a807-d45ac16038f1", "name": "network-vif-plugged", "status": "completed", "tag": "e6d65b5b-a0b6-4135-a10f-2205b568807c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:04:03.747428 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-91630db4-0578-4657-ba2d-4f363e90af56 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.157887 Oct 28 14:04:03.759263 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3518/6944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:04:03 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:03.761603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ff5d0a78-e02c-4f42-bac4-521754f50b28 req-22d850c1-b466-453b-b363-67a525a77254 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:03.761603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ff5d0a78-e02c-4f42-bac4-521754f50b28 req-22d850c1-b466-453b-b363-67a525a77254 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:03.761603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ff5d0a78-e02c-4f42-bac4-521754f50b28 req-22d850c1-b466-453b-b363-67a525a77254 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:03.767987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ff5d0a78-e02c-4f42-bac4-521754f50b28 req-22d850c1-b466-453b-b363-67a525a77254 service nova] Creating event network-vif-plugged:e6d65b5b-a0b6-4135-a10f-2205b568807c for instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 on n-h1-862876-2 Oct 28 14:04:03.773232 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ff5d0a78-e02c-4f42-bac4-521754f50b28 req-22d850c1-b466-453b-b363-67a525a77254 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Oct 28 14:04:03.773844 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3427/6945] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:04:04.769897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:04:04.770541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:04:04.777358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:04.777848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:04.778293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:04.779005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:04.779470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:04.779898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:04.912451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:04:04.920799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f32e07c-f3a7-47ff-bfce-d341f13e2969 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1266 microversion: 2.1 time: 0.155289 Oct 28 14:04:04.921378 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3519/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:04:04 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:05.945322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:04:05.946038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:04:05.952238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:05.952737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:05.953189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:05.953900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:05.954371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:05.954835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:06.087425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:04:06.095641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-10b7a1b7-802e-4b8d-a51a-f09a7aa246ef tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1453 microversion: 2.1 time: 0.154937 Oct 28 14:04:06.096216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3428/6947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:04:05 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:06.117631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:04:06.118249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:04:06.124945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:06.125425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:06.125857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:06.126571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:06.127079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:06.127504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:06.262355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:04:06.271153 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8f9a0c7e-b948-4218-86e2-43a2db8a2734 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1453 microversion: 2.1 time: 0.157278 Oct 28 14:04:06.271752 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3520/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:04:06 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:04:08.157326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-51051def-4739-49b9-aca8-e4d87c2a8d15 req-bd3dbfbc-3dc5-4336-9b97-f7a4c68a9a90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc8acb4-1c81-474d-a807-d45ac16038f1", "tag": "e6d65b5b-a0b6-4135-a10f-2205b568807c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:04:08.163118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:04:08.168729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51051def-4739-49b9-aca8-e4d87c2a8d15 req-bd3dbfbc-3dc5-4336-9b97-f7a4c68a9a90 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:04:08.169239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51051def-4739-49b9-aca8-e4d87c2a8d15 req-bd3dbfbc-3dc5-4336-9b97-f7a4c68a9a90 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:04:08.169717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-51051def-4739-49b9-aca8-e4d87c2a8d15 req-bd3dbfbc-3dc5-4336-9b97-f7a4c68a9a90 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:04:08.173734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:04:08.184575 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-51051def-4739-49b9-aca8-e4d87c2a8d15 req-bd3dbfbc-3dc5-4336-9b97-f7a4c68a9a90 service nova] Creating event network-changed:e6d65b5b-a0b6-4135-a10f-2205b568807c for instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 on n-h1-862876-2 Oct 28 14:04:08.190739 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-51051def-4739-49b9-aca8-e4d87c2a8d15 req-bd3dbfbc-3dc5-4336-9b97-f7a4c68a9a90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036970 Oct 28 14:04:08.193965 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3429/6949] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:06:27.625878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=34 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:06:27.626641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=82 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:06:27.627932 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:06:27.628083 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 14:06:27.632602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1920423783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-400975334", "security_groups": [{"name": "tempest-secgroup-smoke-2111737435"}], "block_device_mapping_v2": [{"uuid": "c58e9685-ba9e-4730-9a28-aa6f9bf826f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa4f7bbb-e234-4168-a958-3be43e967332"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:06:27.864114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] validate_networks() for [('aa4f7bbb-e234-4168-a958-3be43e967332', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:06:28.361122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:06:28.361550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:06:28.362025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:06:28.362436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:06:28.362892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:06:28.372228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:28.372714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:28.373155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:28.373882 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:28.374339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:28.374786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:28.393828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:06:28.399056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Getting quotas for user 869cd0a9a38a43648dd7655a46a78717 and project b0c54eca1f8e4879a9b03f6bc78837bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:06:28.461346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:06:28.461346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c58e9685-ba9e-4730-9a28-aa6f9bf826f0',volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:06:28.841026 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ad38d50-8da5-4672-826b-c7604f68e883 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.217165 Oct 28 14:06:28.841734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3521/6950] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:06:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:06:28.852630 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:06:28.858197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c219133-4803-4cb8-8913-348a2ee53910 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:28.858956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c219133-4803-4cb8-8913-348a2ee53910 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:29.282264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c219133-4803-4cb8-8913-348a2ee53910 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:29.289829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c219133-4803-4cb8-8913-348a2ee53910 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1094 microversion: 2.1 time: 0.440760 Oct 28 14:06:29.290409 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3430/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:28 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1094 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:30.313516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:30.314132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:30.320170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:30.320663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:30.321106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:30.321799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:30.322262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:30.322715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:30.387646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:30.395304 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4c02ff6f-9a6b-43a6-8a3f-a91ccb16d2c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1136 microversion: 2.1 time: 0.086824 Oct 28 14:06:30.395896 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3522/6952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:30 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:31.420848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:31.421647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:31.430195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:31.430634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:31.431113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:31.431829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:31.432303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:31.432745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:31.456102 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51182. Oct 28 14:06:31.503537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:31.513053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca287fe4-021d-4e05-ba67-2c1cbd610e8f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1210 microversion: 2.1 time: 0.096140 Oct 28 14:06:31.515537 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3431/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:31 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:32.541124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:32.542476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:32.550893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:32.551461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:32.551967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:32.552770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:32.554099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:32.554595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:32.753600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:32.764902 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6c343029-68e5-4f06-8367-47657259a64e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1278 microversion: 2.1 time: 0.229002 Oct 28 14:06:32.765723 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3523/6954] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:32 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:32.987697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-1e8cc71f-87e2-4069-bd1c-77d646e308d8 req-e9ac89c9-c9c7-4c45-8e32-b85a0be09765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84e1f4f-b0f9-47de-941a-da403a3ce5ce", "tag": "5c363604-f9b6-4e50-9b49-57a319d27de5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:06:32.998656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1e8cc71f-87e2-4069-bd1c-77d646e308d8 req-e9ac89c9-c9c7-4c45-8e32-b85a0be09765 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:32.999229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1e8cc71f-87e2-4069-bd1c-77d646e308d8 req-e9ac89c9-c9c7-4c45-8e32-b85a0be09765 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:32.999677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-1e8cc71f-87e2-4069-bd1c-77d646e308d8 req-e9ac89c9-c9c7-4c45-8e32-b85a0be09765 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:33.018299 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-1e8cc71f-87e2-4069-bd1c-77d646e308d8 req-e9ac89c9-c9c7-4c45-8e32-b85a0be09765 service nova] Creating event network-changed:5c363604-f9b6-4e50-9b49-57a319d27de5 for instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce on n-h2-862876-2 Oct 28 14:06:33.024610 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-1e8cc71f-87e2-4069-bd1c-77d646e308d8 req-e9ac89c9-c9c7-4c45-8e32-b85a0be09765 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042645 Oct 28 14:06:33.025572 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3432/6955] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:06:33.788549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:33.789294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:33.796322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:33.796894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:33.797364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:33.798067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:33.798656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:33.799157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:33.931735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:33.940566 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-72a2142c-7b9f-4e41-b60f-f609a18d9806 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1278 microversion: 2.1 time: 0.156742 Oct 28 14:06:33.941135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3524/6956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:33 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:34.964967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:34.965727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:34.972724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:34.973220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:34.973670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:34.974371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:34.974872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:34.975363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:35.111609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:35.120088 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2f428d1d-7b97-4bfe-b719-57b9e8bd75e3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1278 microversion: 2.1 time: 0.160561 Oct 28 14:06:35.120671 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3433/6957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:34 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:36.143414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:36.144063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:36.150937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:36.151435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:36.151876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:36.152573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:36.153030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:36.153476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:36.289418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:36.297434 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61f20543-0ee5-4129-865b-2c6e5ceb270b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1278 microversion: 2.1 time: 0.157979 Oct 28 14:06:36.298019 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3525/6958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:36 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:37.320408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:37.321043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:37.328471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:37.328970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:37.329420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:37.330124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:37.330593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:37.331069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:37.462513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:37.470881 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e886c44-2bdb-4731-ae1b-0875a7e6648c tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.154309 Oct 28 14:06:37.471452 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3434/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:37 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:38.499432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:38.500056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:38.502731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:06:38.503417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:06:38.508157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:38.509159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:38.509599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:38.510287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:38.510760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:38.517173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:38.644892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:38.653299 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bbb62aeb-6435-461e-a693-43b897273e1d tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.157865 Oct 28 14:06:38.658222 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3526/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:38 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:39.676634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:39.677262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:39.679774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:06:39.684785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:39.685273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:39.685746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:39.686775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:39.690610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:39.690610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:39.816615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:39.825063 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76d9ce6a-5887-48ec-a4ea-6b604cf70256 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.152541 Oct 28 14:06:39.825632 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3435/6961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:39 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:40.848685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:40.849239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:40.855483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:40.855963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:40.856396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:40.857646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:40.858099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:40.858520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:40.991831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:40.999518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48866f18-a15e-4f6d-92d4-4701896efdad tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.154823 Oct 28 14:06:41.000100 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3527/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:40 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:42.021513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:42.022139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:42.028926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:42.029419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:42.029920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:42.030645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:42.031134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:42.031589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:42.165273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:42.173555 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2fafb61-c8e9-4c8c-a2df-8207f6be2b12 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.155927 Oct 28 14:06:42.174121 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3436/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:42 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:43.197963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:43.198587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:43.206199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:43.212158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:43.212158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:43.212158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:43.212158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:43.212158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:43.339573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:43.347287 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23ea060e-1753-4658-b725-20c69bded920 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.153249 Oct 28 14:06:43.347862 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3528/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:43 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:44.369549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:44.370175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:44.377262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:44.377756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:44.378205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:44.378972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:44.379442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:44.379879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:44.773546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:44.782177 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96237f7b-2399-4bd6-a8ae-945b65dcbbac tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.416487 Oct 28 14:06:44.782805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3437/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:44 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:45.805401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:45.806108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:45.813759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:45.816483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:45.816483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:45.816483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:45.816483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:45.816483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:45.949373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:45.957126 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-df1f1acb-344d-494e-b3d0-330e6e284225 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.155685 Oct 28 14:06:45.957704 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3529/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:45 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:46.710254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-66b0497a-6145-4670-8031-ca390c1e1073 req-6ad382e5-5409-4dac-ae72-3124247d4a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84e1f4f-b0f9-47de-941a-da403a3ce5ce", "name": "network-vif-plugged", "status": "completed", "tag": "5c363604-f9b6-4e50-9b49-57a319d27de5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:06:46.720391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-66b0497a-6145-4670-8031-ca390c1e1073 req-6ad382e5-5409-4dac-ae72-3124247d4a74 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:46.720883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-66b0497a-6145-4670-8031-ca390c1e1073 req-6ad382e5-5409-4dac-ae72-3124247d4a74 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:46.721324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-66b0497a-6145-4670-8031-ca390c1e1073 req-6ad382e5-5409-4dac-ae72-3124247d4a74 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:46.731970 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-66b0497a-6145-4670-8031-ca390c1e1073 req-6ad382e5-5409-4dac-ae72-3124247d4a74 service nova] Creating event network-vif-plugged:5c363604-f9b6-4e50-9b49-57a319d27de5 for instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce on n-h2-862876-2 Oct 28 14:06:46.736889 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-66b0497a-6145-4670-8031-ca390c1e1073 req-6ad382e5-5409-4dac-ae72-3124247d4a74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080403 Oct 28 14:06:46.737484 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3438/6967] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:06:46.979172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:46.979781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:46.986588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:46.987100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:46.987532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:46.988212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:46.988667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:46.989091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:47.124106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:47.131183 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f159a3b8-ac8e-48d6-b466-7020221fdabb tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1266 microversion: 2.1 time: 0.156063 Oct 28 14:06:47.131765 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3530/6968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:46 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:48.156201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:48.156955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:48.163709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:48.175975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:48.175975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:48.175975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:48.175975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:48.175975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:48.302858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:48.311064 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e2840b93-2fed-40c5-84c1-02f98b38aa1e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1452 microversion: 2.1 time: 0.160085 Oct 28 14:06:48.311640 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3439/6969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:48 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:06:48.334128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:06:48.334838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:06:48.341760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:48.342277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:48.342721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:48.343446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:48.343906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:48.344366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:48.794543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:06:48.802920 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b103c93a-f357-4532-9761-98b621be71b3 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1452 microversion: 2.1 time: 0.472730 Oct 28 14:06:48.803501 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3531/6970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:06:48 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1452 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:06:50.970404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bd506422-f4fd-4113-9364-b425c9c97036 req-230f161c-e38d-4e3b-80d3-db8586957cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84e1f4f-b0f9-47de-941a-da403a3ce5ce", "tag": "5c363604-f9b6-4e50-9b49-57a319d27de5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:06:50.980848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd506422-f4fd-4113-9364-b425c9c97036 req-230f161c-e38d-4e3b-80d3-db8586957cc2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:06:50.992877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd506422-f4fd-4113-9364-b425c9c97036 req-230f161c-e38d-4e3b-80d3-db8586957cc2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:06:50.992877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bd506422-f4fd-4113-9364-b425c9c97036 req-230f161c-e38d-4e3b-80d3-db8586957cc2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:06:50.993559 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bd506422-f4fd-4113-9364-b425c9c97036 req-230f161c-e38d-4e3b-80d3-db8586957cc2 service nova] Creating event network-changed:5c363604-f9b6-4e50-9b49-57a319d27de5 for instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce on n-h2-862876-2 Oct 28 14:06:50.998689 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bd506422-f4fd-4113-9364-b425c9c97036 req-230f161c-e38d-4e3b-80d3-db8586957cc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032729 Oct 28 14:06:50.999332 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3440/6971] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:09:06.446504 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:09:06.447746 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:09:06.448220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:06.449386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=62 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:06.450316 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:09:06.450622 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce (ip 10.222.0.25) !!! Oct 28 14:09:06.454248 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:09:06.455195 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 14:09:06.456128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=25 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:06.457220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=49 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:06.457997 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:09:06.458150 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 28 14:09:06.459170 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:09:06.459303 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 28 14:09:06.460370 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:09:06.463213 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 28 14:09:06.463390 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:09:06.463390 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce (ip 10.222.0.25) !!! Oct 28 14:09:06.473991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:06.474499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:06.498710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:06.498710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:06.498710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:06.498710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:06.498710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:06.498710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:06.529746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:09:06.573450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-cd6f4b3b-b4ed-4f79-8a48-c4867432e777 req-4bc7c502-483d-4c84-b351-7ca9f99685ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84e1f4f-b0f9-47de-941a-da403a3ce5ce", "tag": "5c363604-f9b6-4e50-9b49-57a319d27de5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:09:06.592110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cd6f4b3b-b4ed-4f79-8a48-c4867432e777 req-4bc7c502-483d-4c84-b351-7ca9f99685ab service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:06.592526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cd6f4b3b-b4ed-4f79-8a48-c4867432e777 req-4bc7c502-483d-4c84-b351-7ca9f99685ab service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:06.592981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-cd6f4b3b-b4ed-4f79-8a48-c4867432e777 req-4bc7c502-483d-4c84-b351-7ca9f99685ab service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:06.604488 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-cd6f4b3b-b4ed-4f79-8a48-c4867432e777 req-4bc7c502-483d-4c84-b351-7ca9f99685ab service nova] Creating event network-changed:5c363604-f9b6-4e50-9b49-57a319d27de5 for instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce on n-h2-862876-2 Oct 28 14:09:06.611603 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-cd6f4b3b-b4ed-4f79-8a48-c4867432e777 req-4bc7c502-483d-4c84-b351-7ca9f99685ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158890 Oct 28 14:09:06.612241 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3441/6972] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:09:06.901773 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe0e6859-2afe-42ca-ab17-1d0e3acfc850 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 204 len: 0 microversion: 2.1 time: 0.456915 Oct 28 14:09:06.910317 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3532/6973] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:09:06 2022] DELETE /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:09:06.912783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:06.913502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:06.920138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:06.920650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:06.921107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:06.921845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:06.922310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:06.922787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:07.069340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:07.079177 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5d635d1-e3d5-42ce-87e8-051f39c480fa tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1576 microversion: 2.1 time: 0.170120 Oct 28 14:09:07.079828 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3442/6974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:06 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:08.104527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:08.105354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:08.115157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:08.115893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:08.116340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:08.117048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:08.117507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:08.117934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:08.121997 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51304. Oct 28 14:09:08.125928 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51302. Oct 28 14:09:08.253540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:08.261787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4c42090-0e83-44fa-8639-c85185a37e3b tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1576 microversion: 2.1 time: 0.162299 Oct 28 14:09:08.262373 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3533/6975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:08 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:08.903380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f4e00c6f-9208-4426-b777-43da56beb79e req-dfeb8db5-0799-48bb-bdc7-0d07a76dd3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84e1f4f-b0f9-47de-941a-da403a3ce5ce", "name": "network-vif-deleted", "tag": "5c363604-f9b6-4e50-9b49-57a319d27de5"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:09:08.917781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f4e00c6f-9208-4426-b777-43da56beb79e req-dfeb8db5-0799-48bb-bdc7-0d07a76dd3e0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:08.918276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f4e00c6f-9208-4426-b777-43da56beb79e req-dfeb8db5-0799-48bb-bdc7-0d07a76dd3e0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:08.918721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f4e00c6f-9208-4426-b777-43da56beb79e req-dfeb8db5-0799-48bb-bdc7-0d07a76dd3e0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:08.925472 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51310. Oct 28 14:09:08.931286 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51308. Oct 28 14:09:08.933283 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f4e00c6f-9208-4426-b777-43da56beb79e req-dfeb8db5-0799-48bb-bdc7-0d07a76dd3e0 service nova] Creating event network-vif-deleted:5c363604-f9b6-4e50-9b49-57a319d27de5 for instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce on n-h2-862876-2 Oct 28 14:09:08.938223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f4e00c6f-9208-4426-b777-43da56beb79e req-dfeb8db5-0799-48bb-bdc7-0d07a76dd3e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038850 Oct 28 14:09:08.938827 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3443/6976] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:09:09.285643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:09.288091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:09.294989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:09.295568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:09.296078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:09.297241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:09.297942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:09.298450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:09.365761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:09.373719 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b8d78d09-b5d6-43fe-b8c4-4ed0faf88e99 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1225 microversion: 2.1 time: 0.091970 Oct 28 14:09:09.374297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3534/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:09 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:10.398731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:10.399708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:10.405936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:10.406444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:10.406943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:10.407657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:10.408133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:10.408578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:10.471033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:10.479264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b7f41e67-6633-4817-95e3-0485ab9c9853 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1225 microversion: 2.1 time: 0.085590 Oct 28 14:09:10.479773 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3444/6978] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:10 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:11.502804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:11.503419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:11.511160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:11.511644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:11.512076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:11.512771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:11.513229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:11.513655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:11.577055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:11.584797 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bcaacf0d-4c87-422f-8e7c-8e24536a2661 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1225 microversion: 2.1 time: 0.086064 Oct 28 14:09:11.585371 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3535/6979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:11 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:12.609389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:12.609957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:12.616747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:12.617245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:12.617694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:12.618469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:12.618992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:12.619430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:12.689355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:12.697381 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c8f2aefd-c4c3-40a8-8052-5e6e6c06b1f0 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1225 microversion: 2.1 time: 0.092214 Oct 28 14:09:12.697959 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3445/6980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:12 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:13.721366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:13.722024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:13.729416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:13.729916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:13.730358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:13.731077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:13.731536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:13.731963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:13.763143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:13.763631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:13.764072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:13.764522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid c84e1f4f-b0f9-47de-941a-da403a3ce5ce {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:09:13.804757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:13.813469 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b5491b21-79c5-4cf7-9211-ed1204215975 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 200 len: 1230 microversion: 2.1 time: 0.096180 Oct 28 14:09:13.814046 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3536/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:13 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:14.836435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:14.837003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: c84e1f4f-b0f9-47de-941a-da403a3ce5ce] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:14.843887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:14.844389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:14.844844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:14.845554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:14.846027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:14.846480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:14.859621 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce could not be found. Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce HTTP/1.1 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce could not be found. Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'c84e1f4f-b0f9-47de-941a-da403a3ce5ce'} Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce could not be found. Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce could not be found. Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:14.861304 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce could not be found. Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance c84e1f4f-b0f9-47de-941a-da403a3ce5ce could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c65ff8e-a615-4c35-a472-15b6bbb8c42f tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce" status: 404 len: 111 microversion: 2.1 time: 0.030278 Oct 28 14:09:14.866085 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3446/6982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:14 2022] GET /compute/v2.1/servers/c84e1f4f-b0f9-47de-941a-da403a3ce5ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:09:21.779850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:21.780396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:21.782349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a04ff97d-ca98-42d4-b01c-d3551777add6 req-c15fd654-1018-4942-a778-e53a0d55626c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc8acb4-1c81-474d-a807-d45ac16038f1", "tag": "e6d65b5b-a0b6-4135-a10f-2205b568807c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:09:21.787475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:21.787965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:21.788403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:21.789100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:21.789555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:21.790624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:21.795167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a04ff97d-ca98-42d4-b01c-d3551777add6 req-c15fd654-1018-4942-a778-e53a0d55626c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:21.795924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a04ff97d-ca98-42d4-b01c-d3551777add6 req-c15fd654-1018-4942-a778-e53a0d55626c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:21.796571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a04ff97d-ca98-42d4-b01c-d3551777add6 req-c15fd654-1018-4942-a778-e53a0d55626c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:21.808537 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a04ff97d-ca98-42d4-b01c-d3551777add6 req-c15fd654-1018-4942-a778-e53a0d55626c service nova] Creating event network-changed:e6d65b5b-a0b6-4135-a10f-2205b568807c for instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 on n-h1-862876-2 Oct 28 14:09:21.815019 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a04ff97d-ca98-42d4-b01c-d3551777add6 req-c15fd654-1018-4942-a778-e53a0d55626c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 Oct 28 14:09:21.815841 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3447/6983] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:09:21.818279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:09:22.098248 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4d31187-c3b7-4dcb-aaa4-6297dedf8678 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 204 len: 0 microversion: 2.1 time: 0.322001 Oct 28 14:09:22.099235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3537/6984] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:09:21 2022] DELETE /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:09:22.109137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:22.110271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:22.117399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:22.118334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:22.118995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:22.120024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:22.120731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:22.121328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:22.260808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:22.269230 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6332ae47-d360-49f6-a687-37cc1044fe44 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1577 microversion: 2.1 time: 0.164602 Oct 28 14:09:22.270039 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3448/6985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:22 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:23.293755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:23.294489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:23.305170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:23.314385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:23.314385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:23.314385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:23.314385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:23.314385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:23.372311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:23.380265 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11e86a15-bd04-4577-89e3-fe977f300ba5 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1391 microversion: 2.1 time: 0.091537 Oct 28 14:09:23.380836 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3538/6986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:23 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1391 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:23.829538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3df04d11-8641-46c8-9dc7-0971af4a0d69 req-02395937-09aa-4026-9d77-e2d2afc2bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc8acb4-1c81-474d-a807-d45ac16038f1", "name": "network-vif-deleted", "tag": "e6d65b5b-a0b6-4135-a10f-2205b568807c"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:09:23.839765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3df04d11-8641-46c8-9dc7-0971af4a0d69 req-02395937-09aa-4026-9d77-e2d2afc2bef0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:23.840268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3df04d11-8641-46c8-9dc7-0971af4a0d69 req-02395937-09aa-4026-9d77-e2d2afc2bef0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:23.840718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3df04d11-8641-46c8-9dc7-0971af4a0d69 req-02395937-09aa-4026-9d77-e2d2afc2bef0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:23.851564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3df04d11-8641-46c8-9dc7-0971af4a0d69 req-02395937-09aa-4026-9d77-e2d2afc2bef0 service nova] Creating event network-vif-deleted:e6d65b5b-a0b6-4135-a10f-2205b568807c for instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 on n-h1-862876-2 Oct 28 14:09:23.856784 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3df04d11-8641-46c8-9dc7-0971af4a0d69 req-02395937-09aa-4026-9d77-e2d2afc2bef0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031005 Oct 28 14:09:23.857459 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3449/6987] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:09:24.403732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:24.404352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:24.411362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:24.411850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:24.412322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:24.413016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:24.413473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:24.413901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:24.477145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:24.485807 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c9f0a30-8181-4be2-921a-e4029036a29e tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1225 microversion: 2.1 time: 0.086021 Oct 28 14:09:24.486384 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3539/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:24 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:25.510193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:25.511025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:25.517285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:25.517793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:25.518251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:25.519025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:25.519509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:25.519955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:25.585045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:25.593672 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1551f890-2b45-40a1-b047-2b0fe4218066 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1225 microversion: 2.1 time: 0.088607 Oct 28 14:09:25.594258 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3450/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:25 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:26.616906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:26.617683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:26.625318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:26.625828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:26.626267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:26.627006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:26.627472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:26.627903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:26.691211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:26.699032 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3794813a-8ff9-4ce1-99c8-db8fcbca31fc tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1225 microversion: 2.1 time: 0.086161 Oct 28 14:09:26.699606 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3540/6990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:26 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:27.722449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:27.726275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:27.729856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:27.730365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:27.730837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:27.731548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:27.732015 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:27.732454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:27.763893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:27.764385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:27.764841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:27.765299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lazy-loading 'fault' on Instance uuid 8cc8acb4-1c81-474d-a807-d45ac16038f1 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:09:27.808724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869cd0a9a38a43648dd7655a46a78717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c54eca1f8e4879a9b03f6bc78837bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:27.816863 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2e57fbf2-8784-41a3-b605-dad7ac9a47c6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 200 len: 1230 microversion: 2.1 time: 0.098252 Oct 28 14:09:27.817424 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3451/6991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:27 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:28.839909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:28.840476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: 8cc8acb4-1c81-474d-a807-d45ac16038f1] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:28.847273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:28.847760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:28.848197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:28.848885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:28.849340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:28.849766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:28.862898 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 could not be found. Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 HTTP/1.1 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 could not be found. Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '8cc8acb4-1c81-474d-a807-d45ac16038f1'} Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 could not be found. Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 could not be found. Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:28.864534 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 could not be found. Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance 8cc8acb4-1c81-474d-a807-d45ac16038f1 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-56e1d393-2bb7-4581-b380-70117568bb29 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1" status: 404 len: 111 microversion: 2.1 time: 0.030627 Oct 28 14:09:28.869462 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3541/6992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:28 2022] GET /compute/v2.1/servers/8cc8acb4-1c81-474d-a807-d45ac16038f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:09:29.370524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:29.371090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:29.377774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:29.381040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:29.381040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:29.381040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:29.381040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:29.381040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:29.393338 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 HTTP/1.1 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b6661b69-7630-4257-b942-1d96041d36d4'} Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:09:29.395046 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fb5e52dd-949f-4687-be82-9c66a50f9dc7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 404 len: 111 microversion: 2.1 time: 0.030754 Oct 28 14:09:29.399064 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3452/6993] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:09:29 2022] DELETE /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:09:29.409812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:29.411009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] [instance: b6661b69-7630-4257-b942-1d96041d36d4] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:29.421766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:29.422264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:29.422711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:29.423540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:29.424001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:29.424430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:29.438958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] HTTP exception thrown: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Request method failure captured: Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 HTTP/1.1 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW99SNJcBZTG-AtK9-nCalIyiftfOZHffP9SpnUStGI_w_C8YGX4fM-J0F3W_ImQXDCdBY8-s4y7cYRSAHpPree536qNw-nmFB01fe17l22yzqmdybxdT2aJdu6_kwC8HdBUBAsF1F0V9AoKQ2Ht7-o4Do-FJ-r8iNlblyz7JCy7JKD4 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0c54eca1f8e4879a9b03f6bc78837bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0c54eca1f8e4879a9b03f6bc78837bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b0c54eca1f8e4879a9b03f6bc78837bd Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestVolumeBootPattern-65000870 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 869cd0a9a38a43648dd7655a46a78717 Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestVolumeBootPattern-65000870-project Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'b6661b69-7630-4257-b942-1d96041d36d4'} Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:09:29.440510 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Returning 404 to user: Instance b6661b69-7630-4257-b942-1d96041d36d4 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:09:29.445095 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b0defbe-e3ff-4f09-a15d-b5cdf195f6f6 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4" status: 404 len: 111 microversion: 2.1 time: 0.039655 Oct 28 14:09:29.446153 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3542/6994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:29 2022] GET /compute/v2.1/servers/b6661b69-7630-4257-b942-1d96041d36d4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:09:33.062480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62205951-02a6-42f8-9e1d-a3d328763fa7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] Calling method '.version_select at 0x7f27b85cbb80>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:33.143551 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62205951-02a6-42f8-9e1d-a3d328763fa7 tempest-TestVolumeBootPattern-65000870 tempest-TestVolumeBootPattern-65000870-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-400975334" status: 202 len: 0 microversion: 2.1 time: 0.085149 Oct 28 14:09:33.144256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3453/6995] 10.222.0.25 () {58 vars in 1260 bytes} [Fri Oct 28 14:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-400975334 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:09:53.190215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:53.191006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:53.309924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-251996414", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:09:53.363287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] validate_networks() for None {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:09:53.639037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:09:53.639471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:09:53.639959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:09:53.640377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:09:53.640799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:09:53.649830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:53.650308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:53.650815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:53.651554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:53.652019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:53.652454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:53.669345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Getting quotas for project 98935c1a280141fbb0b25bbaae588015. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:09:53.674573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Getting quotas for user 4adab9cf1b0346738d01bb6d7984a551 and project 98935c1a280141fbb0b25bbaae588015. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:09:53.687648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:09:53.690007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:09:53.805070 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8dd880b-8230-4a8d-a8e9-eaec95321bbf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620321 Oct 28 14:09:53.805955 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3543/6996] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:09:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:09:53.816688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=50 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:53.817646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:09:53.821584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00acebf8-4359-4285-8cb5-b39826095a6d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:53.822211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00acebf8-4359-4285-8cb5-b39826095a6d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:53.876067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00acebf8-4359-4285-8cb5-b39826095a6d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:53.884959 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00acebf8-4359-4285-8cb5-b39826095a6d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1221 microversion: 2.1 time: 0.069981 Oct 28 14:09:53.891872 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3454/6997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:53 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:54.909782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51852541-1bb8-43e9-9446-6ed700794d66 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:54.910299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51852541-1bb8-43e9-9446-6ed700794d66 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:54.966331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51852541-1bb8-43e9-9446-6ed700794d66 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:54.971270 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51852541-1bb8-43e9-9446-6ed700794d66 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1221 microversion: 2.1 time: 0.066371 Oct 28 14:09:54.971832 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3544/6998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:54 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:55.994173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:55.994837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:56.005248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:56.005766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:56.006220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:56.006970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:56.007456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:56.007898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:56.083297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:56.092405 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-caf4a91e-e308-40e8-a724-4e6a2e349d11 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1281 microversion: 2.1 time: 0.102197 Oct 28 14:09:56.093049 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3455/6999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:55 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:57.120195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:57.120825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:57.128052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:57.128548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:57.129075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:57.129783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:57.130242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:57.130671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:57.333772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:57.341610 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9e3b3c5-cab2-48f1-a36e-de68be73cccf tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1321 microversion: 2.1 time: 0.226583 Oct 28 14:09:57.342114 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3545/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:57 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:58.036286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a7fd6421-b89f-4087-8c0f-bd1cb8de18c3 req-b4fbb358-7b23-478c-a3d5-28ade3958923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76505f14-1601-4b5e-800f-0948e2296b5c", "tag": "c1998169-ed09-4337-a0a9-39460e658573"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:09:58.047486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a7fd6421-b89f-4087-8c0f-bd1cb8de18c3 req-b4fbb358-7b23-478c-a3d5-28ade3958923 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:58.048032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a7fd6421-b89f-4087-8c0f-bd1cb8de18c3 req-b4fbb358-7b23-478c-a3d5-28ade3958923 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:58.048488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a7fd6421-b89f-4087-8c0f-bd1cb8de18c3 req-b4fbb358-7b23-478c-a3d5-28ade3958923 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:58.060124 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a7fd6421-b89f-4087-8c0f-bd1cb8de18c3 req-b4fbb358-7b23-478c-a3d5-28ade3958923 service nova] Creating event network-changed:c1998169-ed09-4337-a0a9-39460e658573 for instance 76505f14-1601-4b5e-800f-0948e2296b5c on n-h2-862876-2 Oct 28 14:09:58.065535 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a7fd6421-b89f-4087-8c0f-bd1cb8de18c3 req-b4fbb358-7b23-478c-a3d5-28ade3958923 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033189 Oct 28 14:09:58.068021 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3456/7001] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:09:58.373771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:58.374418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:58.381255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:58.381740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:58.382176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:58.382898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:58.383352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:58.383780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:58.602484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:58.610880 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-90984bc6-9574-4dbe-9e97-a08930e9e5b9 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1321 microversion: 2.1 time: 0.240948 Oct 28 14:09:58.611460 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3546/7002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:58 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:09:59.636749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:09:59.637484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:09:59.643685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:59.644195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:59.644657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:59.645366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:09:59.645842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:09:59.646291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:09:59.778424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:09:59.786074 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9982b701-2206-476d-b874-75a97a98393e tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1321 microversion: 2.1 time: 0.155006 Oct 28 14:09:59.786655 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3457/7003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:09:59 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:00.809574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:00.810112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:00.817057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:00.817539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:00.817969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:00.818656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:00.819183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:00.819609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:00.948305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:00.956037 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-57b8d658-61d3-4327-867c-82ddc5b151c4 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1321 microversion: 2.1 time: 0.151000 Oct 28 14:10:00.956636 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3547/7004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:00 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:01.978887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:01.979532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:01.986318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:01.986860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:01.987324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:01.988036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:01.988510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:01.988957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:02.117723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:02.125476 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-335ffd96-35af-4859-9186-22577ab2c40d tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1321 microversion: 2.1 time: 0.150694 Oct 28 14:10:02.126083 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3458/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:01 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:03.148069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:03.148688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:03.155681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:03.156170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:03.156611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:03.157298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:03.157759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:03.158186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:03.288440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:03.296669 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ba2a6241-2a15-4fe5-bb38-6fb5fb48de58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1321 microversion: 2.1 time: 0.152506 Oct 28 14:10:03.297248 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3548/7006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:03 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:03.655278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-168bbfe2-be1f-4b22-afec-f57baad21176 req-7fa16d35-c7aa-4d59-9fe4-8f11fd45b7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76505f14-1601-4b5e-800f-0948e2296b5c", "name": "network-vif-plugged", "status": "completed", "tag": "c1998169-ed09-4337-a0a9-39460e658573"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:03.665741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-168bbfe2-be1f-4b22-afec-f57baad21176 req-7fa16d35-c7aa-4d59-9fe4-8f11fd45b7f9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:03.666241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-168bbfe2-be1f-4b22-afec-f57baad21176 req-7fa16d35-c7aa-4d59-9fe4-8f11fd45b7f9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:03.666770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-168bbfe2-be1f-4b22-afec-f57baad21176 req-7fa16d35-c7aa-4d59-9fe4-8f11fd45b7f9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:03.677480 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-168bbfe2-be1f-4b22-afec-f57baad21176 req-7fa16d35-c7aa-4d59-9fe4-8f11fd45b7f9 service nova] Creating event network-vif-plugged:c1998169-ed09-4337-a0a9-39460e658573 for instance 76505f14-1601-4b5e-800f-0948e2296b5c on n-h2-862876-2 Oct 28 14:10:03.683046 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-168bbfe2-be1f-4b22-afec-f57baad21176 req-7fa16d35-c7aa-4d59-9fe4-8f11fd45b7f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Oct 28 14:10:03.684640 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3459/7007] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:04.320478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:04.321096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:04.322950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:04.328496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:04.328979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:04.329414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:04.330096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:04.330549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:04.331004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:04.458229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:04.466512 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a526c35-c9e2-42ae-86ac-ee0c18848c26 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1321 microversion: 2.1 time: 0.149930 Oct 28 14:10:04.467123 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3549/7008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:04 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:05.486764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:05.491870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:05.492596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:05.499695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:05.501856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:05.501856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:05.501856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:05.501856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:05.502329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:05.635461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:05.648811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2cbac756-ab02-4c17-8f87-9353f3537ad7 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1470 microversion: 2.1 time: 0.162628 Oct 28 14:10:05.649910 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3460/7009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:05 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:05.675096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:05.720999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-286e0e0b-ffd8-4883-8f2d-33d9c1ba1cde tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Calling method '.version_select at 0x7f27b85030d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:05.783442 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-286e0e0b-ffd8-4883-8f2d-33d9c1ba1cde tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d889f2760766401db61c0d2db1f10278" status: 200 len: 371 microversion: 2.1 time: 0.112968 Oct 28 14:10:05.784008 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3550/7010] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 14:10:05 2022] GET /compute/v2.1/os-quota-sets/d889f2760766401db61c0d2db1f10278 => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:05.795900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-db826e53-be54-45da-a62b-1ae017aac1c6 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-416288150", "id": 650564545, "os-flavor-access:is_public": "True"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:05.866881 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-db826e53-be54-45da-a62b-1ae017aac1c6 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.074632 Oct 28 14:10:05.867479 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3461/7011] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:10:05 2022] POST /compute/v2.1/flavors => generated 434 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:05.880551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "650564545"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:05.882884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:05.889548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:05.890037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:05.890487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:05.891243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:05.891714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:05.892144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:05.977335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f38ae66ef6f54411aa32feb08b3e8356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd889f2760766401db61c0d2db1f10278', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:05.983825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-416288150 {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:10:05.990358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:05.990798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:05.991235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:05.992035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:05.992475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:05.992896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:06.016470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Getting quotas for project 98935c1a280141fbb0b25bbaae588015. Resources: {'cores', 'ram'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:10:06.021535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Getting quotas for user 4adab9cf1b0346738d01bb6d7984a551 and project 98935c1a280141fbb0b25bbaae588015. Resources: {'cores', 'ram'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:10:06.034675 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.api [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] ram quota exceeded for d889f2760766401db61c0d2db1f10278, tried to resize instance. Oct 28 14:10:06.035244 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Request method failure captured: Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c/action HTTP/1.1 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 38 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-Kx0KXZy_7tlJqOwAy0CVKkTN1tOOXyDHDd1PA4JBnhuNt_qGRVhpcHHoP3tv7i3SQYr6tvAT5ElaghDaTpe7CoJHLhDfRz9rs25Q5KnTHEPVCVSXq2Wxp3GaxODIoZcSKfrKIsW6j95RzbZxkf99FWflg_NcVMiwHNEeKYS2_4qmY Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d889f2760766401db61c0d2db1f10278 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1665121289 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader,admin Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader,admin Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d889f2760766401db61c0d2db1f10278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d889f2760766401db61c0d2db1f10278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d889f2760766401db61c0d2db1f10278", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d889f2760766401db61c0d2db1f10278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1665121289 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d889f2760766401db61c0d2db1f10278 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1665121289 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersAdminNegativeTestJSON-1665121289-project-admin Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: f38ae66ef6f54411aa32feb08b3e8356 Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1665121289-project-admin Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: {"resize": {"flavorRef": "650564545"}} Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '76505f14-1601-4b5e-800f-0948e2296b5c', 'body': {'resize': {'flavorRef': '650564545'}}} Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:10:06.043819 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-40f94d01-7f44-4e5b-ba08-8edc847307ca tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c/action" status: 403 len: 118 microversion: 2.1 time: 0.168662 Oct 28 14:10:06.049539 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3551/7012] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:10:05 2022] POST /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c/action => generated 118 bytes in 170 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:10:06.054352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a82c58e-a42e-493e-900b-0da32af11f26 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:06.128389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a82c58e-a42e-493e-900b-0da32af11f26 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/650564545" status: 202 len: 0 microversion: 2.1 time: 0.077818 Oct 28 14:10:06.128959 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3462/7013] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 14:10:06 2022] DELETE /compute/v2.1/flavors/650564545 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:10:06.136773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bd9ebda-b489-487f-87c5-603b61d556af tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:06.156792 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bd9ebda-b489-487f-87c5-603b61d556af tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023690 Oct 28 14:10:06.157349 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3552/7014] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 14:10:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:06.183340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e558fac-1486-4e10-87b3-16e10e8becf8 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Calling method '.version_select at 0x7f27b84ef550>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:06.257819 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e558fac-1486-4e10-87b3-16e10e8becf8 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/d889f2760766401db61c0d2db1f10278" status: 200 len: 371 microversion: 2.1 time: 0.077901 Oct 28 14:10:06.258395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3463/7015] 10.222.0.25 () {58 vars in 1242 bytes} [Fri Oct 28 14:10:06 2022] GET /compute/v2.1/os-quota-sets/d889f2760766401db61c0d2db1f10278 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:06.270389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20b796b2-f34e-4568-8354-8ce3a74411e6 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1834254765", "id": 672705739, "os-flavor-access:is_public": "True"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:06.352269 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20b796b2-f34e-4568-8354-8ce3a74411e6 tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.085658 Oct 28 14:10:06.352891 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3553/7016] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:10:06 2022] POST /compute/v2.1/flavors => generated 434 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:06.365813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "672705739"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:06.368243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:06.374732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:06.375267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:06.375722 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:06.376425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:06.376897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:06.377335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:06.562004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f38ae66ef6f54411aa32feb08b3e8356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd889f2760766401db61c0d2db1f10278', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:06.567111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1834254765 {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:10:06.573677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:06.574167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:06.574641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:06.575403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:06.575873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:06.576311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:06.597413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Getting quotas for project 98935c1a280141fbb0b25bbaae588015. Resources: {'cores', 'ram'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:10:06.602394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Getting quotas for user 4adab9cf1b0346738d01bb6d7984a551 and project 98935c1a280141fbb0b25bbaae588015. Resources: {'cores', 'ram'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:10:06.614836 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.compute.api [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] cores quota exceeded for d889f2760766401db61c0d2db1f10278, tried to resize instance. Oct 28 14:10:06.615389 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Request method failure captured: Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c/action HTTP/1.1 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 38 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-Kx0KXZy_7tlJqOwAy0CVKkTN1tOOXyDHDd1PA4JBnhuNt_qGRVhpcHHoP3tv7i3SQYr6tvAT5ElaghDaTpe7CoJHLhDfRz9rs25Q5KnTHEPVCVSXq2Wxp3GaxODIoZcSKfrKIsW6j95RzbZxkf99FWflg_NcVMiwHNEeKYS2_4qmY Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d889f2760766401db61c0d2db1f10278 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1665121289 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader,admin Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader,admin Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d889f2760766401db61c0d2db1f10278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d889f2760766401db61c0d2db1f10278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d889f2760766401db61c0d2db1f10278", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d889f2760766401db61c0d2db1f10278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1665121289 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d889f2760766401db61c0d2db1f10278 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1665121289 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-1665121289-project-admin Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: f38ae66ef6f54411aa32feb08b3e8356 Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1665121289-project-admin Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: {"resize": {"flavorRef": "672705739"}} Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '76505f14-1601-4b5e-800f-0948e2296b5c', 'body': {'resize': {'flavorRef': '672705739'}}} Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:10:06.617451 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3844a0f8-1dfe-4175-8047-ae2c8df7594d tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c/action" status: 403 len: 113 microversion: 2.1 time: 0.257164 Oct 28 14:10:06.630992 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3464/7017] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:10:06 2022] POST /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c/action => generated 113 bytes in 258 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:10:06.634236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-54fa52cb-3838-4933-99da-1cb742a7b28a tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:06.700877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-54fa52cb-3838-4933-99da-1cb742a7b28a tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/672705739" status: 202 len: 0 microversion: 2.1 time: 0.076983 Oct 28 14:10:06.701463 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3554/7018] 10.222.0.25 () {58 vars in 1158 bytes} [Fri Oct 28 14:10:06 2022] DELETE /compute/v2.1/flavors/672705739 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:10:06.709336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f2a541f-3893-4b99-b989-bf9209837c7c tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:06.729421 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f2a541f-3893-4b99-b989-bf9209837c7c tempest-ServersAdminNegativeTestJSON-1665121289 tempest-ServersAdminNegativeTestJSON-1665121289-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023762 Oct 28 14:10:06.729971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3465/7019] 10.222.0.25 () {58 vars in 1146 bytes} [Fri Oct 28 14:10:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:06.751176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:06.751704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:06.758117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:06.758598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:06.759065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:06.759747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:06.760202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:06.760628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:06.785704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:10:07.106877 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c57b24fb-ca0f-49a7-b757-f2a8d38aa819 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 204 len: 0 microversion: 2.1 time: 0.359192 Oct 28 14:10:07.107436 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3555/7020] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:10:06 2022] DELETE /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:10:07.115852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:07.116577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:07.123074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:07.123574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:07.124022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:07.124723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:07.125191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:07.125659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:07.253719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:07.261644 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1b11a0a-8cfd-4a8b-b0e8-e19946eb5492 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1476 microversion: 2.1 time: 0.150075 Oct 28 14:10:07.262820 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3466/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:07 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:08.286047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:08.286772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:08.292688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:08.293176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:08.293734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:08.294425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:08.294911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:08.295340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:08.440522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:08.449019 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0dd1fb89-1484-40c3-a9f2-4c8d6ff54e58 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1476 microversion: 2.1 time: 0.167361 Oct 28 14:10:08.450531 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3556/7022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:08 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:08.981491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-82db3bc1-5399-4ce8-a434-8cbbd1b09586 req-957185c9-4891-4be0-85db-891416623731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76505f14-1601-4b5e-800f-0948e2296b5c", "name": "network-vif-deleted", "tag": "c1998169-ed09-4337-a0a9-39460e658573"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:08.992934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-82db3bc1-5399-4ce8-a434-8cbbd1b09586 req-957185c9-4891-4be0-85db-891416623731 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:08.998607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-82db3bc1-5399-4ce8-a434-8cbbd1b09586 req-957185c9-4891-4be0-85db-891416623731 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:08.998607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-82db3bc1-5399-4ce8-a434-8cbbd1b09586 req-957185c9-4891-4be0-85db-891416623731 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:09.007094 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-82db3bc1-5399-4ce8-a434-8cbbd1b09586 req-957185c9-4891-4be0-85db-891416623731 service nova] Creating event network-vif-deleted:c1998169-ed09-4337-a0a9-39460e658573 for instance 76505f14-1601-4b5e-800f-0948e2296b5c on n-h2-862876-2 Oct 28 14:10:09.012986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-82db3bc1-5399-4ce8-a434-8cbbd1b09586 req-957185c9-4891-4be0-85db-891416623731 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036164 Oct 28 14:10:09.013600 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3467/7023] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:09.474599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:09.475959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:09.484235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:09.484729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:09.485175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:09.485880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:09.486340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:09.486793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:09.518267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:09.518764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:09.519215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:09.519665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lazy-loading 'fault' on Instance uuid 76505f14-1601-4b5e-800f-0948e2296b5c {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:10:09.566587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adab9cf1b0346738d01bb6d7984a551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98935c1a280141fbb0b25bbaae588015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:09.574364 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-69c14dfd-f508-458e-8725-bd8578678927 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 200 len: 1311 microversion: 2.1 time: 0.104562 Oct 28 14:10:09.574978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3557/7024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:09 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:10.599222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:10.599938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] [instance: 76505f14-1601-4b5e-800f-0948e2296b5c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:10.606177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:10.606679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:10.607168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:10.607885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:10.608376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:10.608835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:10.622594 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] HTTP exception thrown: Instance 76505f14-1601-4b5e-800f-0948e2296b5c could not be found. Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Request method failure captured: Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c HTTP/1.1 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-Kwuj3D6DBQMxzCYP8dTqFlYLlLXv-3ySoZBrNIqAqhSrPLRhwtShUjo1ixmMzNbszFUzJelDCGf8eFErTqwBgY1PIXbvHDSufjwr5x-7Jr4Xuv1Dm4p8JdTrECiHAamiKOvqg6Es_mzuDHn0PJv9y54NCWNt_pTSw4alJRBZIaiG8 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 98935c1a280141fbb0b25bbaae588015 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-149446738 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/98935c1a280141fbb0b25bbaae588015"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/98935c1a280141fbb0b25bbaae588015"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_98935c1a280141fbb0b25bbaae588015", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/98935c1a280141fbb0b25bbaae588015"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersAdminNegativeTestJSON-149446738 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 98935c1a280141fbb0b25bbaae588015 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-149446738 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersAdminNegativeTestJSON-149446738-project Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 4adab9cf1b0346738d01bb6d7984a551 Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersAdminNegativeTestJSON-149446738-project Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 76505f14-1601-4b5e-800f-0948e2296b5c could not be found. Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '76505f14-1601-4b5e-800f-0948e2296b5c'} Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76505f14-1601-4b5e-800f-0948e2296b5c could not be found. Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76505f14-1601-4b5e-800f-0948e2296b5c could not be found. Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:10.624319 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76505f14-1601-4b5e-800f-0948e2296b5c could not be found. Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] Returning 404 to user: Instance 76505f14-1601-4b5e-800f-0948e2296b5c could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-203687ba-96d8-4faa-b9f4-ef7176fec981 tempest-ServersAdminNegativeTestJSON-149446738 tempest-ServersAdminNegativeTestJSON-149446738-project] 10.222.0.25 "GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c" status: 404 len: 111 microversion: 2.1 time: 0.032684 Oct 28 14:10:10.628880 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3468/7025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:10 2022] GET /compute/v2.1/servers/76505f14-1601-4b5e-800f-0948e2296b5c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 14:10:19.627286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:19.628193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:19.628996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:19.629828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:19.748854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-569978040", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "e2d68fb2-3b93-4518-afa9-32da457a4519"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:19.804414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] validate_networks() for [('e2d68fb2-3b93-4518-afa9-32da457a4519', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:10:20.203498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:10:20.203928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:10:20.204409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:10:20.204862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:10:20.205321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:10:20.214601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:20.215125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:20.215571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:20.216309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:20.216775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:20.217208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:20.234988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Getting quotas for project c5a2f7e815c9444c929ca6aa5bbcc776. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:10:20.240539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Getting quotas for user 844a22ff2d0041feb6f6e7a9d45ecb8f and project c5a2f7e815c9444c929ca6aa5bbcc776. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:10:20.253654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:10:20.256276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:10:20.412484 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5a961d55-3148-4481-af0d-a21e28f75477 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791360 Oct 28 14:10:20.413165 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3558/7026] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:10:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:10:20.425219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b330bd42-104b-4293-ae61-b8d0275a625a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:20.426005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b330bd42-104b-4293-ae61-b8d0275a625a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:20.430332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:20.431371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:20.491231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b330bd42-104b-4293-ae61-b8d0275a625a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:20.499375 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b330bd42-104b-4293-ae61-b8d0275a625a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1214 microversion: 2.1 time: 0.078100 Oct 28 14:10:20.500151 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3469/7027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:20 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:21.524024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e40db52c-1ef1-4854-8509-4f1a0fc56492 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:21.524540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e40db52c-1ef1-4854-8509-4f1a0fc56492 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:21.580933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e40db52c-1ef1-4854-8509-4f1a0fc56492 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:21.587982 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e40db52c-1ef1-4854-8509-4f1a0fc56492 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1214 microversion: 2.1 time: 0.068918 Oct 28 14:10:21.588576 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3559/7028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:21 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:22.610906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:22.611545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:22.613739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=51 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:22.620580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:22.621092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:22.621549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:22.622264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:22.622757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:22.623207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:22.685482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:22.694031 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-101b0878-a17d-4c0e-bb79-85e9714b8919 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1266 microversion: 2.1 time: 0.087608 Oct 28 14:10:22.694604 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3470/7029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:22 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:10:23.718408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:23.719181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:23.726552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:23.727274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:23.733318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:23.733318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:23.733318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:23.733318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:23.908891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:23.918338 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2b44450-25a4-49b8-bdef-d099a8a3bdea tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1314 microversion: 2.1 time: 0.204632 Oct 28 14:10:23.937442 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3560/7030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:23 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:24.689559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-39587d0c-faac-4b19-86a7-2c294a813e9e req-ba5dd88f-3bd3-4fd7-994b-467adf6d2438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd6d6db-e423-40b6-a349-25d73f189818", "tag": "1fbf943f-515e-4935-9da8-50e7dc6b50d8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:24.699658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-39587d0c-faac-4b19-86a7-2c294a813e9e req-ba5dd88f-3bd3-4fd7-994b-467adf6d2438 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:24.700298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-39587d0c-faac-4b19-86a7-2c294a813e9e req-ba5dd88f-3bd3-4fd7-994b-467adf6d2438 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:24.700739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-39587d0c-faac-4b19-86a7-2c294a813e9e req-ba5dd88f-3bd3-4fd7-994b-467adf6d2438 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:24.714806 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-39587d0c-faac-4b19-86a7-2c294a813e9e req-ba5dd88f-3bd3-4fd7-994b-467adf6d2438 service nova] Creating event network-changed:1fbf943f-515e-4935-9da8-50e7dc6b50d8 for instance 0dd6d6db-e423-40b6-a349-25d73f189818 on n-h1-862876-2 Oct 28 14:10:24.720469 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-39587d0c-faac-4b19-86a7-2c294a813e9e req-ba5dd88f-3bd3-4fd7-994b-467adf6d2438 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034762 Oct 28 14:10:24.721078 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3471/7031] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:24.943935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:24.944722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:24.951364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:24.951862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:24.952812 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:24.953514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:24.953972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:24.954401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:25.182282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:25.191195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ecf82043-41a9-4ffd-a63d-99666a134852 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1314 microversion: 2.1 time: 0.250995 Oct 28 14:10:25.196360 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3561/7032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:24 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:26.217251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:26.218542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:26.220534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:26.225397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:26.225905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:26.226364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:26.227099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:26.227575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:26.234558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:26.357270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:26.364843 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de8befa3-55ff-4d97-acb7-18a8e176730e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1314 microversion: 2.1 time: 0.152669 Oct 28 14:10:26.365414 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3472/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:26 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:27.387289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:27.387838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:27.394730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:27.395246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:27.395690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:27.396385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:27.396848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:27.397282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:27.528058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:27.536562 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bf9d3b9-d2c5-47fd-98fd-2eb32ea8cfc4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1314 microversion: 2.1 time: 0.153188 Oct 28 14:10:27.537161 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3562/7034] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:27 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:28.560072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:28.560719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:28.568433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:28.568946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:28.569406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:28.570126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:28.570604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:28.571091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:28.698977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:28.706606 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92a4b90c-705f-4c91-8174-e160f1728d06 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1314 microversion: 2.1 time: 0.150462 Oct 28 14:10:28.707212 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3473/7035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:28 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:29.729582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:29.730196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:29.736995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:29.737475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:29.737911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:29.738595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:29.739072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:29.739493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:29.878003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e2ca811c-a6dc-4c59-a035-f0922b4b7deb req-834cab76-d8bc-407f-8e1b-eb417180aa8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd6d6db-e423-40b6-a349-25d73f189818", "name": "network-vif-plugged", "status": "completed", "tag": "1fbf943f-515e-4935-9da8-50e7dc6b50d8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:29.879810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:29.887691 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f5556c46-9a60-42a3-9caa-cd44234b1300 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1314 microversion: 2.1 time: 0.161951 Oct 28 14:10:29.888232 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3563/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:29 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:29.889264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2ca811c-a6dc-4c59-a035-f0922b4b7deb req-834cab76-d8bc-407f-8e1b-eb417180aa8c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:29.889807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2ca811c-a6dc-4c59-a035-f0922b4b7deb req-834cab76-d8bc-407f-8e1b-eb417180aa8c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:29.890260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e2ca811c-a6dc-4c59-a035-f0922b4b7deb req-834cab76-d8bc-407f-8e1b-eb417180aa8c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:29.901944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e2ca811c-a6dc-4c59-a035-f0922b4b7deb req-834cab76-d8bc-407f-8e1b-eb417180aa8c service nova] Creating event network-vif-plugged:1fbf943f-515e-4935-9da8-50e7dc6b50d8 for instance 0dd6d6db-e423-40b6-a349-25d73f189818 on n-h1-862876-2 Oct 28 14:10:29.907066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e2ca811c-a6dc-4c59-a035-f0922b4b7deb req-834cab76-d8bc-407f-8e1b-eb417180aa8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033716 Oct 28 14:10:29.907658 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3474/7037] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:10:30.910510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:30.911067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:30.912909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:30.918530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:30.919057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:30.919501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:30.920176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:30.920632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:30.923249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:31.055255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:31.064120 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3ab9f047-46a2-40cb-89f5-b957f6dbf8ab tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1314 microversion: 2.1 time: 0.158091 Oct 28 14:10:31.064724 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3564/7038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:30 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:32.084825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:32.089925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:32.090682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:32.097360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:32.108556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:32.108556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:32.108556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:32.108556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:32.108556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:32.228067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:32.235757 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77c840d1-82ff-4e9c-af9c-112d64ae4dfb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1501 microversion: 2.1 time: 0.151904 Oct 28 14:10:32.236332 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3475/7039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:32 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:32.258035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:32.260468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:32.262365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:32.268457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:32.268944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:32.274612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:32.274612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:32.274612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:32.274612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:32.347523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:32.353010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Old instance type m1.heat2, new instance type m1.heat {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:10:32.359340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:10:32.361071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:10:32.361071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:10:32.361071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:10:32.361071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:10:32.658868 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1288fb3-15b2-4e06-b404-e45c3c7142ff tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "POST /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818/action" status: 202 len: 0 microversion: 2.1 time: 0.404648 Oct 28 14:10:32.659428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3565/7040] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:10:32 2022] POST /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:10:32.667654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:32.668302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:32.675132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:32.681839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:32.681839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:32.681839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:32.681839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:32.681839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:32.810623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:32.819326 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9ac33fac-8d95-44fe-a9f1-4c3515cc52eb tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1510 microversion: 2.1 time: 0.155758 Oct 28 14:10:32.819912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3476/7041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:32 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:33.858863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:33.859478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:33.866677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:33.867266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:33.867764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:33.868514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:33.869036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:33.869655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:33.998522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:34.007146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4186733d-f79c-41f4-a4c0-5c973861aa33 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1510 microversion: 2.1 time: 0.152883 Oct 28 14:10:34.007657 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3566/7042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:33 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:35.030794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:35.031359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:35.038637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:35.049925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:35.049925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:35.049925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:35.049925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:35.049925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:35.176547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:35.184360 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f60dfdde-90e9-41f4-97a6-ef6bb506d366 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1510 microversion: 2.1 time: 0.157587 Oct 28 14:10:35.184932 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3477/7043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:35 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:36.207332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:36.207945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:36.214669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:36.215190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:36.215629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:36.216320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:36.216768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:36.217194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:36.351195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:36.358919 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e5323cef-97aa-4283-b7e3-f998b4a6b3c8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1510 microversion: 2.1 time: 0.155415 Oct 28 14:10:36.359527 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3567/7044] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:36 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:37.382951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:37.383504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:37.390354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:37.390892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:37.391351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:37.392060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:37.392534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:37.393474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:37.526593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:37.535222 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-980a7e88-baea-42b1-89b1-646e6ef5dac9 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.156172 Oct 28 14:10:37.535849 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3478/7045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:37 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:38.558271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:38.558925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:38.565834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:38.566321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:38.566787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:38.567482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:38.567940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:38.568368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:38.699828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:38.708137 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dfe27d3e-d5a7-4630-a9d0-6859af74b297 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.154010 Oct 28 14:10:38.708944 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3568/7046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:38 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:39.731788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:39.732426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:39.739298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:39.739800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:39.740258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:39.740969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:39.741446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:39.741892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:39.868588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:39.876652 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-91bab099-d048-483d-b169-57355090ea69 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.148809 Oct 28 14:10:39.877251 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3479/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:39 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:40.900293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:40.900830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:40.907609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:40.908093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:40.908535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:40.909219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:40.909676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:40.910103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:41.040015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:41.047810 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-469b7e5b-ac14-4e56-b1d5-6372380f4545 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.151495 Oct 28 14:10:41.048590 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3569/7048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:40 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:42.070286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:42.070990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:42.077959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:42.078466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:42.078957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:42.079667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:42.080139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:42.080579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:42.209523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:42.217157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a53d1ec9-50c2-444c-bdf6-8d3aee9f4abe tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.150814 Oct 28 14:10:42.217729 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3480/7049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:42 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:43.240140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:43.240781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:43.247645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:43.248137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:43.248575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:43.249265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:43.249754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:43.250184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:43.377295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:43.385038 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d2cc193-c8ec-4343-8677-ddf481031b75 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.149418 Oct 28 14:10:43.385616 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3570/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:43 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:10:44.408600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:44.409175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:44.416092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:44.416592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:44.417042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:44.417742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:44.418212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:44.418651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:44.546279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:44.554587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6fdb900-2845-43bc-8443-9d86485c278f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.150017 Oct 28 14:10:44.555248 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3481/7051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:44 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:45.577996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:45.578612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:45.585890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:45.586407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:45.586872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:45.587558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:45.588015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:45.588439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:45.716220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:45.724022 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f629faf-f15b-4074-900c-33842fa73e6e tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.149892 Oct 28 14:10:45.724586 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3571/7052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:45 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:46.746937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:46.747579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:46.755923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:46.756432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:46.756897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:46.757615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:46.758109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:46.758541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:46.889528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:46.897334 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f28c3a51-5b37-419c-bc9d-86467c77d734 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.154375 Oct 28 14:10:46.897908 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3482/7053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:46 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:47.920716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:47.921253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:47.929122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:47.929603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:47.930035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:47.930720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:47.931194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:47.931615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:48.062718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:48.070956 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eab5fa1f-1011-43f3-9fa8-e6929faeadb5 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.154377 Oct 28 14:10:48.071525 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3572/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:47 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:49.094764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:49.095418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:49.102880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:49.103382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:49.103831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:49.104534 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:49.105004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:49.105442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:49.232035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:49.240214 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c47e7023-3c3f-49cb-abdc-893149a7e3d6 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.149487 Oct 28 14:10:49.240791 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3483/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:49 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:50.263685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:50.264301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:50.267013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:50.272336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:50.272821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:50.273259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:50.273948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:50.274404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:50.274868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:50.278705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:50.403219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:50.410729 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f6998a49-676a-4f8c-8a78-a16b9ed833f3 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.150959 Oct 28 14:10:50.411320 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3573/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:50 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:51.434432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:51.435100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:51.442185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:51.442694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:51.443183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:51.443905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:51.444386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:51.444833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:51.576443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:51.584991 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fe5c252b-d988-4cd6-ada8-5f1873d18f68 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.154469 Oct 28 14:10:51.585597 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3484/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:51 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:10:52.608766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:52.609384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:52.617134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:52.617615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:52.618053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:52.618739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:52.619219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:52.619648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:52.754684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:52.762467 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d3dcd5fd-2c07-4f52-aa1e-2017f6cf506d tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1515 microversion: 2.1 time: 0.157978 Oct 28 14:10:52.763082 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3574/7058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:52 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:53.785684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:53.786404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:53.793197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:53.793699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:53.794153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:53.794943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:53.795361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:53.795799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:53.799785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=83 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:54.050410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-46377048-ee1a-4d88-aea6-25b25a09c8eb req-a2e6b94d-67ca-4ae1-9dd2-f4cfe25df036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd6d6db-e423-40b6-a349-25d73f189818", "name": "network-vif-unplugged", "status": "completed", "tag": "1fbf943f-515e-4935-9da8-50e7dc6b50d8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:54.063075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46377048-ee1a-4d88-aea6-25b25a09c8eb req-a2e6b94d-67ca-4ae1-9dd2-f4cfe25df036 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:54.063557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46377048-ee1a-4d88-aea6-25b25a09c8eb req-a2e6b94d-67ca-4ae1-9dd2-f4cfe25df036 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:54.064162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46377048-ee1a-4d88-aea6-25b25a09c8eb req-a2e6b94d-67ca-4ae1-9dd2-f4cfe25df036 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:54.076783 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-46377048-ee1a-4d88-aea6-25b25a09c8eb req-a2e6b94d-67ca-4ae1-9dd2-f4cfe25df036 service nova] Creating event network-vif-unplugged:1fbf943f-515e-4935-9da8-50e7dc6b50d8 for instance 0dd6d6db-e423-40b6-a349-25d73f189818 on n-h2-862876-2 Oct 28 14:10:54.082992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-46377048-ee1a-4d88-aea6-25b25a09c8eb req-a2e6b94d-67ca-4ae1-9dd2-f4cfe25df036 service nova] Instance 0dd6d6db-e423-40b6-a349-25d73f189818 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:10:54.094733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-46377048-ee1a-4d88-aea6-25b25a09c8eb req-a2e6b94d-67ca-4ae1-9dd2-f4cfe25df036 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047987 Oct 28 14:10:54.095520 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3575/7059] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:10:54.262964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:54.271513 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca1d16dc-7bd1-4816-a3a2-ebde56cb858a tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1514 microversion: 2.1 time: 0.489814 Oct 28 14:10:54.272091 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3485/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:53 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1514 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:55.297116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:55.297832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:55.303923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:55.304391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:55.304823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:55.305504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:55.305957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:55.306607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:55.438623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:55.448732 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e854636e-c313-420c-ad6b-a89a9107776f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1512 microversion: 2.1 time: 0.156680 Oct 28 14:10:55.449314 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3576/7061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:55 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:56.110236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-fc1798d1-2edf-41ff-b003-53c5b6157cde req-68f00e6b-d542-42ae-a5d9-0a2bcb215d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd6d6db-e423-40b6-a349-25d73f189818", "tag": "1fbf943f-515e-4935-9da8-50e7dc6b50d8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:56.120658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fc1798d1-2edf-41ff-b003-53c5b6157cde req-68f00e6b-d542-42ae-a5d9-0a2bcb215d96 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:56.121157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fc1798d1-2edf-41ff-b003-53c5b6157cde req-68f00e6b-d542-42ae-a5d9-0a2bcb215d96 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:56.121605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-fc1798d1-2edf-41ff-b003-53c5b6157cde req-68f00e6b-d542-42ae-a5d9-0a2bcb215d96 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:56.133781 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-fc1798d1-2edf-41ff-b003-53c5b6157cde req-68f00e6b-d542-42ae-a5d9-0a2bcb215d96 service nova] Creating event network-changed:1fbf943f-515e-4935-9da8-50e7dc6b50d8 for instance 0dd6d6db-e423-40b6-a349-25d73f189818 on n-h2-862876-2 Oct 28 14:10:56.139173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-fc1798d1-2edf-41ff-b003-53c5b6157cde req-68f00e6b-d542-42ae-a5d9-0a2bcb215d96 service nova] Instance 0dd6d6db-e423-40b6-a349-25d73f189818 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:10:56.150366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-fc1798d1-2edf-41ff-b003-53c5b6157cde req-68f00e6b-d542-42ae-a5d9-0a2bcb215d96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043953 Oct 28 14:10:56.150998 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3486/7062] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:10:56.471771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:56.472434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:56.479521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:56.480010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:56.480446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:56.481162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:56.481629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:56.482051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:56.825033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:56.833627 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32b6b9e7-886e-443d-90f4-0652752d40bd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1512 microversion: 2.1 time: 0.365661 Oct 28 14:10:56.838353 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3577/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:56 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:57.860813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:57.861538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:57.864662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=30 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:10:57.868225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:57.868728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:57.869178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:57.869929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:57.870395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:57.870859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:58.007916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:10:58.015690 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-807ae3ec-a0af-43fa-9f7b-5e162cdd34b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1509 microversion: 2.1 time: 0.161931 Oct 28 14:10:58.016330 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3487/7064] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:10:57 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:10:58.037705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:10:58.039269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:10:58.045038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:58.045531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:58.045965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:58.046659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:58.047145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:58.047569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:58.074994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:10:58.247365 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.api [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Found an unconfirmed migration during delete, id: 16, status: finished Oct 28 14:10:59.924811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-625750a3-0b42-4b1c-ad4b-4614da950164 req-a1d51286-9049-49c0-9ba3-8dea41527eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd6d6db-e423-40b6-a349-25d73f189818", "name": "network-vif-plugged", "status": "completed", "tag": "1fbf943f-515e-4935-9da8-50e7dc6b50d8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:10:59.935698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-625750a3-0b42-4b1c-ad4b-4614da950164 req-a1d51286-9049-49c0-9ba3-8dea41527eb9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:10:59.936196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-625750a3-0b42-4b1c-ad4b-4614da950164 req-a1d51286-9049-49c0-9ba3-8dea41527eb9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:10:59.936643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-625750a3-0b42-4b1c-ad4b-4614da950164 req-a1d51286-9049-49c0-9ba3-8dea41527eb9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:10:59.947934 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-625750a3-0b42-4b1c-ad4b-4614da950164 req-a1d51286-9049-49c0-9ba3-8dea41527eb9 service nova] Creating event network-vif-plugged:1fbf943f-515e-4935-9da8-50e7dc6b50d8 for instance 0dd6d6db-e423-40b6-a349-25d73f189818 on n-h2-862876-2 Oct 28 14:10:59.953042 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-625750a3-0b42-4b1c-ad4b-4614da950164 req-a1d51286-9049-49c0-9ba3-8dea41527eb9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032019 Oct 28 14:10:59.953677 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3488/7065] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:11:00.323371 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-882ea33f-bde9-4d04-bf76-71285ae61e42 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 204 len: 0 microversion: 2.1 time: 2.289146 Oct 28 14:11:00.323938 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3578/7066] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:10:58 2022] DELETE /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 0 bytes in 2291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:11:00.333285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:00.334061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:00.340356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:00.340871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:00.341327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:00.342044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:00.342526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:00.343003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:00.476000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:00.483924 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ca5dc67d-1af2-4057-a550-ba95317020e8 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1501 microversion: 2.1 time: 0.155423 Oct 28 14:11:00.484504 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3489/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:00 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:01.508131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:01.508830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:01.517225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:01.517710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:01.518140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:01.518851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:01.519302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:01.519729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:01.648994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:01.656693 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c575eb8f-a585-4e5b-bf3d-e51ec8b907dc tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1501 microversion: 2.1 time: 0.153355 Oct 28 14:11:01.657277 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3579/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:01 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:02.244911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5e780c89-8de1-4722-99b4-3ccdf6014812 req-a3c4bafe-582d-4863-96c1-865f53eafa9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd6d6db-e423-40b6-a349-25d73f189818", "name": "network-vif-deleted", "tag": "1fbf943f-515e-4935-9da8-50e7dc6b50d8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:11:02.256111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e780c89-8de1-4722-99b4-3ccdf6014812 req-a3c4bafe-582d-4863-96c1-865f53eafa9e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:02.256622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e780c89-8de1-4722-99b4-3ccdf6014812 req-a3c4bafe-582d-4863-96c1-865f53eafa9e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:02.257072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e780c89-8de1-4722-99b4-3ccdf6014812 req-a3c4bafe-582d-4863-96c1-865f53eafa9e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:02.271264 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5e780c89-8de1-4722-99b4-3ccdf6014812 req-a3c4bafe-582d-4863-96c1-865f53eafa9e service nova] Creating event network-vif-deleted:1fbf943f-515e-4935-9da8-50e7dc6b50d8 for instance 0dd6d6db-e423-40b6-a349-25d73f189818 on n-h2-862876-2 Oct 28 14:11:02.277269 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5e780c89-8de1-4722-99b4-3ccdf6014812 req-a3c4bafe-582d-4863-96c1-865f53eafa9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 Oct 28 14:11:02.278093 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3490/7069] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:11:02.679782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:02.680401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:02.687301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:02.688042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:02.688483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:02.689170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:02.689625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:02.690050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:02.724841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:02.725343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:02.725782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:02.726235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lazy-loading 'fault' on Instance uuid 0dd6d6db-e423-40b6-a349-25d73f189818 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:11:02.768622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844a22ff2d0041feb6f6e7a9d45ecb8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a2f7e815c9444c929ca6aa5bbcc776', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:02.776836 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7053f94d-9b5e-4f34-b69f-b073518e5a1c tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 200 len: 1304 microversion: 2.1 time: 0.101548 Oct 28 14:11:02.777461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3580/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:02 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:03.801509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:03.802180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:03.808351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:03.808850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:03.809299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:03.809996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:03.810463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:03.810931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:03.824670 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] HTTP exception thrown: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Request method failure captured: Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 HTTP/1.1 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-LL-iRQwG4CDRDB9DhP6MXjJcCrGCf5hbuwjchKdtOX1IXVLsTTRpGVX56P7SAwobGjFfSkrTen9Koc3Ghdmy_50SSG0hq-jPACufsnmWLcZfE3mrerOGpPsmuGgDKqwAvvad4AlN-nzr8R685hTNv-7UywsUBSHDtkUonAT1PR7ug Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c5a2f7e815c9444c929ca6aa5bbcc776 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5a2f7e815c9444c929ca6aa5bbcc776", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c5a2f7e815c9444c929ca6aa5bbcc776 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-520448948-project Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 844a22ff2d0041feb6f6e7a9d45ecb8f Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-520448948-project Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '0dd6d6db-e423-40b6-a349-25d73f189818'} Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:11:03.826295 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Returning 404 to user: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a1ad8f15-a1c0-4ec7-9c3d-a4345e454d8f tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 404 len: 111 microversion: 2.1 time: 0.031413 Oct 28 14:11:03.831259 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3491/7071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:03 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:11:03.843739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:03.844302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:03.850401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:03.850940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:03.851376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:03.852206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:03.852717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:03.853167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:03.866701 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] HTTP exception thrown: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Request method failure captured: Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 HTTP/1.1 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-LL-iRQwG4CDRDB9DhP6MXjJcCrGCf5hbuwjchKdtOX1IXVLsTTRpGVX56P7SAwobGjFfSkrTen9Koc3Ghdmy_50SSG0hq-jPACufsnmWLcZfE3mrerOGpPsmuGgDKqwAvvad4AlN-nzr8R685hTNv-7UywsUBSHDtkUonAT1PR7ug Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: c5a2f7e815c9444c929ca6aa5bbcc776 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5a2f7e815c9444c929ca6aa5bbcc776", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: c5a2f7e815c9444c929ca6aa5bbcc776 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-DeleteServersTestJSON-520448948-project Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 844a22ff2d0041feb6f6e7a9d45ecb8f Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-DeleteServersTestJSON-520448948-project Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '0dd6d6db-e423-40b6-a349-25d73f189818'} Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:11:03.868374 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Returning 404 to user: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5dc4f3e-c996-4087-a914-63e58dccf1fd tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 404 len: 111 microversion: 2.1 time: 0.031037 Oct 28 14:11:03.872932 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3581/7072] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:11:03 2022] DELETE /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:11:03.878336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:03.878992 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] [instance: 0dd6d6db-e423-40b6-a349-25d73f189818] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:03.884811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:03.885307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:03.885759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:03.886457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:03.887022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:03.887460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:03.901132 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] HTTP exception thrown: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Request method failure captured: Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 HTTP/1.1 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-LL-iRQwG4CDRDB9DhP6MXjJcCrGCf5hbuwjchKdtOX1IXVLsTTRpGVX56P7SAwobGjFfSkrTen9Koc3Ghdmy_50SSG0hq-jPACufsnmWLcZfE3mrerOGpPsmuGgDKqwAvvad4AlN-nzr8R685hTNv-7UywsUBSHDtkUonAT1PR7ug Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: c5a2f7e815c9444c929ca6aa5bbcc776 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5a2f7e815c9444c929ca6aa5bbcc776", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5a2f7e815c9444c929ca6aa5bbcc776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: c5a2f7e815c9444c929ca6aa5bbcc776 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-DeleteServersTestJSON-520448948 Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-DeleteServersTestJSON-520448948-project Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 844a22ff2d0041feb6f6e7a9d45ecb8f Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-DeleteServersTestJSON-520448948-project Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '0dd6d6db-e423-40b6-a349-25d73f189818'} Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:11:03.902673 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] Returning 404 to user: Instance 0dd6d6db-e423-40b6-a349-25d73f189818 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-154168af-b67b-4086-a8bb-2414c30864b4 tempest-DeleteServersTestJSON-520448948 tempest-DeleteServersTestJSON-520448948-project] 10.222.0.25 "GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818" status: 404 len: 111 microversion: 2.1 time: 0.029627 Oct 28 14:11:03.907375 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3492/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:03 2022] GET /compute/v2.1/servers/0dd6d6db-e423-40b6-a349-25d73f189818 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:11:15.085315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:15.086070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:15.214273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1560435932", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "177076c2-0cf2-439a-bc1b-bad92858873a"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:11:15.277026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] validate_networks() for [('177076c2-0cf2-439a-bc1b-bad92858873a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:11:15.650886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:11:15.651307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:11:15.651781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:11:15.652504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:11:15.652925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:11:15.662688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:15.663327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:15.663866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:15.664604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:15.665062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:15.665485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:15.683680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Getting quotas for project b797bab260604655a8031e3637fe1d1d. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:11:15.689399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Getting quotas for user 0eedbe4226dd4309bbac8b853a77630c and project b797bab260604655a8031e3637fe1d1d. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:11:15.702607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:11:15.705070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:11:15.845148 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d51b7ab6-6c16-456d-a03f-f84a8fb616d2 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767798 Oct 28 14:11:15.845811 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3582/7074] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:11:15.856847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1d5840a3-4a50-428d-98a4-7b400b811baa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:15.857487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1d5840a3-4a50-428d-98a4-7b400b811baa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:15.860686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=11 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:15.861555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=29 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:15.916706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1d5840a3-4a50-428d-98a4-7b400b811baa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:15.925741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1d5840a3-4a50-428d-98a4-7b400b811baa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1218 microversion: 2.1 time: 0.071234 Oct 28 14:11:15.925741 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3493/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:15 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:16.948544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94383efc-d003-4dbd-924f-438a5e8f6bf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:16.949201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94383efc-d003-4dbd-924f-438a5e8f6bf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:17.006314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94383efc-d003-4dbd-924f-438a5e8f6bf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:17.013871 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94383efc-d003-4dbd-924f-438a5e8f6bf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1218 microversion: 2.1 time: 0.069372 Oct 28 14:11:17.014451 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3583/7076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:16 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:18.039523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:18.040813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:18.052521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:18.056723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:18.056723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:18.056723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:18.056723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:18.056723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:18.121464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:18.135906 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ac85b481-ff65-40e7-8d79-14f804736ac9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1270 microversion: 2.1 time: 0.102266 Oct 28 14:11:18.136745 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3494/7077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:18 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:19.160221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:19.161826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:19.177330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:19.178107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:19.178771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:19.179715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:19.180379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:19.181001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:19.396536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:19.404393 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe1e07f2-fe1a-4073-8c22-fd358aaeeffd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1318 microversion: 2.1 time: 0.248279 Oct 28 14:11:19.404981 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3584/7078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:19 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:20.127619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ece663b9-436f-477d-8c7c-fcdee2ad4912 req-ff201fa1-97be-451c-a69f-01199d8405e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4b8fa0-2818-4285-9cb7-e9f7f462b878", "tag": "2cc811b3-a6b6-4a56-beee-b716bacd991f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:11:20.142637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ece663b9-436f-477d-8c7c-fcdee2ad4912 req-ff201fa1-97be-451c-a69f-01199d8405e2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:20.143475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ece663b9-436f-477d-8c7c-fcdee2ad4912 req-ff201fa1-97be-451c-a69f-01199d8405e2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:20.143919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ece663b9-436f-477d-8c7c-fcdee2ad4912 req-ff201fa1-97be-451c-a69f-01199d8405e2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:20.156082 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ece663b9-436f-477d-8c7c-fcdee2ad4912 req-ff201fa1-97be-451c-a69f-01199d8405e2 service nova] Creating event network-changed:2cc811b3-a6b6-4a56-beee-b716bacd991f for instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 on n-h1-862876-2 Oct 28 14:11:20.161685 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ece663b9-436f-477d-8c7c-fcdee2ad4912 req-ff201fa1-97be-451c-a69f-01199d8405e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037179 Oct 28 14:11:20.162417 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3495/7079] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:11:20.426656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:20.427320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:20.434975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:20.435470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:20.435907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:20.436605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:20.437065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:20.437493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:20.657223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:20.665752 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d1dc0090-1862-4f34-8376-0b117e0f8bce tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1318 microversion: 2.1 time: 0.242855 Oct 28 14:11:20.666346 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3585/7080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:20 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:21.690071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:21.690879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:21.698805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:21.699317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:21.699787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:21.700498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:21.700974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:21.701420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:21.829320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:21.837004 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9dcbc00b-fa6b-42e6-bc45-795cdb119247 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1318 microversion: 2.1 time: 0.151536 Oct 28 14:11:21.837577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3496/7081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:21 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:22.859799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:22.860332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:22.867184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:22.867667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:22.868104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:22.868787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:22.869242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:22.869667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:22.997628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:23.005253 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8fba824-73eb-4ea6-a55c-2cbb3d3538b5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1318 microversion: 2.1 time: 0.149458 Oct 28 14:11:23.006034 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3586/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:22 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:24.030285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:24.030998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:24.038005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:24.039178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:24.039733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:24.040634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:24.041138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:24.041813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:24.189040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:24.197393 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2923fa01-1f2d-4cc7-b784-fcd5754e3548 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1318 microversion: 2.1 time: 0.171559 Oct 28 14:11:24.197960 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3497/7083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:24 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:25.221143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:25.221767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:25.229174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:25.229666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:25.230104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:25.230823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:25.231286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:25.231710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:25.366180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:25.373907 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5be40181-91f1-4f7d-a723-6a015ad2acec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1318 microversion: 2.1 time: 0.156762 Oct 28 14:11:25.374502 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3587/7084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:25 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:26.075916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-730dacb5-d0f8-4ebb-8861-38a539e0af27 req-fabfbecd-2538-4909-a201-32ac8bf2675a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b8fa0-2818-4285-9cb7-e9f7f462b878", "name": "network-vif-plugged", "status": "completed", "tag": "2cc811b3-a6b6-4a56-beee-b716bacd991f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:11:26.081874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:26.087204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-730dacb5-d0f8-4ebb-8861-38a539e0af27 req-fabfbecd-2538-4909-a201-32ac8bf2675a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:26.087796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-730dacb5-d0f8-4ebb-8861-38a539e0af27 req-fabfbecd-2538-4909-a201-32ac8bf2675a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:26.088244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-730dacb5-d0f8-4ebb-8861-38a539e0af27 req-fabfbecd-2538-4909-a201-32ac8bf2675a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:26.103353 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-730dacb5-d0f8-4ebb-8861-38a539e0af27 req-fabfbecd-2538-4909-a201-32ac8bf2675a service nova] Creating event network-vif-plugged:2cc811b3-a6b6-4a56-beee-b716bacd991f for instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 on n-h1-862876-2 Oct 28 14:11:26.104639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-730dacb5-d0f8-4ebb-8861-38a539e0af27 req-fabfbecd-2538-4909-a201-32ac8bf2675a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032760 Oct 28 14:11:26.105328 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3498/7085] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:11:26.397348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:26.397872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:26.399770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:26.405365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:26.405857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:26.406296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:26.407021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:26.407484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:26.415263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:26.540353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:26.548223 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-65b7c33d-ac94-4fa9-ac9c-7f5a3982e36a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1318 microversion: 2.1 time: 0.154871 Oct 28 14:11:26.548808 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3588/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:26 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:27.572428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:27.574475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:27.580700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:27.581195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:27.581642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:27.582346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:27.582990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:27.583436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:27.717691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:27.725559 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d5f39e53-35c8-458f-8b1f-294bd6bae0ec tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1509 microversion: 2.1 time: 0.158052 Oct 28 14:11:27.726219 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3499/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:27 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:27.747971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:27.748583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:27.750431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:27.756054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:27.756542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:27.756985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:27.758264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:27.758783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:27.759220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:27.942504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:27.950249 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-998508b9-6f73-45d1-89cd-8ee55ee53f17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1509 microversion: 2.1 time: 0.206182 Oct 28 14:11:27.950852 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3589/7088] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:27 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:27.972299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:11:27.974715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:27.981167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:27.981665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:27.982113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:27.982872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:27.983345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:27.983783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.105335 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c759028-2979-4839-86cd-d5c54a8ce034 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "PUT /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1081 microversion: 2.1 time: 0.136741 Oct 28 14:11:28.105997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3500/7089] 10.222.0.25 () {60 vars in 1256 bytes} [Fri Oct 28 14:11:27 2022] PUT /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1081 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:28.124826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:28.125439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:28.131475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.131959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.132438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.134924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.135403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.135964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.272494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:28.280643 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-341c5564-4e3a-49d4-a197-7262481f68d8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1507 microversion: 2.1 time: 0.159907 Oct 28 14:11:28.281219 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3590/7090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:28 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:28.303120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:28.303754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:28.309677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.310177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.310630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.311373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.311845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.312287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.441766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:28.449525 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7c03f83b-e52d-4108-8389-0fb6c19e1816 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1507 microversion: 2.1 time: 0.150282 Oct 28 14:11:28.450095 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3501/7091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:28 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:28.472955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:11:28.475678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:28.482170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.482693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.488028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.488028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.488028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.488028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.512929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:28.518596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Old instance type m1.heat2, new instance type m1.heat {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:11:28.525753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:11:28.526178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:11:28.526661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:11:28.527239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:11:28.527656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:11:28.737680 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c5135278-29ff-49f7-8ea9-cfd898e3d6a1 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "POST /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878/action" status: 202 len: 0 microversion: 2.1 time: 0.268626 Oct 28 14:11:28.738297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3591/7092] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:11:28 2022] POST /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:11:28.746595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:28.747389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:28.754037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.754536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.755024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.755734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:28.756206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:28.756642 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:28.884977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:28.892732 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47d05b80-f395-42cc-ba60-547465c44158 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1518 microversion: 2.1 time: 0.149984 Oct 28 14:11:28.893299 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3502/7093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:28 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:29.916822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:29.917442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:29.925174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:29.925662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:29.926101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:29.926824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:29.927287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:29.927715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:30.057836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:30.066125 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44189f6a-3477-40f1-bc1d-537f2053ac42 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1518 microversion: 2.1 time: 0.153902 Oct 28 14:11:30.067608 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3592/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:29 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:31.088750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:31.089431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:31.096430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:31.096941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:31.097400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:31.098122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:31.098600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:31.099081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:31.292130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:31.300053 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-132940c5-4ad5-48b2-9e2a-68e5a5182ef6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1518 microversion: 2.1 time: 0.215478 Oct 28 14:11:31.301465 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3503/7095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:31 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:32.324660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:32.325167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:32.331923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:32.332398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:32.332831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:32.333506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:32.333954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:32.334370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:32.467068 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:32.474740 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d0af3bf4-bde5-4338-88dd-04ae2e88277a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.154699 Oct 28 14:11:32.475337 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3593/7096] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:32 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:33.499340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:33.499977 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:33.506880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:33.507411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:33.507878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:33.508587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:33.509056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:33.509591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:33.641694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:33.649515 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ad5346a-62d9-4f6c-8173-0ae081b4522b tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.154084 Oct 28 14:11:33.650089 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3504/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:33 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:34.673296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:34.673940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:34.680732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:34.681219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:34.681656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:34.682338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:34.682816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:34.683247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:34.810550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:34.818477 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1607c3a6-0d30-4210-be8b-a8162195f6fa tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.149141 Oct 28 14:11:34.819091 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3594/7098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:34 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:35.841541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:35.842076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:35.848955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:35.849462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:35.849920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:35.850632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:35.851139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:35.851585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:35.983578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:35.991305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eef86b28-6c64-4ff3-b1a0-60676ee809bf tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.153863 Oct 28 14:11:35.991883 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3505/7099] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:35 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:37.015956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:37.016570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:37.023327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:37.023809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:37.024245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:37.024917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:37.025367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:37.025786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:37.155154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:37.162884 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-796b01b2-3fcf-4f19-b612-63a56eeb861a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151207 Oct 28 14:11:37.169687 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3595/7100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:37 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:38.185720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:38.186485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:38.193970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:38.194464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:38.194946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:38.195647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:38.196117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:38.196582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:38.327127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:38.335313 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-29445e88-2148-4217-a639-d0abd923d663 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.153526 Oct 28 14:11:38.335882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3506/7101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:38 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:39.358389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:39.358967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:39.366096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:39.366578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:39.367051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:39.367742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:39.368195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:39.368621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:39.499522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:39.507609 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a07704e-c84d-4309-a47d-93d7c75e8d1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.153298 Oct 28 14:11:39.508180 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3596/7102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:39 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:40.530586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:40.531262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:40.537459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:40.537969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:40.538428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:40.539171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:40.539645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:40.540091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:40.669378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:40.677593 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f749d85f-fa15-4592-84e4-4078f041dc4f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151093 Oct 28 14:11:40.678162 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3507/7103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:40 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:41.701393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:41.702011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:41.709348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:41.709828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:41.712969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:41.712969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:41.712969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:41.712969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:41.840785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:41.848519 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dcf61035-a985-4080-a813-074cf511c952 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151084 Oct 28 14:11:41.849094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3597/7104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:41 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:42.872270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:42.872827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:42.879734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:42.882104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:42.882104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:42.882104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:42.882104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:42.882468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:43.014678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:43.023360 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ee774c51-6580-4d14-9bc7-744a69813087 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.155181 Oct 28 14:11:43.023930 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3508/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:42 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:44.045533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:44.046152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:44.053560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:44.054049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:44.054490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:44.055210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:44.055671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:44.056101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:44.190896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:44.194334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:44.198946 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d07b938d-11b4-4024-a648-42da1bdeda95 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.157286 Oct 28 14:11:44.199522 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3598/7106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:44 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:45.223272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:45.223908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:45.230867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:45.231379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:45.231836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:45.232547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:45.233025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:45.233563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:45.361745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:45.370171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f466f2eb-307f-403e-ab44-3b2b0aee3af7 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.150885 Oct 28 14:11:45.370759 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3509/7107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:45 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:46.393154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:46.393806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:46.396855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:46.401883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:46.402371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:46.402842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:46.403535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:46.403995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:46.404424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:46.533278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:46.541131 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-56b4c57f-99c5-447f-9015-11aaacfdc4dd tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151942 Oct 28 14:11:46.541901 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3599/7108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:46 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:47.565026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:47.565654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:47.569023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=37 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:47.573897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:47.574395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:47.574941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:47.575664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:47.576136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:47.576576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:47.711158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:47.718894 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a21c58a3-6ec0-4119-8353-46402d56382f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.158151 Oct 28 14:11:47.719474 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3510/7109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:47 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:48.741993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:48.742611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:48.749535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:48.750019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:48.750458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:48.751184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:48.751637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:48.752064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:48.881282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:48.888945 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06c868f4-a327-4d7b-b090-8c6827b80f03 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151478 Oct 28 14:11:48.889531 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3600/7110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:48 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:49.910968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:49.911602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:49.918562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:49.919095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:49.919550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:49.920257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:49.920733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:49.921173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:49.923740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:11:50.049064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:50.057375 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb1085fe-e09e-4f0b-889f-d484c89d3938 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.150343 Oct 28 14:11:50.058003 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3511/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:49 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:51.080781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:51.081384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:51.088289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:51.088765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:51.089195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:51.089876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:51.090327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:51.090764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:51.220189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:51.228839 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-209327d8-8410-466f-a7d0-faa13023f5e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151907 Oct 28 14:11:51.229420 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3601/7112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:51 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:52.253011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:52.253644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:52.260548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:52.261054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:52.261528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:52.262220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:52.262690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:52.263159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:52.393391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:52.401756 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5db91b27-4fb8-4154-8633-40e9e6d914a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.153099 Oct 28 14:11:52.402339 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3512/7113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:52 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:53.425347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:53.425887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:53.432852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:53.433341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:53.433804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:53.435134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:53.435134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:53.435416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:53.567892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:53.576092 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2fcbfbf-35e6-4945-8883-a6292eb48f4e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.154790 Oct 28 14:11:53.576664 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3602/7114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:53 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:54.600001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:54.600636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:54.608120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:54.608620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:54.609074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:54.609820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:54.610257 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:54.610698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:54.742025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:54.750660 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c5948f51-5011-4eee-b483-6aedcd61bb1d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.154416 Oct 28 14:11:54.751441 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3513/7115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:54 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:55.773645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:55.774260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:55.781144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:55.781637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:55.782076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:55.782788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:55.783252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:55.783685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:55.915026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:55.923840 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-789095d2-28d3-4755-b5ba-1649448c96d5 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.154179 Oct 28 14:11:55.924418 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3603/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:55 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:56.948351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:56.949156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:56.955926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:56.956423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:56.956871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:56.957573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:56.958036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:56.958474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:57.090186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:57.098527 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-45cc6642-d2f0-4531-b99f-732b60c596ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.154009 Oct 28 14:11:57.099160 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3514/7117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:56 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:58.123650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:58.124283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:58.130982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:58.131460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:58.131890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:58.132569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:58.133018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:58.133432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:58.267808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:58.275950 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a08dacb1-31b0-4f86-9d9f-598645bb7886 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.156894 Oct 28 14:11:58.276525 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3604/7118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:58 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:11:59.299547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:11:59.300187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:11:59.307505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:59.308013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:59.308473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:59.309192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:11:59.309668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:11:59.310114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:11:59.442998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:11:59.450733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f3bae25-28f3-43f0-8b14-29d2f7a14f1f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.155177 Oct 28 14:11:59.451337 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3515/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:11:59 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:00.473578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:00.474192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:00.481700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:00.482183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:00.482617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:00.483333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:00.483791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:00.484214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:00.616339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:00.624215 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-22da0d96-0413-4bbd-a147-dc877e4fbd02 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.154482 Oct 28 14:12:00.627542 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3605/7120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:00 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:01.647394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:01.647955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:01.655437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:01.655941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:01.656475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:01.657272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:01.657814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:01.658404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:01.786374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:01.794644 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b31e5255-e71a-4868-97c7-ce699092603f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151245 Oct 28 14:12:01.795242 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3516/7121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:01 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:02.818821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:02.819420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:02.826833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:02.827313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:02.827762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:02.828422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:02.828960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:02.829381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:02.959038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:02.966725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-679c4233-b02d-4db4-a0d2-a9c9c150d750 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1523 microversion: 2.1 time: 0.151927 Oct 28 14:12:02.967321 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3606/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:02 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:03.989606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:03.990270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:03.997220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:03.997737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:03.998192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:03.998939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:03.999417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:03.999864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:04.137272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:04.145055 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c698aee-92a3-4253-9292-978ad8f3faca tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1522 microversion: 2.1 time: 0.159443 Oct 28 14:12:04.145667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3517/7123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:03 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:04.824071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-60995d86-a83f-441a-aa1b-9d26a7017ae1 req-81dc56b9-c01d-4cd8-8b9a-f9e641aaf2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b8fa0-2818-4285-9cb7-e9f7f462b878", "name": "network-vif-unplugged", "status": "completed", "tag": "2cc811b3-a6b6-4a56-beee-b716bacd991f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:04.834225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-60995d86-a83f-441a-aa1b-9d26a7017ae1 req-81dc56b9-c01d-4cd8-8b9a-f9e641aaf2b2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:04.834782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-60995d86-a83f-441a-aa1b-9d26a7017ae1 req-81dc56b9-c01d-4cd8-8b9a-f9e641aaf2b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:04.835222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-60995d86-a83f-441a-aa1b-9d26a7017ae1 req-81dc56b9-c01d-4cd8-8b9a-f9e641aaf2b2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:04.846662 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-60995d86-a83f-441a-aa1b-9d26a7017ae1 req-81dc56b9-c01d-4cd8-8b9a-f9e641aaf2b2 service nova] Creating event network-vif-unplugged:2cc811b3-a6b6-4a56-beee-b716bacd991f for instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 on n-h2-862876-2 Oct 28 14:12:04.852056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-60995d86-a83f-441a-aa1b-9d26a7017ae1 req-81dc56b9-c01d-4cd8-8b9a-f9e641aaf2b2 service nova] Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:12:04.863266 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-60995d86-a83f-441a-aa1b-9d26a7017ae1 req-81dc56b9-c01d-4cd8-8b9a-f9e641aaf2b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042866 Oct 28 14:12:04.863854 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3607/7124] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:12:05.169561 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:05.170237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:05.177482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:05.178036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:05.178498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:05.179415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:05.179891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:05.180377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:05.315276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:05.323291 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-db5e2dd7-bc70-40cf-9a79-fbc7f4b3d6ed tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1522 microversion: 2.1 time: 0.158309 Oct 28 14:12:05.334764 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3518/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:05 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:06.348469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:06.349090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:06.355836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:06.356354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:06.356794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:06.357480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:06.357938 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:06.358365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:06.503447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:06.503447 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1f2b40f-7207-4f72-9e36-22e76b08fa7c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1520 microversion: 2.1 time: 0.153615 Oct 28 14:12:06.503447 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3608/7126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:06 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:06.877432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0e05f077-4661-4572-95f3-75f64a6b14aa req-64770dc0-9832-438b-8dfd-46a7ef1644ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4b8fa0-2818-4285-9cb7-e9f7f462b878", "tag": "2cc811b3-a6b6-4a56-beee-b716bacd991f"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:06.888400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0e05f077-4661-4572-95f3-75f64a6b14aa req-64770dc0-9832-438b-8dfd-46a7ef1644ce service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:06.888893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0e05f077-4661-4572-95f3-75f64a6b14aa req-64770dc0-9832-438b-8dfd-46a7ef1644ce service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:06.889339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0e05f077-4661-4572-95f3-75f64a6b14aa req-64770dc0-9832-438b-8dfd-46a7ef1644ce service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:06.904268 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0e05f077-4661-4572-95f3-75f64a6b14aa req-64770dc0-9832-438b-8dfd-46a7ef1644ce service nova] Creating event network-changed:2cc811b3-a6b6-4a56-beee-b716bacd991f for instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 on n-h2-862876-2 Oct 28 14:12:06.909590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-0e05f077-4661-4572-95f3-75f64a6b14aa req-64770dc0-9832-438b-8dfd-46a7ef1644ce service nova] Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:12:06.920442 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0e05f077-4661-4572-95f3-75f64a6b14aa req-64770dc0-9832-438b-8dfd-46a7ef1644ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046905 Oct 28 14:12:06.921042 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3519/7127] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:12:07.522808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:07.522808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:07.528372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:07.528868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:07.529301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:07.530024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:07.530697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:07.531321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:07.785842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:07.794116 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f484a0f0-dfd0-42fc-87a3-6539850d3d69 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1520 microversion: 2.1 time: 0.278016 Oct 28 14:12:07.794719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3609/7128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:07 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:08.821784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:08.822423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:08.828568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:08.829061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:08.829519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:08.830217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:08.830684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:08.831145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:08.959301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:08.967481 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3c03e123-18db-4733-9b68-aa78d6767325 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1517 microversion: 2.1 time: 0.150909 Oct 28 14:12:08.968050 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3520/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:08 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:08.990198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:08.990736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:08.996859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:08.997337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:08.997768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:08.998450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:08.998936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:08.999360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:09.179479 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2908307a-4b78-4dc5-beda-7cf5cb382892 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "POST /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878/action" status: 204 len: 0 microversion: 2.1 time: 0.192920 Oct 28 14:12:09.180135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3610/7130] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:12:08 2022] POST /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878/action => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:12:09.188318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:09.188949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:09.195179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:09.195679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:09.196129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:09.196837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:09.197306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:09.197746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:09.334973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:09.343845 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3afd57a5-946a-4dd2-85ba-e1bbab1b6802 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1517 microversion: 2.1 time: 0.159391 Oct 28 14:12:09.344359 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3521/7131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:09 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:10.368357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:10.369098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:10.375249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:10.375742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:10.376184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:10.376883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:10.377341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:10.377840 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:10.517423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:10.525609 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7094dc1c-824a-4cc3-88ad-6a3c59fc1755 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1517 microversion: 2.1 time: 0.162444 Oct 28 14:12:10.526233 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3611/7132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:10 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:11.549824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:11.550458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:11.557251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:11.557748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:11.558200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:11.558939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:11.560051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:11.560490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:11.686203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:11.694210 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f3b3973a-ae5b-419c-ae04-5fec36007f23 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1509 microversion: 2.1 time: 0.148348 Oct 28 14:12:11.694799 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3522/7133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:11 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:11.717024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:11.717655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:11.724370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:11.724851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:11.725281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:11.725960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:11.726417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:11.726867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:11.852003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:11.860300 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-540b2d9e-3c62-4486-8bbc-41fa11e40d7d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1509 microversion: 2.1 time: 0.147712 Oct 28 14:12:11.860863 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3612/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:11 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:11.885266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6ae98676-80d7-42d2-a7de-4ae94eb6e84e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'create', calling method: .version_select at 0x7f27b88749d0>, body: {"keypair": {"name": "tempest-keypair-471184391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4tm1IiQZoGA2gInR91uvH5CRvHsVk19qLWNH1KJpSlP4un46S28wOUDUX2oIEP5axvFzKImAC3nC32chd/0yZjQBwY7bXEvFzkBto/d+9kSkSWmtW5yTZHCarXdLTBOw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:11.900421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6ae98676-80d7-42d2-a7de-4ae94eb6e84e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Getting quotas for project b797bab260604655a8031e3637fe1d1d. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:12:11.906255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-6ae98676-80d7-42d2-a7de-4ae94eb6e84e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Getting quotas for user 0eedbe4226dd4309bbac8b853a77630c and project b797bab260604655a8031e3637fe1d1d. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:12:11.920184 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ae98676-80d7-42d2-a7de-4ae94eb6e84e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [8e9a6bd9-dc6c-4f2b-8c2d-cf48bf23457e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:12:12.360888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5dd7ee8e-4324-479a-80c1-dfe254861232 req-df400b97-4cba-4184-a41d-70e39b9585db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b8fa0-2818-4285-9cb7-e9f7f462b878", "name": "network-vif-plugged", "status": "completed", "tag": "2cc811b3-a6b6-4a56-beee-b716bacd991f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:12.370211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5dd7ee8e-4324-479a-80c1-dfe254861232 req-df400b97-4cba-4184-a41d-70e39b9585db service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:12.370677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5dd7ee8e-4324-479a-80c1-dfe254861232 req-df400b97-4cba-4184-a41d-70e39b9585db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:12.371127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5dd7ee8e-4324-479a-80c1-dfe254861232 req-df400b97-4cba-4184-a41d-70e39b9585db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:12.385097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5dd7ee8e-4324-479a-80c1-dfe254861232 req-df400b97-4cba-4184-a41d-70e39b9585db service nova] Creating event network-vif-plugged:2cc811b3-a6b6-4a56-beee-b716bacd991f for instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 on n-h2-862876-2 Oct 28 14:12:12.390541 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5dd7ee8e-4324-479a-80c1-dfe254861232 req-df400b97-4cba-4184-a41d-70e39b9585db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093065 Oct 28 14:12:12.391159 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3613/7135] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:12:12.927166 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ae98676-80d7-42d2-a7de-4ae94eb6e84e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [8e9a6bd9-dc6c-4f2b-8c2d-cf48bf23457e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 51998. Oct 28 14:12:13.004505 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6ae98676-80d7-42d2-a7de-4ae94eb6e84e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.123079 Oct 28 14:12:13.005143 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3523/7136] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:12:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:12:14.881730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:14.882422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:14.889470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:14.889950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:14.890383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:14.891096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:14.891537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:14.891952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:15.020512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:15.028364 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-646705b7-b218-47f5-9e13-a7aa0c8a479f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 200 len: 1509 microversion: 2.1 time: 0.150916 Oct 28 14:12:15.028940 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3614/7137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:14 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:15.052167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:15.052689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:15.058547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:15.059078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:15.059531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:15.060231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:15.060701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:15.061140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:15.085819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:12:15.300745 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cb377a46-b58c-4c80-ac15-e29fea403608 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 204 len: 0 microversion: 2.1 time: 0.253513 Oct 28 14:12:15.301400 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3524/7138] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:12:15 2022] DELETE /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:12:15.359765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1736071710", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "177076c2-0cf2-439a-bc1b-bad92858873a"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:15.412782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] validate_networks() for [('177076c2-0cf2-439a-bc1b-bad92858873a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:12:15.820522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:12:15.820949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:12:15.821428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:12:15.821836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:12:15.822257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:12:15.831324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:15.831886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:15.832330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:15.833053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:15.833550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:15.833937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:15.851256 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Getting quotas for project b797bab260604655a8031e3637fe1d1d. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:12:15.856389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Getting quotas for user 0eedbe4226dd4309bbac8b853a77630c and project b797bab260604655a8031e3637fe1d1d. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:12:15.869293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:12:15.871712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:12:15.987753 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e8f380de-016e-4811-a97b-e4fcf13a0b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631846 Oct 28 14:12:15.988725 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3615/7139] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:12:16.000885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e87787b-7cfb-4928-a52a-bba977057439 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:16.001621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e87787b-7cfb-4928-a52a-bba977057439 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:16.059145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e87787b-7cfb-4928-a52a-bba977057439 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:16.067905 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e87787b-7cfb-4928-a52a-bba977057439 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1218 microversion: 2.1 time: 0.071825 Oct 28 14:12:16.068489 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3525/7140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:15 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:17.065058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-77e50574-0d42-43e7-935b-4dbe5df0f6cc req-be55f5fc-c45b-4ee0-93c4-b8189378b109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4b8fa0-2818-4285-9cb7-e9f7f462b878", "name": "network-vif-deleted", "tag": "2cc811b3-a6b6-4a56-beee-b716bacd991f"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:17.071072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:17.080060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-77e50574-0d42-43e7-935b-4dbe5df0f6cc req-be55f5fc-c45b-4ee0-93c4-b8189378b109 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:17.080060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-77e50574-0d42-43e7-935b-4dbe5df0f6cc req-be55f5fc-c45b-4ee0-93c4-b8189378b109 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:17.080060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-77e50574-0d42-43e7-935b-4dbe5df0f6cc req-be55f5fc-c45b-4ee0-93c4-b8189378b109 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:17.080760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:17.089671 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-77e50574-0d42-43e7-935b-4dbe5df0f6cc req-be55f5fc-c45b-4ee0-93c4-b8189378b109 service nova] Creating event network-vif-deleted:2cc811b3-a6b6-4a56-beee-b716bacd991f for instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 on n-h2-862876-2 Oct 28 14:12:17.092140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:17.092781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:17.100686 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-77e50574-0d42-43e7-935b-4dbe5df0f6cc req-be55f5fc-c45b-4ee0-93c4-b8189378b109 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042098 Oct 28 14:12:17.101571 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3616/7141] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:12:17.107037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:17.110221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:17.110221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:17.110221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:17.110221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:17.110221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:17.188964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:17.195120 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-97ace878-1958-4558-a0c6-4fbfe878e4c4 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1222 microversion: 2.1 time: 0.107146 Oct 28 14:12:17.195715 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3526/7142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:17 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:12:18.220427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:18.221901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:18.231252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:18.231895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:18.232616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:18.233398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:18.234061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:18.234602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:18.556502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:18.565094 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d0f68b3-edab-4819-88e3-a1d72af3b743 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1288 microversion: 2.1 time: 0.349478 Oct 28 14:12:18.565675 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3617/7143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:18 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1288 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:19.589221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:19.589898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:19.593412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:19.598118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:19.598626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:19.599130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:19.599845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:19.600325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:19.600769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:19.732868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:19.740834 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-87d6c0d1-0805-47ae-b6c8-5a77da917cf3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1318 microversion: 2.1 time: 0.155790 Oct 28 14:12:19.741712 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3527/7144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:19 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:20.008502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-68feb031-25c2-4fe5-9004-3992584bd9a8 req-c5255c54-7011-4464-864b-033b225c788f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b79b43b-b385-42ce-b918-86f5638c3850", "tag": "09262965-0964-4c49-8c0e-04972f4c7afa"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:20.020260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68feb031-25c2-4fe5-9004-3992584bd9a8 req-c5255c54-7011-4464-864b-033b225c788f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:20.020741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68feb031-25c2-4fe5-9004-3992584bd9a8 req-c5255c54-7011-4464-864b-033b225c788f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:20.021177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-68feb031-25c2-4fe5-9004-3992584bd9a8 req-c5255c54-7011-4464-864b-033b225c788f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:20.032106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-68feb031-25c2-4fe5-9004-3992584bd9a8 req-c5255c54-7011-4464-864b-033b225c788f service nova] Creating event network-changed:09262965-0964-4c49-8c0e-04972f4c7afa for instance 5b79b43b-b385-42ce-b918-86f5638c3850 on n-h1-862876-2 Oct 28 14:12:20.036942 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-68feb031-25c2-4fe5-9004-3992584bd9a8 req-c5255c54-7011-4464-864b-033b225c788f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032367 Oct 28 14:12:20.038144 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3618/7145] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:12:20.763548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:20.764184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:20.771356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:20.771857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:20.772310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:20.773016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:20.773490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:20.773933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:20.776502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:20.906495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:20.914005 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-40043b08-3c1e-4c76-8317-c9d185c6ba64 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1318 microversion: 2.1 time: 0.154497 Oct 28 14:12:20.914577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3528/7146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:20 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:21.937907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:21.938609 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:21.945838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:21.946319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:21.946775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:21.947455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:21.947902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:21.948321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:22.075766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:22.083387 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7cd80b28-7c8c-4a7f-b6d0-bfab3879cc74 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1318 microversion: 2.1 time: 0.150363 Oct 28 14:12:22.083950 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3619/7147] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:21 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:23.106553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:23.107228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:23.115038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:23.115548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:23.116004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:23.116719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:23.117201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:23.117650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:23.245387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:23.253741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-202600cb-87b9-4566-aef6-d28bd9cbb35c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1318 microversion: 2.1 time: 0.151150 Oct 28 14:12:23.254319 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3529/7148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:23 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:24.275970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:24.276575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:24.284417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:24.284898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:24.285329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:24.286012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:24.286456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:24.286906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:24.367772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e08ee44d-33a8-426a-b61a-6f3f261c623d req-cdffb685-5228-48e4-8d8e-2b46558010cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b79b43b-b385-42ce-b918-86f5638c3850", "name": "network-vif-plugged", "status": "completed", "tag": "09262965-0964-4c49-8c0e-04972f4c7afa"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:24.386653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e08ee44d-33a8-426a-b61a-6f3f261c623d req-cdffb685-5228-48e4-8d8e-2b46558010cd service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:24.387180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e08ee44d-33a8-426a-b61a-6f3f261c623d req-cdffb685-5228-48e4-8d8e-2b46558010cd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:24.387622 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e08ee44d-33a8-426a-b61a-6f3f261c623d req-cdffb685-5228-48e4-8d8e-2b46558010cd service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:24.400077 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e08ee44d-33a8-426a-b61a-6f3f261c623d req-cdffb685-5228-48e4-8d8e-2b46558010cd service nova] Creating event network-vif-plugged:09262965-0964-4c49-8c0e-04972f4c7afa for instance 5b79b43b-b385-42ce-b918-86f5638c3850 on n-h1-862876-2 Oct 28 14:12:24.405170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e08ee44d-33a8-426a-b61a-6f3f261c623d req-cdffb685-5228-48e4-8d8e-2b46558010cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045120 Oct 28 14:12:24.405831 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3530/7149] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:12:24.431222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:24.440478 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-64b7b60c-38a2-4ec9-92e4-db822c26e738 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1318 microversion: 2.1 time: 0.168414 Oct 28 14:12:24.441075 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3620/7150] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:24 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:12:25.466631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:25.467444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:25.475538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:25.476212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:25.476725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:25.477549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:25.478029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:25.478465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:25.618399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:25.621977 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-659dca37-6155-41ae-93ae-3474fc3b57c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1318 microversion: 2.1 time: 0.161030 Oct 28 14:12:25.622545 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3531/7151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:25 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:26.645461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:26.646083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:26.648940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:26.649641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:26.654486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:26.654997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:26.655433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:26.656617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:26.657069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:26.657491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:26.788427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:26.796113 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1209574a-0ecb-4059-bd44-aecaa2fe170d tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1509 microversion: 2.1 time: 0.155374 Oct 28 14:12:26.796631 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3621/7152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:26 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:26.819204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:26.819840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:26.821796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:26.823406 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:12:26.828727 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:12:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 (ip 10.222.0.25) !!! Oct 28 14:12:26.835490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:26.835991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:26.836439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:26.837143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:26.837610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:26.838048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:26.970626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:26.978496 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f7c3bc3c-813d-4e14-961c-f73a282c7b9e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1509 microversion: 2.1 time: 0.163483 Oct 28 14:12:26.979104 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3532/7153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:26 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:27.000470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:12:27.002854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:27.008691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:27.009165 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:27.009593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:27.010270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:27.010719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:27.011162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:27.040475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:27.046078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Old instance type m1.heat2, new instance type m1.heat {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:12:27.055267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:12:27.055267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:12:27.055267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:12:27.055267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:12:27.055267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:12:27.194850 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e673d7a3-e899-4661-87f5-d146882ac312 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "POST /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850/action" status: 202 len: 0 microversion: 2.1 time: 0.198205 Oct 28 14:12:27.195743 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3622/7154] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:12:26 2022] POST /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:12:27.204350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:27.205167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:27.211037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:27.211626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:27.212079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:27.212786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:27.213254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:27.213694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:27.348325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:27.356789 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5684da0e-3d5e-4f20-8a49-b85a3ea0f9e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1516 microversion: 2.1 time: 0.156892 Oct 28 14:12:27.357379 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3533/7155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:27 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:28.380050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:28.380648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:28.383784 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:12:28.383928 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:12:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 (ip 10.222.0.25) !!! Oct 28 14:12:28.396120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:28.396656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:28.397094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:28.397799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:28.398257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:28.404935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:28.538828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:28.547858 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6af241d1-ab8e-4acd-9e89-8af12a2581ee tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1516 microversion: 2.1 time: 0.171678 Oct 28 14:12:28.548452 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3623/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:28 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:29.572349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:29.574493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:29.579587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:29.580103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:29.580557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:29.581274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:29.581751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:29.582199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:29.714507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:29.722832 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da7b302b-2209-41bf-aa9a-e6edfb0bfc3a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1516 microversion: 2.1 time: 0.154374 Oct 28 14:12:29.723421 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3534/7157] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:29 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:30.746982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:30.747627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:30.755246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:30.755732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:30.756168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:30.756850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:30.757302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:30.757725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:30.886782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:30.894409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20f000a7-363d-41ed-b68a-ffb90d6c3785 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.151392 Oct 28 14:12:30.895023 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3624/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:30 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:31.917824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:31.918458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:31.925249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:31.925745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:31.926191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:31.926920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:31.927387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:31.927826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:32.053785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:32.061445 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4f028481-5ae0-4179-b23b-a92ecf177d83 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.147539 Oct 28 14:12:32.062018 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3535/7159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:31 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:33.085270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:33.085800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:33.092679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:33.093167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:33.093606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:33.094298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:33.094793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:33.095229 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:33.224976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:33.232613 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-83ca74bc-3a0e-4377-b565-714c2ea64124 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.151313 Oct 28 14:12:33.233184 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3625/7160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:33 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:34.256587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:34.257220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:34.264116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:34.264620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:34.265076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:34.265782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:34.266255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:34.266699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:34.399371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:34.407061 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a9e94935-05de-42a6-ae85-65bbafb32c17 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.154435 Oct 28 14:12:34.407700 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3536/7161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:34 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:35.433818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:35.434432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:35.441821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:35.442296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:35.442760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:35.443423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:35.443874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:35.444326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:35.576047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:35.583706 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-302b4022-2b5a-4750-8426-48d030f97791 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.153890 Oct 28 14:12:35.584275 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3626/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:35 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:36.606467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:36.607128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:36.613863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:36.614363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:36.614846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:36.615548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:36.616018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:36.616453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:36.744189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:36.752020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-80193343-29a3-44e1-8422-ae58301f2279 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.149390 Oct 28 14:12:36.753223 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3537/7163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:36 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:37.775063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:37.775670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:37.782453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:37.782968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:37.783397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:37.784701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:37.785151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:37.785567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:37.913107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:37.920679 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fd55ec3c-bf58-4cb8-82b2-eac88abce6fc tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.149572 Oct 28 14:12:37.921244 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3627/7164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:37 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:38.944007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:38.944641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:38.950866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:38.953870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:38.953870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:38.953870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:38.953870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:38.953870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:39.085262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:39.093119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0eb76785-bf93-4a26-8721-3c22fae10108 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.153453 Oct 28 14:12:39.093695 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3538/7165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:38 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:40.117592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:40.118270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:40.124223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:40.124705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:40.125150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:40.125834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:40.126288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:40.126711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:40.255965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:40.263664 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-145794a2-e4a0-4f15-be44-a74e66a318eb tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.150278 Oct 28 14:12:40.264244 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3628/7166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:40 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:41.288496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:41.289128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:41.295903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:41.296402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:41.296856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:41.297562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:41.298036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:41.298473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:41.427386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:41.435384 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6d949932-c2d8-44b3-90a7-355a6cf25c19 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.150863 Oct 28 14:12:41.435959 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3539/7167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:41 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:42.459848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:42.460442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:42.467239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:42.467722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:42.468152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:42.468828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:42.469280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:42.469697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:42.598438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:42.606016 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dfdbec30-75ed-4846-930d-f25759cca605 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.150035 Oct 28 14:12:42.606604 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3629/7168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:42 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:43.629520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:43.630140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:43.636956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:43.638003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:43.638453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:43.639187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:43.639658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:43.640099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:43.769690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:43.777424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-677cd64d-e441-44fd-bcaa-de3792a96720 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.151852 Oct 28 14:12:43.778034 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3540/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:43 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:44.801604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:44.802145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:44.808943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:44.809425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:44.809860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:44.810542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:44.811021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:44.811445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:44.943476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:44.951137 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8fe4b23-b8a8-4725-8b8c-881438607c0e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.154065 Oct 28 14:12:44.951705 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3630/7170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:44 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:45.973811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:45.974451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:45.981346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:45.981851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:45.982306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:45.983036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:45.983518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:45.983963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:46.115760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:46.123426 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8114eaf4-d016-469e-930c-71c9b0bbb7e8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.153574 Oct 28 14:12:46.123995 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3541/7171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:45 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:47.146047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:47.146661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:47.153437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:47.153925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:47.154359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:47.155073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:47.155534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:47.155958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:47.283041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:47.290702 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f50815f-50d4-4646-b45b-11d5cf6d2921 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.149209 Oct 28 14:12:47.291297 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3631/7172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:47 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:48.313499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:48.314135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:48.321313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:48.321823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:48.322278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:48.323014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:48.323487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:48.323928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:48.454312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:48.464917 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a14562e1-6aa1-4a55-bc19-741752fd931e tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.155285 Oct 28 14:12:48.465499 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3542/7173] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:48 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:49.489842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:49.490450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:49.493251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=36 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:49.498161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:49.498644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:49.499097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:49.499777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:49.500225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:49.500642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:49.505177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:49.629951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:49.637798 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-231311ba-05ab-4f2f-a05d-b8203a072c06 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.152390 Oct 28 14:12:49.638372 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3632/7174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:49 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:50.661433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:50.662062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:50.669006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:50.669502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:50.669976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:50.670675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:50.671167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:50.671610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:50.803710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:50.811566 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b0e72de-3a54-4748-a3ee-e8d7f14780e0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.154204 Oct 28 14:12:50.812149 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3543/7175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:50 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:51.835901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:51.836442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:51.843227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:51.843704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:51.844137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:51.844817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:51.845265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:51.845686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:51.979181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:51.986937 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b4728b0-14b2-450a-9cc0-79f28ce59a2c tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.155420 Oct 28 14:12:51.987529 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3633/7176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:51 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:53.009974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:53.010625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:53.013358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=34 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:53.018083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:53.018590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:53.019699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:53.020413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:53.020896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:53.021350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:53.149080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:53.156939 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da6336e6-b9f2-423a-881c-bb30db4ddd82 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.150866 Oct 28 14:12:53.157516 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3544/7177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:53 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:54.180115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:54.180726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:54.187448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:54.187927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:54.188359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:54.189040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:54.189492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:54.189909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:54.317372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:54.324990 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-976de660-c376-44b4-b1aa-7d4fb6c350b3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.148828 Oct 28 14:12:54.325556 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3634/7178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:54 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:55.349120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:55.349763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:55.356713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:55.357223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:55.357682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:55.358406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:55.358924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:55.359377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:55.361928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:12:55.491882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:55.499596 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b482bd53-579f-46c6-9e63-d53439d8f2a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.154931 Oct 28 14:12:55.500266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3545/7179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:55 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:56.522216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:56.522854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:56.529848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:56.530342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:56.530940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:56.531634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:56.532084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:56.532504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:56.666884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:56.674730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f5c33141-f7bb-4a71-b525-bbd88b187040 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.156472 Oct 28 14:12:56.675911 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3635/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:56 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:57.697974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:57.698611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:57.705439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:57.705936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:57.706388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:57.707123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:57.707594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:57.708029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:57.840115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:57.847834 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-52fa8e09-5794-4bdc-b689-2739530ed4c6 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.153805 Oct 28 14:12:57.848415 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3546/7181] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:57 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:12:58.871608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:12:58.872134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:12:58.879503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:58.880080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:58.880512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:58.881187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:12:58.881633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:12:58.882049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:12:59.008112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:12:59.015706 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d75e1208-efc4-4854-835d-6d3a103994b9 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.148118 Oct 28 14:12:59.016281 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3636/7182] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:12:58 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:00.039958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:00.040593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:00.047385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:00.047887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:00.048342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:00.049051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:00.049526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:00.049970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:00.178267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:00.186112 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-03220160-ac7b-48b0-be00-d6ed7fd5d329 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.150650 Oct 28 14:13:00.186685 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3547/7183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:00 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:01.209536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:01.210175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:01.217133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:01.217615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:01.218050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:01.218735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:01.219217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:01.219647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:01.352296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:01.360028 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ba22e2e5-57f0-4077-a1c3-378b8c380b34 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1521 microversion: 2.1 time: 0.154548 Oct 28 14:13:01.360602 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3637/7184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:01 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:02.388908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:02.388908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:02.394383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:02.394881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:02.395346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:02.396232 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:02.396782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:02.397267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:02.560037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:02.575078 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b8e78fce-79cf-4ba3-ba38-ab623f56700f tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1520 microversion: 2.1 time: 0.193140 Oct 28 14:13:02.576664 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3548/7185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:02 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:02.788612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a6d00e93-e088-494c-9754-c83c355e7ecd req-d3f6f704-13c2-47bf-b9cb-b98a2cf21718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b79b43b-b385-42ce-b918-86f5638c3850", "name": "network-vif-unplugged", "status": "completed", "tag": "09262965-0964-4c49-8c0e-04972f4c7afa"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:02.799069 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a6d00e93-e088-494c-9754-c83c355e7ecd req-d3f6f704-13c2-47bf-b9cb-b98a2cf21718 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:02.799576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a6d00e93-e088-494c-9754-c83c355e7ecd req-d3f6f704-13c2-47bf-b9cb-b98a2cf21718 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:02.799994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a6d00e93-e088-494c-9754-c83c355e7ecd req-d3f6f704-13c2-47bf-b9cb-b98a2cf21718 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:02.811558 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a6d00e93-e088-494c-9754-c83c355e7ecd req-d3f6f704-13c2-47bf-b9cb-b98a2cf21718 service nova] Creating event network-vif-unplugged:09262965-0964-4c49-8c0e-04972f4c7afa for instance 5b79b43b-b385-42ce-b918-86f5638c3850 on n-h2-862876-2 Oct 28 14:13:02.817591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-a6d00e93-e088-494c-9754-c83c355e7ecd req-d3f6f704-13c2-47bf-b9cb-b98a2cf21718 service nova] Instance 5b79b43b-b385-42ce-b918-86f5638c3850 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:13:02.828368 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a6d00e93-e088-494c-9754-c83c355e7ecd req-d3f6f704-13c2-47bf-b9cb-b98a2cf21718 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043576 Oct 28 14:13:02.828967 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3638/7186] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:13:03.598566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:03.599886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:03.606649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:03.608109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:03.608109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:03.608381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:03.608791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:03.609237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:03.741346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:03.749111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b433ad4f-dc52-4b96-b4d6-64e92aa17901 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1520 microversion: 2.1 time: 0.154980 Oct 28 14:13:03.749684 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3549/7187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:03 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:04.775218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:04.775922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:04.782080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:04.782563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:04.783027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:04.783714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:04.784166 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:04.784592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:04.843085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-054063e7-2162-4565-8763-22187629284c req-2acd5799-9be1-4041-9805-d4141d91441f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b79b43b-b385-42ce-b918-86f5638c3850", "tag": "09262965-0964-4c49-8c0e-04972f4c7afa"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:04.854044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-054063e7-2162-4565-8763-22187629284c req-2acd5799-9be1-4041-9805-d4141d91441f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:04.854540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-054063e7-2162-4565-8763-22187629284c req-2acd5799-9be1-4041-9805-d4141d91441f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:04.855020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-054063e7-2162-4565-8763-22187629284c req-2acd5799-9be1-4041-9805-d4141d91441f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:04.867266 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-054063e7-2162-4565-8763-22187629284c req-2acd5799-9be1-4041-9805-d4141d91441f service nova] Creating event network-changed:09262965-0964-4c49-8c0e-04972f4c7afa for instance 5b79b43b-b385-42ce-b918-86f5638c3850 on n-h2-862876-2 Oct 28 14:13:04.872567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-054063e7-2162-4565-8763-22187629284c req-2acd5799-9be1-4041-9805-d4141d91441f service nova] Instance 5b79b43b-b385-42ce-b918-86f5638c3850 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:13:04.883417 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-054063e7-2162-4565-8763-22187629284c req-2acd5799-9be1-4041-9805-d4141d91441f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043985 Oct 28 14:13:04.884201 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3550/7188] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:13:04.953697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:04.962097 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad09dc8e-2176-44ce-a377-93540d4767f0 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1518 microversion: 2.1 time: 0.192285 Oct 28 14:13:04.962704 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3639/7189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:04 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:05.986047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:05.986711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:05.993967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:05.994467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:05.994950 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:05.995662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:05.996134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:05.996571 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:06.136076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:06.139704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-180e206b-9f69-4436-8000-0d7c82b1eb05 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1515 microversion: 2.1 time: 0.157950 Oct 28 14:13:06.140296 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3551/7190] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:05 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:06.163310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:06.163862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:06.170394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:06.170899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:06.171336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:06.172056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:06.172509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:06.172929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:06.379517 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2aeb022a-450c-41a5-a3ec-72f210915181 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "POST /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850/action" status: 204 len: 0 microversion: 2.1 time: 0.220056 Oct 28 14:13:06.380660 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3640/7191] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:13:06 2022] POST /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850/action => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:13:06.388866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:06.389512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:06.396080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:06.396586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:06.397037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:06.397750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:06.398219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:06.398661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:06.544028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:06.553419 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5f561c04-8ae7-427f-8870-13ce8afd3e93 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1515 microversion: 2.1 time: 0.168940 Oct 28 14:13:06.554281 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3552/7192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:06 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:07.578032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:07.578821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:07.586316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:07.586826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:07.587265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:07.587972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:07.588421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:07.588870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:08.046866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:08.055152 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c21ac12-2c20-4cfa-9bb8-74c92e242243 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1515 microversion: 2.1 time: 0.481400 Oct 28 14:13:08.055728 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3641/7193] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:07 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1515 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:08.630131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-73d6fced-4559-4b2f-b9fc-094687f18d6d req-035951b5-7279-4954-9b70-4e3f4149198d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b79b43b-b385-42ce-b918-86f5638c3850", "name": "network-vif-plugged", "status": "completed", "tag": "09262965-0964-4c49-8c0e-04972f4c7afa"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:08.642688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73d6fced-4559-4b2f-b9fc-094687f18d6d req-035951b5-7279-4954-9b70-4e3f4149198d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:08.643845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73d6fced-4559-4b2f-b9fc-094687f18d6d req-035951b5-7279-4954-9b70-4e3f4149198d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:08.644378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-73d6fced-4559-4b2f-b9fc-094687f18d6d req-035951b5-7279-4954-9b70-4e3f4149198d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:08.656506 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-73d6fced-4559-4b2f-b9fc-094687f18d6d req-035951b5-7279-4954-9b70-4e3f4149198d service nova] Creating event network-vif-plugged:09262965-0964-4c49-8c0e-04972f4c7afa for instance 5b79b43b-b385-42ce-b918-86f5638c3850 on n-h2-862876-2 Oct 28 14:13:08.661431 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-73d6fced-4559-4b2f-b9fc-094687f18d6d req-035951b5-7279-4954-9b70-4e3f4149198d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040806 Oct 28 14:13:08.662048 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3553/7194] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:13:09.078350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:09.078990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:09.085178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.085659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.086098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.086808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.087266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.087687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.218370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:09.226069 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1064251-c3d3-48dd-b6d8-2fc95287a1a3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1507 microversion: 2.1 time: 0.151611 Oct 28 14:13:09.227172 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3642/7195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:09 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:09.250182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:09.250943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:09.257289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.257791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.258246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.259007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.259480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.260103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.392562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:09.400371 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-058af70b-e30f-42c2-b28c-697c07420ab8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1507 microversion: 2.1 time: 0.154729 Oct 28 14:13:09.400951 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3554/7196] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:09 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:09.422918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:09.423533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:09.429472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.430586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.431040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.431722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.432169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.432585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.566041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:09.573735 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f6590a1-b295-4760-bb8d-1d6d76df81de tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1507 microversion: 2.1 time: 0.154800 Oct 28 14:13:09.574310 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3643/7197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:09 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:09.596673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:09.597134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:09.604009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.604520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.605021 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.605742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:09.606221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:09.606668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:09.631393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:13:09.980106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00a1ee06-42e0-4774-bb24-792e1c5b6580 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 204 len: 0 microversion: 2.1 time: 0.387130 Oct 28 14:13:09.980704 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3555/7198] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:13:09 2022] DELETE /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:13:09.998078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:09.998577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:10.004694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:10.005173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:10.005608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:10.006292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:10.006767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:10.007191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:10.033142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:13:10.076419 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.compute.api [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Instance is already in deleting state, ignoring this request Oct 28 14:13:10.077232 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1aa1665-3ff4-4df9-82c9-5728f1b6a3c3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 204 len: 0 microversion: 2.1 time: 0.083163 Oct 28 14:13:10.077788 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3644/7199] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:13:09 2022] DELETE /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 14:13:10.086951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:10.087678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:10.093583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:10.094088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:10.094545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:10.095290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:10.095765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:10.096210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:10.224919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:10.232659 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e6d5585c-7ffa-4291-a4e0-07e58bcaa24a tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1513 microversion: 2.1 time: 0.150519 Oct 28 14:13:10.233175 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3556/7200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:10 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:11.256914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:11.257525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:11.264437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:11.264921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:11.265357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:11.266044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:11.266503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:11.266960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:11.481162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eedbe4226dd4309bbac8b853a77630c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b797bab260604655a8031e3637fe1d1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:11.489361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9f6015a6-910a-4967-ba6c-ec5afb161ed8 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 200 len: 1513 microversion: 2.1 time: 0.236386 Oct 28 14:13:11.489937 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3645/7201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:11 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:11.886014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9dd16fa4-284b-4728-adc4-a0f5e4540900 req-848db133-17d7-4d9f-8d8a-7c6ec0aa7f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b79b43b-b385-42ce-b918-86f5638c3850", "name": "network-vif-deleted", "tag": "09262965-0964-4c49-8c0e-04972f4c7afa"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:11.897573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9dd16fa4-284b-4728-adc4-a0f5e4540900 req-848db133-17d7-4d9f-8d8a-7c6ec0aa7f03 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:11.898178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9dd16fa4-284b-4728-adc4-a0f5e4540900 req-848db133-17d7-4d9f-8d8a-7c6ec0aa7f03 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:11.898724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9dd16fa4-284b-4728-adc4-a0f5e4540900 req-848db133-17d7-4d9f-8d8a-7c6ec0aa7f03 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:11.910490 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9dd16fa4-284b-4728-adc4-a0f5e4540900 req-848db133-17d7-4d9f-8d8a-7c6ec0aa7f03 service nova] Creating event network-vif-deleted:09262965-0964-4c49-8c0e-04972f4c7afa for instance 5b79b43b-b385-42ce-b918-86f5638c3850 on n-h2-862876-2 Oct 28 14:13:11.915578 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9dd16fa4-284b-4728-adc4-a0f5e4540900 req-848db133-17d7-4d9f-8d8a-7c6ec0aa7f03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035185 Oct 28 14:13:11.916183 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3557/7202] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:13:12.513910 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:12.514452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5b79b43b-b385-42ce-b918-86f5638c3850] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:12.521879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:12.522045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:12.522484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:12.523205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:12.524177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:12.524600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:12.540799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] HTTP exception thrown: Instance 5b79b43b-b385-42ce-b918-86f5638c3850 could not be found. Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Request method failure captured: Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 HTTP/1.1 Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-MC2tv7q7myV-RWCcWrs80qYmqu47XmUWRAmvfVpfTg9HOH5mmg42wc1g-2v1TSpd1M_oQ3nD1168y5jKHr9iNPoX_cPlv8gzVfV1iF70Ml-WUPsGCYovkoLy1Vg5PFnbLdRxhpbSwrl-T6_BX94VNX45vXC2pB5JqlzrYzAdLhUFU Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b797bab260604655a8031e3637fe1d1d Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b797bab260604655a8031e3637fe1d1d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b797bab260604655a8031e3637fe1d1d Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerDiskConfigTestJSON-1533956114-project Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0eedbe4226dd4309bbac8b853a77630c Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerDiskConfigTestJSON-1533956114-project Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 5b79b43b-b385-42ce-b918-86f5638c3850 could not be found. Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '5b79b43b-b385-42ce-b918-86f5638c3850'} Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b79b43b-b385-42ce-b918-86f5638c3850 could not be found. Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b79b43b-b385-42ce-b918-86f5638c3850 could not be found. Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:13:12.542466 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b79b43b-b385-42ce-b918-86f5638c3850 could not be found. Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Returning 404 to user: Instance 5b79b43b-b385-42ce-b918-86f5638c3850 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cb4ad8b1-5834-494c-9c80-c46403ca3410 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850" status: 404 len: 111 microversion: 2.1 time: 0.034978 Oct 28 14:13:12.547188 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3646/7203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:12 2022] GET /compute/v2.1/servers/5b79b43b-b385-42ce-b918-86f5638c3850 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:13:12.553842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-02acf938-0d42-45b1-85e1-9e10cf6e5fa3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '.version_select at 0x7f27b8740430>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:12.651414 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-02acf938-0d42-45b1-85e1-9e10cf6e5fa3 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-471184391" status: 202 len: 0 microversion: 2.1 time: 0.101785 Oct 28 14:13:12.652436 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3558/7204] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Oct 28 14:13:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-471184391 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 14:13:13.390171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:13.390669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:13.396653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:13.397131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:13.397560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:13.398239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:13.399220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:13.399640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:13.403725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:13:13.415815 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] HTTP exception thrown: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Request method failure captured: Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 HTTP/1.1 Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-MC2tv7q7myV-RWCcWrs80qYmqu47XmUWRAmvfVpfTg9HOH5mmg42wc1g-2v1TSpd1M_oQ3nD1168y5jKHr9iNPoX_cPlv8gzVfV1iF70Ml-WUPsGCYovkoLy1Vg5PFnbLdRxhpbSwrl-T6_BX94VNX45vXC2pB5JqlzrYzAdLhUFU Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: b797bab260604655a8031e3637fe1d1d Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b797bab260604655a8031e3637fe1d1d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: b797bab260604655a8031e3637fe1d1d Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerDiskConfigTestJSON-1533956114-project Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0eedbe4226dd4309bbac8b853a77630c Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerDiskConfigTestJSON-1533956114-project Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '5a4b8fa0-2818-4285-9cb7-e9f7f462b878'} Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:13:13.417332 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Returning 404 to user: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cf813cac-10b4-4881-8525-3aabd2271e24 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 404 len: 111 microversion: 2.1 time: 0.032468 Oct 28 14:13:13.425376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3647/7205] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:13:13 2022] DELETE /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:13:13.428194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:13.428991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] [instance: 5a4b8fa0-2818-4285-9cb7-e9f7f462b878] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:13.435778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:13.436282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:13.436760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:13.437466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:13.437941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:13.438380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:13.452244 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] HTTP exception thrown: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Request method failure captured: Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 HTTP/1.1 Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-MC2tv7q7myV-RWCcWrs80qYmqu47XmUWRAmvfVpfTg9HOH5mmg42wc1g-2v1TSpd1M_oQ3nD1168y5jKHr9iNPoX_cPlv8gzVfV1iF70Ml-WUPsGCYovkoLy1Vg5PFnbLdRxhpbSwrl-T6_BX94VNX45vXC2pB5JqlzrYzAdLhUFU Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: b797bab260604655a8031e3637fe1d1d Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b797bab260604655a8031e3637fe1d1d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b797bab260604655a8031e3637fe1d1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: b797bab260604655a8031e3637fe1d1d Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1533956114 Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerDiskConfigTestJSON-1533956114-project Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 0eedbe4226dd4309bbac8b853a77630c Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerDiskConfigTestJSON-1533956114-project Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '5a4b8fa0-2818-4285-9cb7-e9f7f462b878'} Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:13:13.453910 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] Returning 404 to user: Instance 5a4b8fa0-2818-4285-9cb7-e9f7f462b878 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f6f7a94-e74c-442d-9a27-0686be0f8003 tempest-ServerDiskConfigTestJSON-1533956114 tempest-ServerDiskConfigTestJSON-1533956114-project] 10.222.0.25 "GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878" status: 404 len: 111 microversion: 2.1 time: 0.031937 Oct 28 14:13:13.458502 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3559/7206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:13 2022] GET /compute/v2.1/servers/5a4b8fa0-2818-4285-9cb7-e9f7f462b878 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:13:24.497045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=31 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:13:24.615934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-175436e3-676f-4c38-8d97-fab484954b62 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'create', calling method: .version_select at 0x7f27bd9a4dc0>, body: {"keypair": {"name": "tempest-keypair-2121299359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7GuxvmrZtlBB0hhzG7jTYryAzzeI/7M9Ah8J01X16YIdqBpNGUN2lyalXv8cy8TIjYBNOU+15iuWtgat+Bh65Iqp0QgvuSJctr1IK1soATkygSk5TxtTBgZ/7u/byDCQ=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:24.633768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-175436e3-676f-4c38-8d97-fab484954b62 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for project d3f099daf43643fd998907948cfdb044. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:13:24.639129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-175436e3-676f-4c38-8d97-fab484954b62 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for user 8d4a165c2fa64514a6372ce0738c2dea and project d3f099daf43643fd998907948cfdb044. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:13:24.779123 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-175436e3-676f-4c38-8d97-fab484954b62 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.288280 Oct 28 14:13:24.780373 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3648/7207] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:13:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:13:27.256168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-825907186", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfec18d1-b194-413f-a18f-93750c65975a"}], "security_groups": [{"name": "tempest-securitygroup--1663753468"}], "key_name": "tempest-keypair-2121299359", "user_data": "}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:27.278277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:13:27.279049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:13:27.376348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] validate_networks() for [('cfec18d1-b194-413f-a18f-93750c65975a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:13:27.773294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:13:27.774066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:13:27.774567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:13:27.775022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:13:27.775465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:13:27.785527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:27.786217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:27.786671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:27.787496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:27.787966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:27.788587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:27.807404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:13:27.814603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for user 8d4a165c2fa64514a6372ce0738c2dea and project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:13:27.828901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:13:27.831387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:13:28.045208 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-edba5c51-d971-42ba-a591-6dc909976129 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.792792 Oct 28 14:13:28.048343 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3560/7208] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:13:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:13:28.057599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1cc5de3-483a-4ac8-83ef-c966efe3bdae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:28.058358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1cc5de3-483a-4ac8-83ef-c966efe3bdae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:28.128443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b1cc5de3-483a-4ac8-83ef-c966efe3bdae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:28.136090 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1cc5de3-483a-4ac8-83ef-c966efe3bdae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1238 microversion: 2.1 time: 0.082226 Oct 28 14:13:28.136847 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3649/7209] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:28 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:29.160149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4e1f874-7cad-4ba5-b7df-a86eac802f5e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:29.160778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4e1f874-7cad-4ba5-b7df-a86eac802f5e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:29.215276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4e1f874-7cad-4ba5-b7df-a86eac802f5e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:29.222925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4e1f874-7cad-4ba5-b7df-a86eac802f5e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1238 microversion: 2.1 time: 0.068404 Oct 28 14:13:29.223509 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3561/7210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:29 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:30.245832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:30.246450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:30.253811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:30.259412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:30.259412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:30.259412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:30.259412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:30.259412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:30.319884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:30.327682 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-38106402-7f4d-4070-a79a-a842ea882ce8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1290 microversion: 2.1 time: 0.085979 Oct 28 14:13:30.328262 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3650/7211] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:30 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:31.351829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:31.352463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:31.360605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:31.361238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:31.361699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:31.362466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:31.362978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:31.363429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:31.424964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:31.432912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92cd4f04-6c33-4d99-aff0-5ed917e3109a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1296 microversion: 2.1 time: 0.085362 Oct 28 14:13:31.433490 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3562/7212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:31 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:32.443143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5f5c8e6d-f288-4a17-b574-5fc0ea727ec5 req-e2b9e691-ad07-4ab6-9460-25558aadd419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b01953-ded8-477e-af82-0dd43e8dc3f2", "tag": "db49bd68-7f88-4dbc-8c19-220ee0a79fa2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:32.453407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5f5c8e6d-f288-4a17-b574-5fc0ea727ec5 req-e2b9e691-ad07-4ab6-9460-25558aadd419 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:32.453891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5f5c8e6d-f288-4a17-b574-5fc0ea727ec5 req-e2b9e691-ad07-4ab6-9460-25558aadd419 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:32.454326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5f5c8e6d-f288-4a17-b574-5fc0ea727ec5 req-e2b9e691-ad07-4ab6-9460-25558aadd419 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:32.465187 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5f5c8e6d-f288-4a17-b574-5fc0ea727ec5 req-e2b9e691-ad07-4ab6-9460-25558aadd419 service nova] Creating event network-changed:db49bd68-7f88-4dbc-8c19-220ee0a79fa2 for instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 on n-h1-862876-2 Oct 28 14:13:32.467548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:32.468324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:32.470494 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5f5c8e6d-f288-4a17-b574-5fc0ea727ec5 req-e2b9e691-ad07-4ab6-9460-25558aadd419 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031345 Oct 28 14:13:32.471299 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3651/7213] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:13:32.476763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:32.477348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:32.477751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:32.478636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:32.479166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:32.479612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:32.617112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:32.624986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-662dcc51-30c2-43a9-b31f-54c8ddb1f5df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1364 microversion: 2.1 time: 0.161790 Oct 28 14:13:32.625571 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3563/7214] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:32 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:13:33.649488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:33.650192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:33.656489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:33.656977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:33.657416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:33.658106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:33.658563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:33.659017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:33.787712 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:33.795338 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51236b8a-4345-4b21-b674-d900657c4d6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1364 microversion: 2.1 time: 0.151069 Oct 28 14:13:33.796413 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3652/7215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:33 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:34.818627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:34.819307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:34.826125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:34.826643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:34.828239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:34.828239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:34.829189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:34.829189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:34.960899 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:34.969061 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8368348e-682e-4ee0-a353-151b18cbfc31 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1364 microversion: 2.1 time: 0.154614 Oct 28 14:13:34.969628 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3564/7216] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:34 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:13:35.992375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:35.992990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:36.000626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:36.001112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:36.001552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:36.002236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:36.002691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:36.003141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:36.133573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:36.141292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5498b355-d98f-4fdf-9ff0-72f928579447 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1364 microversion: 2.1 time: 0.152843 Oct 28 14:13:36.141870 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3653/7217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:35 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:36.792270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-25856ab9-26e3-48cc-a6c1-43d11d8e84f9 req-c27e8487-433a-455c-8006-33bde9639827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b01953-ded8-477e-af82-0dd43e8dc3f2", "name": "network-vif-plugged", "status": "completed", "tag": "db49bd68-7f88-4dbc-8c19-220ee0a79fa2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:36.803017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-25856ab9-26e3-48cc-a6c1-43d11d8e84f9 req-c27e8487-433a-455c-8006-33bde9639827 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:36.803508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-25856ab9-26e3-48cc-a6c1-43d11d8e84f9 req-c27e8487-433a-455c-8006-33bde9639827 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:36.803953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-25856ab9-26e3-48cc-a6c1-43d11d8e84f9 req-c27e8487-433a-455c-8006-33bde9639827 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:36.814683 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-25856ab9-26e3-48cc-a6c1-43d11d8e84f9 req-c27e8487-433a-455c-8006-33bde9639827 service nova] Creating event network-vif-plugged:db49bd68-7f88-4dbc-8c19-220ee0a79fa2 for instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 on n-h1-862876-2 Oct 28 14:13:36.820383 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-25856ab9-26e3-48cc-a6c1-43d11d8e84f9 req-c27e8487-433a-455c-8006-33bde9639827 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031766 Oct 28 14:13:36.820988 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3565/7218] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:13:37.163719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:37.164335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:37.171560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:37.172886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:37.172886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:37.173462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:37.173893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:37.174310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:37.301662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:37.309457 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-527408a3-e14d-4e60-892f-25c3de5d4927 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1364 microversion: 2.1 time: 0.149633 Oct 28 14:13:37.310034 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3654/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:37 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:38.334233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:38.334980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:38.336926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:13:38.343438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:38.343934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:38.350863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:38.350863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:38.350863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:38.350863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:38.473601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:13:38.481334 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c4a98f9a-15fd-451e-a850-4fb13df1f0be tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1551 microversion: 2.1 time: 0.151337 Oct 28 14:13:38.481906 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3566/7220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:13:38 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:13:38.504070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:13:38.504558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:13:38.506833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:13:38.511631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:38.512111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:38.512546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:38.513233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:38.513697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:38.514627 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:38.595926 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d54459a4-3757-40dd-bbbf-6cb342f2d522 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095786 Oct 28 14:13:38.596531 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3655/7221] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 14:13:38 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:13:39.634503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-33e2d20a-93d9-4313-ad30-c98fb83e848f req-aec008b8-3152-4631-8b01-c03dc9d70b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b01953-ded8-477e-af82-0dd43e8dc3f2", "tag": "db49bd68-7f88-4dbc-8c19-220ee0a79fa2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:13:39.639423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:13:39.644693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-33e2d20a-93d9-4313-ad30-c98fb83e848f req-aec008b8-3152-4631-8b01-c03dc9d70b31 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:13:39.645206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-33e2d20a-93d9-4313-ad30-c98fb83e848f req-aec008b8-3152-4631-8b01-c03dc9d70b31 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:13:39.645644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-33e2d20a-93d9-4313-ad30-c98fb83e848f req-aec008b8-3152-4631-8b01-c03dc9d70b31 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:13:39.657462 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-33e2d20a-93d9-4313-ad30-c98fb83e848f req-aec008b8-3152-4631-8b01-c03dc9d70b31 service nova] Creating event network-changed:db49bd68-7f88-4dbc-8c19-220ee0a79fa2 for instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 on n-h1-862876-2 Oct 28 14:13:39.662476 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-33e2d20a-93d9-4313-ad30-c98fb83e848f req-aec008b8-3152-4631-8b01-c03dc9d70b31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031938 Oct 28 14:13:39.663118 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3567/7222] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:14:09.255558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:09.256324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=30 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:09.260984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:09.261625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:09.267751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.269810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.269810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.269810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.269810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.270521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.407497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:09.415808 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28753df3-d59b-4d34-9303-75557a7c788a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1670 microversion: 2.1 time: 0.162292 Oct 28 14:14:09.416402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3656/7223] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:09 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:09.439673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:09.440389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:09.443249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:09.443898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=30 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:09.449570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.450063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.450509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.451241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.451708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.455076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.589471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:09.597220 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ff7f292-4dc6-4e14-8117-113ad70b2593 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1670 microversion: 2.1 time: 0.161850 Oct 28 14:14:09.598318 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3568/7224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:09 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:09.620282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:09.620890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:09.627009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.627533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.627976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.628678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.629135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.629562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.754138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:09.761800 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-140d3fdc-efa2-48c0-bc17-e14d7f6a5d6a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1670 microversion: 2.1 time: 0.145394 Oct 28 14:14:09.762375 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3657/7225] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:09 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1670 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:09.784506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:09.787359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:09.793266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.793770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.794228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.794974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:09.795457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:09.795902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:09.823581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:09.828961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Old instance type m1.heat2, new instance type m1.heat {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:14:09.835990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:14:09.836429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:14:09.836922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:14:09.837351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:14:09.837780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:14:10.046643 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a8e049b-b86c-4dce-b08b-239ca358c305 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2/action" status: 202 len: 0 microversion: 2.1 time: 0.265964 Oct 28 14:14:10.047216 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3569/7226] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:14:09 2022] POST /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:14:10.055575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:10.056916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:10.062309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:10.062809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:10.063305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:10.063998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:10.064458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:10.064889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:10.198559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:10.207712 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-163c5f9e-ec9d-49db-9389-f76a5375e099 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1679 microversion: 2.1 time: 0.155350 Oct 28 14:14:10.208509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3658/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:10 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:11.232197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:11.232824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:11.240884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:11.241407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:11.241866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:11.242589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:11.243092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:11.243537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:11.374728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:11.382567 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f87c51c8-d120-4771-923e-5cc6ecad53bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1679 microversion: 2.1 time: 0.155085 Oct 28 14:14:11.383186 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3570/7228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:11 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:12.405506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:12.406122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:12.413891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:12.414385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:12.414850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:12.415550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:12.416018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:12.416426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:12.612869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:12.621144 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8cbe76d3-b7f1-4a63-924c-9d7991517624 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1679 microversion: 2.1 time: 0.219671 Oct 28 14:14:12.621734 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3659/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:12 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:13.645392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:13.646028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:13.653406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:13.653910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:13.654367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:13.655113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:13.655592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:13.656038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:13.786490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:13.794502 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ac52901-93f4-4f5d-86a5-45f6646863f9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.153100 Oct 28 14:14:13.795115 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3571/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:13 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:14.817837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:14.822681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:14.826033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:14.826596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:14.827123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:14.827879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:14.828413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:14.828934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:15.037879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:15.045834 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1bc49c0f-b984-47cb-b427-76b25c54ff0e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.232318 Oct 28 14:14:15.046609 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3660/7231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:14 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:16.070383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:16.071044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:16.078081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:16.078587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:16.079075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:16.079784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:16.080259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:16.080703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:16.207607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:16.215944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ff5759a4-4a8b-44fd-8dba-edbbffb0e7d4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.150227 Oct 28 14:14:16.216515 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3572/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:16 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:17.239278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:17.239890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:17.246677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:17.247189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:17.247626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:17.248319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:17.248772 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:17.249198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:17.376992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:17.385232 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-38c7ec1a-b0e5-4d1e-903a-5acd3d939a18 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.149815 Oct 28 14:14:17.385802 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3661/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:17 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:18.408945 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:18.409579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:18.416461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:18.416958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:18.417402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:18.418107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:18.418586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:18.419048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:18.553252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:18.561324 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab36b245-130a-45a9-8e88-009a8fd0a2b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.156951 Oct 28 14:14:18.561945 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3573/7234] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:18 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:19.585282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:19.585896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:19.593365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:19.593849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:19.594286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:19.594995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:19.595448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:19.595870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:19.725883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:19.734312 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-db77955b-4b2a-4802-954f-9bf71e7cc94c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.152933 Oct 28 14:14:19.734906 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3662/7235] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:19 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:20.757516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:20.761092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:20.765333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:20.765962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:20.766386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:20.767127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:20.767603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:20.768070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:20.898372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:20.906757 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7433a70d-28e9-40ce-a645-e79fa5e08079 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.153209 Oct 28 14:14:20.907335 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3574/7236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:20 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:21.929230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:21.929936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:21.937438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:21.938050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:21.938512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:21.939271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:21.939658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:21.940109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:22.072720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:22.080428 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b4531b82-6c3b-4b5d-974f-5860d695794a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.155046 Oct 28 14:14:22.080996 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3663/7237] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:21 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:23.103483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:23.104098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:23.110896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:23.111395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:23.111846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:23.112542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:23.113008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:23.113443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:23.245847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:23.254113 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-32565e5e-bcfa-4e8e-9289-8b7ad411ca3e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.154504 Oct 28 14:14:23.254694 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3575/7238] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:23 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:24.277465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:24.278079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:24.285451 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:24.285933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:24.286369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:24.287081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:24.287539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:24.287964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:24.417265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:24.425971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1a3647da-d1e1-427e-835b-5a39d8f47b29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.152413 Oct 28 14:14:24.426553 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3664/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:24 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:25.449523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:25.450156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:25.456915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:25.457413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:25.458512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:25.459251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:25.459728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:25.460171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:25.588090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:25.596451 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-824e21c8-03fe-494f-9b64-b9be25a00e8e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.150868 Oct 28 14:14:25.597033 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3576/7240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:25 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:26.619607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:26.620225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:26.627054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:26.627543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:26.627979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:26.628665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:26.629120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:26.629541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:26.756278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:26.764020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fce508bb-868e-441b-a8a0-5ed224824e1e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.148295 Oct 28 14:14:26.764654 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3665/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:26 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:27.788194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:27.788828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:27.795901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:27.796344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:27.796797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:27.797522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:27.797979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:27.798417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:27.928007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:27.935795 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6878881-022d-4424-864f-e150884821bd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.151567 Oct 28 14:14:27.936374 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3577/7242] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:27 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:28.959894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:28.960483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:28.967222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:28.967699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:28.968128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:28.968804 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:28.969252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:28.969672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:29.102482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:29.110250 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27d82296-13c5-4fae-a041-773784192c97 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.154283 Oct 28 14:14:29.110835 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3666/7243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:28 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:30.133627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:30.134259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:30.141267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:30.141764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:30.142219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:30.142955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:30.143431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:30.143870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:30.275381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:30.283106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fef8daa3-a386-456f-9341-602435ec279f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.153416 Oct 28 14:14:30.283684 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3578/7244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:30 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:31.306030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:31.306644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:31.313951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:31.314436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:31.314903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:31.315592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:31.316078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:31.316502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:31.451462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:31.459278 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ec21eb1c-7244-4072-96c2-17ed949f678b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.157663 Oct 28 14:14:31.463425 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3667/7245] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:31 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:32.482513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:32.483218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:32.490200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:32.490707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:32.491853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:32.492595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:32.493077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:32.493524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:32.624184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:32.632059 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9374c4c1-4e1a-4472-9a17-d738f1dc9939 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.153417 Oct 28 14:14:32.632634 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3579/7246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:32 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:33.656074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:33.656713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:33.663644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:33.664124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:33.664572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:33.665237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:33.665688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:33.666109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:33.792399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:33.800048 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01a55a2c-e835-4c48-b7b5-55290f05bfb7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.147870 Oct 28 14:14:33.800613 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3668/7247] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:33 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:34.824471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:34.825033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:34.831948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:34.832461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:34.832920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:34.833641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:34.834121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:34.834574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:34.973331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:34.982033 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e76e9235-724c-49bf-af51-bfe3edf72268 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1684 microversion: 2.1 time: 0.161657 Oct 28 14:14:34.982619 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3580/7248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:34 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:36.005606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:36.007027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:36.013354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:36.013842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:36.014279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:36.015003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:36.015461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:36.015886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:36.109864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-022ff9ed-2604-4763-9270-2f2ad80a367e req-1040f197-3b13-4a17-a6fa-f059186fd37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b01953-ded8-477e-af82-0dd43e8dc3f2", "name": "network-vif-unplugged", "status": "completed", "tag": "db49bd68-7f88-4dbc-8c19-220ee0a79fa2"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:36.119474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-022ff9ed-2604-4763-9270-2f2ad80a367e req-1040f197-3b13-4a17-a6fa-f059186fd37a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:36.119972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-022ff9ed-2604-4763-9270-2f2ad80a367e req-1040f197-3b13-4a17-a6fa-f059186fd37a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:36.120422 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-022ff9ed-2604-4763-9270-2f2ad80a367e req-1040f197-3b13-4a17-a6fa-f059186fd37a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:36.132566 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-022ff9ed-2604-4763-9270-2f2ad80a367e req-1040f197-3b13-4a17-a6fa-f059186fd37a service nova] Creating event network-vif-unplugged:db49bd68-7f88-4dbc-8c19-220ee0a79fa2 for instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 on n-h2-862876-2 Oct 28 14:14:36.138242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-022ff9ed-2604-4763-9270-2f2ad80a367e req-1040f197-3b13-4a17-a6fa-f059186fd37a service nova] Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:14:36.149911 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-022ff9ed-2604-4763-9270-2f2ad80a367e req-1040f197-3b13-4a17-a6fa-f059186fd37a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105793 Oct 28 14:14:36.150530 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3581/7249] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:14:36.249388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:36.257270 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d7d53e0-69cf-4c55-aa1d-b9b479d8dea4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1683 microversion: 2.1 time: 0.255579 Oct 28 14:14:36.258477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3669/7250] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:36 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1683 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:37.283695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:37.284328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:37.290396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:37.290934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:37.291387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:37.292085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:37.292552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:37.292988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:37.424030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:37.432458 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0a52c238-2c41-4631-98ae-b1ba0427d9fb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1683 microversion: 2.1 time: 0.153916 Oct 28 14:14:37.433074 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3582/7251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:37 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:38.179886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-421bb5e0-fa4a-446e-8ea5-3b042335a9a3 req-4ff8ffa3-50d8-4c61-91ef-9af27c67c637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b01953-ded8-477e-af82-0dd43e8dc3f2", "tag": "db49bd68-7f88-4dbc-8c19-220ee0a79fa2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:38.189311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-421bb5e0-fa4a-446e-8ea5-3b042335a9a3 req-4ff8ffa3-50d8-4c61-91ef-9af27c67c637 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:38.189780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-421bb5e0-fa4a-446e-8ea5-3b042335a9a3 req-4ff8ffa3-50d8-4c61-91ef-9af27c67c637 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:38.190203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-421bb5e0-fa4a-446e-8ea5-3b042335a9a3 req-4ff8ffa3-50d8-4c61-91ef-9af27c67c637 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:38.201687 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-421bb5e0-fa4a-446e-8ea5-3b042335a9a3 req-4ff8ffa3-50d8-4c61-91ef-9af27c67c637 service nova] Creating event network-changed:db49bd68-7f88-4dbc-8c19-220ee0a79fa2 for instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 on n-h2-862876-2 Oct 28 14:14:38.206940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-421bb5e0-fa4a-446e-8ea5-3b042335a9a3 req-4ff8ffa3-50d8-4c61-91ef-9af27c67c637 service nova] Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:14:38.218035 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-421bb5e0-fa4a-446e-8ea5-3b042335a9a3 req-4ff8ffa3-50d8-4c61-91ef-9af27c67c637 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041943 Oct 28 14:14:38.218958 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3670/7252] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:14:38.457153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:38.457807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:38.465272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:38.465782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:38.466238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:38.466987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:38.467467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:38.467912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:38.486951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:38.607473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:38.615296 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c11049f-ba2a-47de-babc-d49ad592038c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1681 microversion: 2.1 time: 0.162060 Oct 28 14:14:38.615889 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3583/7253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:38 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:39.639261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:39.639960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:39.642726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=31 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:39.647581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:39.648557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:39.649008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:39.649744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:39.650206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:39.650631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:39.653372 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=89 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:39.783184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:39.791518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-146f25c2-0cff-447d-92ed-e940041d09c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1678 microversion: 2.1 time: 0.156579 Oct 28 14:14:39.792101 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3671/7254] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:39 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:39.814094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:39.814604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:39.816759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=37 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:39.821695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:39.822201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:39.822649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:39.823394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:39.823839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:39.824274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:40.036839 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-687addca-c007-4364-a9f7-08f344219958 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2/action" status: 204 len: 0 microversion: 2.1 time: 0.226729 Oct 28 14:14:40.037556 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3584/7255] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:14:39 2022] POST /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2/action => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:14:40.045798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:40.046413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:40.052434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:40.052919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:40.054642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:40.054642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:40.054642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:40.055040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:40.226066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:40.234021 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5f2425f1-6fde-46c9-8b11-f27ef8e27c33 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1678 microversion: 2.1 time: 0.192039 Oct 28 14:14:40.234696 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3672/7256] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:40 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:14:41.258348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:41.259039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:41.265277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:41.265777 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:41.266225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:41.266964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:41.267444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:41.267885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:41.409461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:41.419002 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cfea63bd-2e77-417c-8917-77a1b35e1345 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1678 microversion: 2.1 time: 0.165641 Oct 28 14:14:41.423766 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3585/7257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:41 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:14:42.443414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:42.444018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:42.450895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.451375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.451805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.452477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.452925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.453343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.584844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:42.593073 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7f0b472e-50ee-43b2-9960-7235e25f938c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1670 microversion: 2.1 time: 0.153763 Oct 28 14:14:42.593645 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3673/7258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:42 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:42.615205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:42.615842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:42.623338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.623841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.624302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.625013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.625489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.625933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.756453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:42.764835 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-98ad6bb7-39d8-4115-af04-e9f7b4b7e910 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1670 microversion: 2.1 time: 0.153480 Oct 28 14:14:42.765408 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3586/7259] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:42 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:14:42.786726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:42.787359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:42.793404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.793887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.794323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.795033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.795490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.795914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.922769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:42.930930 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b83f8328-f8c1-4e57-80f5-c39f27e8073b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1670 microversion: 2.1 time: 0.148001 Oct 28 14:14:42.931577 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3674/7260] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:42 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:42.953968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:42.954490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:42.960498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.960948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.961402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.962106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:42.962578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:42.963044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:42.988299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:14:43.131044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-67958067-ead1-4eb2-9fb8-8875642d0181 req-05f471cf-324d-4afd-b7c1-236ad922737e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b01953-ded8-477e-af82-0dd43e8dc3f2", "name": "network-vif-plugged", "status": "completed", "tag": "db49bd68-7f88-4dbc-8c19-220ee0a79fa2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:43.140883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-67958067-ead1-4eb2-9fb8-8875642d0181 req-05f471cf-324d-4afd-b7c1-236ad922737e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:43.141356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-67958067-ead1-4eb2-9fb8-8875642d0181 req-05f471cf-324d-4afd-b7c1-236ad922737e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:43.141817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-67958067-ead1-4eb2-9fb8-8875642d0181 req-05f471cf-324d-4afd-b7c1-236ad922737e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:43.153698 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-67958067-ead1-4eb2-9fb8-8875642d0181 req-05f471cf-324d-4afd-b7c1-236ad922737e service nova] Creating event network-vif-plugged:db49bd68-7f88-4dbc-8c19-220ee0a79fa2 for instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 on n-h2-862876-2 Oct 28 14:14:43.158700 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-67958067-ead1-4eb2-9fb8-8875642d0181 req-05f471cf-324d-4afd-b7c1-236ad922737e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031435 Oct 28 14:14:43.159315 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3675/7261] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:14:43.281679 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5fa0520-5607-488a-ae3a-ee30acff475a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 204 len: 0 microversion: 2.1 time: 0.331207 Oct 28 14:14:43.282295 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3587/7262] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:14:42 2022] DELETE /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:14:43.290972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:43.291826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:43.299310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:43.299816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:43.300246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:43.300926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:43.301373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:43.301791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:43.434808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:43.442575 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f2d05c96-daa9-47b2-aa33-f07a48678ac7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1676 microversion: 2.1 time: 0.155768 Oct 28 14:14:43.443463 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3676/7263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:43 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:44.466150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:44.466911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:44.473695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:44.474201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:44.474656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:44.475392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:44.475877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:44.476323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:44.610347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:44.618246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2e108db2-1fc9-4235-88da-9a07dc4e891a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1676 microversion: 2.1 time: 0.156488 Oct 28 14:14:44.618853 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3588/7264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:44 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:45.469028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-392899c4-7c6a-4ba9-8075-d89da01e4ce5 req-86c0a552-2c9d-40e6-9a29-ea87465837fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b01953-ded8-477e-af82-0dd43e8dc3f2", "name": "network-vif-deleted", "tag": "db49bd68-7f88-4dbc-8c19-220ee0a79fa2"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:45.480574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-392899c4-7c6a-4ba9-8075-d89da01e4ce5 req-86c0a552-2c9d-40e6-9a29-ea87465837fe service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:45.481056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-392899c4-7c6a-4ba9-8075-d89da01e4ce5 req-86c0a552-2c9d-40e6-9a29-ea87465837fe service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:45.481485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-392899c4-7c6a-4ba9-8075-d89da01e4ce5 req-86c0a552-2c9d-40e6-9a29-ea87465837fe service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:45.492862 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-392899c4-7c6a-4ba9-8075-d89da01e4ce5 req-86c0a552-2c9d-40e6-9a29-ea87465837fe service nova] Creating event network-vif-deleted:db49bd68-7f88-4dbc-8c19-220ee0a79fa2 for instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 on n-h2-862876-2 Oct 28 14:14:45.498537 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-392899c4-7c6a-4ba9-8075-d89da01e4ce5 req-86c0a552-2c9d-40e6-9a29-ea87465837fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035355 Oct 28 14:14:45.499205 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3677/7265] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:14:45.642315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:45.642996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:45.650207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:45.650693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:45.655998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:45.655998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:45.655998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:45.655998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:45.716962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:45.724957 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12974b0f-95e4-4587-9803-81f91388de29 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 200 len: 1323 microversion: 2.1 time: 0.086716 Oct 28 14:14:45.725669 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3589/7266] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:45 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 1323 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:46.748743 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:46.749447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:46.755614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:46.756104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:46.756549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:46.757239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:46.757696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:46.758122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:46.772380 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 HTTP/1.1 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '36b01953-ded8-477e-af82-0dd43e8dc3f2'} Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:14:46.774013 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2650388-f16c-49b3-b4f7-623d24821aeb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 404 len: 111 microversion: 2.1 time: 0.031811 Oct 28 14:14:46.780391 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3678/7267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:46 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:14:46.791208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:46.791966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:46.798672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:46.799265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:46.799713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:46.800414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:46.800883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:46.801316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:46.814484 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 HTTP/1.1 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '36b01953-ded8-477e-af82-0dd43e8dc3f2'} Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:14:46.816172 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bae3375e-f7e6-4167-9a4b-5508414c88e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 404 len: 111 microversion: 2.1 time: 0.030287 Oct 28 14:14:46.822667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3590/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:46 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:14:46.867295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1126463329", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "cfec18d1-b194-413f-a18f-93750c65975a"}], "security_groups": [{"name": "tempest-securitygroup--1663753468"}], "key_name": "tempest-keypair-2121299359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:46.975212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] validate_networks() for [('cfec18d1-b194-413f-a18f-93750c65975a', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:14:47.340413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:14:47.340838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:14:47.341317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:14:47.341764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:14:47.342177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:14:47.351176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:47.351683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:47.352108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:47.353016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:47.353477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:47.353907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:47.371629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:14:47.376893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for user 8d4a165c2fa64514a6372ce0738c2dea and project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:14:47.389222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:14:47.391669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:14:47.519565 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-52f9ce2c-1dd8-4a1d-8cdb-051a85d960e5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656148 Oct 28 14:14:47.520234 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3679/7269] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:14:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:14:47.531698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c2886829-bb5f-4250-9085-c116c6f5b68d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:47.532472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c2886829-bb5f-4250-9085-c116c6f5b68d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:47.587581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c2886829-bb5f-4250-9085-c116c6f5b68d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:47.594909 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c2886829-bb5f-4250-9085-c116c6f5b68d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1239 microversion: 2.1 time: 0.067215 Oct 28 14:14:47.595482 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3591/7270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:47 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:48.619492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:48.620103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:48.627520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:48.628008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:48.628440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:48.629215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:48.629673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:48.630097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:48.692687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:48.701059 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2508ef9-77d1-4229-b586-e4c84cc5b9c7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1243 microversion: 2.1 time: 0.086538 Oct 28 14:14:48.701622 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3680/7271] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:48 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:49.724791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:49.725435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:49.733305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:49.733807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:49.734252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:49.734991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:49.735460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:49.735900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:49.799593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:49.807435 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9b92a770-43de-4e8b-bf78-6a17727a6f77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1299 microversion: 2.1 time: 0.086575 Oct 28 14:14:49.808009 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3592/7272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:49 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:50.836523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:50.837167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:50.844738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:50.845628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:50.845628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:50.846336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:50.846815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:50.847242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:51.076354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:51.084100 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e7951c1c-85d0-4f71-8308-cd4a66738982 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1365 microversion: 2.1 time: 0.251429 Oct 28 14:14:51.084723 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3681/7273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:50 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:51.649075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6489eb9d-fed5-4321-8e5d-493c76f756f8 req-6ab51b50-e6e1-4ffd-a637-88493afe87ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fbafe4-7f87-4c54-bddd-e13aa3dd5400", "tag": "7d1413f3-898b-429b-a808-1f0a84ff84f7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:51.659503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6489eb9d-fed5-4321-8e5d-493c76f756f8 req-6ab51b50-e6e1-4ffd-a637-88493afe87ce service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:51.660000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6489eb9d-fed5-4321-8e5d-493c76f756f8 req-6ab51b50-e6e1-4ffd-a637-88493afe87ce service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:51.660445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6489eb9d-fed5-4321-8e5d-493c76f756f8 req-6ab51b50-e6e1-4ffd-a637-88493afe87ce service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:51.671616 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6489eb9d-fed5-4321-8e5d-493c76f756f8 req-6ab51b50-e6e1-4ffd-a637-88493afe87ce service nova] Creating event network-changed:7d1413f3-898b-429b-a808-1f0a84ff84f7 for instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 on n-h2-862876-2 Oct 28 14:14:51.676455 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6489eb9d-fed5-4321-8e5d-493c76f756f8 req-6ab51b50-e6e1-4ffd-a637-88493afe87ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031079 Oct 28 14:14:51.684593 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3593/7274] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:14:52.109002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:52.109619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:52.116569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:52.117054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:52.117492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:52.118187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:52.118644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:52.119105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:52.337976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:52.346228 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8ee810e6-db6e-4dae-8833-0313ab1c00db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1365 microversion: 2.1 time: 0.241659 Oct 28 14:14:52.346865 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3682/7275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:52 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:53.372292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:53.373008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:53.379442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:53.379952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:53.380400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:53.381098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:53.381563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:53.381997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:53.515046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:53.522905 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-04974bbf-7a4d-4355-8da6-98e0ab19d996 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1365 microversion: 2.1 time: 0.156301 Oct 28 14:14:53.531822 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3594/7276] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:53 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:54.546213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:54.546849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:54.553744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:54.554222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:54.554663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:54.555371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:54.555825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:54.556246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:54.687836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:54.695787 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-574dd50a-fe69-4dd0-9c4c-30b0c179170e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1365 microversion: 2.1 time: 0.153496 Oct 28 14:14:54.696364 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3683/7277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:54 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:55.720171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:55.720854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:55.727774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:55.728276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:55.728728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:55.729432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:55.729903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:55.730347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:55.855834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:55.863409 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47046292-3f49-4885-9a87-4e14f25f12c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1365 microversion: 2.1 time: 0.147109 Oct 28 14:14:55.863981 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3595/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:55 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:56.887255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:56.887875 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:56.894736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:56.895263 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:56.895703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:56.896399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:56.896857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:56.897282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:57.037179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:57.046235 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3791c0a5-93a6-49cd-b68a-c8a23dc4374e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1365 microversion: 2.1 time: 0.162859 Oct 28 14:14:57.046873 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3684/7279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:56 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:57.325560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-40aa62d1-7f58-4c9a-980b-c5ceffad8569 req-50cb296e-2c78-4119-938e-d3991009e913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fbafe4-7f87-4c54-bddd-e13aa3dd5400", "name": "network-vif-plugged", "status": "completed", "tag": "7d1413f3-898b-429b-a808-1f0a84ff84f7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:14:57.336081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-40aa62d1-7f58-4c9a-980b-c5ceffad8569 req-50cb296e-2c78-4119-938e-d3991009e913 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:57.336601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-40aa62d1-7f58-4c9a-980b-c5ceffad8569 req-50cb296e-2c78-4119-938e-d3991009e913 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:57.337048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-40aa62d1-7f58-4c9a-980b-c5ceffad8569 req-50cb296e-2c78-4119-938e-d3991009e913 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:57.348781 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-40aa62d1-7f58-4c9a-980b-c5ceffad8569 req-50cb296e-2c78-4119-938e-d3991009e913 service nova] Creating event network-vif-plugged:7d1413f3-898b-429b-a808-1f0a84ff84f7 for instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 on n-h2-862876-2 Oct 28 14:14:57.353564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-40aa62d1-7f58-4c9a-980b-c5ceffad8569 req-50cb296e-2c78-4119-938e-d3991009e913 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032354 Oct 28 14:14:57.354220 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3596/7280] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:14:58.069907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:58.070547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:58.072951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:58.073579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:58.079269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:58.079759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:58.080199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:58.080892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:58.081357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:58.081780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:58.212700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:58.220324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-218dcfee-d234-4614-929d-328878e21147 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1365 microversion: 2.1 time: 0.154611 Oct 28 14:14:58.220908 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3685/7281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:58 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:59.241724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:14:59.246717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:59.247466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:59.254066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:59.255330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:59.255330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:59.255820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:59.256299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:59.256751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:59.391263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:14:59.399000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9fac1450-313b-4bf7-95f9-b96cc47c2080 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1552 microversion: 2.1 time: 0.158281 Oct 28 14:14:59.399567 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3597/7282] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:14:59 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:14:59.427739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:14:59.428269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:14:59.434996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:59.435475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:59.435904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:59.436641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:14:59.437093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:14:59.437508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:14:59.513909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b3f588f-2aca-4359-9108-9f1f399868eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090005 Oct 28 14:14:59.515147 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3686/7283] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 14:14:59 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:15:00.512953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f6adaa00-731b-4e78-aecb-d246743c8a5a req-7f3e9264-41d3-47c2-91a7-ab76f48ae4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fbafe4-7f87-4c54-bddd-e13aa3dd5400", "tag": "7d1413f3-898b-429b-a808-1f0a84ff84f7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:15:00.524815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6adaa00-731b-4e78-aecb-d246743c8a5a req-7f3e9264-41d3-47c2-91a7-ab76f48ae4b8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:00.525306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6adaa00-731b-4e78-aecb-d246743c8a5a req-7f3e9264-41d3-47c2-91a7-ab76f48ae4b8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:00.525762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f6adaa00-731b-4e78-aecb-d246743c8a5a req-7f3e9264-41d3-47c2-91a7-ab76f48ae4b8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:00.537370 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f6adaa00-731b-4e78-aecb-d246743c8a5a req-7f3e9264-41d3-47c2-91a7-ab76f48ae4b8 service nova] Creating event network-changed:7d1413f3-898b-429b-a808-1f0a84ff84f7 for instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 on n-h2-862876-2 Oct 28 14:15:00.542800 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f6adaa00-731b-4e78-aecb-d246743c8a5a req-7f3e9264-41d3-47c2-91a7-ab76f48ae4b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033575 Oct 28 14:15:00.543945 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3598/7284] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:15:33.420125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:15:33.420872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=77 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:15:33.424930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae334a87-2920-4edd-ab77-dbda2f7038a7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:15:33.431342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae334a87-2920-4edd-ab77-dbda2f7038a7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:33.434373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae334a87-2920-4edd-ab77-dbda2f7038a7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:33.434373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae334a87-2920-4edd-ab77-dbda2f7038a7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:33.455518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae334a87-2920-4edd-ab77-dbda2f7038a7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 14:15:33.656982 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae334a87-2920-4edd-ab77-dbda2f7038a7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action" status: 202 len: 0 microversion: 2.1 time: 0.238567 Oct 28 14:15:33.657587 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3687/7285] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:15:33 2022] POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:15:33.665030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:15:33.665805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:15:33.669997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:33.670733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:33.676816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:33.677315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:33.678394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:33.679118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:33.679586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:33.680020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:33.808817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:33.816733 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4811b459-b027-4794-bedc-a2b648ee161d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.154556 Oct 28 14:15:33.818308 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3599/7286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:33 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:34.841984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:34.842604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:34.848698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:34.849182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:34.849621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:34.850305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:34.850778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:34.851213 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:34.980753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:34.988426 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b482098f-30da-4bea-a81f-aa8799db1b47 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.151781 Oct 28 14:15:34.988995 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3688/7287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:34 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:36.013319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:36.013955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:36.022064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:36.022570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:36.023050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:36.023763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:36.024240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:36.024681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:36.154118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:36.161793 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-04924ab1-c0bd-4de3-912c-ff2dd7f9803e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.152420 Oct 28 14:15:36.162361 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3600/7288] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:36 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:37.184402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:37.185064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:37.191798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:37.192281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:37.192722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:37.193406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:37.193862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:37.194544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:37.330393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:37.338849 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c232c2c1-8933-408f-983e-53efcf4a462b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.158285 Oct 28 14:15:37.339429 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3689/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:37 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:38.362342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:38.363013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:38.370598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:38.371129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:38.371585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:38.372296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:38.372774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:38.373221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:38.503610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:38.511887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da8e9116-4eab-4458-a024-b5cabc46cd77 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.153405 Oct 28 14:15:38.512762 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3601/7290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:38 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:39.536689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:39.537802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:39.544054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:39.545061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:39.545061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:39.545661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:39.546121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:39.546550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:39.675850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:39.683602 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-53b45706-893f-45e9-9dea-f6c730c11868 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.151179 Oct 28 14:15:39.684184 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3690/7291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:39 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:40.707296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:40.707930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:40.713939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:40.714440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:40.714922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:40.715629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:40.716099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:40.716539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:40.843452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:40.851973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0ddec6e6-1ec5-47c3-ab52-f680607e4f3c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.148889 Oct 28 14:15:40.857801 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3602/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:40 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:41.875264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:41.875792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:41.882531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:41.883050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:41.883489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:41.884170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:41.884661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:41.885087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:42.013826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:42.021502 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f865927f-39ec-4d17-bb54-fe9383a25488 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.150163 Oct 28 14:15:42.022086 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3691/7293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:41 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:43.044605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:43.045293 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:43.052177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:43.053171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:43.053628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:43.054329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:43.054864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:43.055302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:43.185629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:43.193356 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-114c4c27-5b3b-4e9d-a1a7-371f9000a237 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.152682 Oct 28 14:15:43.194818 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3603/7294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:43 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:44.217232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:44.217872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:44.224837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:44.225316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:44.225746 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:44.226424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:44.226907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:44.227328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:44.353110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:44.360806 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-98ac28cc-d003-44cd-bac7-48ac3c9ae4a9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.147436 Oct 28 14:15:44.361384 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3692/7295] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:44 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:45.385471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:45.386033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:45.393218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:45.393719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:45.394174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:45.394915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:45.395390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:45.395842 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:45.522417 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:45.530160 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b1b734a-b565-4843-8655-76aa85116152 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.149351 Oct 28 14:15:45.530771 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3604/7296] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:45 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:46.553954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:46.554558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:46.561316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:46.561788 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:46.562222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:46.562931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:46.563384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:46.563803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:46.691323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:46.699377 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f1bcd029-ce23-403a-a368-99449657bad7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.149886 Oct 28 14:15:46.699962 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3693/7297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:46 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:47.722665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:47.723339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:47.730816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:47.731325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:47.731774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:47.732482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:47.732954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:47.733398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:47.866660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:47.874510 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b35e3e2-8aa2-45c4-a143-5b90d4bd8365 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.155915 Oct 28 14:15:47.875118 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3605/7298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:47 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:15:48.899054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:48.899699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:48.906533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:48.907061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:48.907510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:48.908200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:48.908659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:48.909087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:49.039472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:49.047412 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b534d3ef-213f-43fd-b117-3e794dc069ae tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.152826 Oct 28 14:15:49.048003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3694/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:48 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:50.071560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:50.072201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:50.074994 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:15:50.075161 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 (ip 10.222.0.25) !!! Oct 28 14:15:50.082172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:50.082681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:50.083166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:50.083888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:50.084890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:50.085336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:50.213522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:50.221336 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e360842f-130e-4611-96d6-c789142b3043 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1658 microversion: 2.1 time: 0.154020 Oct 28 14:15:50.221907 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3606/7300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:50 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1658 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:50.243687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:15:50.246031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:50.248479 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:15:50.248610 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action (ip 10.222.0.25) !!! Oct 28 14:15:50.257956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:50.258525 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:50.258990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:50.259674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:50.260126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:50.260546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:50.290359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:50.296062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Old instance type m1.heat2, new instance type m1.heat {{(pid=127793) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:15:50.302434 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:15:50.302912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:15:50.303447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:15:50.303835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:15:50.304238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:15:50.601273 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-21330a04-3f8d-48cc-b422-4f4fed6ef011 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action" status: 202 len: 0 microversion: 2.1 time: 0.361372 Oct 28 14:15:50.601931 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3695/7301] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:15:50 2022] POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:15:50.610739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:50.611391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:50.617863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:50.618363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:50.618841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:50.619552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:50.620022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:50.620459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:50.747529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:50.755404 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c96fcac3-7ef4-498e-b026-37282dd39daa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.149275 Oct 28 14:15:50.755984 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3607/7302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:50 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:51.779613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:51.780251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:51.789829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:51.790316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:51.790783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:51.791493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:51.791952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:51.792376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:51.922566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:51.930431 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-caa64f81-63b0-43b5-974b-4dd73a1234e2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.155521 Oct 28 14:15:51.931054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3696/7303] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:51 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:52.954684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:52.955343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:52.962243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:52.962760 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:52.963222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:52.963930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:52.964406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:52.964847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:53.102867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:53.111019 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-46ea9d99-697e-43e0-a5bc-4b00e4328eec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.160202 Oct 28 14:15:53.111619 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3608/7304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:52 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:54.135115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:54.135677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:54.142400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:54.142929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:54.143385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:54.144054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:54.144514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:54.144941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:54.273114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:54.280872 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cb57162a-700e-4bb4-a0b5-2959193ca955 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1681 microversion: 2.1 time: 0.149750 Oct 28 14:15:54.281449 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3697/7305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:54 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:55.303735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:55.304538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:55.311445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:55.311946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:55.312395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:55.313121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:55.313593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:55.314032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:55.448167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:55.455961 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3f060327-a5b2-4c8f-b19c-a3d0477f2be6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1686 microversion: 2.1 time: 0.156113 Oct 28 14:15:55.456473 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3609/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:55 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:56.480329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:56.481124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:56.489188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:56.489681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:56.490111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:56.490870 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:56.491313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:56.491785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:56.686894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:56.695237 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f73587eb-1dcf-45fe-a79b-e3875967ea2b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1685 microversion: 2.1 time: 0.218828 Oct 28 14:15:56.696246 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3698/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:56 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1685 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:57.018092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9c5d6eb5-77e9-48ab-bbae-91fbf7c3688c req-6fced99e-827e-4b04-843c-278fbbdc87e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fbafe4-7f87-4c54-bddd-e13aa3dd5400", "name": "network-vif-unplugged", "status": "completed", "tag": "7d1413f3-898b-429b-a808-1f0a84ff84f7"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:15:57.028436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c5d6eb5-77e9-48ab-bbae-91fbf7c3688c req-6fced99e-827e-4b04-843c-278fbbdc87e1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:57.028940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c5d6eb5-77e9-48ab-bbae-91fbf7c3688c req-6fced99e-827e-4b04-843c-278fbbdc87e1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:57.029394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9c5d6eb5-77e9-48ab-bbae-91fbf7c3688c req-6fced99e-827e-4b04-843c-278fbbdc87e1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:57.041452 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9c5d6eb5-77e9-48ab-bbae-91fbf7c3688c req-6fced99e-827e-4b04-843c-278fbbdc87e1 service nova] Creating event network-vif-unplugged:7d1413f3-898b-429b-a808-1f0a84ff84f7 for instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 on n-h1-862876-2 Oct 28 14:15:57.047121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-9c5d6eb5-77e9-48ab-bbae-91fbf7c3688c req-6fced99e-827e-4b04-843c-278fbbdc87e1 service nova] Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:15:57.058682 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9c5d6eb5-77e9-48ab-bbae-91fbf7c3688c req-6fced99e-827e-4b04-843c-278fbbdc87e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044311 Oct 28 14:15:57.059341 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3610/7308] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:15:57.719450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:57.720301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:57.727321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:57.727806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:57.728235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:57.728916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:57.729364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:57.729783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:57.941103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:57.949693 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b32624c-0843-41cd-ab1b-f49e61b431eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1685 microversion: 2.1 time: 0.234162 Oct 28 14:15:57.950275 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3699/7309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:57 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1685 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:15:58.976001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:15:58.976717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:15:58.982886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:58.983388 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:58.983840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:58.984541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:58.985008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:58.985444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:59.073207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3662f2ba-3780-4bcb-8140-f8a841fbcfa9 req-0b571693-c559-49f2-8da2-b6add47bb7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fbafe4-7f87-4c54-bddd-e13aa3dd5400", "tag": "7d1413f3-898b-429b-a808-1f0a84ff84f7"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:15:59.083293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3662f2ba-3780-4bcb-8140-f8a841fbcfa9 req-0b571693-c559-49f2-8da2-b6add47bb7a2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:15:59.083763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3662f2ba-3780-4bcb-8140-f8a841fbcfa9 req-0b571693-c559-49f2-8da2-b6add47bb7a2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:15:59.084774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3662f2ba-3780-4bcb-8140-f8a841fbcfa9 req-0b571693-c559-49f2-8da2-b6add47bb7a2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:15:59.096198 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3662f2ba-3780-4bcb-8140-f8a841fbcfa9 req-0b571693-c559-49f2-8da2-b6add47bb7a2 service nova] Creating event network-changed:7d1413f3-898b-429b-a808-1f0a84ff84f7 for instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 on n-h1-862876-2 Oct 28 14:15:59.102025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-3662f2ba-3780-4bcb-8140-f8a841fbcfa9 req-0b571693-c559-49f2-8da2-b6add47bb7a2 service nova] Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:15:59.112827 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3662f2ba-3780-4bcb-8140-f8a841fbcfa9 req-0b571693-c559-49f2-8da2-b6add47bb7a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043457 Oct 28 14:15:59.113429 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3700/7310] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:15:59.114705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:15:59.122816 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e20fbed-26b0-4903-95dd-0dcf9ac76be8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1683 microversion: 2.1 time: 0.152472 Oct 28 14:15:59.123414 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3611/7311] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:15:58 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:00.148346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:00.149049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:00.155641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:00.156138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:00.156575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:00.157258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:00.157727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:00.158131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:00.176751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:00.288463 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:00.296134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51fa81ae-c305-45f7-bf69-aff9a2de0194 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1679 microversion: 2.1 time: 0.152843 Oct 28 14:16:00.296709 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3701/7312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:00 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:00.318640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:00.319210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:00.326298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:00.326834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:00.327286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:00.327990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:00.328459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:00.328949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:00.619838 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31de9f98-e624-4ae6-bfac-7409d8fe2d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action" status: 204 len: 0 microversion: 2.1 time: 0.304864 Oct 28 14:16:00.620540 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3612/7313] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:16:00 2022] POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:16:00.629511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:00.630496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:00.636689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:00.637167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:00.637600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:00.638276 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:00.638723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:00.639164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:00.810089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:00.817918 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a25c9d6e-d5a2-4c41-8caa-5dd26703015f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1679 microversion: 2.1 time: 0.193053 Oct 28 14:16:00.819003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3702/7314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:00 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:01.843056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:01.843769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:01.850113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:01.850674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:01.851159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:01.851876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:01.852348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:01.852791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:01.989443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:01.998029 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eba7805c-0b8a-4e7d-b6f5-13640e8c3455 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1679 microversion: 2.1 time: 0.160065 Oct 28 14:16:01.998617 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3613/7315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:01 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:03.021414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:03.022029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:03.028999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.029485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.029924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.030618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.031120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.031550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.164578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:03.172286 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-03e52494-b985-4d89-acd0-65d4c6b32f01 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1658 microversion: 2.1 time: 0.154743 Oct 28 14:16:03.172856 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3703/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:03 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1658 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:03.195332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:03.195962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:03.203370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.203869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.204318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.205069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.206471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.206941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.347351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:03.349641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:03.356440 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8429734-69a5-416f-9c6e-fa1d10f55204 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1658 microversion: 2.1 time: 0.165381 Oct 28 14:16:03.357013 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3614/7317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:03 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1658 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:03.379138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ae62ecc-4a35-4e49-a4f1-a7a7f9b6799d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:03.385287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ae62ecc-4a35-4e49-a4f1-a7a7f9b6799d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.385777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ae62ecc-4a35-4e49-a4f1-a7a7f9b6799d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.386217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ae62ecc-4a35-4e49-a4f1-a7a7f9b6799d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.409259 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ae62ecc-4a35-4e49-a4f1-a7a7f9b6799d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Going to try to start instance {{(pid=127793) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 14:16:03.629502 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ae62ecc-4a35-4e49-a4f1-a7a7f9b6799d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action" status: 202 len: 0 microversion: 2.1 time: 0.254202 Oct 28 14:16:03.630315 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3704/7318] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:16:03 2022] POST /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:16:03.639406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:03.640166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:03.648324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.648826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.649382 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.650116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.650597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.651080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.654232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1cfb7da3-814f-4c6f-b065-9f3e77139efc req-b3700b92-a756-42e3-a181-d48e83ad7ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fbafe4-7f87-4c54-bddd-e13aa3dd5400", "name": "network-vif-plugged", "status": "completed", "tag": "7d1413f3-898b-429b-a808-1f0a84ff84f7"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:03.659693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=41 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:03.666282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1cfb7da3-814f-4c6f-b065-9f3e77139efc req-b3700b92-a756-42e3-a181-d48e83ad7ef0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:03.666783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1cfb7da3-814f-4c6f-b065-9f3e77139efc req-b3700b92-a756-42e3-a181-d48e83ad7ef0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:03.667212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1cfb7da3-814f-4c6f-b065-9f3e77139efc req-b3700b92-a756-42e3-a181-d48e83ad7ef0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:03.678354 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1cfb7da3-814f-4c6f-b065-9f3e77139efc req-b3700b92-a756-42e3-a181-d48e83ad7ef0 service nova] Creating event network-vif-plugged:7d1413f3-898b-429b-a808-1f0a84ff84f7 for instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 on n-h1-862876-2 Oct 28 14:16:03.683361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1cfb7da3-814f-4c6f-b065-9f3e77139efc req-b3700b92-a756-42e3-a181-d48e83ad7ef0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034184 Oct 28 14:16:03.684016 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3705/7319] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:16:03.785352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:03.793713 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48127108-166c-4930-80e3-0dc5ebc84fd1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1667 microversion: 2.1 time: 0.158268 Oct 28 14:16:03.794300 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3615/7320] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:03 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:16:04.817722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:04.818337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:04.826844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:04.827336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:04.827786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:04.828477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:04.828934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:04.829361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:04.961705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:04.969858 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79230f8d-1e48-48c9-970c-573d555ce1cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1667 microversion: 2.1 time: 0.156379 Oct 28 14:16:04.975864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3706/7321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:04 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:05.993134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:05.993757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:05.996868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=35 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:06.002011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:06.002549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:06.019076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:06.019076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:06.019076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:06.019076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:06.137296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:06.145101 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b28f0f51-0d6c-4821-abf2-021c710d3a26 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1671 microversion: 2.1 time: 0.155948 Oct 28 14:16:06.145667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3616/7322] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:05 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:06.167782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:06.168318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:06.174885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:06.175360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:06.175793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:06.176468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:06.176920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:06.177337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:06.202082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:16:06.522754 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1bfd0015-d055-44ca-bff1-b3227cbbb27c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 204 len: 0 microversion: 2.1 time: 0.358418 Oct 28 14:16:06.523378 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3707/7323] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:16:06 2022] DELETE /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:16:06.531697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:06.532364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:06.538529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:06.539065 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:06.539521 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:06.540241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:06.540716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:06.541160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:06.668520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:06.676247 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81abaa4c-2fd5-4c12-b34b-003451b485af tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1677 microversion: 2.1 time: 0.148614 Oct 28 14:16:06.676820 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3617/7324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:06 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:16:07.701314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:07.702018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:07.708842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:07.709885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:07.710329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:07.711048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:07.711504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:07.711962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:07.876436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:07.885047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c1ff459a-b32b-41cc-9f78-1b2f8c4f90b5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1677 microversion: 2.1 time: 0.187988 Oct 28 14:16:07.885637 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3708/7325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:07 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:08.909364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:08.910107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:08.917462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:08.917963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:08.918586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:08.919374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:08.919874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:08.920332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:08.988543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:08.999626 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0b42e0e1-962a-455b-863c-14db011d75f1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 200 len: 1609 microversion: 2.1 time: 0.094206 Oct 28 14:16:09.015067 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3618/7326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:08 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 1609 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:09.049886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-faecc403-4851-4dae-b660-09858da9ca36 req-3caabfc5-f1a9-4333-846d-e33163fe1e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fbafe4-7f87-4c54-bddd-e13aa3dd5400", "name": "network-vif-deleted", "tag": "7d1413f3-898b-429b-a808-1f0a84ff84f7"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:09.061939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-faecc403-4851-4dae-b660-09858da9ca36 req-3caabfc5-f1a9-4333-846d-e33163fe1e66 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:09.062435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-faecc403-4851-4dae-b660-09858da9ca36 req-3caabfc5-f1a9-4333-846d-e33163fe1e66 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:09.062902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-faecc403-4851-4dae-b660-09858da9ca36 req-3caabfc5-f1a9-4333-846d-e33163fe1e66 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:09.074333 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-faecc403-4851-4dae-b660-09858da9ca36 req-3caabfc5-f1a9-4333-846d-e33163fe1e66 service nova] Creating event network-vif-deleted:7d1413f3-898b-429b-a808-1f0a84ff84f7 for instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 on n-h1-862876-2 Oct 28 14:16:09.079259 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-faecc403-4851-4dae-b660-09858da9ca36 req-3caabfc5-f1a9-4333-846d-e33163fe1e66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033187 Oct 28 14:16:09.079868 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3709/7327] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:16:10.025910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:10.026637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:10.033910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:10.034420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:10.034916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:10.035643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:10.036121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:10.036567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:10.051202 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 HTTP/1.1 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '21fbafe4-7f87-4c54-bddd-e13aa3dd5400'} Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:16:10.052866 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-710b9f99-08fc-43a1-9871-2dafefdb5d4f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 404 len: 111 microversion: 2.1 time: 0.033019 Oct 28 14:16:10.057709 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3619/7328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:10 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:16:10.073687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:10.074394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:10.081382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:10.081872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:10.082310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:10.083027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:10.083483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:10.083912 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:10.097726 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 HTTP/1.1 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '21fbafe4-7f87-4c54-bddd-e13aa3dd5400'} Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:16:10.099398 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-efc8a40d-a4b4-43b5-9593-26df64c23c13 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 404 len: 111 microversion: 2.1 time: 0.032285 Oct 28 14:16:10.105469 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3710/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:10 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:16:10.156614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-819003186", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "cfec18d1-b194-413f-a18f-93750c65975a"}], "security_groups": [{"name": "tempest-securitygroup--1663753468"}], "key_name": "tempest-keypair-2121299359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:10.260898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] validate_networks() for [('cfec18d1-b194-413f-a18f-93750c65975a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:16:10.662871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:16:10.663300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:16:10.663789 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:16:10.664243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:16:10.664671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:16:10.673482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:10.673983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:10.674442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:10.675230 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:10.675705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:10.676152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:10.692670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:16:10.698637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for user 8d4a165c2fa64514a6372ce0738c2dea and project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:16:10.711983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:16:10.714366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:16:10.828540 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f36f69a-c0b7-41e0-9872-378720ca588c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675859 Oct 28 14:16:10.829193 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3620/7330] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:16:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:16:10.840490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ccf7f382-e7e1-45b6-a85d-a5f11a04eeb8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:10.841108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ccf7f382-e7e1-45b6-a85d-a5f11a04eeb8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:10.899484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ccf7f382-e7e1-45b6-a85d-a5f11a04eeb8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:10.906466 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ccf7f382-e7e1-45b6-a85d-a5f11a04eeb8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1238 microversion: 2.1 time: 0.069977 Oct 28 14:16:10.907069 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3711/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:10 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:11.931264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:11.931898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:11.938656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:11.940740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:11.940740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:11.940740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:11.941096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:11.941192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:12.010766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:12.015130 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ab4082ff-3fcc-4e95-a049-380399659687 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1242 microversion: 2.1 time: 0.089411 Oct 28 14:16:12.015698 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3621/7332] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:11 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:13.038148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:13.038796 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:13.046565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:13.047076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:13.047513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:13.048800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:13.049270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:13.049701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:13.147573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:13.159762 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e0b727e9-08f3-4db1-bcf8-08790e7b068d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1298 microversion: 2.1 time: 0.125530 Oct 28 14:16:13.161149 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3712/7333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:13 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:14.184325 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:14.185265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:14.195839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:14.195839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:14.195839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:14.195839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:14.195839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:14.196960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:14.330572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:14.338994 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9c122a01-2b53-44e4-be52-98c00242b7db tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.158586 Oct 28 14:16:14.339662 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3622/7334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:14 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:14.859752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-af88ccac-ed42-4170-ad76-c6350cb75401 req-d72c4c8c-fd1b-4972-835a-5318ad3e439b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:14.870601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af88ccac-ed42-4170-ad76-c6350cb75401 req-d72c4c8c-fd1b-4972-835a-5318ad3e439b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:14.871110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af88ccac-ed42-4170-ad76-c6350cb75401 req-d72c4c8c-fd1b-4972-835a-5318ad3e439b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:14.871534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-af88ccac-ed42-4170-ad76-c6350cb75401 req-d72c4c8c-fd1b-4972-835a-5318ad3e439b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:14.884368 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-af88ccac-ed42-4170-ad76-c6350cb75401 req-d72c4c8c-fd1b-4972-835a-5318ad3e439b service nova] Creating event network-changed:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h2-862876-2 Oct 28 14:16:14.889380 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-af88ccac-ed42-4170-ad76-c6350cb75401 req-d72c4c8c-fd1b-4972-835a-5318ad3e439b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034544 Oct 28 14:16:14.890208 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3713/7335] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:16:15.362617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:15.363394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:15.370407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:15.370948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:15.371400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:15.372108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:15.372577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:15.373014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:15.506424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:15.514163 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad4110c0-4b3a-4b02-8724-3806f4873dd7 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.155491 Oct 28 14:16:15.514775 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3623/7336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:15 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:16.550707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:16.551444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:16.558333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:16.558865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:16.559305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:16.559981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:16.560433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:16.560855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:16.689332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:16.697223 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-86cb3d01-9710-4280-b52e-3dff534a94e0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.151623 Oct 28 14:16:16.697793 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3714/7337] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:16 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:17.720302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:17.720944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:17.727898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:17.728406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:17.728863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:17.729577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:17.730058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:17.730507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:18.173574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:18.181893 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6904141e-c2cf-4fef-a28a-4c52bf5b0d54 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.465599 Oct 28 14:16:18.182471 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3624/7338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:17 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:19.205135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:19.205780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:19.212596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:19.213079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:19.213515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:19.214194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:19.214647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:19.215163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:19.342252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:19.350475 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c956b1da-4b9b-4562-952a-5201e1fe0f99 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.149173 Oct 28 14:16:19.351307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3715/7339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:19 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:20.373558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:20.374133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:20.381036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:20.382035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:20.382486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:20.383262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:20.383736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:20.384174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:20.510954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:20.518527 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83df626a-7794-4281-b425-b92f152960dc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.148967 Oct 28 14:16:20.519707 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3625/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:20 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:21.543636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:21.544443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:21.547315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:21.552252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:21.552741 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:21.553205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:21.553897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:21.554385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:21.554837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:21.576725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f575af54-83ad-4e58-afb0-d5c6ac067288 req-1c2378ab-7f24-4376-beba-f28b0bd1ad5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "name": "network-vif-plugged", "status": "completed", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:21.581845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:21.582501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:21.589799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f575af54-83ad-4e58-afb0-d5c6ac067288 req-1c2378ab-7f24-4376-beba-f28b0bd1ad5a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:21.590295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f575af54-83ad-4e58-afb0-d5c6ac067288 req-1c2378ab-7f24-4376-beba-f28b0bd1ad5a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:21.590731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f575af54-83ad-4e58-afb0-d5c6ac067288 req-1c2378ab-7f24-4376-beba-f28b0bd1ad5a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:21.602995 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f575af54-83ad-4e58-afb0-d5c6ac067288 req-1c2378ab-7f24-4376-beba-f28b0bd1ad5a service nova] Creating event network-vif-plugged:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h2-862876-2 Oct 28 14:16:21.608006 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f575af54-83ad-4e58-afb0-d5c6ac067288 req-1c2378ab-7f24-4376-beba-f28b0bd1ad5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035454 Oct 28 14:16:21.608810 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3626/7341] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:16:21.728003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:21.735835 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a28012b-5c21-438b-b23f-b086f19373c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.197056 Oct 28 14:16:21.736522 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3716/7342] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:21 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:22.762130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:22.762865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:22.770020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:22.770515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:22.770989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:22.771682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:22.772151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:22.773093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:22.905638 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:22.914311 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9a66dda8-b563-4953-9fae-77117b941aba tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1364 microversion: 2.1 time: 0.157230 Oct 28 14:16:22.914937 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3627/7343] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:22 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:23.937389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:23.938006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:23.944876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:23.945619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:23.946051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:23.946728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:23.947207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:23.947681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:24.084554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:24.092377 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b3b596d-dcb9-4f52-81ff-1631174c659f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1550 microversion: 2.1 time: 0.158844 Oct 28 14:16:24.092969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3717/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:23 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:24.123616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:24.124136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:24.130956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:24.131460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:24.131916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:24.132648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:24.133122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:24.133576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:24.208741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b93f16a9-057c-430f-b05c-e9035c873777 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088919 Oct 28 14:16:24.209339 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3628/7345] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 14:16:24 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:16:25.279697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6002f7a8-8e88-4c59-ae27-b437ef3987f4 req-0ce2895f-3cfc-40b3-816c-42a74a4fdce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:25.289317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6002f7a8-8e88-4c59-ae27-b437ef3987f4 req-0ce2895f-3cfc-40b3-816c-42a74a4fdce8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:25.289795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6002f7a8-8e88-4c59-ae27-b437ef3987f4 req-0ce2895f-3cfc-40b3-816c-42a74a4fdce8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:25.290230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6002f7a8-8e88-4c59-ae27-b437ef3987f4 req-0ce2895f-3cfc-40b3-816c-42a74a4fdce8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:25.301202 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6002f7a8-8e88-4c59-ae27-b437ef3987f4 req-0ce2895f-3cfc-40b3-816c-42a74a4fdce8 service nova] Creating event network-changed:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h2-862876-2 Oct 28 14:16:25.306704 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6002f7a8-8e88-4c59-ae27-b437ef3987f4 req-0ce2895f-3cfc-40b3-816c-42a74a4fdce8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085917 Oct 28 14:16:25.307401 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3718/7346] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:16:58.110963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:58.111737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=71 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:58.115755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:16:58.118035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:58.123901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:58.125741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:58.125741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:58.126185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:58.126667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:58.127210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:58.158698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:58.164091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Old instance type m1.heat2, new instance type m1.heat {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:16:58.170431 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:16:58.170896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:16:58.171380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:16:58.172287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:16:58.172752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:16:58.349102 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ccd0015f-ad2b-44a6-b2c8-98954708ea10 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b/action" status: 202 len: 0 microversion: 2.1 time: 0.240701 Oct 28 14:16:58.349734 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3629/7347] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:16:58 2022] POST /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 14:16:58.356350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:58.357117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:16:58.362364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:58.362484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:58.368429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:58.368923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:58.369367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:58.370060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:58.370519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:58.370975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:58.604557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:58.607964 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-affcfaa6-423a-445c-81ce-cdaf9855816c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1678 microversion: 2.1 time: 0.253858 Oct 28 14:16:58.608596 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3719/7348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:58 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:16:59.632329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:16:59.632964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:16:59.640013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:59.641017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:59.641483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:59.642189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:16:59.642665 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:16:59.643133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:16:59.825991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:16:59.835188 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9726ea9d-3fbc-4f38-97a0-eeaaeedbf5fc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1678 microversion: 2.1 time: 0.206815 Oct 28 14:16:59.836540 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3630/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:16:59 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:00.859948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:00.861109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:00.867793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:00.868280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:00.868713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:00.869413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:00.869842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:00.870262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:01.071009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:01.079598 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-445b86d0-3197-43ff-a1ba-c85a8844b4c9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1678 microversion: 2.1 time: 0.223566 Oct 28 14:17:01.080190 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3720/7350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:00 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:02.102646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:02.103337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:02.110255 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:02.110772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:02.111244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:02.111949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:02.112418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:02.112854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:02.244738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:02.253266 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5bb85666-a1c8-483c-9f70-932e2bf71a12 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.154531 Oct 28 14:17:02.260180 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3631/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:02 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:03.277727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:03.278369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:03.285789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:03.286359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:03.286809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:03.287493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:03.287943 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:03.288363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:03.416049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:03.423692 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f8c03f20-4d10-4e45-8be4-e08cd2893761 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.150180 Oct 28 14:17:03.424259 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3721/7352] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:03 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:04.447152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:04.447792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:04.454614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:04.455155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:04.455607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:04.456311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:04.456787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:04.457231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:04.587023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:04.595949 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6c081dcc-4817-49a1-a88c-536154f0f3d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.151826 Oct 28 14:17:04.596368 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3632/7353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:04 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:05.619521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:05.620126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:05.628871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:05.629352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:05.629781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:05.630466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:05.630950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:05.631370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:05.852567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:05.860938 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-31a00a93-97a9-4c86-b46c-3194878b5568 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.245502 Oct 28 14:17:05.861515 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3722/7354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:05 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:06.884716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:06.885281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:06.892661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:06.893167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:06.893625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:06.894336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:06.894848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:06.895299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:07.026607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:07.034224 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e575b9a6-e247-49e2-b1b3-ec6474eb73c3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.153494 Oct 28 14:17:07.034847 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3633/7355] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:06 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:08.056398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:08.057002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:08.063832 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:08.064309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:08.064737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:08.065510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:08.065963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:08.066381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:08.196844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:08.205207 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73d520c5-8f8b-4cdb-b196-187cef53338d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.152676 Oct 28 14:17:08.205796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3723/7356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:08 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:09.228264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:09.228937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:09.236103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:09.236607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:09.237049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:09.237757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:09.238234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:09.238680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:09.369969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:09.377713 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ede5256-ef31-4f29-bcbf-e56a442aa265 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.153385 Oct 28 14:17:09.378286 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3634/7357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:09 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:10.401540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:10.402174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:10.409004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:10.409480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:10.409901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:10.410579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:10.411052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:10.411478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:10.545612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:10.554055 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-017734eb-6b87-49db-9cfb-df216c82aec4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.156476 Oct 28 14:17:10.554633 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3724/7358] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:10 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:11.577357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:11.577981 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:11.585394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:11.585889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:11.586333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:11.587063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:11.587530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:11.587965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:11.714903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:11.722769 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-483e12a6-f47f-4d45-9eb8-60f4749018a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.149237 Oct 28 14:17:11.724792 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3635/7359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:11 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:12.746945 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:12.747555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:12.754967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:12.755452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:12.755888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:12.756571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:12.757034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:12.757459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:12.884300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:12.892647 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e133a89-c531-4e66-a018-0f59c9534e3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1683 microversion: 2.1 time: 0.149653 Oct 28 14:17:12.893205 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3725/7360] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:12 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:13.916603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:13.917370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:13.924767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:13.925275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:13.925730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:13.926455 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:13.926969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:13.927415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:14.037101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1a3cd012-a2cb-4ca5-bac0-3ecdd4b2e097 req-639c902e-c256-4a7b-a2b1-3b91e6d9f9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "name": "network-vif-unplugged", "status": "completed", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:14.047995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a3cd012-a2cb-4ca5-bac0-3ecdd4b2e097 req-639c902e-c256-4a7b-a2b1-3b91e6d9f9db service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:14.048646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a3cd012-a2cb-4ca5-bac0-3ecdd4b2e097 req-639c902e-c256-4a7b-a2b1-3b91e6d9f9db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:14.049480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1a3cd012-a2cb-4ca5-bac0-3ecdd4b2e097 req-639c902e-c256-4a7b-a2b1-3b91e6d9f9db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:14.061448 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1a3cd012-a2cb-4ca5-bac0-3ecdd4b2e097 req-639c902e-c256-4a7b-a2b1-3b91e6d9f9db service nova] Creating event network-vif-unplugged:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h1-862876-2 Oct 28 14:17:14.064552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:14.066920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-1a3cd012-a2cb-4ca5-bac0-3ecdd4b2e097 req-639c902e-c256-4a7b-a2b1-3b91e6d9f9db service nova] Instance 869508c9-a34a-40d7-86da-c0578dfe022b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:17:14.073720 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48e0f83e-d3c1-4d90-a934-afaeb3252301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1682 microversion: 2.1 time: 0.161327 Oct 28 14:17:14.074296 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3636/7361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:13 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:14.078471 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1a3cd012-a2cb-4ca5-bac0-3ecdd4b2e097 req-639c902e-c256-4a7b-a2b1-3b91e6d9f9db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046528 Oct 28 14:17:14.079104 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3726/7362] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:17:15.102443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:15.103757 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:15.113718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:15.115725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:15.116480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:15.117229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:15.117717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:15.118166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:15.269994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:15.274701 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e5c9d6a5-b3cc-4915-8379-281f40757d3b tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1682 microversion: 2.1 time: 0.177913 Oct 28 14:17:15.275380 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3637/7363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:15 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:16.095003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4ac5705a-4f56-4f3d-a7a0-ecbd2802f681 req-9e5ae1b3-4a42-4ce9-8dcd-debf50245be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:16.104367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4ac5705a-4f56-4f3d-a7a0-ecbd2802f681 req-9e5ae1b3-4a42-4ce9-8dcd-debf50245be3 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:16.104817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4ac5705a-4f56-4f3d-a7a0-ecbd2802f681 req-9e5ae1b3-4a42-4ce9-8dcd-debf50245be3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:16.105239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4ac5705a-4f56-4f3d-a7a0-ecbd2802f681 req-9e5ae1b3-4a42-4ce9-8dcd-debf50245be3 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:16.116988 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4ac5705a-4f56-4f3d-a7a0-ecbd2802f681 req-9e5ae1b3-4a42-4ce9-8dcd-debf50245be3 service nova] Creating event network-changed:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h1-862876-2 Oct 28 14:17:16.122047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-4ac5705a-4f56-4f3d-a7a0-ecbd2802f681 req-9e5ae1b3-4a42-4ce9-8dcd-debf50245be3 service nova] Instance 869508c9-a34a-40d7-86da-c0578dfe022b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:17:16.133281 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4ac5705a-4f56-4f3d-a7a0-ecbd2802f681 req-9e5ae1b3-4a42-4ce9-8dcd-debf50245be3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043192 Oct 28 14:17:16.133853 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3727/7364] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:17:16.298862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:16.299500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:16.306949 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:16.307457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:16.307915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:16.308631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:16.309115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:16.309563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:16.444333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:16.452539 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9699763e-00b4-40de-bd45-538551c34652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1680 microversion: 2.1 time: 0.157597 Oct 28 14:17:16.453368 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3638/7365] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:16 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:17.479280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:17.480583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:17.486966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:17.487693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:17.488930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:17.489641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:17.490099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:17.490527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:17.688108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:17.694269 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-42117af5-44b5-4199-8bca-b12783bdad87 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1677 microversion: 2.1 time: 0.220551 Oct 28 14:17:17.694866 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3728/7366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:17 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:17.717830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:17.718399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:17.725088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:17.725595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:17.726050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:17.727086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:17.727566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:17.728014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:17.766041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:17.766704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:17.767008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:17.767775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:17.768237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:17.769181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:17.789347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for project d3f099daf43643fd998907948cfdb044. Resources: {'cores', 'ram'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:17:17.794812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for user 8d4a165c2fa64514a6372ce0738c2dea and project d3f099daf43643fd998907948cfdb044. Resources: {'cores', 'ram'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:17:18.191785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-416ac8f0-3e20-4e21-acde-12474c839ee8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b/action" status: 202 len: 0 microversion: 2.1 time: 0.477812 Oct 28 14:17:18.192448 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3639/7367] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:17:17 2022] POST /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:17:18.201024 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:18.201745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:18.207998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:18.208778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:18.209083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:18.209769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:18.210221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:18.210643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:18.419471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:18.427951 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a84c1937-c712-49f1-9dae-bfa9c9b55f66 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1676 microversion: 2.1 time: 0.230524 Oct 28 14:17:18.428390 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3729/7368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:18 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:19.454983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:19.455703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:19.465686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:19.466193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:19.466661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:19.467426 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:19.467901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:19.468364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:19.598188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:19.605933 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1465860e-0c74-40df-85a6-58aed2de2062 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1676 microversion: 2.1 time: 0.156267 Oct 28 14:17:19.606511 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3640/7369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:19 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:20.130241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-b0bf6d06-a6e9-43ac-86c9-779ddb8fb1ff req-4fc25771-2cbe-4b41-bfb2-c0677a0021ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "name": "network-vif-plugged", "status": "completed", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:20.139704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b0bf6d06-a6e9-43ac-86c9-779ddb8fb1ff req-4fc25771-2cbe-4b41-bfb2-c0677a0021ed service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:20.140180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b0bf6d06-a6e9-43ac-86c9-779ddb8fb1ff req-4fc25771-2cbe-4b41-bfb2-c0677a0021ed service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:20.140605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-b0bf6d06-a6e9-43ac-86c9-779ddb8fb1ff req-4fc25771-2cbe-4b41-bfb2-c0677a0021ed service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:20.152917 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-b0bf6d06-a6e9-43ac-86c9-779ddb8fb1ff req-4fc25771-2cbe-4b41-bfb2-c0677a0021ed service nova] Creating event network-vif-plugged:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h1-862876-2 Oct 28 14:17:20.158151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-b0bf6d06-a6e9-43ac-86c9-779ddb8fb1ff req-4fc25771-2cbe-4b41-bfb2-c0677a0021ed service nova] Instance 869508c9-a34a-40d7-86da-c0578dfe022b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:17:20.168691 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-b0bf6d06-a6e9-43ac-86c9-779ddb8fb1ff req-4fc25771-2cbe-4b41-bfb2-c0677a0021ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099703 Oct 28 14:17:20.169288 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3730/7370] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:17:20.630265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:20.630837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:20.637539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:20.638041 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:20.638528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:20.639275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:20.639750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:20.640190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:20.644322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:20.774286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:20.782106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b0bc805f-2a8a-48b7-b80c-2e7e43ff5cf1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1676 microversion: 2.1 time: 0.156489 Oct 28 14:17:20.782662 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3641/7371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:20 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:21.807070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:21.807778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:21.814127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:21.814605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:21.815066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:21.815768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:21.816062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d11dbe04-8dcc-415e-9270-72ed7803046e req-b2d0d0ad-c22d-489f-82ed-07a0234a54d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "name": "network-vif-unplugged", "status": "completed", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:21.817025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:21.817123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:21.827863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d11dbe04-8dcc-415e-9270-72ed7803046e req-b2d0d0ad-c22d-489f-82ed-07a0234a54d2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:21.833270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d11dbe04-8dcc-415e-9270-72ed7803046e req-b2d0d0ad-c22d-489f-82ed-07a0234a54d2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:21.833270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d11dbe04-8dcc-415e-9270-72ed7803046e req-b2d0d0ad-c22d-489f-82ed-07a0234a54d2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:21.841219 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d11dbe04-8dcc-415e-9270-72ed7803046e req-b2d0d0ad-c22d-489f-82ed-07a0234a54d2 service nova] Creating event network-vif-unplugged:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h2-862876-2 Oct 28 14:17:21.846503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-d11dbe04-8dcc-415e-9270-72ed7803046e req-b2d0d0ad-c22d-489f-82ed-07a0234a54d2 service nova] Instance 869508c9-a34a-40d7-86da-c0578dfe022b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:17:21.857677 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d11dbe04-8dcc-415e-9270-72ed7803046e req-b2d0d0ad-c22d-489f-82ed-07a0234a54d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045707 Oct 28 14:17:21.860922 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3642/7372] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:17:22.055338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:22.063108 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10bc9742-b78c-45c7-8a1e-b5dfee823d3f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1676 microversion: 2.1 time: 0.261485 Oct 28 14:17:22.067049 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3731/7373] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:21 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1676 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:23.089155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:23.089794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:23.096885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:23.097476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:23.098592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:23.099364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:23.099852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:23.100306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:23.229721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:23.237820 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4cfa0171-4542-4c1e-a9c4-1208c0ee5a36 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1676 microversion: 2.1 time: 0.153471 Oct 28 14:17:23.238397 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3643/7374] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:23 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:23.881721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e97f514b-b38f-41ba-b37f-cf12fef5a8ef req-74541b1e-b2a2-4483-8963-f0e0b65a7c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:23.899871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e97f514b-b38f-41ba-b37f-cf12fef5a8ef req-74541b1e-b2a2-4483-8963-f0e0b65a7c00 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:23.900465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e97f514b-b38f-41ba-b37f-cf12fef5a8ef req-74541b1e-b2a2-4483-8963-f0e0b65a7c00 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:23.900897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e97f514b-b38f-41ba-b37f-cf12fef5a8ef req-74541b1e-b2a2-4483-8963-f0e0b65a7c00 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:23.912953 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e97f514b-b38f-41ba-b37f-cf12fef5a8ef req-74541b1e-b2a2-4483-8963-f0e0b65a7c00 service nova] Creating event network-changed:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h2-862876-2 Oct 28 14:17:23.918131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-e97f514b-b38f-41ba-b37f-cf12fef5a8ef req-74541b1e-b2a2-4483-8963-f0e0b65a7c00 service nova] Instance 869508c9-a34a-40d7-86da-c0578dfe022b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:17:23.929184 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e97f514b-b38f-41ba-b37f-cf12fef5a8ef req-74541b1e-b2a2-4483-8963-f0e0b65a7c00 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055251 Oct 28 14:17:23.929801 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3732/7375] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:17:24.261857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:24.263217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:24.272963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:24.273602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:24.274131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:24.274969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:24.275518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:24.276033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:24.432334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:24.440241 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-85f34ef6-0ef7-45d8-ba96-4d355c096457 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1676 microversion: 2.1 time: 0.182971 Oct 28 14:17:24.440835 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3644/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:24 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:25.465385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:25.466083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:25.472246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:25.473225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:25.473658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:25.474373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:25.474856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:25.475281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:25.603504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:25.611227 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8107f951-d209-49d1-b9b6-318b7420c124 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1669 microversion: 2.1 time: 0.150917 Oct 28 14:17:25.611970 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3733/7377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:25 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:25.635435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:25.636094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:25.642872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:25.643384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:25.643868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:25.644583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:25.645059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:25.645502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:25.778718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:25.787046 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6d035662-baa3-4ccd-8a25-ce98478ea47f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1669 microversion: 2.1 time: 0.155471 Oct 28 14:17:25.787622 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3645/7378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:25 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:25.809555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:25.810109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:25.816104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:25.816597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:25.817037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:25.817731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:25.818192 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:25.818618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:25.959570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:25.967911 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1825b9d0-4633-418a-a765-040ebdea1dfa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1669 microversion: 2.1 time: 0.162408 Oct 28 14:17:25.968468 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3734/7379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:25 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:25.991816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:25.992329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:25.998236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:25.998730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:25.999212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:25.999969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:26.000437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:26.000872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:26.029009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:17:26.368856 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ee4293b-97c9-4d7f-915b-7034d3ca21d6 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 204 len: 0 microversion: 2.1 time: 0.380623 Oct 28 14:17:26.369390 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3646/7380] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:17:25 2022] DELETE /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:17:26.377713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:26.381488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:26.385544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:26.386041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:26.386630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:26.387363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:26.387815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:26.388239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:26.516167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:26.523856 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-39265aa3-4262-4292-b9fe-dc4d0f9b5301 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1675 microversion: 2.1 time: 0.150102 Oct 28 14:17:26.524422 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3735/7381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:26 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:27.546943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:27.547659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:27.554340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:27.554877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:27.555327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:27.556023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:27.556491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:27.556928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:27.694381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:27.703345 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-347e08f0-4fdb-4373-b822-c4dec250522f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1675 microversion: 2.1 time: 0.160613 Oct 28 14:17:27.708027 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3647/7382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:27 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:27.868413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-c7f28342-fcf4-483d-8dd6-554b7f5fa15a req-fb8ffeb4-0522-42ab-b4a8-96c702c9efbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "name": "network-vif-plugged", "status": "completed", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:27.877549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c7f28342-fcf4-483d-8dd6-554b7f5fa15a req-fb8ffeb4-0522-42ab-b4a8-96c702c9efbc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:27.878037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c7f28342-fcf4-483d-8dd6-554b7f5fa15a req-fb8ffeb4-0522-42ab-b4a8-96c702c9efbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:27.878471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-c7f28342-fcf4-483d-8dd6-554b7f5fa15a req-fb8ffeb4-0522-42ab-b4a8-96c702c9efbc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:27.890441 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-c7f28342-fcf4-483d-8dd6-554b7f5fa15a req-fb8ffeb4-0522-42ab-b4a8-96c702c9efbc service nova] Creating event network-vif-plugged:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h2-862876-2 Oct 28 14:17:27.896081 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-c7f28342-fcf4-483d-8dd6-554b7f5fa15a req-fb8ffeb4-0522-42ab-b4a8-96c702c9efbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033777 Oct 28 14:17:27.897059 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3736/7383] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:17:28.728209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:28.728758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:28.731011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:28.732763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:28.737568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:28.743779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:28.743779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:28.743779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:28.743779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:28.743779 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:28.808860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:28.817146 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-844e4cba-1a5f-4d42-afe8-d72072d6f2e1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 200 len: 1607 microversion: 2.1 time: 0.092942 Oct 28 14:17:28.824364 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3648/7384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:28 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 1607 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:28.849388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-780d0e48-ee1e-48b4-b7bb-c39ba2e059f7 req-b3a54fb2-d25e-443c-ba7b-380aa452d03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869508c9-a34a-40d7-86da-c0578dfe022b", "name": "network-vif-deleted", "tag": "fe22cce3-4617-46cf-8cba-2d8bb9373c0b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:28.856225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=37 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:28.860071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-780d0e48-ee1e-48b4-b7bb-c39ba2e059f7 req-b3a54fb2-d25e-443c-ba7b-380aa452d03f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:28.860553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-780d0e48-ee1e-48b4-b7bb-c39ba2e059f7 req-b3a54fb2-d25e-443c-ba7b-380aa452d03f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:28.860981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-780d0e48-ee1e-48b4-b7bb-c39ba2e059f7 req-b3a54fb2-d25e-443c-ba7b-380aa452d03f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:28.872127 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-780d0e48-ee1e-48b4-b7bb-c39ba2e059f7 req-b3a54fb2-d25e-443c-ba7b-380aa452d03f service nova] Creating event network-vif-deleted:fe22cce3-4617-46cf-8cba-2d8bb9373c0b for instance 869508c9-a34a-40d7-86da-c0578dfe022b on n-h2-862876-2 Oct 28 14:17:28.877071 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-780d0e48-ee1e-48b4-b7bb-c39ba2e059f7 req-b3a54fb2-d25e-443c-ba7b-380aa452d03f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Oct 28 14:17:28.877666 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3737/7385] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:17:29.841664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:29.842302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:29.849610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:29.850115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:29.850570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:29.851348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:29.851824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:29.852266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:29.865856 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b HTTP/1.1 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '869508c9-a34a-40d7-86da-c0578dfe022b'} Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:17:29.867608 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c812817e-37d6-4112-83a8-5d3a10a48be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 404 len: 111 microversion: 2.1 time: 0.031419 Oct 28 14:17:29.872692 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3649/7386] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:29 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:17:29.885927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:29.886728 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:29.893986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:29.894467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:29.894929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:29.895616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:29.896072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:29.896497 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:29.900522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=100 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:29.909485 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b HTTP/1.1 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '869508c9-a34a-40d7-86da-c0578dfe022b'} Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:17:29.912298 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-34c7cbf3-92ac-4ec4-9085-a4fa7555c7ec tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 404 len: 111 microversion: 2.1 time: 0.031396 Oct 28 14:17:29.917409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3738/7387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:29 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 14:17:29.963478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2033125864", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "cfec18d1-b194-413f-a18f-93750c65975a"}], "security_groups": [{"name": "tempest-securitygroup--1663753468"}], "key_name": "tempest-keypair-2121299359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:30.077633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] validate_networks() for [('cfec18d1-b194-413f-a18f-93750c65975a', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:17:30.443008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:17:30.443445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:17:30.443928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:17:30.444377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:17:30.444803 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:17:30.454018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:30.454515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:30.454998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:30.455734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:30.456204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:30.457185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:30.474728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:17:30.480273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for user 8d4a165c2fa64514a6372ce0738c2dea and project d3f099daf43643fd998907948cfdb044. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:17:30.492485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:17:30.494889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:17:30.611310 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7f361c71-2574-4e26-9785-378fb87ca76e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.654130 Oct 28 14:17:30.612006 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3650/7388] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:17:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:17:30.623614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6fd36d16-2a60-475f-9729-32babbf51b34 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:30.628085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6fd36d16-2a60-475f-9729-32babbf51b34 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:30.681398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6fd36d16-2a60-475f-9729-32babbf51b34 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:30.689185 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6fd36d16-2a60-475f-9729-32babbf51b34 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1239 microversion: 2.1 time: 0.069718 Oct 28 14:17:30.689748 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3739/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:30 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:31.714132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:31.714794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:31.721434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:31.721941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:31.722982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:31.723699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:31.724171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:31.724616 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:31.785958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:31.793758 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bd34daaf-f984-4457-bac0-1979527878df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1243 microversion: 2.1 time: 0.084510 Oct 28 14:17:31.794388 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3651/7390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:31 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1243 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:32.817975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:32.818608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:32.825588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:32.826071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:32.826504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:32.827222 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:32.827674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:32.828098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:32.889428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:32.897465 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9561d41-efb1-4379-a60a-ceb50cd75f3a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1299 microversion: 2.1 time: 0.084144 Oct 28 14:17:32.898054 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3740/7391] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:32 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:33.921767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:33.922409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:33.929284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:33.929794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:33.930245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:33.930988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:33.931465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:33.931906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:34.069462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:34.077470 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a1176a0-e0ec-453e-945a-0eb857e64201 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1365 microversion: 2.1 time: 0.159798 Oct 28 14:17:34.078048 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3652/7392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:33 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:34.290888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0d2ee9a4-9586-436e-a02f-dfbb61c2e3fd req-f95f5a1f-621b-44f9-8b11-32b91f64d527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:34.302130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d2ee9a4-9586-436e-a02f-dfbb61c2e3fd req-f95f5a1f-621b-44f9-8b11-32b91f64d527 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:34.302601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d2ee9a4-9586-436e-a02f-dfbb61c2e3fd req-f95f5a1f-621b-44f9-8b11-32b91f64d527 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:34.303109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0d2ee9a4-9586-436e-a02f-dfbb61c2e3fd req-f95f5a1f-621b-44f9-8b11-32b91f64d527 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:34.315779 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0d2ee9a4-9586-436e-a02f-dfbb61c2e3fd req-f95f5a1f-621b-44f9-8b11-32b91f64d527 service nova] Creating event network-changed:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h1-862876-2 Oct 28 14:17:34.321799 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0d2ee9a4-9586-436e-a02f-dfbb61c2e3fd req-f95f5a1f-621b-44f9-8b11-32b91f64d527 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 Oct 28 14:17:34.325921 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3741/7393] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:17:35.102006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:35.102601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:35.109749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:35.110250 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:35.110710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:35.111444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:35.111921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:35.112365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:35.243727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:35.251436 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a313715a-4088-4f08-b18a-625bb7539f21 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1365 microversion: 2.1 time: 0.154046 Oct 28 14:17:35.254483 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3653/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:35 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:36.277116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:36.277756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:36.283914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:36.284413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:36.285475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:36.286156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:36.286608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:36.287058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:36.420462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:36.428065 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-763ce8c3-f378-4f82-a312-83ca345e369c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1365 microversion: 2.1 time: 0.156106 Oct 28 14:17:36.428630 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3742/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:36 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:37.451520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:37.452146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:37.459882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:37.460375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:37.460821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:37.461515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:37.461980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:37.462412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:37.590270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:37.598025 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-489dcfc2-44c7-4dce-a9be-a8fb05363652 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1365 microversion: 2.1 time: 0.150454 Oct 28 14:17:37.598629 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3654/7396] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:37 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:38.621237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:38.621839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:38.628038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:38.628612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:38.629045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:38.629727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:38.630176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:38.630600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:38.757145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:38.764768 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9caeff3a-02b6-4ae8-ae0b-eaa76dc87672 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1365 microversion: 2.1 time: 0.147437 Oct 28 14:17:38.765347 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3743/7397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:38 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:39.787934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:39.788564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:39.794932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:39.795386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:39.795831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:39.796527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:39.796991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:39.797427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:39.926707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:39.934394 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fcb4eb70-fcca-463f-86af-1605113ded9c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1365 microversion: 2.1 time: 0.150403 Oct 28 14:17:39.935025 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3655/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:39 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:40.183354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-46c810fe-f128-4458-b547-34590c53526f req-58fdee47-f8db-4961-8e0b-23c558bd6d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "name": "network-vif-plugged", "status": "completed", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:40.194437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46c810fe-f128-4458-b547-34590c53526f req-58fdee47-f8db-4961-8e0b-23c558bd6d51 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:40.195066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46c810fe-f128-4458-b547-34590c53526f req-58fdee47-f8db-4961-8e0b-23c558bd6d51 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:40.195503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-46c810fe-f128-4458-b547-34590c53526f req-58fdee47-f8db-4961-8e0b-23c558bd6d51 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:40.207116 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-46c810fe-f128-4458-b547-34590c53526f req-58fdee47-f8db-4961-8e0b-23c558bd6d51 service nova] Creating event network-vif-plugged:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h1-862876-2 Oct 28 14:17:40.212014 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-46c810fe-f128-4458-b547-34590c53526f req-58fdee47-f8db-4961-8e0b-23c558bd6d51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Oct 28 14:17:40.212597 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3744/7399] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:17:40.958839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:40.959401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:40.961269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:40.961923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:40.967482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:40.967979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:40.968425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:40.969116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:40.969582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:40.970018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:41.097027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:41.105279 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-135a0eef-b215-4d2f-877d-eca5d67d278c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1365 microversion: 2.1 time: 0.150906 Oct 28 14:17:41.105850 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3656/7400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:40 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:42.125483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:17:42.130507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:42.131258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:42.137283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:42.137760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:42.138200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:42.138914 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:42.139370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:42.139794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:42.267167 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:17:42.275337 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb549eed-9a77-4d59-a094-d4286d4e814c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1552 microversion: 2.1 time: 0.150829 Oct 28 14:17:42.275920 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3745/7401] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:17:42 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:17:42.299233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:17:42.299743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:17:42.306416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:42.306955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:42.307408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:42.308110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:42.308580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:42.309022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:42.384397 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d1723014-4fed-4844-92c9-0a8d725045cd tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089159 Oct 28 14:17:42.384997 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3657/7402] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 14:17:42 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:17:43.356969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-70c19aee-3fa2-40ff-95a8-6c9a4d69dc4d req-9da5c135-1d73-4020-a3b1-303e486e78bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:17:43.367939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-70c19aee-3fa2-40ff-95a8-6c9a4d69dc4d req-9da5c135-1d73-4020-a3b1-303e486e78bc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:17:43.368414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-70c19aee-3fa2-40ff-95a8-6c9a4d69dc4d req-9da5c135-1d73-4020-a3b1-303e486e78bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:17:43.368847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-70c19aee-3fa2-40ff-95a8-6c9a4d69dc4d req-9da5c135-1d73-4020-a3b1-303e486e78bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:17:43.380312 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-70c19aee-3fa2-40ff-95a8-6c9a4d69dc4d req-9da5c135-1d73-4020-a3b1-303e486e78bc service nova] Creating event network-changed:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h1-862876-2 Oct 28 14:17:43.385264 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-70c19aee-3fa2-40ff-95a8-6c9a4d69dc4d req-9da5c135-1d73-4020-a3b1-303e486e78bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032027 Oct 28 14:17:43.385860 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3746/7403] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:18:16.529871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:16.530906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:16.534558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:16.535213 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:16.541604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:16.543073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:16.543073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:16.543494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:16.543978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:16.544420 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:16.699109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:16.706905 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2943464c-249d-4834-aa29-8e92b68c5758 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1671 microversion: 2.1 time: 0.179179 Oct 28 14:18:16.707474 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3658/7404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:16 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:16.729249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=21 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:16.730012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=30 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:16.734423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "681bb464-9e91-4de4-be22-bed085516aec"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:18:16.740135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:16.744946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:16.745447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:16.745886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:16.746589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:16.747079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:16.747505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:17.395948 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8840a57f-849c-4466-8ec6-3c380320e395 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669114 Oct 28 14:18:17.396993 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3747/7405] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 14:18:16 2022] POST /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:18:29.275682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:18:29.278121 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:29.280917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:29.281596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:29.286409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:29.292495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:29.292495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:29.292495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:29.292495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:29.292495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:29.319812 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:29.326139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Old instance type m1.heat2, new instance type m1.heat {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:18:29.333012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:18:29.333449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:18:29.333937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:18:29.334361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:18:29.334811 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:18:29.562937 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f02e30c2-df38-4f81-8547-29227a479272 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/action" status: 202 len: 0 microversion: 2.1 time: 0.291114 Oct 28 14:18:29.563657 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3659/7406] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:18:29 2022] POST /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:18:29.570090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:29.570868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:29.575552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:29.576204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:29.582130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:29.582604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:29.583058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:29.583852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:29.584305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:29.584722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:29.721398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:29.729993 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66ea97d4-d758-4f30-a09b-9d1059393b2c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1726 microversion: 2.1 time: 0.161744 Oct 28 14:18:29.730578 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3748/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:29 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:30.755389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:30.756020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:30.762604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:30.763132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:30.763581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:30.764354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:30.764820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:30.765253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:30.897007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:30.905411 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ae9d8be-89f1-4624-aa09-dbc3ccca52ff tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1726 microversion: 2.1 time: 0.154992 Oct 28 14:18:30.905989 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3660/7408] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:30 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:31.929665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:31.930283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:31.937548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:31.938031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:31.938466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:31.939193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:31.939647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:31.940071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:32.142944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:32.151361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-08ce4729-20bd-4276-be95-b6a7a8a8c2eb tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1726 microversion: 2.1 time: 0.225952 Oct 28 14:18:32.151943 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3749/7409] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:31 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:33.175010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:33.175599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:33.183053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:33.183555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:33.184005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:33.184708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:33.185176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:33.185620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:33.316177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:33.325319 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f93aeea-1496-453f-875c-5a0aa2e54060 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.154298 Oct 28 14:18:33.325911 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3661/7410] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:33 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:34.349203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:34.349863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:34.356631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:34.357122 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:34.357579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:34.358239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:34.358692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:34.359140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:34.489588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:34.498281 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46e49d82-0813-4a71-9d58-c10f36ace02d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.153331 Oct 28 14:18:34.498898 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3750/7411] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:34 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:35.521476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:35.522141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:35.529643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:35.530143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:35.530596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:35.531336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:35.531806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:35.532247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:35.660352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:35.668771 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1ee65ee2-f33d-4ba6-9fdd-a8a0015155c4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.151237 Oct 28 14:18:35.669394 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3662/7412] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:35 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:36.691439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:36.692091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:36.699775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:36.700268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:36.700704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:36.701679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:36.702145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:36.702575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:36.829023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:36.837465 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-56c6d408-4614-45ea-ad82-ab1aadf96478 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.149896 Oct 28 14:18:36.838042 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3751/7413] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:36 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:37.861472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:37.862008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:37.868712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:37.869801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:37.870247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:37.870970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:37.871435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:37.871868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:37.997597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:38.005858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f840df8-0b92-4678-a0fe-891534f93351 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.148376 Oct 28 14:18:38.006436 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3663/7414] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:37 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:39.028552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:39.029191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:39.035863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:39.036342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:39.036773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:39.037457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:39.037906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:39.038323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:39.168399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:39.176564 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-55e50c3b-d9df-44fe-ae53-253deb894ef4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.152049 Oct 28 14:18:39.177125 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3752/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:39 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:40.201454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:40.202110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:40.208210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:40.208716 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:40.209170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:40.209877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:40.210352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:40.210821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:40.349871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:40.358411 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8e808e8f-c41d-4003-90fb-19027197a61d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.161990 Oct 28 14:18:40.359035 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3664/7416] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:40 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:41.382509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:41.383139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:41.390191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:41.390667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:41.391125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:41.391801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:41.392248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:41.392665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:41.523254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:41.531997 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e531b1e6-e0e0-4b3e-a643-07b9726e293d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.153370 Oct 28 14:18:41.532565 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3753/7417] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:41 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:42.555011 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:42.555647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:42.562444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:42.562991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:42.563446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:42.564201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:42.564671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:42.565106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:42.693615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:42.702181 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2edd5a6a-8ee2-4d71-bdf4-d5154b916112 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.151318 Oct 28 14:18:42.702765 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3665/7418] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:42 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:43.726088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:43.726693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:43.733625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:43.734108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:43.734553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:43.735261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:43.735709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:43.736124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:43.864081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:43.872134 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-844ab61f-e34a-4fde-957b-5326d73296bf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.149883 Oct 28 14:18:43.872702 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3754/7419] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:43 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:44.896271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:44.896897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:44.904352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:44.904832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:44.905275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:44.905970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:44.906436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:44.906897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:45.373650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:45.382112 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50173244-8d35-44ad-aff3-9d6f3264fddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.490157 Oct 28 14:18:45.382698 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3666/7420] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:44 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:46.406060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:46.406682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:46.413468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:46.416349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:46.416349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:46.416349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:46.416349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:46.416349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:46.554909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:46.563765 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-343fc925-bc9d-497d-9420-74641cb7d38f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1731 microversion: 2.1 time: 0.161534 Oct 28 14:18:46.564428 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3755/7421] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:46 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:47.493880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-d2ab25e1-457c-45fd-8c63-5fa209caaecc req-6619528e-f8fe-4fcd-b74c-dfda4511d707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "name": "network-vif-unplugged", "status": "completed", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:18:47.505022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d2ab25e1-457c-45fd-8c63-5fa209caaecc req-6619528e-f8fe-4fcd-b74c-dfda4511d707 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:47.505593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d2ab25e1-457c-45fd-8c63-5fa209caaecc req-6619528e-f8fe-4fcd-b74c-dfda4511d707 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:47.505969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-d2ab25e1-457c-45fd-8c63-5fa209caaecc req-6619528e-f8fe-4fcd-b74c-dfda4511d707 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:47.518022 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-d2ab25e1-457c-45fd-8c63-5fa209caaecc req-6619528e-f8fe-4fcd-b74c-dfda4511d707 service nova] Creating event network-vif-unplugged:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h2-862876-2 Oct 28 14:18:47.523401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-d2ab25e1-457c-45fd-8c63-5fa209caaecc req-6619528e-f8fe-4fcd-b74c-dfda4511d707 service nova] Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:18:47.535172 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-d2ab25e1-457c-45fd-8c63-5fa209caaecc req-6619528e-f8fe-4fcd-b74c-dfda4511d707 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045087 Oct 28 14:18:47.535838 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3667/7422] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:18:47.644845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:47.646197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:47.654282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:47.654795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:47.655232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:47.655963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:47.656417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:47.656847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:47.875775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:47.884333 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7cd31dc1-75bf-4bb6-9c04-4f96398ce8a1 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1730 microversion: 2.1 time: 0.243432 Oct 28 14:18:47.895036 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3756/7423] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:47 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:48.910846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:48.911575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:48.918314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:48.918852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:48.919309 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:48.920124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:48.920495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:48.920936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:49.051201 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:49.060144 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4cf190d2-bb16-4fed-8580-335719855ddc tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1730 microversion: 2.1 time: 0.154414 Oct 28 14:18:49.060720 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3668/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:48 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:49.550049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a7a6dece-c370-4b73-a693-adc1fdadff96 req-ff320734-907e-47c6-a9c0-090f490b75e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:18:49.560630 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7a6dece-c370-4b73-a693-adc1fdadff96 req-ff320734-907e-47c6-a9c0-090f490b75e6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:49.561108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7a6dece-c370-4b73-a693-adc1fdadff96 req-ff320734-907e-47c6-a9c0-090f490b75e6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:49.561537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7a6dece-c370-4b73-a693-adc1fdadff96 req-ff320734-907e-47c6-a9c0-090f490b75e6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:49.573324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a7a6dece-c370-4b73-a693-adc1fdadff96 req-ff320734-907e-47c6-a9c0-090f490b75e6 service nova] Creating event network-changed:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h2-862876-2 Oct 28 14:18:49.578479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-a7a6dece-c370-4b73-a693-adc1fdadff96 req-ff320734-907e-47c6-a9c0-090f490b75e6 service nova] Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:18:49.589602 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a7a6dece-c370-4b73-a693-adc1fdadff96 req-ff320734-907e-47c6-a9c0-090f490b75e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043265 Oct 28 14:18:49.590198 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3757/7425] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:18:50.084617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:50.085198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:50.092996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:50.093707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:50.094214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:50.095035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:50.095628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:50.096131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:50.236467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:50.245575 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-437ab8de-fbd1-4f42-8d00-a95f9539b33d tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.165215 Oct 28 14:18:50.254123 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3669/7426] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:50 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:51.271416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:51.272153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:51.279099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:51.279596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:51.280033 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:51.280725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:51.281185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:51.281615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:51.415184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:51.423825 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09e33e50-f487-4d64-b262-4ddc222833a3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.157411 Oct 28 14:18:51.424424 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3758/7427] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:51 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:52.448240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:52.448240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:52.455153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:52.455662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:52.456165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:52.456879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:52.457352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:52.457793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:52.593764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:52.602229 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0aeb9117-c4bd-4ae9-b6ec-165f934b2db2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.159133 Oct 28 14:18:52.602825 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3670/7428] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:52 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:53.626184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:53.626993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:53.633819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:53.634301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:53.635342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:53.636038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:53.636487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:53.636905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:53.768554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:53.777627 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-62c245c1-e5a4-4186-a9a6-5ff51ff4348f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.155409 Oct 28 14:18:53.778201 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3759/7429] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:53 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:54.801115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:54.801678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:54.809158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:54.809660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:54.810119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:54.810855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:54.811331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:54.811774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:54.947284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:54.956019 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6c7227ff-10b5-423a-826f-939446e07852 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.158911 Oct 28 14:18:54.956608 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3671/7430] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:54 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:55.979255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:55.979991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:55.987021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:55.987585 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:55.988098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:55.988855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:55.989396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:55.989908 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:56.124234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:56.135609 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d9ad7976-c74e-4ab0-bfa3-a6abffde8ad2 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.159513 Oct 28 14:18:56.136189 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3760/7431] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:55 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:57.158830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:57.159478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:57.166249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:57.166761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:57.167226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:57.167927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:57.168414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:57.168836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:57.299767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:57.308118 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2a5f12bf-fbec-48b5-88de-b80ec90c0008 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.153315 Oct 28 14:18:57.308701 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3672/7432] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:57 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:58.331924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:58.333163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:58.340374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:58.340853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:58.341287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:58.341968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:58.342417 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:58.342860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:58.480339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:58.488669 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb5a2df8-b8c7-4c0c-af12-d42653f2bbde tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.160631 Oct 28 14:18:58.489260 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3761/7433] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:58 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:18:59.511960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:18:59.512583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:18:59.515432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=33 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:59.520163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:59.520658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:59.521102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:59.521799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:18:59.522306 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:18:59.522770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:18:59.525339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:18:59.652068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:18:59.660431 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a4c6080-58e3-4bf1-b57c-2afb85cd9fbe tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.152393 Oct 28 14:18:59.661007 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3673/7434] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:18:59 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:00.684826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:00.685433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:00.688307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=29 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:00.693023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:00.693506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:00.693936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:00.694622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:00.695097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:00.695523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:00.828485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:00.836743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb6a3b76-4747-4f20-991f-57874b379bf3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1728 microversion: 2.1 time: 0.156443 Oct 28 14:19:00.837312 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3762/7435] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:00 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:01.860610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:01.861160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:01.868052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:01.868545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:01.868989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:01.869691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:01.870156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:01.870598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:02.001572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:02.009875 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5a2a08ca-8ada-4dc5-a64f-bd1d185b3ebf tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1725 microversion: 2.1 time: 0.153290 Oct 28 14:19:02.010445 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3674/7436] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:01 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:02.032922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:02.033454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:02.040368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:02.040858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:02.041302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:02.041997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:02.042459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:02.042919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:02.046965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=89 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:02.081653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:02.082382 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:02.082836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:02.083557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:02.084008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:02.084457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:02.104292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for project d3f099daf43643fd998907948cfdb044. Resources: {'cores', 'ram'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:19:02.110099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Getting quotas for user 8d4a165c2fa64514a6372ce0738c2dea and project d3f099daf43643fd998907948cfdb044. Resources: {'cores', 'ram'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:19:02.443197 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce0a0515-4484-42ff-85ed-d5217949c136 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "POST /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/action" status: 202 len: 0 microversion: 2.1 time: 0.413898 Oct 28 14:19:02.443836 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3763/7437] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:19:02 2022] POST /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:19:02.453209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:02.453849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:02.460018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:02.460536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:02.460976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:02.461686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:02.462158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:02.462597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:02.604574 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:02.615917 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-265b9a0b-d83a-40de-9ed3-83a2b47d6a6f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.167500 Oct 28 14:19:02.616839 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3675/7438] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:02 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:03.641107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:03.641805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:03.647917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:03.648396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:03.648822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:03.649496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:03.650062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:03.650470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:03.783673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:03.791764 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cd7414f5-a4a2-44b3-b2f8-d98a6f174a55 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.155819 Oct 28 14:19:03.792905 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3764/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:03 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:04.280052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8e3307e7-35a9-426a-9ec9-68e64bd88f85 req-5b37f9ca-4b21-4ee9-aea7-0e9fb67327af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "name": "network-vif-plugged", "status": "completed", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:04.290219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e3307e7-35a9-426a-9ec9-68e64bd88f85 req-5b37f9ca-4b21-4ee9-aea7-0e9fb67327af service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:04.290719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e3307e7-35a9-426a-9ec9-68e64bd88f85 req-5b37f9ca-4b21-4ee9-aea7-0e9fb67327af service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:04.291202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e3307e7-35a9-426a-9ec9-68e64bd88f85 req-5b37f9ca-4b21-4ee9-aea7-0e9fb67327af service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:04.303027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8e3307e7-35a9-426a-9ec9-68e64bd88f85 req-5b37f9ca-4b21-4ee9-aea7-0e9fb67327af service nova] Creating event network-vif-plugged:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h2-862876-2 Oct 28 14:19:04.308819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-8e3307e7-35a9-426a-9ec9-68e64bd88f85 req-5b37f9ca-4b21-4ee9-aea7-0e9fb67327af service nova] Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:19:04.319725 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8e3307e7-35a9-426a-9ec9-68e64bd88f85 req-5b37f9ca-4b21-4ee9-aea7-0e9fb67327af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043406 Oct 28 14:19:04.320484 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3676/7440] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:19:04.816135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:04.817285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:04.824023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:04.824510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:04.824949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:04.825642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:04.826099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:04.826523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:04.960860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:04.969635 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-02350918-620d-4726-ab3b-8fd55fdd3d05 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.157454 Oct 28 14:19:04.973018 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3765/7441] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:04 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:05.995393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:05.996102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:06.002939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:06.003437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:06.003883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:06.004582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:06.005045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:06.005479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:06.142465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:06.150953 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4793e9ee-bf3e-4811-8a86-c55cdf0bf69a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.160606 Oct 28 14:19:06.151524 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3677/7442] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:05 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:07.173440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:07.173992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:07.180715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:07.181200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:07.181637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:07.182321 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:07.182816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:07.183249 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:07.316949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:07.329552 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8547af5b-c0a1-42c7-84e9-c591aa390707 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.160055 Oct 28 14:19:07.330152 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3766/7443] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:07 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:08.189376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4e42985e-15e0-4329-82fd-cafc08e44ddd req-1a0b7a14-8aed-42dc-abf3-45cc55fdcd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "name": "network-vif-unplugged", "status": "completed", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:08.199865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4e42985e-15e0-4329-82fd-cafc08e44ddd req-1a0b7a14-8aed-42dc-abf3-45cc55fdcd42 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:08.200997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4e42985e-15e0-4329-82fd-cafc08e44ddd req-1a0b7a14-8aed-42dc-abf3-45cc55fdcd42 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:08.201448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4e42985e-15e0-4329-82fd-cafc08e44ddd req-1a0b7a14-8aed-42dc-abf3-45cc55fdcd42 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:08.212990 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4e42985e-15e0-4329-82fd-cafc08e44ddd req-1a0b7a14-8aed-42dc-abf3-45cc55fdcd42 service nova] Creating event network-vif-unplugged:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h1-862876-2 Oct 28 14:19:08.218247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-4e42985e-15e0-4329-82fd-cafc08e44ddd req-1a0b7a14-8aed-42dc-abf3-45cc55fdcd42 service nova] Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:19:08.228656 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4e42985e-15e0-4329-82fd-cafc08e44ddd req-1a0b7a14-8aed-42dc-abf3-45cc55fdcd42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043529 Oct 28 14:19:08.229263 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3678/7444] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:19:08.354429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:08.356221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:08.364195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:08.364688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:08.365132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:08.365831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:08.366295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:08.366858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:08.591619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:08.600180 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe227e80-aaa4-4239-961a-b09294cb2166 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.250478 Oct 28 14:19:08.600764 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3767/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:08 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:09.626175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:09.626913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:09.633024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:09.633517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:09.633961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:09.634657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:09.635144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:09.635582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:09.768106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:09.776889 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-004121ed-6c2f-4688-8861-2d016a74f135 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.156417 Oct 28 14:19:09.777520 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3679/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:09 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:10.243566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5fb397d4-79bb-46ba-ab93-1860aa23d029 req-80a9ff53-c64c-447c-84a6-3d335f56cdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:10.253890 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fb397d4-79bb-46ba-ab93-1860aa23d029 req-80a9ff53-c64c-447c-84a6-3d335f56cdf6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:10.254370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fb397d4-79bb-46ba-ab93-1860aa23d029 req-80a9ff53-c64c-447c-84a6-3d335f56cdf6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:10.254823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fb397d4-79bb-46ba-ab93-1860aa23d029 req-80a9ff53-c64c-447c-84a6-3d335f56cdf6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:10.267032 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5fb397d4-79bb-46ba-ab93-1860aa23d029 req-80a9ff53-c64c-447c-84a6-3d335f56cdf6 service nova] Creating event network-changed:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h1-862876-2 Oct 28 14:19:10.272416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-5fb397d4-79bb-46ba-ab93-1860aa23d029 req-80a9ff53-c64c-447c-84a6-3d335f56cdf6 service nova] Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:19:10.283999 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5fb397d4-79bb-46ba-ab93-1860aa23d029 req-80a9ff53-c64c-447c-84a6-3d335f56cdf6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044104 Oct 28 14:19:10.284986 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3768/7447] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:19:10.801590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:10.802152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:10.805054 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:19:10.805416 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 (ip 10.222.0.25) !!! Oct 28 14:19:10.815661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:10.816830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:10.817301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:10.818039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:10.818762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:10.819386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:10.962171 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:10.968900 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-61a79714-5a82-448d-a036-1cbfb8cc9a48 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.171786 Oct 28 14:19:10.969577 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3680/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:10 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:11.990570 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:19:11.991161 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 (ip 10.222.0.25) !!! Oct 28 14:19:11.991763 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:19:11.991905 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 (ip 10.222.0.25) !!! Oct 28 14:19:11.996921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:11.997638 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:12.007432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:12.007918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:12.008358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:12.009045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:12.009501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:12.009926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:12.095848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:12.142230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:12.150497 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8cffe25-5fb2-4b60-8127-42d8bde70366 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.161104 Oct 28 14:19:12.151104 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3769/7449] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:11 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:13.175229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:13.175793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:13.183087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:13.183512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:13.183966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:13.185243 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:13.185718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:13.186158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:13.322831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:13.331517 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-03154aa1-bbf8-421f-80c5-00c59c4898b9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.160590 Oct 28 14:19:13.332109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3681/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:13 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:14.355164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:14.355778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:14.363092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:14.363578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:14.364019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:14.364702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:14.365160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:14.365582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:14.505862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:14.514046 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de5d57f9-024a-4e6c-b20a-58727531b285 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.162724 Oct 28 14:19:14.514612 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3770/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:14 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:15.539196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:15.539723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:15.546729 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:15.547262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:15.547720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:15.548437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:15.548915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:15.549361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:15.677391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:15.685887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cf8b980d-7726-4f90-b582-9a7a8fb56847 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.150823 Oct 28 14:19:15.686462 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3682/7452] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:15 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:16.709608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:16.710215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:16.717595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:16.718079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:16.718511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:16.719302 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:16.719752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:16.720169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:16.859485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:16.869019 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-18dc8b97-2c96-456e-be4e-8221798b1be4 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.162119 Oct 28 14:19:16.869019 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3771/7453] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:16 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:17.892089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:17.892715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:17.899745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:17.900162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:17.900610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:17.901308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:17.901771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:17.902206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:18.034727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:18.043366 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de709f98-f2cb-477c-a2ed-3e00bd052549 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.155304 Oct 28 14:19:18.050230 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3683/7454] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:17 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:19.068121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:19.068778 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:19.076088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:19.082080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:19.082080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:19.082080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:19.082080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:19.082080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:19.208308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:19.216503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-59bd8afd-a420-425a-b6a2-cc2efb00e6c0 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.152329 Oct 28 14:19:19.217616 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3772/7455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:19 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:20.240795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:20.241460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:20.249383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:20.249887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:20.250348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:20.251079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:20.251555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:20.251997 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:20.382875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:20.391821 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a230e864-8f7e-4a4d-b21c-4846e804ffb3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.154942 Oct 28 14:19:20.392403 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3684/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:20 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:21.415480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:21.416102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:21.423051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:21.423534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:21.423962 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:21.424641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:21.425090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:21.425507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:21.566389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:21.573400 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-05314fc4-3493-4283-977b-dfe539345dd9 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1724 microversion: 2.1 time: 0.161819 Oct 28 14:19:21.574250 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3773/7457] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:21 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:22.597988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:22.598620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:22.605569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:22.606069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:22.606522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:22.607271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:22.607746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:22.608186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:22.742099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:22.751298 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-25d83151-310e-45f2-bae3-7496bd0c1b52 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1717 microversion: 2.1 time: 0.157276 Oct 28 14:19:22.751885 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3685/7458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:22 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:22.773777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:22.774389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:22.781330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:22.781809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:22.782240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:22.782957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:22.783412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:22.783836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:22.919333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:22.921083 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c86cc663-92fa-4181-828f-dc79b1baa742 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1717 microversion: 2.1 time: 0.151086 Oct 28 14:19:22.922180 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3774/7459] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:22 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:22.943974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:22.944612 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:22.951817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:22.952360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:22.952819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:22.953542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:22.954020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:22.954468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:23.083691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:23.092258 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-abc6ad95-a78f-4e3b-836c-f7a783230f20 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1717 microversion: 2.1 time: 0.152135 Oct 28 14:19:23.093344 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3686/7460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:22 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:23.115797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:23.116230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:23.122211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:23.122693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:23.123158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:23.123841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:23.124325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:23.124751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:23.148798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:19:23.247433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:23.420112 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5d26fab0-940d-4d5a-ad87-989db80b750c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 204 len: 0 microversion: 2.1 time: 0.307878 Oct 28 14:19:23.420797 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3775/7461] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:19:23 2022] DELETE /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:19:23.429053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:23.429765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:23.436055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:23.436600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:23.437055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:23.437762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:23.438234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:23.438675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:23.568637 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:23.578022 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-132ba281-663e-42a1-b3f7-b8bc91b725aa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1723 microversion: 2.1 time: 0.152912 Oct 28 14:19:23.578621 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3687/7462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:23 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:24.602187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:24.602918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:24.611350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:24.611833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:24.612313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:24.613000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:24.613454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:24.613874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:24.752455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:24.760814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b3fc279e-00cc-403c-998b-1691e7c44698 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1723 microversion: 2.1 time: 0.162831 Oct 28 14:19:24.761391 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3776/7463] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:24 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:25.785067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:25.786397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:25.794739 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:25.795297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:25.796248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:25.796995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:25.797473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:25.797917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:25.824480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a7ddf73d-81db-4e87-89ef-f9ba3959b0ca req-dde6a220-a1f3-4bd3-9149-a837250fc34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6718d40a-0f97-4ad2-b2ac-02800187cee5", "name": "network-vif-deleted", "tag": "52f79139-d98e-4ca5-b4cd-2b1a9a3ae938"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:25.838231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7ddf73d-81db-4e87-89ef-f9ba3959b0ca req-dde6a220-a1f3-4bd3-9149-a837250fc34d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:25.838665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7ddf73d-81db-4e87-89ef-f9ba3959b0ca req-dde6a220-a1f3-4bd3-9149-a837250fc34d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:25.839150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a7ddf73d-81db-4e87-89ef-f9ba3959b0ca req-dde6a220-a1f3-4bd3-9149-a837250fc34d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:25.855289 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a7ddf73d-81db-4e87-89ef-f9ba3959b0ca req-dde6a220-a1f3-4bd3-9149-a837250fc34d service nova] Creating event network-vif-deleted:52f79139-d98e-4ca5-b4cd-2b1a9a3ae938 for instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 on n-h1-862876-2 Oct 28 14:19:25.865007 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a7ddf73d-81db-4e87-89ef-f9ba3959b0ca req-dde6a220-a1f3-4bd3-9149-a837250fc34d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044648 Oct 28 14:19:25.875508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:25.879308 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3777/7464] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:19:25.885388 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-497513c1-49af-4b3e-970b-796127f602b8 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1655 microversion: 2.1 time: 0.104504 Oct 28 14:19:25.886199 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3688/7465] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:25 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:26.911051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:26.911766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:26.918524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:26.919063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:26.919863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:26.920596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:26.921090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:26.921705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:26.989715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:26.998328 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb091bac-9890-4c15-888e-1a1949215e8f tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1370 microversion: 2.1 time: 0.092672 Oct 28 14:19:26.999460 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3778/7466] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:26 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:28.021741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:28.022280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:28.029205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:28.029699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:28.030800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:28.031506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:28.031974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:28.032410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:28.094995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:28.103414 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-46b6ac77-c7de-48dd-b0f9-248141d910fa tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1370 microversion: 2.1 time: 0.085677 Oct 28 14:19:28.103995 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3689/7467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:28 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:29.127012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:29.127620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:29.134576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:29.135107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:29.135544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:29.136244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:29.136762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:29.137194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:29.203477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:29.211725 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c52bc1c-477a-4ce2-8b44-6124ebde6551 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1370 microversion: 2.1 time: 0.088834 Oct 28 14:19:29.212320 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3779/7468] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:29 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:30.235743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:30.236389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:30.239411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=34 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:30.244119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:30.244611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:30.245067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:30.245761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:30.246228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:30.246700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:30.251219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=98 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:30.311236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d4a165c2fa64514a6372ce0738c2dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f099daf43643fd998907948cfdb044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:30.320134 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-47e5facc-0e64-44d7-9e69-a45856b3c459 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 200 len: 1370 microversion: 2.1 time: 0.088777 Oct 28 14:19:30.320860 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3690/7469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:30 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:31.343874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:31.344487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:31.347421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:31.352144 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:31.352610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:31.353046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:31.353726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:31.354178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:31.354598 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:31.370582 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 HTTP/1.1 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6718d40a-0f97-4ad2-b2ac-02800187cee5'} Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:31.372262 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-87c91799-73bb-4123-9ed3-5dfdeb9d5a7c tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 404 len: 111 microversion: 2.1 time: 0.033673 Oct 28 14:19:31.377271 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3780/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:31 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 14:19:31.434400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:31.437141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:31.444339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:31.444841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:31.445296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:31.446001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:31.446475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:31.446960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:31.460667 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/os-volume_attachments HTTP/1.1 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '6718d40a-0f97-4ad2-b2ac-02800187cee5'} Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:31.462374 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4adeebd9-6ac4-4714-8fe6-ed6b54b75518 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033434 Oct 28 14:19:31.466436 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3691/7471] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:19:31 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:34.899769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:34.900380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:34.908894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:34.909380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:34.909818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:34.910512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:34.911000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:34.911433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:34.925129 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 HTTP/1.1 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '6718d40a-0f97-4ad2-b2ac-02800187cee5'} Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:34.926724 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0ec33666-0d9c-4b58-ae25-937a7e152284 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 404 len: 111 microversion: 2.1 time: 0.032615 Oct 28 14:19:34.931060 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3781/7472] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:19:34 2022] DELETE /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:34.937177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:34.937848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 6718d40a-0f97-4ad2-b2ac-02800187cee5] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:34.944882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:34.945386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:34.945840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:34.946547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:34.947058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:34.947497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:34.965040 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 HTTP/1.1 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '6718d40a-0f97-4ad2-b2ac-02800187cee5'} Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:34.966520 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 6718d40a-0f97-4ad2-b2ac-02800187cee5 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d0e217bd-291d-4ccd-baa1-3bd948bf665a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5" status: 404 len: 111 microversion: 2.1 time: 0.035155 Oct 28 14:19:34.970850 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3692/7473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:34 2022] GET /compute/v2.1/servers/6718d40a-0f97-4ad2-b2ac-02800187cee5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:34.976556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:34.977054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:34.983363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:34.983850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:34.984290 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:34.984978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:34.985433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:34.985854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:34.999960 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b HTTP/1.1 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '869508c9-a34a-40d7-86da-c0578dfe022b'} Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:35.001502 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-af62065b-4d85-4cb2-b994-7a2ff400b74e tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 404 len: 111 microversion: 2.1 time: 0.030154 Oct 28 14:19:35.005854 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3782/7474] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:19:34 2022] DELETE /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 14:19:35.011641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:35.012276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 869508c9-a34a-40d7-86da-c0578dfe022b] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:35.019053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.019551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.020002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.020705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.021179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.021614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.035166 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b HTTP/1.1 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '869508c9-a34a-40d7-86da-c0578dfe022b'} Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.036756 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 869508c9-a34a-40d7-86da-c0578dfe022b could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f316592-188b-48c8-a4ac-2efb1ff2236a tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b" status: 404 len: 111 microversion: 2.1 time: 0.030408 Oct 28 14:19:35.042023 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3693/7475] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:35 2022] GET /compute/v2.1/servers/869508c9-a34a-40d7-86da-c0578dfe022b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:35.050584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:35.050584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:35.052898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.053386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.053824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.054508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.055113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.055544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.070205 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 HTTP/1.1 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '21fbafe4-7f87-4c54-bddd-e13aa3dd5400'} Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:35.079836 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ecfb560-a401-4de7-8c89-ab348031e516 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 404 len: 111 microversion: 2.1 time: 0.030452 Oct 28 14:19:35.084536 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3783/7476] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:19:35 2022] DELETE /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:35.088146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:35.088788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 21fbafe4-7f87-4c54-bddd-e13aa3dd5400] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:35.095444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.095952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.096408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.097117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.097598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.098042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.112485 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 HTTP/1.1 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '21fbafe4-7f87-4c54-bddd-e13aa3dd5400'} Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.114030 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 21fbafe4-7f87-4c54-bddd-e13aa3dd5400 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:35.119205 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c56b9220-c659-4c52-ab30-cec1b8eb1d88 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400" status: 404 len: 111 microversion: 2.1 time: 0.037408 Oct 28 14:19:35.120053 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3694/7477] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:35 2022] GET /compute/v2.1/servers/21fbafe4-7f87-4c54-bddd-e13aa3dd5400 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:35.124834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:35.125633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:35.131775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.132352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.132855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.133613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.134155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.134836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.149008 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: request: DELETE /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 HTTP/1.1 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '36b01953-ded8-477e-af82-0dd43e8dc3f2'} Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:35.150715 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:35.156077 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1b8660bf-62c0-4722-8f52-93a37d7c87df tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 404 len: 111 microversion: 2.1 time: 0.032777 Oct 28 14:19:35.157492 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3784/7478] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:19:35 2022] DELETE /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:35.165390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:35.166031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] [instance: 36b01953-ded8-477e-af82-0dd43e8dc3f2] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:35.172686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.173189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.173640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.174347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:35.174851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:35.175301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:35.188828 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] HTTP exception thrown: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Request method failure captured: Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 HTTP/1.1 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-OEr5GUeDnP4ktUKY19wp4xUxemC85FoRQXOmy3nkVtFGmBnReuWXLTu5VWtVbf7FOWHtm61vl8nlIpvmcD2x8dPm38Haw5Q27GD0dT5oa2kPHdQ-AXF9giCKKeqZxFx2Q0y0_kh7kWkRN53VOgRAQf0N8sE78fCz4PVS6fjX8pbow Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3f099daf43643fd998907948cfdb044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3f099daf43643fd998907948cfdb044", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3f099daf43643fd998907948cfdb044"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: d3f099daf43643fd998907948cfdb044 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServerActionsTestJSON-1075600201 Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 8d4a165c2fa64514a6372ce0738c2dea Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServerActionsTestJSON-1075600201-project Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '36b01953-ded8-477e-af82-0dd43e8dc3f2'} Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:19:35.190368 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Returning 404 to user: Instance 36b01953-ded8-477e-af82-0dd43e8dc3f2 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6f6eb20a-1942-48e9-8895-fd3c8c2481e3 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2" status: 404 len: 111 microversion: 2.1 time: 0.030373 Oct 28 14:19:35.195107 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3695/7479] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:35 2022] GET /compute/v2.1/servers/36b01953-ded8-477e-af82-0dd43e8dc3f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:19:35.200766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c01121c4-64f3-47d7-9bf4-82bbdd1782c5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] Calling method '.version_select at 0x7f27b84bea60>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:35.284826 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c01121c4-64f3-47d7-9bf4-82bbdd1782c5 tempest-ServerActionsTestJSON-1075600201 tempest-ServerActionsTestJSON-1075600201-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2121299359" status: 202 len: 0 microversion: 2.1 time: 0.087888 Oct 28 14:19:35.285342 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3785/7480] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Oct 28 14:19:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2121299359 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:19:47.768879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=11 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:47.772474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=15 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:47.893697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1711124495", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "78e9389f-03f0-4fbb-97a4-235a962ffc82"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:47.950771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] validate_networks() for [('78e9389f-03f0-4fbb-97a4-235a962ffc82', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:19:48.318885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:19:48.319324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:19:48.319865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:19:48.320292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:19:48.320721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:19:48.330400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:48.330933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:48.331433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:48.332219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:48.332650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:48.333089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:48.350875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Getting quotas for project 01e8e13e21ee447bb072e53626291771. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:19:48.356416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Getting quotas for user 7014dacd4b2c44ff9d0b9c7291e0d480 and project 01e8e13e21ee447bb072e53626291771. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:19:48.370510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:19:48.372994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:19:48.519912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e951a0e2-1aa9-43db-bffa-14b6293a0982 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756203 Oct 28 14:19:48.527540 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3696/7481] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 14:19:48.530299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:48.531503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:48.535803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-31129028-7259-4468-814b-cacb3aa1d29f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:48.536760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-31129028-7259-4468-814b-cacb3aa1d29f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:48.610420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-31129028-7259-4468-814b-cacb3aa1d29f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:48.620255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-31129028-7259-4468-814b-cacb3aa1d29f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1217 microversion: 2.1 time: 0.091838 Oct 28 14:19:48.621028 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3786/7482] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:48 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:49.646525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:49.647215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:49.654825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:49.656407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:49.656844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:49.657833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:49.658304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:49.658988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:49.726464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:49.734353 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f40bc8f2-2941-42c5-9be1-9250bf2886e4 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1221 microversion: 2.1 time: 0.093338 Oct 28 14:19:49.734946 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3697/7483] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:49 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:50.757611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:50.758476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:50.766606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:50.767131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:50.767562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:50.768313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:50.768762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:50.769179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:50.859880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:50.868047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad987e82-accf-4869-98fe-2c70b65b6cb0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1269 microversion: 2.1 time: 0.115059 Oct 28 14:19:50.870226 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3787/7484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:50 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:51.891212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:51.892589 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:51.900419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:51.900938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:51.901387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:51.902284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:51.902774 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:51.903247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:52.041038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:52.049508 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-89f29f8a-cf0f-437b-a39b-c36f1672c359 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.162436 Oct 28 14:19:52.050076 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3698/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:51 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:52.660425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-4296d48a-2e45-48ca-854e-e5417cbb6595 req-82cf8eb1-aec2-40c9-aaf8-92eb305739c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8a2653-e305-4828-9d3e-60d316dd307d", "tag": "911a1b91-6705-4e93-b5a4-95290289e47c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:52.669977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4296d48a-2e45-48ca-854e-e5417cbb6595 req-82cf8eb1-aec2-40c9-aaf8-92eb305739c8 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:52.677366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4296d48a-2e45-48ca-854e-e5417cbb6595 req-82cf8eb1-aec2-40c9-aaf8-92eb305739c8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:52.677366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-4296d48a-2e45-48ca-854e-e5417cbb6595 req-82cf8eb1-aec2-40c9-aaf8-92eb305739c8 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:52.681898 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-4296d48a-2e45-48ca-854e-e5417cbb6595 req-82cf8eb1-aec2-40c9-aaf8-92eb305739c8 service nova] Creating event network-changed:911a1b91-6705-4e93-b5a4-95290289e47c for instance bb8a2653-e305-4828-9d3e-60d316dd307d on n-h1-862876-2 Oct 28 14:19:52.686831 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-4296d48a-2e45-48ca-854e-e5417cbb6595 req-82cf8eb1-aec2-40c9-aaf8-92eb305739c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093510 Oct 28 14:19:52.687439 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3788/7486] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:19:53.073200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:53.073836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:53.081569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:53.082077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:53.082536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:53.083365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:53.083840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:53.084285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:53.212928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:53.221123 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ed98a62e-01e2-412e-b64a-ac15c99e54e9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.151786 Oct 28 14:19:53.221700 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3699/7487] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:53 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:54.245027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:54.245727 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:54.252698 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:54.253178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:54.253607 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:54.254292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:54.254738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:54.255178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:54.414801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:54.423146 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-28857cca-9b8e-44b0-b748-08ef4c9c2088 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.183282 Oct 28 14:19:54.423751 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3789/7488] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:54 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:55.445730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:55.446365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:55.454092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:55.454583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:55.455053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:55.455752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:55.456216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:55.456655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:55.593623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:55.601858 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-08ddefc7-6f50-4082-83e9-81e0b82eabae tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.159994 Oct 28 14:19:55.602454 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3700/7489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:55 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:56.625905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:56.627064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:56.634293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:56.634891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:56.635418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:56.636194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:56.636763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:56.637473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:56.783633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:56.791596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-11b80c0e-bbfd-452c-aea7-ae78223ff1ee tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.170225 Oct 28 14:19:56.792344 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3790/7490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:56 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:57.813814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:57.814437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:57.821125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:57.821631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:57.822082 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:57.822818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:57.823295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:57.823801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:57.955772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:57.963395 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-507804e0-4888-4f8e-8e0d-35026736ec89 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.153582 Oct 28 14:19:57.963972 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3701/7491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:57 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:19:58.776410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7dcc8e1a-3ecc-49e7-a81d-b7e07ade6d2a req-70424813-378f-4a11-bc40-bcd899a4f779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8a2653-e305-4828-9d3e-60d316dd307d", "name": "network-vif-plugged", "status": "completed", "tag": "911a1b91-6705-4e93-b5a4-95290289e47c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:19:58.782387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:58.788130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7dcc8e1a-3ecc-49e7-a81d-b7e07ade6d2a req-70424813-378f-4a11-bc40-bcd899a4f779 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:58.788696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7dcc8e1a-3ecc-49e7-a81d-b7e07ade6d2a req-70424813-378f-4a11-bc40-bcd899a4f779 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:58.789125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7dcc8e1a-3ecc-49e7-a81d-b7e07ade6d2a req-70424813-378f-4a11-bc40-bcd899a4f779 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:58.987990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:19:58.988630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:19:58.990677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:58.991489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:19:58.997639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:58.998150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:58.998605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:58.999446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:19:58.999924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:19:59.000368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:19:59.075506 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7dcc8e1a-3ecc-49e7-a81d-b7e07ade6d2a req-70424813-378f-4a11-bc40-bcd899a4f779 service nova] Creating event network-vif-plugged:911a1b91-6705-4e93-b5a4-95290289e47c for instance bb8a2653-e305-4828-9d3e-60d316dd307d on n-h1-862876-2 Oct 28 14:19:59.080396 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7dcc8e1a-3ecc-49e7-a81d-b7e07ade6d2a req-70424813-378f-4a11-bc40-bcd899a4f779 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308527 Oct 28 14:19:59.080996 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3791/7492] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:19:59.136183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:19:59.143986 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1445c601-3e61-4440-9f9f-c88b41f48052 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.160602 Oct 28 14:19:59.144565 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3702/7493] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:19:58 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:20:00.168169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:00.168869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:00.175389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:00.175877 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:00.176304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:00.177188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:00.177637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:00.178062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:00.310636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:00.318897 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9e1695dd-cd65-46ce-b146-2e6fda1d62a8 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1317 microversion: 2.1 time: 0.155831 Oct 28 14:20:00.319460 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3792/7494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:00 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:01.341816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:01.342457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:01.349453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:01.349956 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:01.350409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:01.351146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:01.351625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:01.352067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:01.484111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:01.492214 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd2ef444-6ef7-4f11-a314-e7c7d9cb344f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1506 microversion: 2.1 time: 0.154490 Oct 28 14:20:01.492907 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3703/7495] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:01 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:01.568481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-34373441", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "78e9389f-03f0-4fbb-97a4-235a962ffc82"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:01.622929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] validate_networks() for [('78e9389f-03f0-4fbb-97a4-235a962ffc82', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:20:02.041735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:20:02.042190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:20:02.042664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:20:02.043106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:20:02.043517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:20:02.052669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:02.053095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:02.053535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:02.054258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:02.054718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:02.055176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:02.072626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Getting quotas for project 01e8e13e21ee447bb072e53626291771. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:20:02.078826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Getting quotas for user 7014dacd4b2c44ff9d0b9c7291e0d480 and project 01e8e13e21ee447bb072e53626291771. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:20:02.090888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:20:02.093277 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:20:02.211500 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2ded9a89-a628-45d6-b593-3e5137e9583f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646882 Oct 28 14:20:02.212150 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3793/7496] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:20:02.223443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-214d361f-75de-46ff-b190-38ab9a8c5f00 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:02.224078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-214d361f-75de-46ff-b190-38ab9a8c5f00 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:02.278198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-214d361f-75de-46ff-b190-38ab9a8c5f00 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:02.285453 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-214d361f-75de-46ff-b190-38ab9a8c5f00 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1215 microversion: 2.1 time: 0.065933 Oct 28 14:20:02.286039 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3704/7497] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:02 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:03.309490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:03.310038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:03.317546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:03.318032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:03.318473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:03.319200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:03.319657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:03.320085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:03.387368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:03.395078 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f96d6275-46a4-4e05-a2bf-105c1088f647 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1219 microversion: 2.1 time: 0.090489 Oct 28 14:20:03.395641 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3794/7498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:03 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:04.419817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:04.422450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:04.432761 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:04.433906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:04.434357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:04.435986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:04.436663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:04.437103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:04.503049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:04.510924 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-673c425a-99f3-42eb-927e-15ab395476a3 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1273 microversion: 2.1 time: 0.097306 Oct 28 14:20:04.522767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3705/7499] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:04 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:05.535423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:05.536139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:05.543009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:05.543606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:05.544134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:05.545439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:05.545635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:05.546621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:05.688446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:05.696105 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d250b40-916b-46df-a43e-b9f1133c8709 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1315 microversion: 2.1 time: 0.165036 Oct 28 14:20:05.696677 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3795/7500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:05 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:06.059476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c524e968-87b7-44e4-9232-ad4d8b4d65fb req-0cb9b9ed-d60a-4543-82ae-53edce7b5438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe077c9c-6aef-4f92-8dc7-e7decbbc81a7", "tag": "d9c7df9d-20dc-4dde-9c67-cf7d0e9e8679"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:06.070181 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c524e968-87b7-44e4-9232-ad4d8b4d65fb req-0cb9b9ed-d60a-4543-82ae-53edce7b5438 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:06.074670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c524e968-87b7-44e4-9232-ad4d8b4d65fb req-0cb9b9ed-d60a-4543-82ae-53edce7b5438 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:06.074670 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c524e968-87b7-44e4-9232-ad4d8b4d65fb req-0cb9b9ed-d60a-4543-82ae-53edce7b5438 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:06.083655 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c524e968-87b7-44e4-9232-ad4d8b4d65fb req-0cb9b9ed-d60a-4543-82ae-53edce7b5438 service nova] Creating event network-changed:d9c7df9d-20dc-4dde-9c67-cf7d0e9e8679 for instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 on n-h2-862876-2 Oct 28 14:20:06.088935 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c524e968-87b7-44e4-9232-ad4d8b4d65fb req-0cb9b9ed-d60a-4543-82ae-53edce7b5438 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033016 Oct 28 14:20:06.089558 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3706/7501] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:20:06.719526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:06.720175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:06.727127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:06.727619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:06.728061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:06.728766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:06.729225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:06.729655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:06.861798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:06.869388 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19f3a75b-2be9-4372-9ff1-4242d9a50eb6 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1315 microversion: 2.1 time: 0.154375 Oct 28 14:20:06.869952 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3796/7502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:06 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:07.893998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:07.894714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:07.901158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:07.901656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:07.902102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:07.902820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:07.903292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:07.903724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:08.034205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:08.041941 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1f39fa1b-d305-463a-a6a0-6c5e357a9ea7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1315 microversion: 2.1 time: 0.153559 Oct 28 14:20:08.042449 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3707/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:07 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:09.064922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:09.065543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:09.071844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:09.072337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:09.072783 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:09.073474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:09.073927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:09.074353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:09.208843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:09.216494 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c68b2cc6-b5a9-4d62-898d-512a151ad204 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1315 microversion: 2.1 time: 0.155961 Oct 28 14:20:09.217060 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3797/7504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:09 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:10.240286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:10.240946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:10.247172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:10.247675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:10.248143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:10.248870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:10.249343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:10.249786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:10.384075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:10.391745 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-277ab973-3234-42ba-b5c7-6bfa0b27f67f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1315 microversion: 2.1 time: 0.155542 Oct 28 14:20:10.392333 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3708/7505] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:10 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:11.415404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:11.416025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:11.423392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:11.423921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:11.424364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:11.425054 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:11.425513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:11.425942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:11.554072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:11.562578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f5d06a8-1879-4dc4-b65f-c7c3384f51d9 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1315 microversion: 2.1 time: 0.150784 Oct 28 14:20:11.563190 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3798/7506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:11 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:12.493871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-507e0231-7495-410d-840e-6bcf5685a4cc req-0b6f06d7-2989-4dec-aa12-6cb7706e7022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe077c9c-6aef-4f92-8dc7-e7decbbc81a7", "name": "network-vif-plugged", "status": "completed", "tag": "d9c7df9d-20dc-4dde-9c67-cf7d0e9e8679"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:12.500660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:20:12.505825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-507e0231-7495-410d-840e-6bcf5685a4cc req-0b6f06d7-2989-4dec-aa12-6cb7706e7022 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:12.506305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-507e0231-7495-410d-840e-6bcf5685a4cc req-0b6f06d7-2989-4dec-aa12-6cb7706e7022 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:12.506755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-507e0231-7495-410d-840e-6bcf5685a4cc req-0b6f06d7-2989-4dec-aa12-6cb7706e7022 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:12.518562 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-507e0231-7495-410d-840e-6bcf5685a4cc req-0b6f06d7-2989-4dec-aa12-6cb7706e7022 service nova] Creating event network-vif-plugged:d9c7df9d-20dc-4dde-9c67-cf7d0e9e8679 for instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 on n-h2-862876-2 Oct 28 14:20:12.523873 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-507e0231-7495-410d-840e-6bcf5685a4cc req-0b6f06d7-2989-4dec-aa12-6cb7706e7022 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033709 Oct 28 14:20:12.524525 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3709/7507] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:20:12.587681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:12.588224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:12.590146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:20:12.591448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:20:12.597110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:12.597531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:12.598562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:12.599300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:12.603059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:12.603059 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:12.764353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:12.772057 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-12dc32b1-2d0a-48ee-9c80-f759bc8d6dbc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1315 microversion: 2.1 time: 0.189603 Oct 28 14:20:12.772630 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3799/7508] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:12 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:13.796767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:13.797498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:13.803933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:13.804433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:13.804885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:13.805596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:13.806067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:13.806513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:13.935626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:13.943925 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-31591fcf-8619-4910-a75c-03ab96aa8efc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1504 microversion: 2.1 time: 0.152837 Oct 28 14:20:13.944501 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3710/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:13 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:13.966813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:13.967353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:13.974265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:13.974800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:13.975226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:13.975923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:13.976386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:13.976823 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:14.001664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:20:14.214239 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19bfdf87-dd1f-46fd-aebd-4f871aeccccc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 204 len: 0 microversion: 2.1 time: 0.250980 Oct 28 14:20:14.214926 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3800/7510] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:20:13 2022] DELETE /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:20:14.222965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:14.223609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:14.229690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:14.230196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:14.230644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:14.231380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:14.231857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:14.232300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:14.363964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:14.371768 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4c8a9ef6-f95d-4db2-8ff9-c51959a06e73 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1510 microversion: 2.1 time: 0.152806 Oct 28 14:20:14.372343 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3711/7511] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:14 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:15.396367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:15.397072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:15.403889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:15.404401 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:15.404843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:15.405527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:15.405983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:15.406405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:15.578121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:15.586645 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-49a2032a-b12b-4156-b561-9ee40b3b51c5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1510 microversion: 2.1 time: 0.195148 Oct 28 14:20:15.587256 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3801/7512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:15 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:16.020759 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-43c3fd83-bd49-4818-a442-594883bb09c7 req-7262f1c1-01ab-4e7f-a7d7-932fa31a9aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe077c9c-6aef-4f92-8dc7-e7decbbc81a7", "name": "network-vif-deleted", "tag": "d9c7df9d-20dc-4dde-9c67-cf7d0e9e8679"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:16.031362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43c3fd83-bd49-4818-a442-594883bb09c7 req-7262f1c1-01ab-4e7f-a7d7-932fa31a9aaf service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:16.031867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43c3fd83-bd49-4818-a442-594883bb09c7 req-7262f1c1-01ab-4e7f-a7d7-932fa31a9aaf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:16.032354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-43c3fd83-bd49-4818-a442-594883bb09c7 req-7262f1c1-01ab-4e7f-a7d7-932fa31a9aaf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:16.044488 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-43c3fd83-bd49-4818-a442-594883bb09c7 req-7262f1c1-01ab-4e7f-a7d7-932fa31a9aaf service nova] Creating event network-vif-deleted:d9c7df9d-20dc-4dde-9c67-cf7d0e9e8679 for instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 on n-h2-862876-2 Oct 28 14:20:16.050442 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-43c3fd83-bd49-4818-a442-594883bb09c7 req-7262f1c1-01ab-4e7f-a7d7-932fa31a9aaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033360 Oct 28 14:20:16.053017 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3712/7513] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:20:16.609688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:16.610342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:16.618098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:16.621254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:16.621254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:16.621254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:16.621254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:16.621254 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:16.655687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:16.656178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:16.656629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:16.657096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lazy-loading 'fault' on Instance uuid fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:20:16.701363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:16.709870 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-439bfe1f-52e9-4210-9bb6-373d1f46a583 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 200 len: 1305 microversion: 2.1 time: 0.104028 Oct 28 14:20:16.711719 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3802/7514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:16 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:20:17.736124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:17.737506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:17.744127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:17.744699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:17.745404 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:17.746137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:17.746614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:17.747079 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:17.760788 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] HTTP exception thrown: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Request method failure captured: Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 HTTP/1.1 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-UDQuvNUFVs8RygT5PybGWWeaomxekDs9yGCZOIW8_Bda1MvsItCRY3fYKndSRIZVVjHhpmBpdAh6XsUatNPp2R6q7xI0LzauGkF4nKMVi9_E1c92wNVa9fLrppFZTK7z5-AztEKHSOakgzAOOzKxwa5hxvRB-DNYSo5aNyLaQAXqY Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e8e13e21ee447bb072e53626291771", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e8e13e21ee447bb072e53626291771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7014dacd4b2c44ff9d0b9c7291e0d480 Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'fe077c9c-6aef-4f92-8dc7-e7decbbc81a7'} Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:17.762497 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Returning 404 to user: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-513599af-41ee-412a-b826-7c478030be94 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 404 len: 111 microversion: 2.1 time: 0.033941 Oct 28 14:20:17.768214 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3713/7515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:17 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:20:17.774038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:17.774866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:17.781734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:17.782842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:17.783223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:17.783959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:17.784438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:17.784988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:17.807859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:20:17.999947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:18.008056 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-09d38419-3d2e-413d-bcc9-e57962c17d78 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1506 microversion: 2.1 time: 0.238639 Oct 28 14:20:18.008648 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3803/7516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:17 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:18.031267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-641d4eba-eb42-4cc2-8382-d4ec7c49f042 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:18.035083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-641d4eba-eb42-4cc2-8382-d4ec7c49f042 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:18.037098 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:20:18.041597 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-641d4eba-eb42-4cc2-8382-d4ec7c49f042 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] HTTP exception thrown: Instance b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547 could not be found. Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-641d4eba-eb42-4cc2-8382-d4ec7c49f042 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Request method failure captured: Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547/action HTTP/1.1 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 32 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-UDQuvNUFVs8RygT5PybGWWeaomxekDs9yGCZOIW8_Bda1MvsItCRY3fYKndSRIZVVjHhpmBpdAh6XsUatNPp2R6q7xI0LzauGkF4nKMVi9_E1c92wNVa9fLrppFZTK7z5-AztEKHSOakgzAOOzKxwa5hxvRB-DNYSo5aNyLaQAXqY Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e8e13e21ee447bb072e53626291771", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e8e13e21ee447bb072e53626291771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7014dacd4b2c44ff9d0b9c7291e0d480 Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: {"resize": {"flavorRef": "452"}} Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547 could not be found. Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547', 'body': {'resize': {'flavorRef': '452'}}} Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547 could not be found. Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:20:18.043212 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547 could not be found. Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547 could not be found. Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-641d4eba-eb42-4cc2-8382-d4ec7c49f042 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Returning 404 to user: Instance b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-641d4eba-eb42-4cc2-8382-d4ec7c49f042 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "POST /compute/v2.1/servers/b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547/action" status: 404 len: 111 microversion: 2.1 time: 0.017623 Oct 28 14:20:18.048223 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3714/7517] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:20:18 2022] POST /compute/v2.1/servers/b97d9d2c-c9d3-4e0b-aa6b-333cd60a5547/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:20:18.053794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:18.054420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:18.060425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.060918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.061362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.062060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.062541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.062990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.290563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:18.298383 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-30293078-fddd-40ef-95c7-b21e0c7c695b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1506 microversion: 2.1 time: 0.248453 Oct 28 14:20:18.299003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3804/7518] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:18 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:18.322338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:18.323044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:18.331489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.332007 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.332462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.333180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.333660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.334110 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.336907 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=83 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:20:18.467069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:18.474887 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-82044aa3-9424-4ea6-a4f4-31cb65de8d08 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1506 microversion: 2.1 time: 0.156406 Oct 28 14:20:18.475630 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3715/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:18 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:18.497464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "0196c133-11dc-4af4-bf7f-d9f93fef9d2f"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:18.499927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:18.506516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.507044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.507498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.508204 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.508667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.509101 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.551020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:18.556442 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] HTTP exception thrown: Flavor 0196c133-11dc-4af4-bf7f-d9f93fef9d2f could not be found. Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Request method failure captured: Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: request: POST /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d/action HTTP/1.1 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 65 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-UDQuvNUFVs8RygT5PybGWWeaomxekDs9yGCZOIW8_Bda1MvsItCRY3fYKndSRIZVVjHhpmBpdAh6XsUatNPp2R6q7xI0LzauGkF4nKMVi9_E1c92wNVa9fLrppFZTK7z5-AztEKHSOakgzAOOzKxwa5hxvRB-DNYSo5aNyLaQAXqY Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e8e13e21ee447bb072e53626291771", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e8e13e21ee447bb072e53626291771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 7014dacd4b2c44ff9d0b9c7291e0d480 Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: {"resize": {"flavorRef": "0196c133-11dc-4af4-bf7f-d9f93fef9d2f"}} Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: exception: Flavor 0196c133-11dc-4af4-bf7f-d9f93fef9d2f could not be found. Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bb8a2653-e305-4828-9d3e-60d316dd307d', 'body': {'resize': {'flavorRef': '0196c133-11dc-4af4-bf7f-d9f93fef9d2f'}}} Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:18.558387 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0196c133-11dc-4af4-bf7f-d9f93fef9d2f could not be found. Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 0196c133-11dc-4af4-bf7f-d9f93fef9d2f could not be found. Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0196c133-11dc-4af4-bf7f-d9f93fef9d2f could not be found. Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Returning 400 to user: Flavor 0196c133-11dc-4af4-bf7f-d9f93fef9d2f could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36e932f7-b206-4654-b4ae-9b271a113d8b tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "POST /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d/action" status: 400 len: 107 microversion: 2.1 time: 0.066418 Oct 28 14:20:18.563376 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3805/7520] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:20:18 2022] POST /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d/action => generated 107 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 14:20:18.571454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:18.572083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:18.578191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.578684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.579847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.580541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.581005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.581437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.713052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:18.720910 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd4dd118-ec1d-4037-b23c-2c4b41e5a906 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1506 microversion: 2.1 time: 0.153269 Oct 28 14:20:18.721411 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3716/7521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:18 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:18.743815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:18.744429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:18.750345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.750839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.751312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.751994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.752445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.752867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.887876 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:18.896258 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c81a7702-3759-45ae-8f1f-6630395417fc tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1506 microversion: 2.1 time: 0.156253 Oct 28 14:20:18.896835 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3806/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:18 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:18.919010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-886dfa8b-3ceb-4cb4-8d81-58a8c2d12deb tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-886dfa8b-3ceb-4cb4-8d81-58a8c2d12deb tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Request method failure captured: Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: request: POST /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d/action HTTP/1.1 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 29 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-UDQuvNUFVs8RygT5PybGWWeaomxekDs9yGCZOIW8_Bda1MvsItCRY3fYKndSRIZVVjHhpmBpdAh6XsUatNPp2R6q7xI0LzauGkF4nKMVi9_E1c92wNVa9fLrppFZTK7z5-AztEKHSOakgzAOOzKxwa5hxvRB-DNYSo5aNyLaQAXqY Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e8e13e21ee447bb072e53626291771", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e8e13e21ee447bb072e53626291771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7014dacd4b2c44ff9d0b9c7291e0d480 Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: {"resize": {"flavorRef": ""}} Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'bb8a2653-e305-4828-9d3e-60d316dd307d', 'body': {'resize': {'flavorRef': ''}}} Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise error Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi '' Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.922611 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-886dfa8b-3ceb-4cb4-8d81-58a8c2d12deb tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-886dfa8b-3ceb-4cb4-8d81-58a8c2d12deb tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "POST /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d/action" status: 400 len: 113 microversion: 2.1 time: 0.009115 Oct 28 14:20:18.928124 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3717/7523] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:20:18 2022] POST /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 14:20:18.932198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:18.932808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:18.938722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.939238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.939678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:18.940363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:18.940821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:18.941244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.069390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:19.077561 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b62664cf-0048-4860-94c8-a4587c15113c tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1506 microversion: 2.1 time: 0.149103 Oct 28 14:20:19.078133 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3807/7524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:18 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:19.104432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:19.104942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:19.111932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.112428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.112877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.113573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.114146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.114477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.128004 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] HTTP exception thrown: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Request method failure captured: Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 HTTP/1.1 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-UDQuvNUFVs8RygT5PybGWWeaomxekDs9yGCZOIW8_Bda1MvsItCRY3fYKndSRIZVVjHhpmBpdAh6XsUatNPp2R6q7xI0LzauGkF4nKMVi9_E1c92wNVa9fLrppFZTK7z5-AztEKHSOakgzAOOzKxwa5hxvRB-DNYSo5aNyLaQAXqY Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e8e13e21ee447bb072e53626291771", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e8e13e21ee447bb072e53626291771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 7014dacd4b2c44ff9d0b9c7291e0d480 Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'fe077c9c-6aef-4f92-8dc7-e7decbbc81a7'} Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:20:19.129545 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Returning 404 to user: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f9ff1a5e-5cef-4c63-8b6b-0e4cb7ea597f tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 404 len: 111 microversion: 2.1 time: 0.031213 Oct 28 14:20:19.134424 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3718/7525] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:20:19 2022] DELETE /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:20:19.139913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:19.140530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: fe077c9c-6aef-4f92-8dc7-e7decbbc81a7] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:19.147199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.148657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.148657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.148866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.149224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.149640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.162968 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] HTTP exception thrown: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Request method failure captured: Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 HTTP/1.1 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-UDQuvNUFVs8RygT5PybGWWeaomxekDs9yGCZOIW8_Bda1MvsItCRY3fYKndSRIZVVjHhpmBpdAh6XsUatNPp2R6q7xI0LzauGkF4nKMVi9_E1c92wNVa9fLrppFZTK7z5-AztEKHSOakgzAOOzKxwa5hxvRB-DNYSo5aNyLaQAXqY Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e8e13e21ee447bb072e53626291771", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e8e13e21ee447bb072e53626291771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 7014dacd4b2c44ff9d0b9c7291e0d480 Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'fe077c9c-6aef-4f92-8dc7-e7decbbc81a7'} Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:19.164479 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Returning 404 to user: Instance fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f93a55c7-f448-4a2a-a60b-cc45a25176d0 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7" status: 404 len: 111 microversion: 2.1 time: 0.030035 Oct 28 14:20:19.169504 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3808/7526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:19 2022] GET /compute/v2.1/servers/fe077c9c-6aef-4f92-8dc7-e7decbbc81a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:20:19.174569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:19.175103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:19.180989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.181478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.181920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.182605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.183095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.183532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.211196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:20:19.407901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a3d56ac9-8bd1-40d2-a230-d3781f0e8054 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 204 len: 0 microversion: 2.1 time: 0.236922 Oct 28 14:20:19.408555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3719/7527] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:20:19 2022] DELETE /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:20:19.416748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:19.418244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:19.423581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.424055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.424487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.425164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:19.425614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:19.426031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:19.559016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:19.567383 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0baaf19e-bfb6-47aa-943a-33665ef21ca5 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1512 microversion: 2.1 time: 0.154545 Oct 28 14:20:19.567950 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3809/7528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:19 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:20.590932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:20.591684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:20.598646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:20.599196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:20.599647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:20.600363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:20.600839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:20.601282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:20.729764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:20.737691 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e88cc7a0-f8b7-4741-8a8c-d0832af71244 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1512 microversion: 2.1 time: 0.151080 Oct 28 14:20:20.738269 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3720/7529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:20 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:21.252241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-85279a47-1caf-4dc4-9e9c-a2a78cfab7c9 req-12a22b5e-57e9-4232-8a36-72f93d702f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8a2653-e305-4828-9d3e-60d316dd307d", "name": "network-vif-deleted", "tag": "911a1b91-6705-4e93-b5a4-95290289e47c"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:20:21.257891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:20:21.263274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85279a47-1caf-4dc4-9e9c-a2a78cfab7c9 req-12a22b5e-57e9-4232-8a36-72f93d702f21 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:21.263994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85279a47-1caf-4dc4-9e9c-a2a78cfab7c9 req-12a22b5e-57e9-4232-8a36-72f93d702f21 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:21.264437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85279a47-1caf-4dc4-9e9c-a2a78cfab7c9 req-12a22b5e-57e9-4232-8a36-72f93d702f21 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:21.278900 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-85279a47-1caf-4dc4-9e9c-a2a78cfab7c9 req-12a22b5e-57e9-4232-8a36-72f93d702f21 service nova] Creating event network-vif-deleted:911a1b91-6705-4e93-b5a4-95290289e47c for instance bb8a2653-e305-4828-9d3e-60d316dd307d on n-h1-862876-2 Oct 28 14:20:21.285875 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-85279a47-1caf-4dc4-9e9c-a2a78cfab7c9 req-12a22b5e-57e9-4232-8a36-72f93d702f21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037919 Oct 28 14:20:21.286695 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3810/7530] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:20:21.761097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:21.761718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:21.769043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:21.769548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:21.769993 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:21.770694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:21.771188 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:21.771626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:21.805771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:21.805771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:21.805771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:21.805771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lazy-loading 'fault' on Instance uuid bb8a2653-e305-4828-9d3e-60d316dd307d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:20:21.845861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014dacd4b2c44ff9d0b9c7291e0d480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e8e13e21ee447bb072e53626291771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:20:21.854208 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2380756c-9371-42ce-b366-cad47f41f80d tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 200 len: 1307 microversion: 2.1 time: 0.097048 Oct 28 14:20:21.854793 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3721/7531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:21 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:20:22.879078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:20:22.880564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] [instance: bb8a2653-e305-4828-9d3e-60d316dd307d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:20:22.886216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:22.886697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:22.887158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:22.887852 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:20:22.888308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:20:22.888734 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:20:22.902181 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] HTTP exception thrown: Instance bb8a2653-e305-4828-9d3e-60d316dd307d could not be found. Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Request method failure captured: Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d HTTP/1.1 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-UDQuvNUFVs8RygT5PybGWWeaomxekDs9yGCZOIW8_Bda1MvsItCRY3fYKndSRIZVVjHhpmBpdAh6XsUatNPp2R6q7xI0LzauGkF4nKMVi9_E1c92wNVa9fLrppFZTK7z5-AztEKHSOakgzAOOzKxwa5hxvRB-DNYSo5aNyLaQAXqY Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e8e13e21ee447bb072e53626291771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e8e13e21ee447bb072e53626291771", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e8e13e21ee447bb072e53626291771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 01e8e13e21ee447bb072e53626291771 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-ServersNegativeTestJSON-544016184 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 7014dacd4b2c44ff9d0b9c7291e0d480 Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-ServersNegativeTestJSON-544016184-project Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bb8a2653-e305-4828-9d3e-60d316dd307d could not be found. Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bb8a2653-e305-4828-9d3e-60d316dd307d'} Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8a2653-e305-4828-9d3e-60d316dd307d could not be found. Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8a2653-e305-4828-9d3e-60d316dd307d could not be found. Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:20:22.906667 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8a2653-e305-4828-9d3e-60d316dd307d could not be found. Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] Returning 404 to user: Instance bb8a2653-e305-4828-9d3e-60d316dd307d could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0134cca2-b6e3-4437-97e0-778fbba3e0d7 tempest-ServersNegativeTestJSON-544016184 tempest-ServersNegativeTestJSON-544016184-project] 10.222.0.25 "GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d" status: 404 len: 111 microversion: 2.1 time: 0.031713 Oct 28 14:20:22.911946 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3811/7532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:20:22 2022] GET /compute/v2.1/servers/bb8a2653-e305-4828-9d3e-60d316dd307d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:21:03.946119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:03.947057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:04.125418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1932918a-be84-4d4e-8aba-8e6bbaff8450 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: .version_select at 0x7f27bd96ef70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2024551379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR+J2J+9k6n9q4sqDwBIUf+OUnmCsO/caZrq9OrtQNGS3FTEUgcs0Hb08rd2yRmNHHn/P6LVwpfBbr6+2VA2o33WzCZu5jm2x11HDB1/EWY+oCjDcor0Pn+Q4bWVPyjpA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:04.141530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1932918a-be84-4d4e-8aba-8e6bbaff8450 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:21:04.147368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1932918a-be84-4d4e-8aba-8e6bbaff8450 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for user b47fc3b32f96488aabd343bc4f0dac4a and project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:21:04.265934 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1932918a-be84-4d4e-8aba-8e6bbaff8450 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.326328 Oct 28 14:21:04.266564 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3722/7533] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:21:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:04.319950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1005575186", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2024551379", "networks": [{"uuid": "77f85c54-a80f-4395-b890-3748d58b6047"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:04.329763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=36 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:04.392037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] validate_networks() for [('77f85c54-a80f-4395-b890-3748d58b6047', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:21:04.827897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:21:04.828978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:21:04.829495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:21:04.830107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:21:04.830527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:21:04.839967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:04.840731 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:04.841163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:04.841887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:04.842342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:04.842829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:04.861824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:21:04.867207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for user b47fc3b32f96488aabd343bc4f0dac4a and project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:21:04.886633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:21:04.886633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:21:05.005350 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cd81948b-8c2d-4038-a90f-bd6f5a51a3c1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690070 Oct 28 14:21:05.006006 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3812/7534] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:21:05.018551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d74b16ab-2d7d-43cd-b04e-2a36b881e395 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:05.019224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d74b16ab-2d7d-43cd-b04e-2a36b881e395 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:05.079143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d74b16ab-2d7d-43cd-b04e-2a36b881e395 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:05.090782 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d74b16ab-2d7d-43cd-b04e-2a36b881e395 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1263 microversion: 2.1 time: 0.074752 Oct 28 14:21:05.090782 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3723/7535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:05 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:21:06.113725 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:06.114342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:06.121281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:06.121776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:06.122219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:06.122949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:06.123411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:06.123842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:06.185515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:06.193990 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10c67ec7-a8e4-41b6-9c07-92378dc9a6ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1267 microversion: 2.1 time: 0.085958 Oct 28 14:21:06.194570 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3813/7536] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:06 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:07.217180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:07.217822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:07.224702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:07.225237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:07.225710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:07.226425 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:07.226967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:07.227419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:07.310282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:07.320714 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bd6f1c3-3554-461b-9005-a713383dbb5f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1323 microversion: 2.1 time: 0.107538 Oct 28 14:21:07.321333 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3724/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:07 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1323 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:21:08.346996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:08.352031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:08.354718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:08.355314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:08.355820 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:08.356799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:08.357334 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:08.357825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:08.586377 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:08.595226 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-131862e4-dbe5-420f-83e4-5a76c804c1c8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1363 microversion: 2.1 time: 0.252528 Oct 28 14:21:08.595810 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3814/7538] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:08 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:09.045104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-2064462a-08c4-4b9f-afd1-4df5e8c31c70 req-b606c51e-b888-4dab-aa8f-0113c458afb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f26b948-ec5d-4176-8db5-c85a0128208c", "tag": "ae437a9f-e029-4872-bd05-4cc264e876d1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:09.057241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2064462a-08c4-4b9f-afd1-4df5e8c31c70 req-b606c51e-b888-4dab-aa8f-0113c458afb7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:09.057746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2064462a-08c4-4b9f-afd1-4df5e8c31c70 req-b606c51e-b888-4dab-aa8f-0113c458afb7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:09.058185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-2064462a-08c4-4b9f-afd1-4df5e8c31c70 req-b606c51e-b888-4dab-aa8f-0113c458afb7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:09.070824 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-2064462a-08c4-4b9f-afd1-4df5e8c31c70 req-b606c51e-b888-4dab-aa8f-0113c458afb7 service nova] Creating event network-changed:ae437a9f-e029-4872-bd05-4cc264e876d1 for instance 7f26b948-ec5d-4176-8db5-c85a0128208c on n-h2-862876-2 Oct 28 14:21:09.076665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-2064462a-08c4-4b9f-afd1-4df5e8c31c70 req-b606c51e-b888-4dab-aa8f-0113c458afb7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035237 Oct 28 14:21:09.077284 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3725/7539] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:09.621247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:09.622578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:09.631023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:09.631737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:09.632885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:09.633944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:09.634697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:09.635364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:09.853264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:09.860875 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2d28abf6-db31-49c2-927f-c81b31e2b812 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1363 microversion: 2.1 time: 0.244568 Oct 28 14:21:09.861455 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3815/7540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:09 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:10.884486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:10.885180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:10.892158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:10.892649 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:10.893093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:10.893785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:10.894251 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:10.894682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:11.029471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:11.037674 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-186420bd-e9c5-44d1-8e4d-dff9ebd34e9e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1363 microversion: 2.1 time: 0.157565 Oct 28 14:21:11.038189 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3726/7541] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:10 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:12.061238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:12.061848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:12.069398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:12.069821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:12.070253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:12.070987 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:12.071444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:12.071865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:12.204992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:12.212596 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f01df4a7-9ffc-4a44-969a-5eef029cd232 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1363 microversion: 2.1 time: 0.155355 Oct 28 14:21:12.213171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3816/7542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:12 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:13.235467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:13.236090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:13.243448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:13.243947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:13.244391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:13.245085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:13.245544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:13.245968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:13.379849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:13.387509 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8753f01-f735-4df1-a007-82703bde788b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1363 microversion: 2.1 time: 0.155949 Oct 28 14:21:13.388088 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3727/7543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:13 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:14.411018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:14.411632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:14.418414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:14.418956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:14.419396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:14.420091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:14.420552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:14.420986 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:14.554035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:14.561858 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-579f4b31-6f34-4cc3-aa74-05eb89d11591 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1363 microversion: 2.1 time: 0.154768 Oct 28 14:21:14.562435 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3817/7544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:14 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:14.770968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-986115b2-38d2-41d3-9293-bad651c78c7e req-1416b6ad-2977-44c8-911e-670b77d6e1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f26b948-ec5d-4176-8db5-c85a0128208c", "name": "network-vif-plugged", "status": "completed", "tag": "ae437a9f-e029-4872-bd05-4cc264e876d1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:14.781429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-986115b2-38d2-41d3-9293-bad651c78c7e req-1416b6ad-2977-44c8-911e-670b77d6e1aa service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:14.781924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-986115b2-38d2-41d3-9293-bad651c78c7e req-1416b6ad-2977-44c8-911e-670b77d6e1aa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:14.782407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-986115b2-38d2-41d3-9293-bad651c78c7e req-1416b6ad-2977-44c8-911e-670b77d6e1aa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:14.793846 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-986115b2-38d2-41d3-9293-bad651c78c7e req-1416b6ad-2977-44c8-911e-670b77d6e1aa service nova] Creating event network-vif-plugged:ae437a9f-e029-4872-bd05-4cc264e876d1 for instance 7f26b948-ec5d-4176-8db5-c85a0128208c on n-h2-862876-2 Oct 28 14:21:14.799137 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-986115b2-38d2-41d3-9293-bad651c78c7e req-1416b6ad-2977-44c8-911e-670b77d6e1aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031958 Oct 28 14:21:14.799767 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3728/7545] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:15.585300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:15.585915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:15.587816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:15.588491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:15.594088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:15.594574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:15.597400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:15.597400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:15.597400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:15.597400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:15.725269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:15.732927 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d317b2f-3b7d-4260-877d-892929de0626 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1363 microversion: 2.1 time: 0.152139 Oct 28 14:21:15.733535 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3818/7546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:15 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:16.754452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:16.759905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:16.764562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:16.767435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:16.767951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:16.768403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:16.769123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:16.770195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:16.770771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:16.913824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:16.921771 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d1da813e-71c3-4d25-b8ac-d7e534db6890 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1556 microversion: 2.1 time: 0.169044 Oct 28 14:21:16.922349 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3729/7547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:16 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:16.945021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:16.945634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:16.952760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:16.953252 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:16.953691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:16.954381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:16.954872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:16.955303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:17.091573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:17.099610 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-20d1f55a-6fc0-4d57-b998-d3dbe019f95d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1556 microversion: 2.1 time: 0.159081 Oct 28 14:21:17.100222 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3819/7548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:16 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:20.130856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acfe0e46-4c02-4d3d-ab56-1a786e15a294"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:20.133823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:20.140625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:20.141118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:20.141569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:20.142277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:20.142772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:20.143280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:20.978020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4e50977c-8520-4017-9d48-662205826191 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851033 Oct 28 14:21:20.978672 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3730/7549] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 14:21:20 2022] POST /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:32.753012 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:32.757696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:32.757696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:32.757696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=44 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:32.761681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:32.762164 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:32.762595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:32.763305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:32.763759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:32.764184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:32.843566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lazy-loading 'services' on Instance uuid 7f26b948-ec5d-4176-8db5-c85a0128208c {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:21:33.074949 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b1237ffd-c167-433d-8c2e-d362db7fb557 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments/acfe0e46-4c02-4d3d-ab56-1a786e15a294" status: 202 len: 0 microversion: 2.1 time: 0.325659 Oct 28 14:21:33.075550 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3820/7550] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:21:32 2022] DELETE /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments/acfe0e46-4c02-4d3d-ab56-1a786e15a294 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:21:33.083304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:33.084500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:33.089459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:33.091917 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:33.098890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:33.099400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:33.099851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:33.100613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:33.101085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:33.101533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:33.131982 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-319ba35c-ee98-4306-a779-09ae0890a5c5 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051684 Oct 28 14:21:33.132555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3731/7551] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:21:33 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:34.146909 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:34.149431 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:34.155955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:34.156445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:34.156884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:34.157577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:34.158037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:34.158466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:34.189331 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-248328ff-d818-4de4-bc7d-65d51f6ef90f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047770 Oct 28 14:21:34.189901 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3821/7552] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:21:34 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:35.203468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:35.205746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:35.214673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:35.215796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:35.216377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:35.217135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:35.217620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:35.218068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:35.255141 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5b2eddc-66d4-469a-8846-0d7ae28ab2ad tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056605 Oct 28 14:21:35.255758 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3732/7553] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:21:35 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:36.268411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:36.270608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:36.278159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:36.278559 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:36.279020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:36.279700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:36.280156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:36.280576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:36.309432 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9bd47484-7f9f-4086-8e1d-59e55dee916b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Oct 28 14:21:36.309988 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3822/7554] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:21:36 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:37.322175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:37.324369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:37.331755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:37.332249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:37.332694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:37.333392 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:37.333858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:37.334572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:37.365062 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f8be3605-ce37-454c-8456-bdb1fe5d89ba tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047178 Oct 28 14:21:37.365630 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3733/7555] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:21:37 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:38.377576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:38.379795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:38.386113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:38.386601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:38.387077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:38.387768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:38.388227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:38.388654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:38.417376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d103c32c-d9d7-4fb4-b6ee-540715f6b49c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043772 Oct 28 14:21:38.418130 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3823/7556] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:21:38 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 14:21:38.431998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:38.432922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:38.441228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:38.441784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:38.442402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:38.443160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:38.443625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:38.444158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:38.526028 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] HTTP exception thrown: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c is not attached to volume acfe0e46-4c02-4d3d-ab56-1a786e15a294 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Request method failure captured: Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments/acfe0e46-4c02-4d3d-ab56-1a786e15a294 HTTP/1.1 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-VJijWBnqulVys_IBLIuVKgRzBjdrFRbAR6J9Ioh49M_KWX_f6tbe40cgTrtPXrNP0bWxt0Rznp_KQQc4QX1YzwyIiJxVDpXZUBCF4imoCvwIUckoH4WqYDONxZHayRcdWkW7LQI5PiQN1c2ZZyutZFK9euj1yrngHeJY4CQ4P4Jmo Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e08b5ec7d5d4bf7a2a5fd70caa79b77", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: b47fc3b32f96488aabd343bc4f0dac4a Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c is not attached to volume acfe0e46-4c02-4d3d-ab56-1a786e15a294 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '7f26b948-ec5d-4176-8db5-c85a0128208c', 'id': 'acfe0e46-4c02-4d3d-ab56-1a786e15a294'} Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id acfe0e46-4c02-4d3d-ab56-1a786e15a294. Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c is not attached to volume acfe0e46-4c02-4d3d-ab56-1a786e15a294 Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:21:38.532494 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:21:38.537276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:21:38.537276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:21:38.537276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c is not attached to volume acfe0e46-4c02-4d3d-ab56-1a786e15a294 Oct 28 14:21:38.537276 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:38.537276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Returning 404 to user: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c is not attached to volume acfe0e46-4c02-4d3d-ab56-1a786e15a294 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:21:38.537276 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5294bc16-b1b7-4b23-962c-c50e3b9ec132 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments/acfe0e46-4c02-4d3d-ab56-1a786e15a294" status: 404 len: 154 microversion: 2.1 time: 0.108495 Oct 28 14:21:38.537276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3734/7557] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:21:38 2022] DELETE /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c/os-volume_attachments/acfe0e46-4c02-4d3d-ab56-1a786e15a294 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:21:42.067119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:42.067664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:42.074697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:42.075220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:42.075665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:42.076625 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:42.077085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:42.077513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:42.106565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:21:42.332824 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-10fb1efe-fa24-4b63-a205-6b1dbe2b7045 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 204 len: 0 microversion: 2.1 time: 0.269794 Oct 28 14:21:42.335675 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3824/7558] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:21:42 2022] DELETE /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:21:42.342397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:42.343156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:42.349796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:42.350367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:42.350911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:42.351676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:42.352239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:42.352786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:42.485732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:42.494204 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f5b1b617-9d06-4f6a-89bb-5b8e53677949 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1562 microversion: 2.1 time: 0.155730 Oct 28 14:21:42.494786 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3735/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:42 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:43.518311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:43.519036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:43.526935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:43.527418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:43.527853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:43.528530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:43.528997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:43.529402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:43.670935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:43.678611 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a1b658a9-b626-499a-981a-ff72fb15390b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1562 microversion: 2.1 time: 0.164586 Oct 28 14:21:43.679215 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3825/7560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:43 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:44.676772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4b5cca97-e9fc-4c75-b276-bca5080e10e5 req-2ace51d7-921c-4c4f-86f6-de3292e47daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f26b948-ec5d-4176-8db5-c85a0128208c", "name": "network-vif-deleted", "tag": "ae437a9f-e029-4872-bd05-4cc264e876d1"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:44.687925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4b5cca97-e9fc-4c75-b276-bca5080e10e5 req-2ace51d7-921c-4c4f-86f6-de3292e47daa service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:44.688742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4b5cca97-e9fc-4c75-b276-bca5080e10e5 req-2ace51d7-921c-4c4f-86f6-de3292e47daa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:44.688878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4b5cca97-e9fc-4c75-b276-bca5080e10e5 req-2ace51d7-921c-4c4f-86f6-de3292e47daa service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:44.699829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4b5cca97-e9fc-4c75-b276-bca5080e10e5 req-2ace51d7-921c-4c4f-86f6-de3292e47daa service nova] Creating event network-vif-deleted:ae437a9f-e029-4872-bd05-4cc264e876d1 for instance 7f26b948-ec5d-4176-8db5-c85a0128208c on n-h2-862876-2 Oct 28 14:21:44.701707 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:44.702366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:44.705177 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4b5cca97-e9fc-4c75-b276-bca5080e10e5 req-2ace51d7-921c-4c4f-86f6-de3292e47daa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032095 Oct 28 14:21:44.705779 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3736/7561] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:44.710550 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:44.711079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:44.711591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:44.712337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:44.712815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:44.713253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:44.777315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:44.785287 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-729f2d98-cc04-45c8-bcf4-e1b22e5ca81d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 200 len: 1520 microversion: 2.1 time: 0.087743 Oct 28 14:21:44.785868 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3826/7562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:44 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 1520 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:21:45.812284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:45.813034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: 7f26b948-ec5d-4176-8db5-c85a0128208c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:45.819165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:45.819667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:45.820116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:45.820820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:45.821897 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:45.822334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:45.835699 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] HTTP exception thrown: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c could not be found. Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Request method failure captured: Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c HTTP/1.1 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-VJijWBnqulVys_IBLIuVKgRzBjdrFRbAR6J9Ioh49M_KWX_f6tbe40cgTrtPXrNP0bWxt0Rznp_KQQc4QX1YzwyIiJxVDpXZUBCF4imoCvwIUckoH4WqYDONxZHayRcdWkW7LQI5PiQN1c2ZZyutZFK9euj1yrngHeJY4CQ4P4Jmo Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e08b5ec7d5d4bf7a2a5fd70caa79b77", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: b47fc3b32f96488aabd343bc4f0dac4a Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c could not be found. Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '7f26b948-ec5d-4176-8db5-c85a0128208c'} Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c could not be found. Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c could not be found. Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:21:45.837351 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c could not be found. Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Returning 404 to user: Instance 7f26b948-ec5d-4176-8db5-c85a0128208c could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-79357d5a-ec86-410a-aa69-fffee9cfb131 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c" status: 404 len: 111 microversion: 2.1 time: 0.031619 Oct 28 14:21:45.842623 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3737/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:45 2022] GET /compute/v2.1/servers/7f26b948-ec5d-4176-8db5-c85a0128208c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:21:45.847450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5df8d85-5224-4d25-9075-49459a35baf1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '.version_select at 0x7f27b882f700>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:45.945419 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5df8d85-5224-4d25-9075-49459a35baf1 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2024551379" status: 202 len: 0 microversion: 2.1 time: 0.101787 Oct 28 14:21:45.945993 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3827/7564] 10.222.0.25 () {58 vars in 1278 bytes} [Fri Oct 28 14:21:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2024551379 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 14:21:45.964120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a228dacc-0f4e-4856-b54a-c4569e1a4a1a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: .version_select at 0x7f27b8451a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-414059545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDGILRtHBE01vghepfXBIOny+0ZjsjW8z7SP0rv7fUS+VjoX68gaGi1lxuIvsPSiEFBcsx8lTatSK4Pk68/Npwtm0XdchegjD1PRvWlk/QzcXOvvFk0ik2RKVZ8M/ZtcA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:45.979860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a228dacc-0f4e-4856-b54a-c4569e1a4a1a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:21:45.988823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-a228dacc-0f4e-4856-b54a-c4569e1a4a1a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for user b47fc3b32f96488aabd343bc4f0dac4a and project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:21:46.077267 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a228dacc-0f4e-4856-b54a-c4569e1a4a1a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.117017 Oct 28 14:21:46.077815 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3738/7565] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:21:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:46.128209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-629536061", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-414059545", "networks": [{"uuid": "77f85c54-a80f-4395-b890-3748d58b6047"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:46.180191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] validate_networks() for [('77f85c54-a80f-4395-b890-3748d58b6047', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:21:46.543483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:21:46.543901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:21:46.544368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:21:46.544771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:21:46.545407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:21:46.553961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:46.554438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:46.554898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:46.555615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:46.556124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:46.556837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:46.573749 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:21:46.579221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for user b47fc3b32f96488aabd343bc4f0dac4a and project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:21:46.591733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:21:46.594089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:21:46.714288 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60ae80d7-dd17-4d5c-819d-fe3b0b9bdd8b tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589948 Oct 28 14:21:46.717501 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3828/7566] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:21:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:21:46.726229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9f4e3baa-e505-4a96-8779-602b397398c2 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:46.726882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9f4e3baa-e505-4a96-8779-602b397398c2 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:46.786447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9f4e3baa-e505-4a96-8779-602b397398c2 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:46.793470 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9f4e3baa-e505-4a96-8779-602b397398c2 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1261 microversion: 2.1 time: 0.071082 Oct 28 14:21:46.794055 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3739/7567] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:46 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:47.816733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:47.817262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:47.824230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:47.824745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:47.825182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:47.825868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:47.826589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:47.827041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:47.888072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:47.897431 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9008a6be-6017-453e-9388-196adaaa22ae tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1265 microversion: 2.1 time: 0.084509 Oct 28 14:21:47.897431 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3829/7568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:47 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:48.920206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:48.920780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:48.927680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:48.928190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:48.928640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:48.929352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:48.929829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:48.930267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:48.998343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:49.006312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-05645600-7211-4195-bef5-36abf17d310c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1331 microversion: 2.1 time: 0.090171 Oct 28 14:21:49.006992 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3740/7569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:48 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:50.029470 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:50.030097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:50.036826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:50.037315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:50.037759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:50.038456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:50.038944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:50.039371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:50.200153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:50.208122 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-993adf6d-4435-45b0-aca7-57c7d30062ab tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.182579 Oct 28 14:21:50.208681 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3830/7570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:50 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:50.254625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-a52300cc-3012-4af0-bb80-10e02e348f8a req-e6cdcb87-4c94-49c6-91d9-88159c201af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36b5408-909e-4fbf-80cb-9299831e9805", "tag": "df710dfd-6698-4666-94aa-4257a20a6daf"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:50.265372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a52300cc-3012-4af0-bb80-10e02e348f8a req-e6cdcb87-4c94-49c6-91d9-88159c201af9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:50.265867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a52300cc-3012-4af0-bb80-10e02e348f8a req-e6cdcb87-4c94-49c6-91d9-88159c201af9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:50.266313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-a52300cc-3012-4af0-bb80-10e02e348f8a req-e6cdcb87-4c94-49c6-91d9-88159c201af9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:50.277170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-a52300cc-3012-4af0-bb80-10e02e348f8a req-e6cdcb87-4c94-49c6-91d9-88159c201af9 service nova] Creating event network-changed:df710dfd-6698-4666-94aa-4257a20a6daf for instance c36b5408-909e-4fbf-80cb-9299831e9805 on n-h1-862876-2 Oct 28 14:21:50.282087 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-a52300cc-3012-4af0-bb80-10e02e348f8a req-e6cdcb87-4c94-49c6-91d9-88159c201af9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031207 Oct 28 14:21:50.282690 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3741/7571] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:51.230300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:51.230941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:51.237747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:51.238227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:51.238664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:51.239371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:51.239822 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:51.240247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:51.367442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:51.375088 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f71a4690-beff-44a1-92e6-badaaaa8965c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.148640 Oct 28 14:21:51.375668 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3831/7572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:51 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:52.400509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:52.401144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:52.407319 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:52.407816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:52.408267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:52.408994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:52.409471 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:52.409909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:52.539840 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:52.548351 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a5910459-8b02-43f2-a0ec-bc2c24ad0716 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.153658 Oct 28 14:21:52.548935 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3742/7573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:52 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:53.570936 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:53.571547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:53.578673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:53.579184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:53.579615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:53.580295 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:53.580742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:53.581163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:53.710064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:53.718356 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-837c8632-e6c6-4020-83f3-858f1bffa29f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.151654 Oct 28 14:21:53.718956 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3832/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:53 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:54.741625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:54.742253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:54.749662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:54.750160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:54.750608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:54.751343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:54.751920 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:54.752360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:54.877919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:54.885646 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cd8e89e3-ba0b-4bf2-9119-82fcf6008503 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.147963 Oct 28 14:21:54.886225 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3743/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:54 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:55.908370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:55.908988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:55.915825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:55.916315 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:55.916763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:55.917484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:55.917942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:55.918369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:56.047863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:56.055578 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eed2e6c4-0edf-4f93-97f2-af1c4404344d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.151171 Oct 28 14:21:56.058256 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3833/7576] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:55 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:57.080083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:57.080706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:57.083550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:57.088458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:57.088960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:57.089409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:57.091492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:57.092073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:57.095028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:57.142447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1c0834df-0855-45e4-ac7b-df6665c91d0a req-8e40f647-8708-40a9-85fc-c88dd753c2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b5408-909e-4fbf-80cb-9299831e9805", "name": "network-vif-plugged", "status": "completed", "tag": "df710dfd-6698-4666-94aa-4257a20a6daf"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:21:57.153206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:57.154472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:57.157605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1c0834df-0855-45e4-ac7b-df6665c91d0a req-8e40f647-8708-40a9-85fc-c88dd753c2d7 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:57.158330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1c0834df-0855-45e4-ac7b-df6665c91d0a req-8e40f647-8708-40a9-85fc-c88dd753c2d7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:57.159153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1c0834df-0855-45e4-ac7b-df6665c91d0a req-8e40f647-8708-40a9-85fc-c88dd753c2d7 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:57.172178 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1c0834df-0855-45e4-ac7b-df6665c91d0a req-8e40f647-8708-40a9-85fc-c88dd753c2d7 service nova] Creating event network-vif-plugged:df710dfd-6698-4666-94aa-4257a20a6daf for instance c36b5408-909e-4fbf-80cb-9299831e9805 on n-h1-862876-2 Oct 28 14:21:57.178216 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1c0834df-0855-45e4-ac7b-df6665c91d0a req-8e40f647-8708-40a9-85fc-c88dd753c2d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039342 Oct 28 14:21:57.181296 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3834/7577] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:21:57.238772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:57.247430 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92607b0f-0d50-49f1-9bfb-8a4f543cfe56 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.171533 Oct 28 14:21:57.248038 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3744/7578] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:57 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:58.273557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:58.274262 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:58.282381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:58.282911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:58.283355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:58.284047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:58.284509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:58.284941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:58.516621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:58.524361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb7fd3fc-ee6c-470e-8d10-1bb0662cafc9 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1361 microversion: 2.1 time: 0.255772 Oct 28 14:21:58.524940 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3835/7579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:58 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:59.548053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:59.548735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:59.555564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:59.556054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:59.556525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:59.557220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:59.557685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:59.558119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:59.692888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:59.701161 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3830fb19-af43-4071-a627-f989d3502c8a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1554 microversion: 2.1 time: 0.157068 Oct 28 14:21:59.701982 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3745/7580] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:59 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:21:59.723283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:21:59.723901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:21:59.730771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:59.731455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:59.731901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:59.732603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:21:59.733065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:21:59.733499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:21:59.752310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:21:59.862709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:21:59.870320 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d61912a9-eae2-414a-bf09-5c83a35f7bf8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1554 microversion: 2.1 time: 0.150906 Oct 28 14:21:59.870907 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3836/7581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:21:59 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:22:02.837600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82468955-3521-4c30-81be-1982c53608a3"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:22:02.839991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:02.847070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:02.847569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:02.848020 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:02.848730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:02.849204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:02.849643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:03.492093 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4e500b28-cbea-4c5c-bb73-c6a9cb48e124 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658127 Oct 28 14:22:03.492646 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3746/7582] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 14:22:02 2022] POST /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:15.271720 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:15.272283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:15.275303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:15.277447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:15.280866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:15.281360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:15.281898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:15.282496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:15.282989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:15.283418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:15.369469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lazy-loading 'services' on Instance uuid c36b5408-909e-4fbf-80cb-9299831e9805 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:22:15.617193 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-993b824f-e397-4520-89d8-d872d9118993 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments/82468955-3521-4c30-81be-1982c53608a3" status: 202 len: 0 microversion: 2.1 time: 0.349464 Oct 28 14:22:15.617823 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3837/7583] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:22:15 2022] DELETE /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments/82468955-3521-4c30-81be-1982c53608a3 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:22:15.625913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:15.626868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:15.631153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:15.641721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:15.641721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:15.641721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:15.641721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:15.641721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:15.641721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:15.642321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:15.675114 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdb1c4b4-5d41-40e6-998e-dbc0593e2bc6 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052275 Oct 28 14:22:15.675606 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3747/7584] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:15 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:16.690359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:16.692878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:16.699350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:16.699869 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:16.700308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:16.701085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:16.701575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:16.702272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:16.733225 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-abce39c8-1351-4a22-9384-aa79f6a6a4a4 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049200 Oct 28 14:22:16.733802 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3838/7585] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:16 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:17.746302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:17.759829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:17.767108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:17.768089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:17.768975 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:17.769878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:17.770693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:17.771166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:17.802596 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-df2050ca-9581-4c61-919d-ec7cce678f42 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060706 Oct 28 14:22:17.803224 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3748/7586] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:17 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:22:18.816629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:18.819047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:18.828177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:18.829128 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:18.829965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:18.830771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:18.831369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:18.831873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:18.866971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e9815666-2668-44ac-bc86-337e492bb07d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054437 Oct 28 14:22:18.867668 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3839/7587] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:18 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:19.879813 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:19.881979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:19.890216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:19.890715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:19.891189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:19.891944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:19.892413 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:19.892851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:19.923962 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d1617731-4945-437f-af36-d5b89b01e53c tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048707 Oct 28 14:22:19.924575 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3749/7588] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:19 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:20.936040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:20.938232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:20.945008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:20.945495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:20.945931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:20.946626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:20.947110 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:20.947539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:20.977745 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b26e27f6-1232-4386-87cd-bf9e6aeebb05 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045657 Oct 28 14:22:20.978300 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3840/7589] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:20 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 14:22:20.989148 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:20.989662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:20.996393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:20.996886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:20.997332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:20.998025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:20.998492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:20.998953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:21.072629 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] HTTP exception thrown: Instance c36b5408-909e-4fbf-80cb-9299831e9805 is not attached to volume 82468955-3521-4c30-81be-1982c53608a3 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Request method failure captured: Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments/82468955-3521-4c30-81be-1982c53608a3 HTTP/1.1 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-VJijWBnqulVys_IBLIuVKgRzBjdrFRbAR6J9Ioh49M_KWX_f6tbe40cgTrtPXrNP0bWxt0Rznp_KQQc4QX1YzwyIiJxVDpXZUBCF4imoCvwIUckoH4WqYDONxZHayRcdWkW7LQI5PiQN1c2ZZyutZFK9euj1yrngHeJY4CQ4P4Jmo Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e08b5ec7d5d4bf7a2a5fd70caa79b77", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: b47fc3b32f96488aabd343bc4f0dac4a Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance c36b5408-909e-4fbf-80cb-9299831e9805 is not attached to volume 82468955-3521-4c30-81be-1982c53608a3 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': 'c36b5408-909e-4fbf-80cb-9299831e9805', 'id': '82468955-3521-4c30-81be-1982c53608a3'} Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 82468955-3521-4c30-81be-1982c53608a3. Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36b5408-909e-4fbf-80cb-9299831e9805 is not attached to volume 82468955-3521-4c30-81be-1982c53608a3 Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:22:21.074302 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:22:21.080713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:22:21.080713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:22:21.080713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36b5408-909e-4fbf-80cb-9299831e9805 is not attached to volume 82468955-3521-4c30-81be-1982c53608a3 Oct 28 14:22:21.080713 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:21.080713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Returning 404 to user: Instance c36b5408-909e-4fbf-80cb-9299831e9805 is not attached to volume 82468955-3521-4c30-81be-1982c53608a3 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:22:21.080713 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-874a65d7-46c1-48e1-a632-98db038db845 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments/82468955-3521-4c30-81be-1982c53608a3" status: 404 len: 154 microversion: 2.1 time: 0.090639 Oct 28 14:22:21.080713 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3750/7590] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:22:20 2022] DELETE /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805/os-volume_attachments/82468955-3521-4c30-81be-1982c53608a3 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:22:24.599285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:24.599891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:24.607148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:24.607626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:24.608056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:24.608733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:24.609183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:24.609612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:24.635654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:22:24.915651 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3718091d-8f4c-42fc-82aa-e5ebf5fc098d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 204 len: 0 microversion: 2.1 time: 0.319942 Oct 28 14:22:24.916293 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3841/7591] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:22:24 2022] DELETE /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:22:24.924541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:24.926378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:24.932756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:24.933266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:24.933721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:24.934437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:24.934941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:24.935916 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:25.073061 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:25.081889 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b521d3b6-fa3c-49cc-91da-cc9cedddb62a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1560 microversion: 2.1 time: 0.161223 Oct 28 14:22:25.082458 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3751/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:24 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:22:26.105810 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:26.106544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:26.113489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:26.113983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:26.114428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:26.115161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:26.115622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:26.116051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:26.253270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:26.261168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-764f36b2-7d65-46bc-a218-b3b036ff6035 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1560 microversion: 2.1 time: 0.159748 Oct 28 14:22:26.261741 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3842/7593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:26 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:26.941307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-60c1f2f7-947b-4fa9-8c9f-0848b25493b6 req-f84ff128-a3e9-429c-9fde-ee879128937d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b5408-909e-4fbf-80cb-9299831e9805", "name": "network-vif-deleted", "tag": "df710dfd-6698-4666-94aa-4257a20a6daf"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:22:26.951763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-60c1f2f7-947b-4fa9-8c9f-0848b25493b6 req-f84ff128-a3e9-429c-9fde-ee879128937d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:26.953090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-60c1f2f7-947b-4fa9-8c9f-0848b25493b6 req-f84ff128-a3e9-429c-9fde-ee879128937d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:26.953090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-60c1f2f7-947b-4fa9-8c9f-0848b25493b6 req-f84ff128-a3e9-429c-9fde-ee879128937d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:26.964171 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-60c1f2f7-947b-4fa9-8c9f-0848b25493b6 req-f84ff128-a3e9-429c-9fde-ee879128937d service nova] Creating event network-vif-deleted:df710dfd-6698-4666-94aa-4257a20a6daf for instance c36b5408-909e-4fbf-80cb-9299831e9805 on n-h1-862876-2 Oct 28 14:22:26.969119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-60c1f2f7-947b-4fa9-8c9f-0848b25493b6 req-f84ff128-a3e9-429c-9fde-ee879128937d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031507 Oct 28 14:22:26.969706 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3752/7594] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:27.285221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:27.285833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:27.293093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:27.293560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:27.294208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:27.295042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:27.295501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:27.295923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:27.329931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:27.330409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:27.330863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:27.331326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lazy-loading 'fault' on Instance uuid c36b5408-909e-4fbf-80cb-9299831e9805 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:22:27.376661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:27.384403 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-41801515-0e2b-4d51-b448-79388a744426 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 200 len: 1351 microversion: 2.1 time: 0.103178 Oct 28 14:22:27.384973 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3843/7595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:27 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:28.410026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:28.410735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: c36b5408-909e-4fbf-80cb-9299831e9805] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:28.416887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:28.417380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:28.417824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:28.418527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:28.419029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:28.419468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:28.432577 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] HTTP exception thrown: Instance c36b5408-909e-4fbf-80cb-9299831e9805 could not be found. Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Request method failure captured: Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 HTTP/1.1 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-VJijWBnqulVys_IBLIuVKgRzBjdrFRbAR6J9Ioh49M_KWX_f6tbe40cgTrtPXrNP0bWxt0Rznp_KQQc4QX1YzwyIiJxVDpXZUBCF4imoCvwIUckoH4WqYDONxZHayRcdWkW7LQI5PiQN1c2ZZyutZFK9euj1yrngHeJY4CQ4P4Jmo Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e08b5ec7d5d4bf7a2a5fd70caa79b77", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: b47fc3b32f96488aabd343bc4f0dac4a Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance c36b5408-909e-4fbf-80cb-9299831e9805 could not be found. Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'c36b5408-909e-4fbf-80cb-9299831e9805'} Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36b5408-909e-4fbf-80cb-9299831e9805 could not be found. Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36b5408-909e-4fbf-80cb-9299831e9805 could not be found. Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:22:28.434182 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36b5408-909e-4fbf-80cb-9299831e9805 could not be found. Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Returning 404 to user: Instance c36b5408-909e-4fbf-80cb-9299831e9805 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3a05be7e-4a49-4f62-8ee2-e9182284da34 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805" status: 404 len: 111 microversion: 2.1 time: 0.030675 Oct 28 14:22:28.439406 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3753/7596] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:28 2022] GET /compute/v2.1/servers/c36b5408-909e-4fbf-80cb-9299831e9805 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:22:28.444226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94729b86-7951-4586-9731-658eb06015b8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '.version_select at 0x7f27b82424c0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:28.534224 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94729b86-7951-4586-9731-658eb06015b8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-414059545" status: 202 len: 0 microversion: 2.1 time: 0.093659 Oct 28 14:22:28.534831 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3844/7597] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 14:22:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-414059545 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:22:28.552896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86d9d36b-f724-48b7-8e19-bff632020a08 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: .version_select at 0x7f27b9427820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-755127360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeBewKiFjFp1BNypn9VE6vFM9j9mJknLNFTSj8BrwglTKVd16Uk9WJRKwBFNZeYkrb74jTVMptz3kdKTA298Yg2bwe/4O1kNmoKvaKTNVJfbVl6oe9Wwh+3Ud3U1oU4aA=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:22:28.568428 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-86d9d36b-f724-48b7-8e19-bff632020a08 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:22:28.574312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-86d9d36b-f724-48b7-8e19-bff632020a08 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for user b47fc3b32f96488aabd343bc4f0dac4a and project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:22:28.654430 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86d9d36b-f724-48b7-8e19-bff632020a08 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.105444 Oct 28 14:22:28.655082 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3754/7598] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:22:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:28.705409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-252484915", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-755127360", "networks": [{"uuid": "77f85c54-a80f-4395-b890-3748d58b6047"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:22:28.757347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] validate_networks() for [('77f85c54-a80f-4395-b890-3748d58b6047', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:22:29.125536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:22:29.125965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:22:29.126443 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:22:29.126888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:22:29.127305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:22:29.136208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:29.136691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:29.137130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:29.137853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:29.138311 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:29.138765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:29.155310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:22:29.160506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Getting quotas for user b47fc3b32f96488aabd343bc4f0dac4a and project 0e08b5ec7d5d4bf7a2a5fd70caa79b77. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:22:29.173151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:22:29.175545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:22:29.284939 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50a72cac-f89a-448f-a730-4a56c46e650f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584077 Oct 28 14:22:29.285519 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3845/7599] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:22:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:22:29.297220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b18480d-5e2d-495a-ae58-5a82698084ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:29.297852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1b18480d-5e2d-495a-ae58-5a82698084ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:29.353087 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b18480d-5e2d-495a-ae58-5a82698084ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:29.361416 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b18480d-5e2d-495a-ae58-5a82698084ee tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1261 microversion: 2.1 time: 0.068053 Oct 28 14:22:29.362096 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3755/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:29 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:30.385220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:30.385828 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:30.392397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:30.392881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:30.393319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:30.394003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:30.394452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:30.395022 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:30.457706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:30.465512 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-38087923-de99-4ff0-a23e-600e10d2987a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1265 microversion: 2.1 time: 0.085155 Oct 28 14:22:30.466139 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3846/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:30 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:31.489891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:31.490509 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:31.498263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:31.499054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:31.499519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:31.500242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:31.500889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:31.501336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:31.569627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:31.577767 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f75139eb-fdf8-4e61-9a1a-6626ca575346 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1331 microversion: 2.1 time: 0.092421 Oct 28 14:22:31.578349 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3756/7602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:31 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:32.601549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:32.602066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:32.609042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:32.609530 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:32.609972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:32.610663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:32.611148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:32.611575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:32.769160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:32.777168 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6d77df04-bcd3-4057-a59f-b4a0bae5ae38 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1361 microversion: 2.1 time: 0.179712 Oct 28 14:22:32.777796 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3847/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:32 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:33.080808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8e6411ce-2da0-4a19-a079-0fa4e7e0abcb req-9b3b38de-0e56-4bb1-ad97-aeea5057c1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeaa2520-a48e-4f84-ba14-7e51577b6882", "tag": "cf97b51b-a922-4ee1-b14e-bde17e6eee12"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:22:33.092129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e6411ce-2da0-4a19-a079-0fa4e7e0abcb req-9b3b38de-0e56-4bb1-ad97-aeea5057c1f6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:33.092628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e6411ce-2da0-4a19-a079-0fa4e7e0abcb req-9b3b38de-0e56-4bb1-ad97-aeea5057c1f6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:33.093077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8e6411ce-2da0-4a19-a079-0fa4e7e0abcb req-9b3b38de-0e56-4bb1-ad97-aeea5057c1f6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:33.104410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8e6411ce-2da0-4a19-a079-0fa4e7e0abcb req-9b3b38de-0e56-4bb1-ad97-aeea5057c1f6 service nova] Creating event network-changed:cf97b51b-a922-4ee1-b14e-bde17e6eee12 for instance aeaa2520-a48e-4f84-ba14-7e51577b6882 on n-h1-862876-2 Oct 28 14:22:33.110043 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8e6411ce-2da0-4a19-a079-0fa4e7e0abcb req-9b3b38de-0e56-4bb1-ad97-aeea5057c1f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033294 Oct 28 14:22:33.110924 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3757/7604] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:22:33.801272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:33.801821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:33.808785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:33.809392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:33.809844 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:33.810551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:33.811036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:33.811467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:34.047465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:34.055227 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-758db16f-ac04-4879-99dd-7d433a3d3724 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1361 microversion: 2.1 time: 0.257923 Oct 28 14:22:34.055741 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3848/7605] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:33 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:35.084911 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:35.085654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:35.093281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:35.093780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:35.094229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:35.094961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:35.095432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:35.095901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:35.225322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:35.233071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e0ec960f-410d-4ea4-87e3-ac2ec4a91db7 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1361 microversion: 2.1 time: 0.152548 Oct 28 14:22:35.233644 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3758/7606] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:35 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:36.255193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:36.255806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:36.262916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:36.263402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:36.263834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:36.264522 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:36.265001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:36.265424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:36.396183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:36.404458 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bcc2b73d-5b38-4eeb-a2f9-b328c122b294 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1361 microversion: 2.1 time: 0.152568 Oct 28 14:22:36.405075 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3849/7607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:36 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:37.426664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:37.427359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:37.434233 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:37.434723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:37.435200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:37.435890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:37.436354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:37.436787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:37.570052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:37.578711 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eb4ac5e9-c566-4f82-9d04-8fce5ac9d751 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1361 microversion: 2.1 time: 0.156066 Oct 28 14:22:37.579528 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3759/7608] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:37 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:38.601694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:38.602309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:38.608952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:38.609436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:38.609874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:38.610560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:38.611050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:38.611478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:38.741294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:38.748947 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-add5939e-2203-4b91-9ab9-324d7bbf350d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1361 microversion: 2.1 time: 0.151505 Oct 28 14:22:38.751927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3850/7609] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:38 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:39.358189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:39.378600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-9023404f-a6fa-4e1f-8400-dc3736a8e102 req-3bc8ef1f-4873-487d-aa75-e14be8248226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeaa2520-a48e-4f84-ba14-7e51577b6882", "name": "network-vif-plugged", "status": "completed", "tag": "cf97b51b-a922-4ee1-b14e-bde17e6eee12"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:22:39.389132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9023404f-a6fa-4e1f-8400-dc3736a8e102 req-3bc8ef1f-4873-487d-aa75-e14be8248226 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:39.389620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9023404f-a6fa-4e1f-8400-dc3736a8e102 req-3bc8ef1f-4873-487d-aa75-e14be8248226 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:39.390147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-9023404f-a6fa-4e1f-8400-dc3736a8e102 req-3bc8ef1f-4873-487d-aa75-e14be8248226 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:39.403410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-9023404f-a6fa-4e1f-8400-dc3736a8e102 req-3bc8ef1f-4873-487d-aa75-e14be8248226 service nova] Creating event network-vif-plugged:cf97b51b-a922-4ee1-b14e-bde17e6eee12 for instance aeaa2520-a48e-4f84-ba14-7e51577b6882 on n-h1-862876-2 Oct 28 14:22:39.408520 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-9023404f-a6fa-4e1f-8400-dc3736a8e102 req-3bc8ef1f-4873-487d-aa75-e14be8248226 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089285 Oct 28 14:22:39.409165 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3760/7610] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:39.772967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:39.773583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:39.775591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:39.776278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:39.782317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:39.782824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:39.783257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:39.783937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:39.784393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:39.784815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:39.945478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:39.945675 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3742850c-ea94-4f2e-806f-830f9c6fee83 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1361 microversion: 2.1 time: 0.176301 Oct 28 14:22:39.946146 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3851/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:39 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:40.973663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:40.974375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:40.980941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:40.981436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:40.981898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:40.982628 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:40.983124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:40.983560 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:41.114569 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:41.122453 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8a29f3d5-a9b6-476f-9bc4-701728a9767d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1553 microversion: 2.1 time: 0.154428 Oct 28 14:22:41.123109 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3761/7612] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:40 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:41.144971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:41.145590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:41.152516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:41.152999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:41.153444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:41.154792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:41.155250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:41.155677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:41.173847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:41.289704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:22:41.298011 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-90dc033e-b2de-4c04-a16a-1f8b9d39efd8 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1553 microversion: 2.1 time: 0.156941 Oct 28 14:22:41.298588 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3852/7613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:22:41 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:22:44.401532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8319541c-60e5-4b5b-a5f8-91e0810359b4"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:22:44.404174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:44.407208 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:22:44.407352 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments (ip 10.222.0.25) !!! Oct 28 14:22:44.414347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:44.414873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:44.415323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:44.416025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:44.416490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:44.416923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:45.171945 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c9051f8-8030-4b6c-8d99-08a33aa6ff12 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "POST /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774117 Oct 28 14:22:45.172599 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3762/7614] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 14:22:44 2022] POST /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:56.943666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:56.944230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:56.947848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:56.953918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:56.954409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:56.954865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:56.955563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:56.956021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:56.956445 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:57.039957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lazy-loading 'services' on Instance uuid aeaa2520-a48e-4f84-ba14-7e51577b6882 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:22:57.297157 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07831230-7369-4c43-a503-f75461648037 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments/8319541c-60e5-4b5b-a5f8-91e0810359b4" status: 202 len: 0 microversion: 2.1 time: 0.357353 Oct 28 14:22:57.297752 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3853/7615] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:22:56 2022] DELETE /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments/8319541c-60e5-4b5b-a5f8-91e0810359b4 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:22:57.311214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:57.311214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:22:57.311214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:57.312969 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:57.319027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:57.319530 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:57.319985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:57.320681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:57.321145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:57.321579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:57.353022 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c9a4733f-448e-4e9d-ae8a-8e1433a0b802 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050710 Oct 28 14:22:57.353542 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3763/7616] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:57 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:58.367593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:58.370045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:58.376640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:58.377151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:58.377586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:58.378279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:58.378729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:58.379175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:58.409838 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-93573c65-da32-4e9a-9381-aa0daa8a2c97 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047923 Oct 28 14:22:58.410403 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3854/7617] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:58 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:22:59.428091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:22:59.428091 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:22:59.434047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:59.434551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:59.435066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:59.435801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:22:59.436282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:22:59.436727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:22:59.470288 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdf4c261-ad67-492a-9fa8-7bf4fc0c4390 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052427 Oct 28 14:22:59.470882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3764/7618] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:22:59 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:23:00.483340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:00.485488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:00.492327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:00.492808 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:00.493245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:00.493961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:00.494414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:00.494860 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:00.527685 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9318385b-8486-4624-b04d-f7c4e98f079e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049031 Oct 28 14:23:00.528252 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3855/7619] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:23:00 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:23:01.540915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:01.543157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:01.551513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:01.552022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:01.552475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:01.553191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:01.553664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:01.554104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:01.585407 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-21881795-3db9-49e9-b4c4-65e0d6add50f tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Oct 28 14:23:01.585977 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3765/7620] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:23:01 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:23:02.598460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:02.600705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:02.608201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:02.608681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:02.609114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:02.609792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:02.610242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:02.610663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:02.639103 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ed489b17-5753-43ae-920c-a4f4fcc4e868 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044415 Oct 28 14:23:02.639656 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3856/7621] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:23:02 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 14:23:02.650274 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:02.650827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:02.658582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:02.659112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:02.659568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:02.660269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:02.660741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:02.661180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:02.735210 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] HTTP exception thrown: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 is not attached to volume 8319541c-60e5-4b5b-a5f8-91e0810359b4 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Request method failure captured: Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments/8319541c-60e5-4b5b-a5f8-91e0810359b4 HTTP/1.1 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-VJijWBnqulVys_IBLIuVKgRzBjdrFRbAR6J9Ioh49M_KWX_f6tbe40cgTrtPXrNP0bWxt0Rznp_KQQc4QX1YzwyIiJxVDpXZUBCF4imoCvwIUckoH4WqYDONxZHayRcdWkW7LQI5PiQN1c2ZZyutZFK9euj1yrngHeJY4CQ4P4Jmo Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e08b5ec7d5d4bf7a2a5fd70caa79b77", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: b47fc3b32f96488aabd343bc4f0dac4a Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 is not attached to volume 8319541c-60e5-4b5b-a5f8-91e0810359b4 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': 'aeaa2520-a48e-4f84-ba14-7e51577b6882', 'id': '8319541c-60e5-4b5b-a5f8-91e0810359b4'} Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8319541c-60e5-4b5b-a5f8-91e0810359b4. Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 is not attached to volume 8319541c-60e5-4b5b-a5f8-91e0810359b4 Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:23:02.736820 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:23:02.741436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:23:02.741436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:23:02.741436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 is not attached to volume 8319541c-60e5-4b5b-a5f8-91e0810359b4 Oct 28 14:23:02.741436 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:02.741436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Returning 404 to user: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 is not attached to volume 8319541c-60e5-4b5b-a5f8-91e0810359b4 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:23:02.741436 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-53226c7e-42a7-412b-a022-f62fabd1164a tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments/8319541c-60e5-4b5b-a5f8-91e0810359b4" status: 404 len: 154 microversion: 2.1 time: 0.092113 Oct 28 14:23:02.741436 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3766/7622] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:23:02 2022] DELETE /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882/os-volume_attachments/8319541c-60e5-4b5b-a5f8-91e0810359b4 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:23:06.261013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:06.263475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:06.268587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:06.269076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:06.269509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:06.270197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:06.270647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:06.271103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:06.298575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:23:06.556554 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-91eacd79-4929-45c4-b957-b2e2b84f6ced tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 204 len: 0 microversion: 2.1 time: 0.299218 Oct 28 14:23:06.557340 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3857/7623] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:23:06 2022] DELETE /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:23:06.566159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:06.569150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:06.574785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:06.575288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:06.575741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:06.577044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:06.577526 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:06.578218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:06.714336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:06.722829 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-13941116-abe9-456a-9a6e-576544fa7dbe tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1559 microversion: 2.1 time: 0.160602 Oct 28 14:23:06.723413 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3767/7624] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:06 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:07.746125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:07.746859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:07.754239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:07.754722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:07.755189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:07.755878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:07.756348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:07.756762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:07.885884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:07.894429 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9060037a-cf8e-4dc9-be20-f13dab5444f0 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1559 microversion: 2.1 time: 0.152649 Oct 28 14:23:07.895033 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3858/7625] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:07 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:08.611776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c11ec77c-24f8-441e-b9fb-80ab268bacc3 req-552830da-e93a-4ccc-83ba-b7c541ea428c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeaa2520-a48e-4f84-ba14-7e51577b6882", "name": "network-vif-deleted", "tag": "cf97b51b-a922-4ee1-b14e-bde17e6eee12"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:23:08.622083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c11ec77c-24f8-441e-b9fb-80ab268bacc3 req-552830da-e93a-4ccc-83ba-b7c541ea428c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:08.623469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c11ec77c-24f8-441e-b9fb-80ab268bacc3 req-552830da-e93a-4ccc-83ba-b7c541ea428c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:08.623608 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c11ec77c-24f8-441e-b9fb-80ab268bacc3 req-552830da-e93a-4ccc-83ba-b7c541ea428c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:08.634679 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c11ec77c-24f8-441e-b9fb-80ab268bacc3 req-552830da-e93a-4ccc-83ba-b7c541ea428c service nova] Creating event network-vif-deleted:cf97b51b-a922-4ee1-b14e-bde17e6eee12 for instance aeaa2520-a48e-4f84-ba14-7e51577b6882 on n-h1-862876-2 Oct 28 14:23:08.640254 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c11ec77c-24f8-441e-b9fb-80ab268bacc3 req-552830da-e93a-4ccc-83ba-b7c541ea428c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032151 Oct 28 14:23:08.640836 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3768/7626] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:23:08.919329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:08.919329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:08.926458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:08.927386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:08.927831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:08.928538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:08.929488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:08.929867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:08.964582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:08.965080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:08.965519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:08.965980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lazy-loading 'fault' on Instance uuid aeaa2520-a48e-4f84-ba14-7e51577b6882 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:23:09.008675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b47fc3b32f96488aabd343bc4f0dac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e08b5ec7d5d4bf7a2a5fd70caa79b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:09.016770 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6047b3c2-beae-498c-a4ab-6d00d7f4d96e tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 200 len: 1351 microversion: 2.1 time: 0.103183 Oct 28 14:23:09.017359 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3859/7627] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:08 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:10.041795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:10.042528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] [instance: aeaa2520-a48e-4f84-ba14-7e51577b6882] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:10.048733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:10.049240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:10.049694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:10.050400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:10.050909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:10.051356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:10.071235 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] HTTP exception thrown: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 could not be found. Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Request method failure captured: Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 HTTP/1.1 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-VJijWBnqulVys_IBLIuVKgRzBjdrFRbAR6J9Ioh49M_KWX_f6tbe40cgTrtPXrNP0bWxt0Rznp_KQQc4QX1YzwyIiJxVDpXZUBCF4imoCvwIUckoH4WqYDONxZHayRcdWkW7LQI5PiQN1c2ZZyutZFK9euj1yrngHeJY4CQ4P4Jmo Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0e08b5ec7d5d4bf7a2a5fd70caa79b77", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0e08b5ec7d5d4bf7a2a5fd70caa79b77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 0e08b5ec7d5d4bf7a2a5fd70caa79b77 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-439285552 Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: b47fc3b32f96488aabd343bc4f0dac4a Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestEncryptedCinderVolumes-439285552-project Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 could not be found. Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'aeaa2520-a48e-4f84-ba14-7e51577b6882'} Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 could not be found. Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 could not be found. Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:23:10.072890 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 could not be found. Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Returning 404 to user: Instance aeaa2520-a48e-4f84-ba14-7e51577b6882 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12f9fab2-1f6a-4cd9-8a69-082e6a85e8f3 tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882" status: 404 len: 111 microversion: 2.1 time: 0.037670 Oct 28 14:23:10.078605 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3769/7628] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:10 2022] GET /compute/v2.1/servers/aeaa2520-a48e-4f84-ba14-7e51577b6882 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:23:10.085976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00a80b2c-612b-44a5-a89f-00ff09c4c74d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] Calling method '.version_select at 0x7f27b9b629d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:10.174119 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00a80b2c-612b-44a5-a89f-00ff09c4c74d tempest-TestEncryptedCinderVolumes-439285552 tempest-TestEncryptedCinderVolumes-439285552-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-755127360" status: 202 len: 0 microversion: 2.1 time: 0.093144 Oct 28 14:23:10.174712 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3860/7629] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Oct 28 14:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-755127360 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 14:23:42.950438 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-254ff776-021b-4524-8286-f277345b8a59 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'create', calling method: .version_select at 0x7f27b883f0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1033748527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABTVPlAGbefy/2/jy+5ZdUD+lCSB7indqz6h9LbkZn3jY5W1ZVzGnrlRSa2dI56YEwVgNNPw5wp/226t1rACYFZExR6vA3EuglSVhe79rWsdzp/VR5v9xEZkhpaRFjmoQ=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:23:42.957432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=14 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:23:42.961179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=34 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:23:42.969058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-254ff776-021b-4524-8286-f277345b8a59 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for project f77666164b3f4142b79337cf86a1783e. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:23:42.974119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-254ff776-021b-4524-8286-f277345b8a59 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for user bc01eae7880047038d21a56e8f7af9ec and project f77666164b3f4142b79337cf86a1783e. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:23:43.075076 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-254ff776-021b-4524-8286-f277345b8a59 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.128591 Oct 28 14:23:43.075775 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3770/7630] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:23:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:23:43.125944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:23:43.126686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:23:43.130774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-915502289", "imageRef": "6d019bc1-4476-4e87-b702-dcffd1ee6570", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1033748527", "networks": [{"uuid": "82871c12-8269-4b24-8879-b8c9d59aa0d4"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:23:43.182469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] validate_networks() for [('82871c12-8269-4b24-8879-b8c9d59aa0d4', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:23:43.552040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:23:43.552631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:23:43.553139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:23:43.553798 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:23:43.553939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:23:43.563536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:43.564016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:43.564450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:43.565201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:43.565665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:43.566088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:43.584158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for project f77666164b3f4142b79337cf86a1783e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:23:43.589438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for user bc01eae7880047038d21a56e8f7af9ec and project f77666164b3f4142b79337cf86a1783e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:23:43.602350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:23:43.604813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6d019bc1-4476-4e87-b702-dcffd1ee6570',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:23:43.733373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-73daf8d7-c88b-4c59-b3ec-2ac2529ce21e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609518 Oct 28 14:23:43.734065 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3861/7631] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:23:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:23:43.745337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-897f758f-a1a1-4aa8-ae70-946baa6fe8b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:43.750947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-897f758f-a1a1-4aa8-ae70-946baa6fe8b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:43.801719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-897f758f-a1a1-4aa8-ae70-946baa6fe8b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:43.808927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-897f758f-a1a1-4aa8-ae70-946baa6fe8b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1258 microversion: 2.1 time: 0.067898 Oct 28 14:23:43.809771 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3771/7632] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:43 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:44.832322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70cb3f17-d787-4851-adb4-10ccc364e3a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:44.832847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70cb3f17-d787-4851-adb4-10ccc364e3a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:44.886684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70cb3f17-d787-4851-adb4-10ccc364e3a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:44.894348 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70cb3f17-d787-4851-adb4-10ccc364e3a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1258 microversion: 2.1 time: 0.066530 Oct 28 14:23:44.894934 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3862/7633] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:44 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:45.918112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:45.918675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:45.927189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:45.927691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:45.928137 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:45.928829 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:45.929295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:45.929748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:45.993617 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:46.002082 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59b1a017-c29d-47a2-b716-c3aec159fbc6 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1310 microversion: 2.1 time: 0.088066 Oct 28 14:23:46.002673 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3772/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:45 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:47.027301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:47.028350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:47.042825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:47.043296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:47.043687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:47.044487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:47.045124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:47.045543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:47.240845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:47.250319 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f9752724-13dc-48f2-bb87-e25dae39da97 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.227498 Oct 28 14:23:47.251307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3863/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:47 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:48.139283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7ae60160-befd-4f36-aff4-810d40b165c2 req-116f6875-96be-4b1a-b6ae-1c48c4708423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0e0e8b-4ef4-41c0-a781-e2b4e571d105", "tag": "546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:23:48.153191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ae60160-befd-4f36-aff4-810d40b165c2 req-116f6875-96be-4b1a-b6ae-1c48c4708423 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:48.156676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ae60160-befd-4f36-aff4-810d40b165c2 req-116f6875-96be-4b1a-b6ae-1c48c4708423 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:48.157734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ae60160-befd-4f36-aff4-810d40b165c2 req-116f6875-96be-4b1a-b6ae-1c48c4708423 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:48.172055 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7ae60160-befd-4f36-aff4-810d40b165c2 req-116f6875-96be-4b1a-b6ae-1c48c4708423 service nova] Creating event network-changed:546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b for instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 on n-h1-862876-2 Oct 28 14:23:48.180987 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7ae60160-befd-4f36-aff4-810d40b165c2 req-116f6875-96be-4b1a-b6ae-1c48c4708423 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045396 Oct 28 14:23:48.182055 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3773/7636] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:23:48.275595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:48.276212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:48.283957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:48.284529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:48.285057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:48.285773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:48.286237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:48.286661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:48.435780 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:48.447391 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-85bde1bd-4b1f-452e-8929-a9f30a723bbd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.175601 Oct 28 14:23:48.448108 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3864/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:48 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:49.475097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:49.475849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:49.483196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:49.486909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:49.486909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:49.486909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:49.486909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:49.486909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:49.637882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:49.646113 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1459a264-5ea5-4f88-b41c-b46ad768f593 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.175222 Oct 28 14:23:49.646677 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3774/7638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:49 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:50.669533 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:50.670177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:50.678120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:50.678602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:50.679120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:50.679968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:50.680651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:50.681397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:50.841691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:50.851316 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fe707308-5f59-41ad-ab25-383d45161b0e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.185667 Oct 28 14:23:50.852025 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3865/7639] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:50 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:51.878896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:51.879553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:51.886698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:51.887245 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:51.887700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:51.888418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:51.888893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:51.889337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:52.050289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:52.062551 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-54a1d96f-36e3-4613-8f2a-be93f269c8df tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.187520 Oct 28 14:23:52.063369 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3775/7640] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:51 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:53.085602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:53.087416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:53.096093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:53.097127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:53.097802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:53.099075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:53.099759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:53.100358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:53.238935 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:53.247790 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94bbf483-0ebc-459e-a7e7-4ece71841313 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.166568 Oct 28 14:23:53.248361 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3866/7641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:53 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:54.271893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:54.272579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:54.276594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:23:54.280341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:54.281499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:54.281926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:54.282661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:54.283161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:54.283604 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:54.423323 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:54.431213 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b072abee-dafb-44d3-a283-3fc96834d554 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.163160 Oct 28 14:23:54.431889 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3776/7642] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:54 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:55.463053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:55.463691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:55.465523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:23:55.467073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:23:55.472352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:55.475310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:55.475310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:55.475310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:55.475310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:55.475310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:55.607858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:55.615633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0c6e7e60-4bd7-40de-a96d-e01e046325d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.156554 Oct 28 14:23:55.618477 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3867/7643] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:55 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:56.637704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:56.638330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:56.645226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:56.645724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:56.646166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:56.646892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:56.647356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:56.647792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:56.779821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:56.788356 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63aa08f3-86dd-40b9-9ca2-3af4a8d7c6b9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.154464 Oct 28 14:23:56.788877 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3777/7644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:56 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:57.815345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:57.815345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:57.819794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:57.820274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:57.820732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:57.821418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:57.821901 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:57.822327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:57.951440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:57.959346 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4e3125bb-6c8f-4093-b975-6b7e8ad9f28a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.151682 Oct 28 14:23:57.959916 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3868/7645] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:57 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:23:58.981448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:23:58.982090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:23:58.989052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:58.989557 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:58.990013 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:58.990724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:23:58.991242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:23:58.991688 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:23:59.120947 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:23:59.129102 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-daa2fe39-dcba-4ff0-b3c9-ba7a72497569 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.151559 Oct 28 14:23:59.129689 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3778/7646] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:23:58 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:00.152367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:00.152939 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:00.160304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:00.160791 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:00.161231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:00.161917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:00.162375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:00.162830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:00.296125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:00.304892 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ea7000b8-49d6-40c6-90a3-0e49af646648 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.156484 Oct 28 14:24:00.305486 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3869/7647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:00 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:01.328881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:01.329494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:01.336258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:01.336750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:01.337198 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:01.337889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:01.338352 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:01.338805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:01.469591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:01.477260 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-26fe6298-58d2-4395-b8dc-e92099976898 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.152598 Oct 28 14:24:01.477842 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3779/7648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:01 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:01.768999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-66623f3b-9347-439d-87c0-daeb1ec82b91 req-33151072-a6db-493c-9c4d-6b75e50be5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0e0e8b-4ef4-41c0-a781-e2b4e571d105", "name": "network-vif-plugged", "status": "completed", "tag": "546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:24:01.779504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-66623f3b-9347-439d-87c0-daeb1ec82b91 req-33151072-a6db-493c-9c4d-6b75e50be5ec service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:01.779981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-66623f3b-9347-439d-87c0-daeb1ec82b91 req-33151072-a6db-493c-9c4d-6b75e50be5ec service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:01.780410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-66623f3b-9347-439d-87c0-daeb1ec82b91 req-33151072-a6db-493c-9c4d-6b75e50be5ec service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:01.792317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-66623f3b-9347-439d-87c0-daeb1ec82b91 req-33151072-a6db-493c-9c4d-6b75e50be5ec service nova] Creating event network-vif-plugged:546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b for instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 on n-h1-862876-2 Oct 28 14:24:01.797355 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-66623f3b-9347-439d-87c0-daeb1ec82b91 req-33151072-a6db-493c-9c4d-6b75e50be5ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032723 Oct 28 14:24:01.803576 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3870/7649] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:24:02.499968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:02.501227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:02.508074 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:02.508578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:02.509029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:02.509735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:02.510208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:02.510652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:02.644193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:02.651801 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f4655982-1a0c-4cc8-a44e-3abd240da801 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1358 microversion: 2.1 time: 0.155757 Oct 28 14:24:02.652369 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3780/7650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:02 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:03.675792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:03.676501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:03.683571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:03.684058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:03.684491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:03.685181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:03.685637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:03.686060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:03.817159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:03.824975 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-faa4b009-479e-4fcd-909a-364487a8f1a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1547 microversion: 2.1 time: 0.154206 Oct 28 14:24:03.825549 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3871/7651] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:03 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:03.848114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:03.848788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:03.855614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:03.856120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:03.856579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:03.857289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:03.857763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:03.858206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:03.982805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:03.990497 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-72e87887-b8f7-4e54-a7b4-b0197c189149 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1547 microversion: 2.1 time: 0.146760 Oct 28 14:24:04.000586 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3781/7652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:03 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:04.021393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:04.026162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:04.026971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Searching by: {'deleted': False, 'project_id': 'f77666164b3f4142b79337cf86a1783e'} {{(pid=127793) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 14:24:04.032376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:04.033400 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:04.033850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:04.034570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:04.035064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:04.035487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:04.058364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.multi_cell_list [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 14:24:04.085758 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b91e64ca-ad93-4295-a572-6007e3988753 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068633 Oct 28 14:24:04.086267 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3872/7653] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 14:24:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:24:04.097810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:04.098447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:04.104505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:04.105010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:04.105466 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:04.106174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:04.106648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:04.107117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:04.235186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:04.242897 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-82e4d0e4-c364-472b-9c47-2a1252d2bf19 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1547 microversion: 2.1 time: 0.148939 Oct 28 14:24:04.243472 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3782/7654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:04 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:07.227421 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43293abf-ea66-482c-aed9-df1319fb2de3"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:24:07.229775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:07.237235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:07.237713 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:07.238147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:07.238857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:07.239310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:07.239732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:07.976702 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4afa3af6-e213-4e09-bef0-6183445cafba tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753199 Oct 28 14:24:07.977350 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3873/7655] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 14:24:07 2022] POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments => generated 194 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:24:22.442939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:22.443576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:22.445931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:24:22.446653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=62 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:24:22.455927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:22.455927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:22.455927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:22.455927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:22.455927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:22.455927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:22.584183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:22.592685 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ad7540a9-f855-45c7-8b99-6600dc960484 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1593 microversion: 2.1 time: 0.154279 Oct 28 14:24:22.593256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3783/7656] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:22 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:24:25.161927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:24:25.162462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:24:25.163358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:24:25.279926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-d4096190-34cf-42d8-a8b9-740d9dbbd4f4 req-91b5322b-dcf3-4a95-8a34-0fea97dd643b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0e0e8b-4ef4-41c0-a781-e2b4e571d105", "tag": "546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:24:25.290483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4096190-34cf-42d8-a8b9-740d9dbbd4f4 req-91b5322b-dcf3-4a95-8a34-0fea97dd643b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:25.290994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4096190-34cf-42d8-a8b9-740d9dbbd4f4 req-91b5322b-dcf3-4a95-8a34-0fea97dd643b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:25.291424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-d4096190-34cf-42d8-a8b9-740d9dbbd4f4 req-91b5322b-dcf3-4a95-8a34-0fea97dd643b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:25.304767 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-d4096190-34cf-42d8-a8b9-740d9dbbd4f4 req-91b5322b-dcf3-4a95-8a34-0fea97dd643b service nova] Creating event network-changed:546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b for instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 on n-h1-862876-2 Oct 28 14:24:25.309074 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-d4096190-34cf-42d8-a8b9-740d9dbbd4f4 req-91b5322b-dcf3-4a95-8a34-0fea97dd643b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153046 Oct 28 14:24:25.310138 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3874/7657] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:24:28.116698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1799253678"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:24:28.117246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:28.125597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:28.126093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:28.126539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:28.127280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:28.127731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:28.134016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:28.257644 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.security_group_api [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Adding security group a3ea62cb-4b05-4b88-9190-ad91b2d9d878 to port 546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b Oct 28 14:24:28.621868 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b889e61c-0648-4b38-abe2-905131c92cf8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action" status: 202 len: 0 microversion: 2.1 time: 0.509124 Oct 28 14:24:28.622489 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3784/7658] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:24:28 2022] POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:24:28.633605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f42c715a-be25-4461-b88d-63bd2a3d4074 req-a8a22f01-2176-45a2-9db3-20a0bc4e88e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0e0e8b-4ef4-41c0-a781-e2b4e571d105", "tag": "546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:24:28.638563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:24:28.638563 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:24:28.642029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:28.642632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:28.643195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:28.644014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:28.644729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:28.645374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:28.646050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f42c715a-be25-4461-b88d-63bd2a3d4074 req-a8a22f01-2176-45a2-9db3-20a0bc4e88e5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:24:28.647060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f42c715a-be25-4461-b88d-63bd2a3d4074 req-a8a22f01-2176-45a2-9db3-20a0bc4e88e5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:24:28.648291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f42c715a-be25-4461-b88d-63bd2a3d4074 req-a8a22f01-2176-45a2-9db3-20a0bc4e88e5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:24:28.661285 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f42c715a-be25-4461-b88d-63bd2a3d4074 req-a8a22f01-2176-45a2-9db3-20a0bc4e88e5 service nova] Creating event network-changed:546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b for instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 on n-h1-862876-2 Oct 28 14:24:28.668337 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f42c715a-be25-4461-b88d-63bd2a3d4074 req-a8a22f01-2176-45a2-9db3-20a0bc4e88e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038467 Oct 28 14:24:28.671091 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3785/7659] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:24:28.909081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:24:28.917796 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ca46a1de-c7f8-41ae-a773-a7215ebc72c1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1759 microversion: 2.1 time: 0.288862 Oct 28 14:24:28.918659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3875/7660] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:24:28 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1759 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:26:00.461200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:26:00.462024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=12 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:26:00.467048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:26:00.471619 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:26:00.475651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:00.476156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:00.476610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:00.477321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:00.477797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:00.478344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:00.741737 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-09af48ff-ff0e-4be6-937a-5302742840b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action" status: 202 len: 0 microversion: 2.1 time: 0.282742 Oct 28 14:26:00.742325 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3786/7661] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:26:00 2022] POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:26:00.749318 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:26:00.749845 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 (ip 10.222.0.25) !!! Oct 28 14:26:00.750692 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:26:00.751754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:26:00.756344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:26:00.756969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:26:00.764635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:00.765123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:00.765570 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:00.766270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:00.766721 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:00.767172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:00.919148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:26:00.927659 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-729e191a-7778-4f50-aa87-d22559c2ed7f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1761 microversion: 2.1 time: 0.180945 Oct 28 14:26:00.928255 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3876/7662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:26:00 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1761 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:26:01.951686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:26:01.952406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:26:01.959963 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:01.960464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:01.960908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:01.961614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:01.962081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:01.962516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:02.115399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:26:02.123608 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75c4e1d0-78ce-415e-8720-0b2b6b399855 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1766 microversion: 2.1 time: 0.176278 Oct 28 14:26:02.124176 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3787/7663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:26:01 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1766 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:26:03.147307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:26:03.147918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:26:03.154982 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:03.155466 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:03.155903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:03.156588 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:26:03.157052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:26:03.157475 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:26:03.298237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:26:03.306508 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fde56057-6729-4c67-8e34-c67b0ce8bc85 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1759 microversion: 2.1 time: 0.163166 Oct 28 14:26:03.307121 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3877/7664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:26:03 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:17.214012 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:27:17.214594 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:27:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action (ip 10.222.0.25) !!! Oct 28 14:27:17.215173 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:27:17.215327 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:27:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action (ip 10.222.0.25) !!! Oct 28 14:27:17.216218 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:17.216965 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:17.221646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1799253678"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:27:17.222191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:17.230051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:17.230551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:17.231097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:17.231805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:17.232271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:17.232704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:17.437650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.network.security_group_api [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Removing security group a3ea62cb-4b05-4b88-9190-ad91b2d9d878 from port 546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b Oct 28 14:27:17.790373 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3122c7e6-eb4a-46b1-9c5f-c4b8dcfdab24 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action" status: 202 len: 0 microversion: 2.1 time: 0.578547 Oct 28 14:27:17.794490 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3788/7665] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:27:17 2022] POST /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:27:17.801960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0e0e8b-4ef4-41c0-a781-e2b4e571d105", "tag": "546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:27:17.815208 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:17.817156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:17.819937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:17.820751 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:17.821460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:17.851892 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] Creating event network-changed:546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b for instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 on n-h1-862876-2 Oct 28 14:27:17.856587 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] [0ae69491-1d9d-4d11-aa60-51f63b35000e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:27:18.863520 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] [0ae69491-1d9d-4d11-aa60-51f63b35000e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 54480. Oct 28 14:27:18.867253 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-f6d15631-965d-4691-8944-cdee7652722f req-533fd01d-b2e1-4ef5-a40f-f99962b12644 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.071151 Oct 28 14:27:18.867864 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3878/7666] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:27:18.962946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:18.963481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:18.970055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:18.970564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:18.971066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:18.971782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:18.972248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:18.972682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:19.056027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lazy-loading 'services' on Instance uuid bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:27:19.305650 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d14b34e0-c07a-4adf-b17d-ef9096522c7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments/43293abf-ea66-482c-aed9-df1319fb2de3" status: 202 len: 0 microversion: 2.1 time: 0.347838 Oct 28 14:27:19.306265 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3789/7667] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:27:18 2022] DELETE /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments/43293abf-ea66-482c-aed9-df1319fb2de3 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:27:19.317930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:19.322286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:19.329457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:19.330690 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:19.331412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:19.332603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:19.333289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:19.333813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:19.366387 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a5957b73-afbb-4dde-9ad6-d21f8237c5ae tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055408 Oct 28 14:27:19.367280 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3879/7668] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:27:19 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:27:20.382515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:20.384876 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:20.391186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:20.391689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:20.392147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:20.393364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:20.393835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:20.394276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:20.424085 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc32d291-718b-48f9-826d-078a4218a4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048024 Oct 28 14:27:20.424667 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3790/7669] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:27:20 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:27:20.883528 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-cc05880d-25e5-4e19-8b92-42d87e1ae7a1 req-184906f6-9c07-4fff-87b2-87e9b2ae5ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0e0e8b-4ef4-41c0-a781-e2b4e571d105", "tag": "546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:27:20.893819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cc05880d-25e5-4e19-8b92-42d87e1ae7a1 req-184906f6-9c07-4fff-87b2-87e9b2ae5ca9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:20.894292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cc05880d-25e5-4e19-8b92-42d87e1ae7a1 req-184906f6-9c07-4fff-87b2-87e9b2ae5ca9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:20.894717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-cc05880d-25e5-4e19-8b92-42d87e1ae7a1 req-184906f6-9c07-4fff-87b2-87e9b2ae5ca9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:20.907450 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-cc05880d-25e5-4e19-8b92-42d87e1ae7a1 req-184906f6-9c07-4fff-87b2-87e9b2ae5ca9 service nova] Creating event network-changed:546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b for instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 on n-h1-862876-2 Oct 28 14:27:20.912523 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-cc05880d-25e5-4e19-8b92-42d87e1ae7a1 req-184906f6-9c07-4fff-87b2-87e9b2ae5ca9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032783 Oct 28 14:27:20.913126 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3880/7670] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:27:21.437927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:21.441117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:21.448806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:21.449313 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:21.449769 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:21.450494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:21.451123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:21.451599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:21.486554 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-05037c50-5bf5-43b2-982b-b02d236896e8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053748 Oct 28 14:27:21.487167 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3791/7671] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:27:21 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:27:22.500584 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:22.503754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:22.509981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:22.510465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:22.510933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:22.511620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:22.512073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:22.512502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:22.542592 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-cffdac50-d5e2-4a1c-b9b3-75791efb0612 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047172 Oct 28 14:27:22.543402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3881/7672] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:27:22 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:27:23.555380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:23.557737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:23.565238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:23.565809 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:23.566332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:23.567204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:23.567733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:23.568241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:23.598128 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-efd1a391-5902-4c53-90a8-56c60c3b0d30 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046742 Oct 28 14:27:23.598697 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3792/7673] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:27:23 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:27:24.610685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:24.612931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:24.619776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:24.620257 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:24.620686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:24.621362 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:24.621813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:24.622233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:24.650519 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ce289420-4b28-4ea8-9da3-1640f9c47fb7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043873 Oct 28 14:27:24.651089 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3882/7674] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:27:24 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 14:27:24.662326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:24.662891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:24.669563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:24.670060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:24.670513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:24.671248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:24.671717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:24.672159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:24.745940 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] HTTP exception thrown: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 is not attached to volume 43293abf-ea66-482c-aed9-df1319fb2de3 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Request method failure captured: Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments/43293abf-ea66-482c-aed9-df1319fb2de3 HTTP/1.1 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-Xdyhx_PUzP2wtXMxFdcQ206TVTQNmd4S8hN-jGdPMz6jb3IRoj6Lx9G2QVbOJLnePVjrK0QttIUFgx3UU9I-P7oyMv9QE18pLOEQb1WW_8sBC2f0GQJEIx4ji_-8ItZVlBK6nz1Xq2Lu0qmECRIlEszagDiYNwXoTQ_6z-Eh5JJNQ Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f77666164b3f4142b79337cf86a1783e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: bc01eae7880047038d21a56e8f7af9ec Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 is not attached to volume 43293abf-ea66-482c-aed9-df1319fb2de3 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': 'bb0e0e8b-4ef4-41c0-a781-e2b4e571d105', 'id': '43293abf-ea66-482c-aed9-df1319fb2de3'} Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 43293abf-ea66-482c-aed9-df1319fb2de3. Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 is not attached to volume 43293abf-ea66-482c-aed9-df1319fb2de3 Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:27:24.747598 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:27:24.752564 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:27:24.752564 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:27:24.752564 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 is not attached to volume 43293abf-ea66-482c-aed9-df1319fb2de3 Oct 28 14:27:24.752564 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:24.752564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Returning 404 to user: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 is not attached to volume 43293abf-ea66-482c-aed9-df1319fb2de3 {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:27:24.752564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f8f7675-1754-4170-a461-0a5a32385be7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments/43293abf-ea66-482c-aed9-df1319fb2de3" status: 404 len: 154 microversion: 2.1 time: 0.091405 Oct 28 14:27:24.752564 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3793/7675] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:27:24 2022] DELETE /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105/os-volume_attachments/43293abf-ea66-482c-aed9-df1319fb2de3 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:27:28.115454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:28.116027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:28.123759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:28.124324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:28.124774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:28.125476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:28.125937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:28.126371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:28.155026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:27:28.383549 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf40933c-4e39-4de0-bca3-c03b5702c1c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 204 len: 0 microversion: 2.1 time: 0.271718 Oct 28 14:27:28.384202 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3883/7676] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:27:28 2022] DELETE /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:27:28.392717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:28.393348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:28.401163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:28.401666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:28.402112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:28.402845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:28.403312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:28.403743 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:28.542032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:28.551496 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-544eec49-5f46-46a0-b559-f63a0d41fde9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1553 microversion: 2.1 time: 0.162767 Oct 28 14:27:28.552077 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3794/7677] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:28 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:29.576009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:29.576716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:29.584538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:29.586241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:29.586241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:29.586241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:29.586634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:29.587088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:29.768915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:29.777361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1ee417f8-30fb-498a-911f-ada0c3268592 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1553 microversion: 2.1 time: 0.205570 Oct 28 14:27:29.777936 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3884/7678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:29 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:30.506317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-56b25789-540c-4b41-acc4-a3ff4e97bb14 req-164bb774-cd82-40e7-a041-5445ede70251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0e0e8b-4ef4-41c0-a781-e2b4e571d105", "name": "network-vif-deleted", "tag": "546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:27:30.516005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-56b25789-540c-4b41-acc4-a3ff4e97bb14 req-164bb774-cd82-40e7-a041-5445ede70251 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:30.516508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-56b25789-540c-4b41-acc4-a3ff4e97bb14 req-164bb774-cd82-40e7-a041-5445ede70251 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:30.516958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-56b25789-540c-4b41-acc4-a3ff4e97bb14 req-164bb774-cd82-40e7-a041-5445ede70251 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:30.528528 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-56b25789-540c-4b41-acc4-a3ff4e97bb14 req-164bb774-cd82-40e7-a041-5445ede70251 service nova] Creating event network-vif-deleted:546b36d6-fcf8-4af5-a1ff-e6b78f5e3d7b for instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 on n-h1-862876-2 Oct 28 14:27:30.537573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-56b25789-540c-4b41-acc4-a3ff4e97bb14 req-164bb774-cd82-40e7-a041-5445ede70251 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093068 Oct 28 14:27:30.538826 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3795/7679] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:27:30.800839 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:30.801814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:30.809130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:30.809622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:30.810063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:30.810811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:30.811280 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:30.811742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:30.844891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:30.845384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:30.845819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:30.846268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lazy-loading 'fault' on Instance uuid bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:27:30.891329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:30.899734 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66eb9203-5456-4357-8ceb-141900433636 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 200 len: 1348 microversion: 2.1 time: 0.102921 Oct 28 14:27:30.900291 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3885/7680] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:30 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:31.925002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:31.926183 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: bb0e0e8b-4ef4-41c0-a781-e2b4e571d105] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:31.932360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:31.932886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:31.933338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:31.934043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:31.934514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:31.934987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:31.948024 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] HTTP exception thrown: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 could not be found. Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Request method failure captured: Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 HTTP/1.1 Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-Xdyhx_PUzP2wtXMxFdcQ206TVTQNmd4S8hN-jGdPMz6jb3IRoj6Lx9G2QVbOJLnePVjrK0QttIUFgx3UU9I-P7oyMv9QE18pLOEQb1WW_8sBC2f0GQJEIx4ji_-8ItZVlBK6nz1Xq2Lu0qmECRIlEszagDiYNwXoTQ_6z-Eh5JJNQ Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f77666164b3f4142b79337cf86a1783e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: bc01eae7880047038d21a56e8f7af9ec Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 could not be found. Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'bb0e0e8b-4ef4-41c0-a781-e2b4e571d105'} Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 could not be found. Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 could not be found. Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:27:31.949631 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 could not be found. Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Returning 404 to user: Instance bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12d21e88-0e21-4dac-9587-450e4ab7169b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105" status: 404 len: 111 microversion: 2.1 time: 0.031278 Oct 28 14:27:31.955242 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3796/7681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:31 2022] GET /compute/v2.1/servers/bb0e0e8b-4ef4-41c0-a781-e2b4e571d105 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:27:31.960140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5c013ed4-9344-4813-8940-61c69451cfb5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '.version_select at 0x7f27b983c310>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:32.052673 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5c013ed4-9344-4813-8940-61c69451cfb5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1033748527" status: 202 len: 0 microversion: 2.1 time: 0.096611 Oct 28 14:27:32.053288 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3886/7682] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 14:27:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1033748527 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 14:27:43.272531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0c347685-15f1-46fe-afb6-ed7f43e851cd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'create', calling method: .version_select at 0x7f27b88e7550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1436536227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNReetkHsC4k2OmyEpPE7ee/Qr+T9DZSjcm7LaUFyJy66W+8xU+0JXQt+WefBtQErb4cZOgTqI6sAlayIAK/7UisdGIJc5eyns3/GRwd0wrFU5iSN8Rq0agCL40Y98IZuw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:27:43.278340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=18 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:43.279027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:43.289989 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0c347685-15f1-46fe-afb6-ed7f43e851cd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for project f77666164b3f4142b79337cf86a1783e. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:27:43.295851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0c347685-15f1-46fe-afb6-ed7f43e851cd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for user bc01eae7880047038d21a56e8f7af9ec and project f77666164b3f4142b79337cf86a1783e. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:27:43.430420 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0c347685-15f1-46fe-afb6-ed7f43e851cd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.162549 Oct 28 14:27:43.432089 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3797/7683] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:27:43 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:27:43.484867 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:27:43.485399 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 14:27:43.486405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:43.487216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:43.492324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-166319263", "imageRef": "c74b4107-7571-41a0-ac50-e69a425d8946", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1436536227", "networks": [{"uuid": "82871c12-8269-4b24-8879-b8c9d59aa0d4"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:27:43.549210 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] validate_networks() for [('82871c12-8269-4b24-8879-b8c9d59aa0d4', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:27:43.961867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:27:43.962292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:27:43.962801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:27:43.965623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:27:43.965623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:27:43.972521 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:43.973000 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:43.973498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:43.974224 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:43.974689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:43.975178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:43.993084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for project f77666164b3f4142b79337cf86a1783e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:27:43.998374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Getting quotas for user bc01eae7880047038d21a56e8f7af9ec and project f77666164b3f4142b79337cf86a1783e. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:27:44.011732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:27:44.014049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c74b4107-7571-41a0-ac50-e69a425d8946',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:27:44.122841 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a092b8a6-6704-4744-a17e-11340bda604d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640707 Oct 28 14:27:44.123497 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3887/7684] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 14:27:44.136031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-15ff5a8a-506c-4a24-b16d-cb50ce36115d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:44.136706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-15ff5a8a-506c-4a24-b16d-cb50ce36115d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:44.193506 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-15ff5a8a-506c-4a24-b16d-cb50ce36115d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:44.200435 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-15ff5a8a-506c-4a24-b16d-cb50ce36115d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1258 microversion: 2.1 time: 0.069176 Oct 28 14:27:44.201008 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3798/7685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:44 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:45.223221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c281a2c6-d6b5-456f-ac1b-abc207a5fe44 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:45.224384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c281a2c6-d6b5-456f-ac1b-abc207a5fe44 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:45.278758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c281a2c6-d6b5-456f-ac1b-abc207a5fe44 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:45.286477 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c281a2c6-d6b5-456f-ac1b-abc207a5fe44 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1258 microversion: 2.1 time: 0.068052 Oct 28 14:27:45.287076 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3888/7686] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:45 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:46.309792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a27bceb1-09e4-49a3-b317-5345cd3a06be tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:46.310450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a27bceb1-09e4-49a3-b317-5345cd3a06be tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:46.364184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a27bceb1-09e4-49a3-b317-5345cd3a06be tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:46.371955 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a27bceb1-09e4-49a3-b317-5345cd3a06be tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1258 microversion: 2.1 time: 0.066071 Oct 28 14:27:46.372671 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3799/7687] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:46 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:47.395591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-be68e8f3-0da0-4a38-bf25-834b44bfa8b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:47.396126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-be68e8f3-0da0-4a38-bf25-834b44bfa8b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:47.448027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-be68e8f3-0da0-4a38-bf25-834b44bfa8b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:47.454982 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-be68e8f3-0da0-4a38-bf25-834b44bfa8b0 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1258 microversion: 2.1 time: 0.063971 Oct 28 14:27:47.455553 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3889/7688] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:47 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:48.478169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:48.478816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:48.485606 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:48.486094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:48.486539 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:48.487268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:48.487733 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:48.488169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:48.550556 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:48.559024 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8321553f-ca8c-4a53-80dc-80c32c879c1e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1262 microversion: 2.1 time: 0.084729 Oct 28 14:27:48.559597 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3800/7689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:48 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:49.581903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:49.585572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:49.590637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:49.591156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:49.591594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:49.592349 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:49.592809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:49.593238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:49.654270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:49.662123 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3eb02dba-181e-451f-bba6-1abd777cd5e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1310 microversion: 2.1 time: 0.084154 Oct 28 14:27:49.662703 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3890/7690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:49 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:50.686228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:50.686925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:50.693860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:50.694366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:50.694873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:50.701851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:50.701851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:50.701851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:50.971266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:50.987448 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b474ccdc-393f-41ff-96dc-7102cc059208 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.304827 Oct 28 14:27:50.988137 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3801/7691] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:50 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:52.017111 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:52.018591 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:52.027169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:52.027756 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:52.028293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:52.029077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:52.029637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:52.030131 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:52.170357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:52.178936 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-447ca334-dda4-4774-9b2f-83a0bac2f391 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.166167 Oct 28 14:27:52.179534 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3891/7692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:52 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:53.201541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:53.202169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:53.209663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:53.210166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:53.210621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:53.211373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:53.211846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:53.212289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:53.364247 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:53.372294 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-392b96a2-c90f-4613-9a25-3161b452c9a8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.174684 Oct 28 14:27:53.373067 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3802/7693] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:53 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:54.396581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:54.397220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:54.400066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:54.405292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:54.405793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:54.406239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:54.406980 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:54.407450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:54.418175 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:54.557660 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:54.565984 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36bee466-275d-4b9c-a0fb-d1f8b2d7d4f4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.173354 Oct 28 14:27:54.566807 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3892/7694] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:54 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:55.590857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:55.592282 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:55.599383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:55.599893 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:55.600405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:55.601073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:55.601548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:55.602031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:55.740520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:55.748710 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8c177517-7b37-4053-ac4e-7d2a7bea30d7 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.161701 Oct 28 14:27:55.749485 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3803/7695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:55 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:56.773402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:56.774015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:56.785423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:56.785918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:56.786365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:56.787103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:56.791225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:56.791679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:56.992648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:57.006029 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b82798be-c403-4a99-9da8-81587c1560c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.237137 Oct 28 14:27:57.007311 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3893/7696] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:56 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:27:58.029668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:58.032464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:58.033601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:58.038517 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:58.039056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:58.039513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:58.040235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:58.040710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:58.041164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:58.176749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:58.184554 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c0bcd186-f23f-48ae-954c-916c28b96824 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.158764 Oct 28 14:27:58.190490 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3804/7697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:58 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:59.208232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:27:59.208854 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:27:59.210738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=10 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:27:59.216407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:59.216893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:59.217327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:59.218016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:59.218508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:59.218956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:59.431929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:27:59.439638 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b3a68ea-f18e-4e3b-8965-6d0a002ae081 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.235732 Oct 28 14:27:59.440409 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3894/7698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:27:59 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:27:59.729991 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-618e652e-4dfd-4e3b-b9b4-7320cf29eee9 req-8c505f02-7226-4c5e-9c78-7673b51e9046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cb0e85-51b2-4412-a1e0-acf248b3fe11", "tag": "7e173461-9981-4843-b536-52a858b06485"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:27:59.741565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-618e652e-4dfd-4e3b-b9b4-7320cf29eee9 req-8c505f02-7226-4c5e-9c78-7673b51e9046 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:27:59.746533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-618e652e-4dfd-4e3b-b9b4-7320cf29eee9 req-8c505f02-7226-4c5e-9c78-7673b51e9046 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:27:59.746533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-618e652e-4dfd-4e3b-b9b4-7320cf29eee9 req-8c505f02-7226-4c5e-9c78-7673b51e9046 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:27:59.753567 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-618e652e-4dfd-4e3b-b9b4-7320cf29eee9 req-8c505f02-7226-4c5e-9c78-7673b51e9046 service nova] Creating event network-changed:7e173461-9981-4843-b536-52a858b06485 for instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 on n-h2-862876-2 Oct 28 14:27:59.759106 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-618e652e-4dfd-4e3b-b9b4-7320cf29eee9 req-8c505f02-7226-4c5e-9c78-7673b51e9046 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032779 Oct 28 14:27:59.759710 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3805/7699] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:28:00.462503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:00.463157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:00.470197 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:00.470680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:00.471142 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:00.471827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:00.472281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:00.473230 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:00.604027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:00.611790 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-802005c9-63ef-4a27-8660-75be9907aed4 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.153352 Oct 28 14:28:00.612363 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3895/7700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:00 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:28:01.636508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:01.637244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:01.643415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:01.643918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:01.644406 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:01.645117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:01.645588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:01.646027 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:01.773703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:01.781567 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8aac3502-f267-4c4c-8043-db306df43e50 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.150258 Oct 28 14:28:01.782139 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3806/7701] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:01 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:02.804929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:02.805503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:02.812180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:02.812667 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:02.813105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:02.813797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:02.814255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:02.814682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:02.948682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:02.956637 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0082f90a-fae8-4fd4-9b8c-eb03ec79e650 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.155580 Oct 28 14:28:02.958280 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3896/7702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:02 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:03.980210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:03.980838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:03.987748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:03.988836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:03.989292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:03.989987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:03.990453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:03.990921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:04.122966 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:04.130562 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d65986d4-0f9d-4d37-8bd5-8720129cc81d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.154325 Oct 28 14:28:04.131173 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3807/7703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:03 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:05.153259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:05.153923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:05.161350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:05.161852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:05.162302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:05.163039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:05.163516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:05.163960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:05.200923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-aaea48bb-85cf-4422-96d6-e078cdd7be77 req-7225558c-f463-48dd-a041-8e24c3c4776c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cb0e85-51b2-4412-a1e0-acf248b3fe11", "name": "network-vif-plugged", "status": "completed", "tag": "7e173461-9981-4843-b536-52a858b06485"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:28:05.211546 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-aaea48bb-85cf-4422-96d6-e078cdd7be77 req-7225558c-f463-48dd-a041-8e24c3c4776c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:05.212026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-aaea48bb-85cf-4422-96d6-e078cdd7be77 req-7225558c-f463-48dd-a041-8e24c3c4776c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:05.212457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-aaea48bb-85cf-4422-96d6-e078cdd7be77 req-7225558c-f463-48dd-a041-8e24c3c4776c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:05.224580 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-aaea48bb-85cf-4422-96d6-e078cdd7be77 req-7225558c-f463-48dd-a041-8e24c3c4776c service nova] Creating event network-vif-plugged:7e173461-9981-4843-b536-52a858b06485 for instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 on n-h2-862876-2 Oct 28 14:28:05.230095 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-aaea48bb-85cf-4422-96d6-e078cdd7be77 req-7225558c-f463-48dd-a041-8e24c3c4776c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089369 Oct 28 14:28:05.230728 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3897/7704] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:28:05.309721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:05.317810 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-acf4e988-530b-4116-8b53-a596c7d01007 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.168265 Oct 28 14:28:05.318493 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3808/7705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:05 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:28:06.343013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:06.343887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:06.351216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:06.352801 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:06.353327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:06.354118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:06.354697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:06.355228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:06.502715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:06.511224 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-474276a3-52bd-4599-a3aa-384dd3482e60 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1358 microversion: 2.1 time: 0.173367 Oct 28 14:28:06.511821 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3898/7706] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:06 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:28:07.535286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:07.535952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:07.542933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.543439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.543910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:07.544744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.545063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.545505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:07.683237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:07.691130 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-75b3f57b-3b48-404f-b781-d8a7ee9269ac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1547 microversion: 2.1 time: 0.159811 Oct 28 14:28:07.691714 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3809/7707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:07 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:07.713537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:07.714145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:07.720929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.721410 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.721841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:07.723044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.723504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.723925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:07.853305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:07.861053 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9a0c58e8-fa9c-4429-b679-ed9551fa6b7b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1547 microversion: 2.1 time: 0.151369 Oct 28 14:28:07.861620 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3899/7708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:07 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:07.883371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:07.888197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:07.889056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Searching by: {'deleted': False, 'project_id': 'f77666164b3f4142b79337cf86a1783e'} {{(pid=127794) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 14:28:07.894341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.894868 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.898853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:07.898853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.898853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.898853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:07.921175 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.multi_cell_list [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127794) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 14:28:07.947686 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-48567894-702d-47b7-928f-1afe6c0a1837 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068340 Oct 28 14:28:07.948266 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3810/7709] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Oct 28 14:28:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:28:07.960057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:07.960668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:07.966562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.967082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.967517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:07.968199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:07.968652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:07.969072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:08.100709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:08.108516 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6f1d924b-64fb-407e-9c84-c7a9fc36fccd tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1547 microversion: 2.1 time: 0.152589 Oct 28 14:28:08.109094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3900/7710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:07 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:10.936421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2f610ce-9a9d-41f6-83e4-39a26be55cbe"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:28:10.938862 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:10.945042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:10.945546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:10.946003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:10.946780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:10.947263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:10.947709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:11.620841 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6a28511c-a89c-418d-90bd-b1ce6676757d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688406 Oct 28 14:28:11.621453 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3811/7711] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Oct 28 14:28:10 2022] POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:28:23.461982 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:28:23.462801 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:28:23.466245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:23.466893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:23.468957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:23.469614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=64 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:23.474270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:23.475379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:23.475821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:23.483385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:23.483385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:23.483385 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:23.612806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:23.621438 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5285bda5-959d-4c0c-858e-abc06090dbac tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1593 microversion: 2.1 time: 0.160846 Oct 28 14:28:23.622044 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3901/7712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:23 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:25.482397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:25.483369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:25.484047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:25.488327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8fb08092-fdf5-46dc-bb78-d488dd69f949 req-12c68d3b-2043-4ac7-b175-d7f700393dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cb0e85-51b2-4412-a1e0-acf248b3fe11", "tag": "7e173461-9981-4843-b536-52a858b06485"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:28:25.498623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8fb08092-fdf5-46dc-bb78-d488dd69f949 req-12c68d3b-2043-4ac7-b175-d7f700393dce service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:25.500858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8fb08092-fdf5-46dc-bb78-d488dd69f949 req-12c68d3b-2043-4ac7-b175-d7f700393dce service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:25.500858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8fb08092-fdf5-46dc-bb78-d488dd69f949 req-12c68d3b-2043-4ac7-b175-d7f700393dce service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:25.511704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8fb08092-fdf5-46dc-bb78-d488dd69f949 req-12c68d3b-2043-4ac7-b175-d7f700393dce service nova] Creating event network-changed:7e173461-9981-4843-b536-52a858b06485 for instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 on n-h2-862876-2 Oct 28 14:28:25.516646 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8fb08092-fdf5-46dc-bb78-d488dd69f949 req-12c68d3b-2043-4ac7-b175-d7f700393dce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036892 Oct 28 14:28:25.517232 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3812/7713] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:28:27.747967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1010923077"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:28:27.748510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:27.758019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:27.758503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:27.758970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:27.759658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:27.760109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:27.760529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:27.764575 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 54822. Oct 28 14:28:27.765362 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 54820. Oct 28 14:28:27.895719 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.network.security_group_api [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Adding security group 9b4f95b2-89d8-447c-ba56-303e5cbaa170 to port 7e173461-9981-4843-b536-52a858b06485 Oct 28 14:28:28.287870 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5707bff9-fcdd-4c53-aae2-f591a4100639 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/action" status: 202 len: 0 microversion: 2.1 time: 0.543766 Oct 28 14:28:28.293531 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3902/7714] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:28:27 2022] POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:28:28.297724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:28.298552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:28.307742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-0df761c3-d916-4339-9c27-aa185cf8dfe2 req-fbd19e1e-fb8c-4fd3-bccd-89376ed72c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cb0e85-51b2-4412-a1e0-acf248b3fe11", "tag": "7e173461-9981-4843-b536-52a858b06485"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:28:28.322674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:28.323482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:28.325083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:28.327698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:28.328297 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:28.329176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:28.335109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0df761c3-d916-4339-9c27-aa185cf8dfe2 req-fbd19e1e-fb8c-4fd3-bccd-89376ed72c26 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:28.335729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0df761c3-d916-4339-9c27-aa185cf8dfe2 req-fbd19e1e-fb8c-4fd3-bccd-89376ed72c26 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:28.336159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-0df761c3-d916-4339-9c27-aa185cf8dfe2 req-fbd19e1e-fb8c-4fd3-bccd-89376ed72c26 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:28.352511 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-0df761c3-d916-4339-9c27-aa185cf8dfe2 req-fbd19e1e-fb8c-4fd3-bccd-89376ed72c26 service nova] Creating event network-changed:7e173461-9981-4843-b536-52a858b06485 for instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 on n-h2-862876-2 Oct 28 14:28:28.359382 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-0df761c3-d916-4339-9c27-aa185cf8dfe2 req-fbd19e1e-fb8c-4fd3-bccd-89376ed72c26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058419 Oct 28 14:28:28.360611 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3903/7715] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:28:28.502283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:28.510816 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-50489fa9-f5ce-45fa-abd5-6a6b80f9a964 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1759 microversion: 2.1 time: 0.217386 Oct 28 14:28:28.526795 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3813/7716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:28 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1759 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:40.534317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:40.535139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:40.584159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:28:40.587032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:40.593091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:40.593573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:40.594005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:40.594683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:40.595159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:40.595608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:40.815641 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1f74dd06-2737-442e-ab87-1a1ec644425f tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/action" status: 202 len: 0 microversion: 2.1 time: 0.282819 Oct 28 14:28:40.816190 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3904/7717] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:28:40 2022] POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 14:28:40.824239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:40.831259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:40.831259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:40.831259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=8 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:28:40.833345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:40.833854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:40.834305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:40.835052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:40.836026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:40.836469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:40.987046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:40.995523 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8ecc0345-007c-4568-8ad2-29155aa7be54 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1751 microversion: 2.1 time: 0.175166 Oct 28 14:28:40.996101 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3814/7718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:40 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:42.021258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:42.021958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:42.028118 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:42.028597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:42.029029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:42.029879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:42.030336 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:42.030790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:42.179937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:42.188290 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a3ef68b1-0dfa-4e52-ba3b-5bc173c24ece tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.172122 Oct 28 14:28:42.188855 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3905/7719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:42 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:43.211928 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:43.212554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:43.219308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:43.219807 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:43.220262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:43.221002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:43.221463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:43.221898 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:43.362078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:43.370797 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-82f07e4d-d583-49ff-a603-a0fc040d14c5 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.163159 Oct 28 14:28:43.371381 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3815/7720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:43 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:44.394158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:44.394792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:44.402121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:44.402608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:44.403076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:44.403762 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:44.404217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:44.404643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:44.545967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:44.554302 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4de5d932-dcea-4536-b9a2-3e87a325eb9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.164101 Oct 28 14:28:44.554897 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3906/7721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:44 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:45.577766 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:45.578359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:45.585387 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:45.585889 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:45.586337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:45.587068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:45.587549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:45.587990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:45.725454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:45.734212 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-154376eb-5389-4fde-bc51-f639375ff69d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.160427 Oct 28 14:28:45.734805 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3816/7722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:45 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:46.758606 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:46.759266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:46.766076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:46.766551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:46.767023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:46.767699 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:46.768147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:46.768565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:46.909066 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:46.917356 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b3b002aa-0243-4bbb-9dd2-26b932840cd8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.163275 Oct 28 14:28:46.917927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3907/7723] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:46 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:47.941328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:47.941955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:47.949206 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:47.949700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:47.950147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:47.950891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:47.951366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:47.953104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:48.096363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:48.104912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5e03d190-ae7e-447b-a033-cdc0dfdcb0b8 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.167504 Oct 28 14:28:48.107557 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3817/7724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:47 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:49.129343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:49.129954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:49.136807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:49.137285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:49.137718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:49.138402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:49.138892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:49.139314 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:49.281535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:49.290208 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-939f45f8-8c79-4f19-bad8-3c6f903b2a5b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.165237 Oct 28 14:28:49.290799 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3908/7725] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:49 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:50.314009 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:50.314636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:50.321919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:50.322411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:50.322887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:50.323586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:50.324052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:50.324485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:50.463358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:50.471885 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e92a272-efcf-4b89-9e0f-cc01afbb3f70 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.161750 Oct 28 14:28:50.472463 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3818/7726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:50 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:51.496051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:51.496654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:51.503805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:51.504292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:51.504733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:51.505425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:51.505884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:51.506313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:51.647390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:51.655896 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-98f53408-323b-4450-aa11-c118199a6a7c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.164317 Oct 28 14:28:51.659714 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3909/7727] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:51 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:52.678995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:52.679658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:52.687046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:52.687544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:52.687996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:52.688694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:52.689163 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:52.689599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:52.833853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:52.842196 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aafe4eef-fc5a-45b9-a190-e762c4f6fc91 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.167002 Oct 28 14:28:52.842830 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3819/7728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:52 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:53.865543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:53.866082 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:53.872850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:53.873327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:53.873754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:53.874436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:53.874927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:53.875345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:54.025485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:54.033852 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b6beaaac-bbc2-41eb-9d73-2167497c723e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.172371 Oct 28 14:28:54.034433 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3910/7729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:53 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:55.057930 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:55.058624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:55.065453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:55.066066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:55.066525 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:55.067254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:55.067724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:55.068165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:55.211671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:55.220016 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6b9d752-c60f-44d5-924e-f4056463a30d tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.166553 Oct 28 14:28:55.220600 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3820/7730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:55 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:56.243701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:56.244332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:56.251438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:56.251929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:56.252368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:56.253086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:56.253543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:56.253969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:56.399568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:56.408066 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a3768bc-e597-4c9b-9eb8-3116d7b53f05 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1756 microversion: 2.1 time: 0.168418 Oct 28 14:28:56.408655 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3911/7731] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:56 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:28:57.431333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:28:57.431990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:28:57.439835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:57.440337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:57.440796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:57.441499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:28:57.441988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:28:57.442487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:28:57.588240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:28:57.596554 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-195f582e-fd5c-459a-b4c1-f82e83d20628 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1759 microversion: 2.1 time: 0.169100 Oct 28 14:28:57.597124 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3821/7732] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:28:57 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:29:29.423865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1010923077"}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:29:29.424416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:29.426691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:29:29.427383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:29:29.433433 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:29.433915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:29.434346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:29.435058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:29.435507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:29.435933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:29.576633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.network.security_group_api [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Removing security group 9b4f95b2-89d8-447c-ba56-303e5cbaa170 from port 7e173461-9981-4843-b536-52a858b06485 Oct 28 14:29:29.916210 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-50295de7-776c-44f6-af14-b5148ae657d3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/action" status: 202 len: 0 microversion: 2.1 time: 0.496592 Oct 28 14:29:29.917279 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3912/7733] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:29:29 2022] POST /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:29:29.925798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4994d1a1-4a0d-4600-8eca-6a5c5c3c5ac6 req-e0c190a5-b595-4eb8-b626-d0e8019209d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cb0e85-51b2-4412-a1e0-acf248b3fe11", "tag": "7e173461-9981-4843-b536-52a858b06485"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:29:29.930999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=16 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:29:29.931822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=48 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:29:29.937290 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4994d1a1-4a0d-4600-8eca-6a5c5c3c5ac6 req-e0c190a5-b595-4eb8-b626-d0e8019209d5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:29.937792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4994d1a1-4a0d-4600-8eca-6a5c5c3c5ac6 req-e0c190a5-b595-4eb8-b626-d0e8019209d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:29.938246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4994d1a1-4a0d-4600-8eca-6a5c5c3c5ac6 req-e0c190a5-b595-4eb8-b626-d0e8019209d5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:29.950682 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4994d1a1-4a0d-4600-8eca-6a5c5c3c5ac6 req-e0c190a5-b595-4eb8-b626-d0e8019209d5 service nova] Creating event network-changed:7e173461-9981-4843-b536-52a858b06485 for instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 on n-h2-862876-2 Oct 28 14:29:29.956223 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4994d1a1-4a0d-4600-8eca-6a5c5c3c5ac6 req-e0c190a5-b595-4eb8-b626-d0e8019209d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034423 Oct 28 14:29:29.957162 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3822/7734] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:31.559994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:31.560510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:31.567169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:31.567663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:31.568095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:31.568789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:31.569381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:31.569803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:31.607454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3feba2a9-0424-4d26-9b81-f0e9ed46baf3 req-cac3ca2f-07f6-4d49-aa37-7fd15ca1dff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cb0e85-51b2-4412-a1e0-acf248b3fe11", "tag": "7e173461-9981-4843-b536-52a858b06485"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:29:31.617751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3feba2a9-0424-4d26-9b81-f0e9ed46baf3 req-cac3ca2f-07f6-4d49-aa37-7fd15ca1dff0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:31.618254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3feba2a9-0424-4d26-9b81-f0e9ed46baf3 req-cac3ca2f-07f6-4d49-aa37-7fd15ca1dff0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:31.618704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3feba2a9-0424-4d26-9b81-f0e9ed46baf3 req-cac3ca2f-07f6-4d49-aa37-7fd15ca1dff0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:31.630475 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3feba2a9-0424-4d26-9b81-f0e9ed46baf3 req-cac3ca2f-07f6-4d49-aa37-7fd15ca1dff0 service nova] Creating event network-changed:7e173461-9981-4843-b536-52a858b06485 for instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 on n-h2-862876-2 Oct 28 14:29:31.635877 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3feba2a9-0424-4d26-9b81-f0e9ed46baf3 req-cac3ca2f-07f6-4d49-aa37-7fd15ca1dff0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086931 Oct 28 14:29:31.636796 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3823/7735] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:31.673214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lazy-loading 'services' on Instance uuid 17cb0e85-51b2-4412-a1e0-acf248b3fe11 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:29:31.879935 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f17b647-f924-4f33-a663-5b56e95123d1 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments/e2f610ce-9a9d-41f6-83e4-39a26be55cbe" status: 202 len: 0 microversion: 2.1 time: 0.333204 Oct 28 14:29:31.883728 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3913/7736] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:29:31 2022] DELETE /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments/e2f610ce-9a9d-41f6-83e4-39a26be55cbe => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:29:31.895120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:31.897434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:31.909792 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:31.910429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:31.911127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:31.917544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:31.917544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:31.917544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:31.944042 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5196202e-a869-4300-b59e-e4f4ceb4c12e tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058273 Oct 28 14:29:31.944732 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3824/7737] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:29:31 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:32.959669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:32.962150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:32.969168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:32.969655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:32.970216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:32.970958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:32.971418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:32.971846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:33.002358 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d2650f5-bb91-445d-b4b9-6eedb13edc47 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048416 Oct 28 14:29:33.002999 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3914/7738] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:29:32 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:34.015870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:34.018285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:34.025358 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:34.025861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:34.026337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:34.027109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:34.027579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:34.028018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:34.060436 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5c9b68e8-676d-4e8a-8e7b-eda82cc93e1a tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048557 Oct 28 14:29:34.061033 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3825/7739] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:29:34 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:35.073468 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:35.075829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:35.083121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:35.083608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:35.084339 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:35.085025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:35.085480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:35.085904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:35.115909 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-69f9b375-1513-401b-923c-07e2f9c232c3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046656 Oct 28 14:29:35.116484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3915/7740] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:29:35 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:36.129629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:36.131775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:36.139433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:36.139944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:36.140395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:36.141106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:36.141572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:36.142008 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:36.171119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f189e52a-d031-41be-8170-156bca257f89 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045927 Oct 28 14:29:36.171693 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3826/7741] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:29:36 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:37.183604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:37.185851 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:37.192672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:37.193153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:37.193616 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:37.194293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:37.194760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:37.195191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:37.224697 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-97be883e-9850-40d3-b5e4-81d0ac5a07c9 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045076 Oct 28 14:29:37.225278 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3916/7742] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Oct 28 14:29:37 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 14:29:37.236162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:37.239155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:37.243614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:37.244117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:37.244573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:37.245276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:37.245751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:37.246195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:37.320314 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] HTTP exception thrown: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 is not attached to volume e2f610ce-9a9d-41f6-83e4-39a26be55cbe Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Request method failure captured: Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: request: DELETE /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments/e2f610ce-9a9d-41f6-83e4-39a26be55cbe HTTP/1.1 Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-Xdyhx_PUzP2wtXMxFdcQ206TVTQNmd4S8hN-jGdPMz6jb3IRoj6Lx9G2QVbOJLnePVjrK0QttIUFgx3UU9I-P7oyMv9QE18pLOEQb1WW_8sBC2f0GQJEIx4ji_-8ItZVlBK6nz1Xq2Lu0qmECRIlEszagDiYNwXoTQ_6z-Eh5JJNQ Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f77666164b3f4142b79337cf86a1783e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: bc01eae7880047038d21a56e8f7af9ec Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 is not attached to volume e2f610ce-9a9d-41f6-83e4-39a26be55cbe Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'server_id': '17cb0e85-51b2-4412-a1e0-acf248b3fe11', 'id': 'e2f610ce-9a9d-41f6-83e4-39a26be55cbe'} Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e2f610ce-9a9d-41f6-83e4-39a26be55cbe. Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 is not attached to volume e2f610ce-9a9d-41f6-83e4-39a26be55cbe Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:29:37.321990 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:29:37.328200 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:29:37.328200 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:29:37.328200 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 is not attached to volume e2f610ce-9a9d-41f6-83e4-39a26be55cbe Oct 28 14:29:37.328200 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:37.328200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Returning 404 to user: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 is not attached to volume e2f610ce-9a9d-41f6-83e4-39a26be55cbe {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:29:37.328200 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b6e9ea84-2837-4ea9-a702-f6183549fb2c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments/e2f610ce-9a9d-41f6-83e4-39a26be55cbe" status: 404 len: 154 microversion: 2.1 time: 0.091495 Oct 28 14:29:37.328200 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3827/7743] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Oct 28 14:29:37 2022] DELETE /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11/os-volume_attachments/e2f610ce-9a9d-41f6-83e4-39a26be55cbe => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:29:40.687462 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:40.688071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:40.695148 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:40.695631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:40.696062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:40.696750 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:40.697201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:40.697620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:40.723251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:29:41.057393 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9390c7c1-78ba-4edb-8c1d-d215fd0844ce tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 204 len: 0 microversion: 2.1 time: 0.374013 Oct 28 14:29:41.057911 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3917/7744] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:29:40 2022] DELETE /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:29:41.067276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:41.068150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:41.074736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:41.075278 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:41.075710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:41.076421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:41.076892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:41.077324 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:41.216694 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:29:41.224596 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-165445e1-1994-4e37-925c-034e375034e3 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1553 microversion: 2.1 time: 0.161516 Oct 28 14:29:41.225175 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3828/7745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:29:41 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:29:42.249067 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:42.249775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:42.257397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:42.257862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:42.258296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:42.259011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:42.259501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:42.259928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:42.389784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:29:42.397701 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f65131c5-808b-4b8a-8724-fe32cfd8cb8b tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1553 microversion: 2.1 time: 0.152937 Oct 28 14:29:42.398295 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3918/7746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:29:42 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:29:43.190228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-78468baa-786c-407c-a1c1-00a8da1fb1c2 req-025ca26d-551c-4af2-baeb-7ea5adb77cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cb0e85-51b2-4412-a1e0-acf248b3fe11", "name": "network-vif-deleted", "tag": "7e173461-9981-4843-b536-52a858b06485"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:29:43.200747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-78468baa-786c-407c-a1c1-00a8da1fb1c2 req-025ca26d-551c-4af2-baeb-7ea5adb77cb0 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:43.201244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-78468baa-786c-407c-a1c1-00a8da1fb1c2 req-025ca26d-551c-4af2-baeb-7ea5adb77cb0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:43.201695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-78468baa-786c-407c-a1c1-00a8da1fb1c2 req-025ca26d-551c-4af2-baeb-7ea5adb77cb0 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:43.213067 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-78468baa-786c-407c-a1c1-00a8da1fb1c2 req-025ca26d-551c-4af2-baeb-7ea5adb77cb0 service nova] Creating event network-vif-deleted:7e173461-9981-4843-b536-52a858b06485 for instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 on n-h2-862876-2 Oct 28 14:29:43.218644 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-78468baa-786c-407c-a1c1-00a8da1fb1c2 req-025ca26d-551c-4af2-baeb-7ea5adb77cb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032146 Oct 28 14:29:43.219268 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3829/7747] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:29:43.421784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:43.422326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:43.429114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:43.429601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:43.430042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:43.430733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:43.431220 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:43.431649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:43.496787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc01eae7880047038d21a56e8f7af9ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77666164b3f4142b79337cf86a1783e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:29:43.505345 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ad1da02-0f9d-4e95-ba8d-01f88131b010 tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 200 len: 1343 microversion: 2.1 time: 0.088185 Oct 28 14:29:43.505941 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3919/7748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:29:43 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 1343 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:29:44.531652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:44.532272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] [instance: 17cb0e85-51b2-4412-a1e0-acf248b3fe11] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:29:44.538502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:44.539035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:44.539483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:44.540190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:29:44.540655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:29:44.541089 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:29:44.554564 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] HTTP exception thrown: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 could not be found. Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Request method failure captured: Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 HTTP/1.1 Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-Xdyhx_PUzP2wtXMxFdcQ206TVTQNmd4S8hN-jGdPMz6jb3IRoj6Lx9G2QVbOJLnePVjrK0QttIUFgx3UU9I-P7oyMv9QE18pLOEQb1WW_8sBC2f0GQJEIx4ji_-8ItZVlBK6nz1Xq2Lu0qmECRIlEszagDiYNwXoTQ_6z-Eh5JJNQ Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f77666164b3f4142b79337cf86a1783e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f77666164b3f4142b79337cf86a1783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: f77666164b3f4142b79337cf86a1783e Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1630899754 Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: bc01eae7880047038d21a56e8f7af9ec Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestMinimumBasicScenario-1630899754-project Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 could not be found. Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '17cb0e85-51b2-4412-a1e0-acf248b3fe11'} Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 could not be found. Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 could not be found. Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:29:44.556263 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 could not be found. Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Returning 404 to user: Instance 17cb0e85-51b2-4412-a1e0-acf248b3fe11 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07f5f458-660d-4051-a563-04bb214d56ff tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11" status: 404 len: 111 microversion: 2.1 time: 0.031228 Oct 28 14:29:44.562279 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3830/7749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:29:44 2022] GET /compute/v2.1/servers/17cb0e85-51b2-4412-a1e0-acf248b3fe11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:29:44.567037 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a400e632-0cad-4025-99c3-4a336af16f9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] Calling method '.version_select at 0x7f27b88009d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:29:44.652454 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a400e632-0cad-4025-99c3-4a336af16f9c tempest-TestMinimumBasicScenario-1630899754 tempest-TestMinimumBasicScenario-1630899754-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1436536227" status: 202 len: 0 microversion: 2.1 time: 0.089222 Oct 28 14:29:44.653039 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3920/7750] 10.222.0.25 () {58 vars in 1272 bytes} [Fri Oct 28 14:29:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1436536227 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:29:56.009602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=18 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:29:56.010365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=38 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:29:56.191591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-371e23d6-2f2e-43e1-95c3-dc9e949b8cc0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: .version_select at 0x7f27b88e7310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1116191036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5nAlAPIH1RFsYqCsIcx0Xq1C+zkjsGtl4EqTLG3pwZNJRioIzwwMQrVSPR6afnbAW9M1YluglqX5qf1fGvIjlsihfb6Aa7uLb4OGN5MjuSN/rFSZq9zFbP/sSU6uTUdg=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:29:56.207671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-371e23d6-2f2e-43e1-95c3-dc9e949b8cc0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:29:56.214301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-371e23d6-2f2e-43e1-95c3-dc9e949b8cc0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:29:56.302938 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-371e23d6-2f2e-43e1-95c3-dc9e949b8cc0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.298826 Oct 28 14:29:56.303557 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3831/7751] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:29:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:30:04.585639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:04.586375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:04.591640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1826139229", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "55c721fa-2c24-478f-8df3-4052ec92dce8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1116191036", "security_groups": [{"name": "tempest-secgroup-smoke-1496868633"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:04.727109 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] validate_networks() for [('55c721fa-2c24-478f-8df3-4052ec92dce8', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:30:05.185422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:30:05.185934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:30:05.186461 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:30:05.186933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:30:05.187360 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:30:05.198013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:05.198503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:05.199061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:05.199835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:05.200540 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:05.200976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:05.236717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:30:05.244489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:30:05.264015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:30:05.267173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:30:05.404387 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d81e97ca-9157-4daf-bf5e-818b9b1c782e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.821171 Oct 28 14:30:05.405280 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3921/7752] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:30:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:30:05.419102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-558f6936-b354-4277-9d24-e8250213e455 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:05.420389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-558f6936-b354-4277-9d24-e8250213e455 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:05.508735 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-558f6936-b354-4277-9d24-e8250213e455 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:05.518061 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-558f6936-b354-4277-9d24-e8250213e455 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1267 microversion: 2.1 time: 0.105459 Oct 28 14:30:05.519734 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3832/7753] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:05 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:06.544677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ef45e18f-41e3-48be-8d99-44a4a8208bf0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:06.548604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ef45e18f-41e3-48be-8d99-44a4a8208bf0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:06.600600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ef45e18f-41e3-48be-8d99-44a4a8208bf0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:06.609257 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ef45e18f-41e3-48be-8d99-44a4a8208bf0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1267 microversion: 2.1 time: 0.070603 Oct 28 14:30:06.609802 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3922/7754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:06 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:07.633073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:07.633710 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:07.641623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:07.642135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:07.642585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:07.643332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:07.643801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:07.644240 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:07.718984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:07.727352 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5eb05622-6b18-44b3-9372-3719ce6c0173 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1319 microversion: 2.1 time: 0.098137 Oct 28 14:30:07.727940 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3833/7755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:07 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:08.753770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:08.754420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:08.761200 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:08.762186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:08.762662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:08.763379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:08.763834 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:08.764286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:08.825573 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:08.833177 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5552a129-c66d-4499-a182-0b87492e96ff tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1325 microversion: 2.1 time: 0.083586 Oct 28 14:30:08.833750 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3923/7756] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:08 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1325 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:09.857685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:09.858328 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:09.864480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:09.864980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:09.865427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:09.866125 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:09.866594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:09.867058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:09.913427 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-008fd0ef-c755-4d73-b4cf-15b2d9207798 req-b4ca660c-5bbb-4338-8006-bc67c74e7953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceae928a-ea34-4b79-bc7e-011c1440fcae", "tag": "d56c9c84-602b-4d39-adc1-b01259e68563"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:09.925047 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-008fd0ef-c755-4d73-b4cf-15b2d9207798 req-b4ca660c-5bbb-4338-8006-bc67c74e7953 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:09.925815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-008fd0ef-c755-4d73-b4cf-15b2d9207798 req-b4ca660c-5bbb-4338-8006-bc67c74e7953 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:09.926624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-008fd0ef-c755-4d73-b4cf-15b2d9207798 req-b4ca660c-5bbb-4338-8006-bc67c74e7953 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:09.939530 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-008fd0ef-c755-4d73-b4cf-15b2d9207798 req-b4ca660c-5bbb-4338-8006-bc67c74e7953 service nova] Creating event network-changed:d56c9c84-602b-4d39-adc1-b01259e68563 for instance ceae928a-ea34-4b79-bc7e-011c1440fcae on n-h1-862876-2 Oct 28 14:30:09.944557 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-008fd0ef-c755-4d73-b4cf-15b2d9207798 req-b4ca660c-5bbb-4338-8006-bc67c74e7953 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040974 Oct 28 14:30:09.945496 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3924/7757] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:30:10.023227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:10.031681 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-24b695c7-bd7b-4080-8c65-50feb3fdc0f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1393 microversion: 2.1 time: 0.178032 Oct 28 14:30:10.032260 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3834/7758] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:09 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:11.055643 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:11.056348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:11.062560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:11.063088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:11.063527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:11.064215 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:11.064674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:11.065102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:11.199145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:11.207408 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4daac47e-b45b-4ce8-8f0b-10122258c032 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1393 microversion: 2.1 time: 0.157021 Oct 28 14:30:11.207982 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3925/7759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:11 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:12.248655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:12.375384 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:12.383156 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b276963e-4765-46b9-8791-9cc3a58434b5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1393 microversion: 2.1 time: 0.155967 Oct 28 14:30:12.383734 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3835/7760] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:12 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:13.405569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:13.406184 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:13.412921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:13.413940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:13.414383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:13.415105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:13.415564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:13.415989 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:13.550160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:13.558005 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-792673de-a464-412e-a245-be81786f47e3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1393 microversion: 2.1 time: 0.156379 Oct 28 14:30:13.558791 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3926/7761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:13 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:14.581436 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:14.582078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:14.589253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:14.589758 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:14.590214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:14.590957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:14.591435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:14.591886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:14.726810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:14.734539 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d56518ea-4b6a-40ca-a1c4-b0bf5ec74a8a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1393 microversion: 2.1 time: 0.157004 Oct 28 14:30:14.735555 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3836/7762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:14 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:15.530325 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-dfef1f89-ea3d-4439-bcad-7264cc7d5bc4 req-3c3b5d07-9923-4e59-9694-5e00d9df4b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceae928a-ea34-4b79-bc7e-011c1440fcae", "name": "network-vif-plugged", "status": "completed", "tag": "d56c9c84-602b-4d39-adc1-b01259e68563"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:15.537503 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:15.541556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dfef1f89-ea3d-4439-bcad-7264cc7d5bc4 req-3c3b5d07-9923-4e59-9694-5e00d9df4b4b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:15.542043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dfef1f89-ea3d-4439-bcad-7264cc7d5bc4 req-3c3b5d07-9923-4e59-9694-5e00d9df4b4b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:15.542483 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-dfef1f89-ea3d-4439-bcad-7264cc7d5bc4 req-3c3b5d07-9923-4e59-9694-5e00d9df4b4b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:15.559733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-dfef1f89-ea3d-4439-bcad-7264cc7d5bc4 req-3c3b5d07-9923-4e59-9694-5e00d9df4b4b service nova] Creating event network-vif-plugged:d56c9c84-602b-4d39-adc1-b01259e68563 for instance ceae928a-ea34-4b79-bc7e-011c1440fcae on n-h1-862876-2 Oct 28 14:30:15.559733 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-dfef1f89-ea3d-4439-bcad-7264cc7d5bc4 req-3c3b5d07-9923-4e59-9694-5e00d9df4b4b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033040 Oct 28 14:30:15.560984 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3927/7763] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:30:15.756663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:15.757298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:15.759192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:15.764973 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:15.765476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:15.765929 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:15.766699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:15.767197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:15.767636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:15.901435 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:15.909757 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ba3469a0-0e09-4e58-ab44-bf1de3e0ec9e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1393 microversion: 2.1 time: 0.157083 Oct 28 14:30:15.910349 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3837/7764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:15 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:16.931283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:16.935402 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:16.936103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:16.943248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:16.943793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:16.944233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:16.944920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:16.945376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:16.945799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:17.077481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:17.085417 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-874ddef2-6c69-4774-8456-f4d99576fdce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1565 microversion: 2.1 time: 0.156002 Oct 28 14:30:17.085987 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3928/7765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:16 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:17.107490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:17.108645 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:17.115577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:17.116084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:17.116543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:17.117261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:17.117736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:17.118180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:17.254321 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:17.262151 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41204419-00b6-4151-a9f1-e43b01cc5938 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1565 microversion: 2.1 time: 0.158518 Oct 28 14:30:17.262731 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3838/7766] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:17 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:19.168292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:19.169150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:19.170884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4efaf280-fb93-4c3d-8358-1106d1fe308f req-efb52d54-7eca-4e38-8824-eb372057dc24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceae928a-ea34-4b79-bc7e-011c1440fcae", "tag": "d56c9c84-602b-4d39-adc1-b01259e68563"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:19.177703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:19.178917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:19.179460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:19.180329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4efaf280-fb93-4c3d-8358-1106d1fe308f req-efb52d54-7eca-4e38-8824-eb372057dc24 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:19.180452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:19.180830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4efaf280-fb93-4c3d-8358-1106d1fe308f req-efb52d54-7eca-4e38-8824-eb372057dc24 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:19.181073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:19.181279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4efaf280-fb93-4c3d-8358-1106d1fe308f req-efb52d54-7eca-4e38-8824-eb372057dc24 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:19.181683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:19.192639 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4efaf280-fb93-4c3d-8358-1106d1fe308f req-efb52d54-7eca-4e38-8824-eb372057dc24 service nova] Creating event network-changed:d56c9c84-602b-4d39-adc1-b01259e68563 for instance ceae928a-ea34-4b79-bc7e-011c1440fcae on n-h1-862876-2 Oct 28 14:30:19.197730 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4efaf280-fb93-4c3d-8358-1106d1fe308f req-efb52d54-7eca-4e38-8824-eb372057dc24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031519 Oct 28 14:30:19.198580 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3839/7767] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:30:19.406576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:19.416913 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-342f1c36-c3d5-4a01-af08-9d0d4e7236b7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1565 microversion: 2.1 time: 0.252829 Oct 28 14:30:19.418004 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3929/7768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:19 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1565 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:40.681130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:40.681896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=38 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:40.683070 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:30:40.683217 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action (ip 10.222.0.25) !!! Oct 28 14:30:40.688103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:40.690362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:40.697756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:40.702152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:40.702152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:40.702152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:40.702152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:40.702152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:40.751051 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-04dd1806-c503-4cea-883c-51430a3b9934 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action" status: 200 len: 24566 microversion: 2.1 time: 0.071871 Oct 28 14:30:40.751738 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3840/7769] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:30:40 2022] POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action => generated 24566 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:30:51.796115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:51.796675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:51.798947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:51.799622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=36 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:30:51.804413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:51.804898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:51.805340 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:51.806026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:51.806486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:51.806941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:51.996972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-744f4b58-a7c2-4a5f-9140-dca7d89d1de5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action" status: 202 len: 0 microversion: 2.1 time: 0.204638 Oct 28 14:30:51.997750 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3930/7770] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:30:51 2022] POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:30:52.007341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:52.008252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:52.016871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:52.017383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:52.017835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:52.018548 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:52.019049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:52.025058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:52.489227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:52.497174 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-11d115de-46ff-4171-bb41-c3917804c11b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1689 microversion: 2.1 time: 0.494464 Oct 28 14:30:52.498591 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3841/7771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:52 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1689 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:53.522590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:53.523331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:53.529868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:53.530367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:53.530836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:53.531543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:53.532004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:53.532436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:53.667996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:53.676468 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e61d9117-ac03-44ec-9c34-d41d29794a04 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1669 microversion: 2.1 time: 0.159294 Oct 28 14:30:53.677053 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3931/7772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:53 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:54.771857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:54.774052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:54.781550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:54.782046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:54.783030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:54.783737 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:54.784202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:54.784639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:54.832727 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-032b13b8-4c94-437d-8d25-d207dd20abbc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action" status: 200 len: 32639 microversion: 2.1 time: 0.064615 Oct 28 14:30:54.833352 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3842/7773] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:30:54 2022] POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action => generated 32639 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:30:54.845618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:54.846185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:54.853011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:54.853493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:54.853928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:54.854615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:54.855094 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:54.855520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:55.059405 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff868387-9e67-42e6-b0aa-5dadb7a7d086 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action" status: 202 len: 0 microversion: 2.1 time: 0.217896 Oct 28 14:30:55.060061 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3932/7774] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:30:54 2022] POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:30:55.069164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:55.080805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:55.080805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:55.080805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:55.080805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:55.080805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:55.080805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:55.080805 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:55.212707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:55.221832 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6b50cf85-7adf-462d-b53b-d3984bd02fcb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1676 microversion: 2.1 time: 0.156986 Oct 28 14:30:55.222408 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3843/7775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:55 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:30:56.246597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:56.247361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:56.253678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:56.254154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:56.254595 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:56.255308 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:56.255760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:56.256183 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:56.387479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:56.395307 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-89847737-5e4f-472c-8f69-17832c825894 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1684 microversion: 2.1 time: 0.153852 Oct 28 14:30:56.395879 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3933/7776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:56 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:56.498238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:56.500850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:56.511871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:56.512389 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:56.512845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:56.513577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:56.514049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:56.514567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:56.567164 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c476ab6f-193b-4caf-9d3e-30e4b8929f11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action" status: 200 len: 38497 microversion: 2.1 time: 0.072810 Oct 28 14:30:56.574803 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3844/7777] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:30:56 2022] POST /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae/action => generated 38497 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:30:57.606604 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:57.607207 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:57.609300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7ba66089-152d-4317-b985-00090ddc2a06 req-99e8d0af-c59f-4a8e-b96b-e2dcf47a126b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceae928a-ea34-4b79-bc7e-011c1440fcae", "tag": "d56c9c84-602b-4d39-adc1-b01259e68563"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:57.615046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:57.615612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:57.616318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:57.617088 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:57.617618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:57.618116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:57.621157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ba66089-152d-4317-b985-00090ddc2a06 req-99e8d0af-c59f-4a8e-b96b-e2dcf47a126b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:57.621685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ba66089-152d-4317-b985-00090ddc2a06 req-99e8d0af-c59f-4a8e-b96b-e2dcf47a126b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:57.622184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7ba66089-152d-4317-b985-00090ddc2a06 req-99e8d0af-c59f-4a8e-b96b-e2dcf47a126b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:57.634215 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7ba66089-152d-4317-b985-00090ddc2a06 req-99e8d0af-c59f-4a8e-b96b-e2dcf47a126b service nova] Creating event network-changed:d56c9c84-602b-4d39-adc1-b01259e68563 for instance ceae928a-ea34-4b79-bc7e-011c1440fcae on n-h1-862876-2 Oct 28 14:30:57.639838 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7ba66089-152d-4317-b985-00090ddc2a06 req-99e8d0af-c59f-4a8e-b96b-e2dcf47a126b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034823 Oct 28 14:30:57.640680 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3845/7778] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:30:57.646374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:30:57.914599 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3eb0d725-4c13-4d7c-af61-5158f81a73da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 204 len: 0 microversion: 2.1 time: 0.311913 Oct 28 14:30:57.917724 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3934/7779] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:30:57 2022] DELETE /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:30:57.926424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:57.927284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:57.933985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:57.934859 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:57.935433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:57.936229 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:57.936781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:57.937314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:58.072442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:58.080824 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-afe0af16-91ad-43af-9d0b-abfb4146c113 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1690 microversion: 2.1 time: 0.160946 Oct 28 14:30:58.081406 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3846/7780] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:57 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:59.106017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:30:59.106636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:30:59.113827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:59.114319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:59.114776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:59.115508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:59.115964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:59.116389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:59.272626 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:30:59.280373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-36fd243b-e49e-46c8-ba5b-3d4bb7e1e122 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1690 microversion: 2.1 time: 0.178636 Oct 28 14:30:59.280950 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3935/7781] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:30:59 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:30:59.925749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-4e302503-fc40-44c7-a430-0d7330109270 req-f522cf0f-f342-4d64-9483-c04ad88cdc06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceae928a-ea34-4b79-bc7e-011c1440fcae", "name": "network-vif-deleted", "tag": "d56c9c84-602b-4d39-adc1-b01259e68563"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:30:59.936111 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4e302503-fc40-44c7-a430-0d7330109270 req-f522cf0f-f342-4d64-9483-c04ad88cdc06 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:30:59.936607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4e302503-fc40-44c7-a430-0d7330109270 req-f522cf0f-f342-4d64-9483-c04ad88cdc06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:30:59.937055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-4e302503-fc40-44c7-a430-0d7330109270 req-f522cf0f-f342-4d64-9483-c04ad88cdc06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:30:59.948459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-4e302503-fc40-44c7-a430-0d7330109270 req-f522cf0f-f342-4d64-9483-c04ad88cdc06 service nova] Creating event network-vif-deleted:d56c9c84-602b-4d39-adc1-b01259e68563 for instance ceae928a-ea34-4b79-bc7e-011c1440fcae on n-h1-862876-2 Oct 28 14:30:59.953492 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-4e302503-fc40-44c7-a430-0d7330109270 req-f522cf0f-f342-4d64-9483-c04ad88cdc06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031582 Oct 28 14:30:59.954079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3847/7782] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:31:00.304221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:00.304861 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:00.312179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:00.312668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:00.313100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:00.314452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:00.314942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:00.315369 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:00.347074 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:00.347558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:00.347990 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:00.348432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lazy-loading 'fault' on Instance uuid ceae928a-ea34-4b79-bc7e-011c1440fcae {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:31:00.392173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:00.400129 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9c1135b3-1214-4fa6-9d41-aec093f83781 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 200 len: 1357 microversion: 2.1 time: 0.099975 Oct 28 14:31:00.400708 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3936/7783] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:00 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:01.428597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:01.429365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ceae928a-ea34-4b79-bc7e-011c1440fcae] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:01.435570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:01.436070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:01.436523 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:01.437220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:01.437691 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:01.438126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:01.451810 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] HTTP exception thrown: Instance ceae928a-ea34-4b79-bc7e-011c1440fcae could not be found. Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Request method failure captured: Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae HTTP/1.1 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-djbicO_a8uKRdhpmXjWnbohIhvTz7I2xrDCfnsBlJjItv72kC-Dlf1jQ6CrN_NjSoLrQU3-izIfqwaEmCdLEWpkPpF6UEp5A6IfEbu7s9Aylg3LxrCSZ6d3Lg4HM1zK7_BIZtKzPlTQTZHIP7y5JDOn4jAs-RBIoMG93zzjv2k6MY Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e36afd88e27a46f4b3f82a9fc63cfb09", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 0297a20d29894a10b39125e80260a31b Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance ceae928a-ea34-4b79-bc7e-011c1440fcae could not be found. Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'ceae928a-ea34-4b79-bc7e-011c1440fcae'} Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceae928a-ea34-4b79-bc7e-011c1440fcae could not be found. Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceae928a-ea34-4b79-bc7e-011c1440fcae could not be found. Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:31:01.453446 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceae928a-ea34-4b79-bc7e-011c1440fcae could not be found. Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Returning 404 to user: Instance ceae928a-ea34-4b79-bc7e-011c1440fcae could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de7eeab7-037d-458b-b711-b7a044b104b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae" status: 404 len: 111 microversion: 2.1 time: 0.032135 Oct 28 14:31:01.459623 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3848/7784] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:01 2022] GET /compute/v2.1/servers/ceae928a-ea34-4b79-bc7e-011c1440fcae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:31:05.232313 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a25136e-e22f-46fe-af82-c6d30391bc6c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '.version_select at 0x7f27bd9d30d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:05.317971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a25136e-e22f-46fe-af82-c6d30391bc6c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1116191036" status: 202 len: 0 microversion: 2.1 time: 0.089601 Oct 28 14:31:05.318509 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3937/7785] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 14:31:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1116191036 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:31:05.347896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c7a862cc-ff21-4558-b689-376c3df2c2d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: .version_select at 0x7f27b84499d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-686654233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6GMCcR48YQarYIHts52/tXVyLPLCMeZQRZGJZHewO4/djgunYobrqChxNCtpBCykrsXMe7e0sR91E/8QHaoKIoG0bULlA0F6RlByJN66sj8cU4P0gNwk0sviuhTkQg9g=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:31:05.364496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c7a862cc-ff21-4558-b689-376c3df2c2d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:31:05.369738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-c7a862cc-ff21-4558-b689-376c3df2c2d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:31:05.478290 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c7a862cc-ff21-4558-b689-376c3df2c2d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.134653 Oct 28 14:31:05.478947 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3849/7786] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:31:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:31:13.704482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2059055946", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "4ce98553-936e-497a-abe6-d7c34aa57e2c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-686654233", "security_groups": [{"name": "tempest-secgroup-smoke-1891245072"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:31:13.720932 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:13.820637 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] validate_networks() for [('4ce98553-936e-497a-abe6-d7c34aa57e2c', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:31:14.196139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:31:14.196572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:31:14.197049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:31:14.197459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:31:14.197907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:31:14.208113 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:14.208603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:14.209039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:14.209767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:14.210223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:14.210941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:14.229479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:31:14.235149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:31:14.248547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:31:14.251539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:31:14.379242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9f906da9-2aa4-45f4-8e3f-d94bcb921282 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.679156 Oct 28 14:31:14.379967 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3938/7787] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:31:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:31:14.392277 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-01e5219e-8771-4e1d-914c-cce0e2410b17 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:14.393164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-01e5219e-8771-4e1d-914c-cce0e2410b17 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:14.399219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=36 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:14.457204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-01e5219e-8771-4e1d-914c-cce0e2410b17 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:14.466319 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-01e5219e-8771-4e1d-914c-cce0e2410b17 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1266 microversion: 2.1 time: 0.078401 Oct 28 14:31:14.467473 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3850/7788] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:14 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:15.489867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:15.490515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:15.501991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:15.502484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:15.502966 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:15.503669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:15.504347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:15.505444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:15.581080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:15.589580 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6ab0e5de-e6ef-43d5-909c-49abe1c8b686 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1270 microversion: 2.1 time: 0.103707 Oct 28 14:31:15.590822 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3939/7789] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:15 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:16.614363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:16.614938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:16.622663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:16.625445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:16.625445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:16.625445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:16.625445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:16.625445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:16.692860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:16.700927 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0092994f-4506-4d4e-a69a-c1a0deb17369 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1336 microversion: 2.1 time: 0.091016 Oct 28 14:31:16.701582 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3851/7790] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:16 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:17.728658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:17.729957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:17.737278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:17.738005 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:17.738644 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:17.739548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:17.740169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:17.740758 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:17.952895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:17.961680 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-16272212-9e1a-40ca-bac8-c19bcee45db2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1392 microversion: 2.1 time: 0.236927 Oct 28 14:31:17.962272 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3940/7791] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:17 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:18.428536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-ddaf7aa8-842d-4d9b-b212-e63f18b17df9 req-51637bbf-fb36-4511-b5a8-c0fef1b321c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f18bd1-a1d5-4c85-91b4-2098917063aa", "tag": "956b8a14-ccfa-4f0d-8bdc-66b3075f3111"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:31:18.444365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ddaf7aa8-842d-4d9b-b212-e63f18b17df9 req-51637bbf-fb36-4511-b5a8-c0fef1b321c6 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:18.445444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ddaf7aa8-842d-4d9b-b212-e63f18b17df9 req-51637bbf-fb36-4511-b5a8-c0fef1b321c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:18.446147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-ddaf7aa8-842d-4d9b-b212-e63f18b17df9 req-51637bbf-fb36-4511-b5a8-c0fef1b321c6 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:18.458695 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-ddaf7aa8-842d-4d9b-b212-e63f18b17df9 req-51637bbf-fb36-4511-b5a8-c0fef1b321c6 service nova] Creating event network-changed:956b8a14-ccfa-4f0d-8bdc-66b3075f3111 for instance 13f18bd1-a1d5-4c85-91b4-2098917063aa on n-h2-862876-2 Oct 28 14:31:18.464172 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-ddaf7aa8-842d-4d9b-b212-e63f18b17df9 req-51637bbf-fb36-4511-b5a8-c0fef1b321c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039435 Oct 28 14:31:18.465178 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3852/7792] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:31:18.984648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:18.985907 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:18.992776 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:18.993260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:18.993697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:18.994380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:18.994865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:18.995291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:19.196967 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:19.205154 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac3bd731-b38c-4c2e-85e7-011fd1d27511 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1392 microversion: 2.1 time: 0.224343 Oct 28 14:31:19.205668 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3941/7793] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:18 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:20.228888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:20.229594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:20.237185 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:20.237681 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:20.238134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:20.238854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:20.239318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:20.239749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:20.374821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:20.383294 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f971382c-1109-45e7-b0ab-cec12e0b0a7c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1392 microversion: 2.1 time: 0.158645 Oct 28 14:31:20.383881 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3853/7794] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:20 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:21.406564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:21.407138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:21.414366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:21.414965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:21.415409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:21.416163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:21.416621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:21.417048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:21.552686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:21.560194 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-994c66c9-bb76-4077-aff9-7274217dc2cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1392 microversion: 2.1 time: 0.157657 Oct 28 14:31:21.560760 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3942/7795] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:21 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:22.583765 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:22.584397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:22.587600 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:22.593699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:22.594194 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:22.595186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:22.602793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:22.602793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:22.602793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:22.728782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:22.737042 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8529671b-e486-469a-8322-58e3d4304650 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1392 microversion: 2.1 time: 0.157182 Oct 28 14:31:22.737618 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3854/7796] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:22 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:23.760818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:23.761739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:23.764221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:23.769013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:23.771272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:23.771272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:23.771272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:23.771272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:23.771709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:23.908093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:23.916085 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32f5e6c6-6b02-4dce-8cd7-4dd812365ad3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1392 microversion: 2.1 time: 0.159169 Oct 28 14:31:23.917091 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3943/7797] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:23 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:23.967434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-aed1ebf1-f6ea-4583-b7e8-e78e46e1e3ce req-c2c8c8f4-2fb8-4750-9338-757e9b16a214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f18bd1-a1d5-4c85-91b4-2098917063aa", "name": "network-vif-plugged", "status": "completed", "tag": "956b8a14-ccfa-4f0d-8bdc-66b3075f3111"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:31:23.978071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aed1ebf1-f6ea-4583-b7e8-e78e46e1e3ce req-c2c8c8f4-2fb8-4750-9338-757e9b16a214 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:23.978564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aed1ebf1-f6ea-4583-b7e8-e78e46e1e3ce req-c2c8c8f4-2fb8-4750-9338-757e9b16a214 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:23.979046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aed1ebf1-f6ea-4583-b7e8-e78e46e1e3ce req-c2c8c8f4-2fb8-4750-9338-757e9b16a214 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:23.990485 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-aed1ebf1-f6ea-4583-b7e8-e78e46e1e3ce req-c2c8c8f4-2fb8-4750-9338-757e9b16a214 service nova] Creating event network-vif-plugged:956b8a14-ccfa-4f0d-8bdc-66b3075f3111 for instance 13f18bd1-a1d5-4c85-91b4-2098917063aa on n-h2-862876-2 Oct 28 14:31:23.995373 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-aed1ebf1-f6ea-4583-b7e8-e78e46e1e3ce req-c2c8c8f4-2fb8-4750-9338-757e9b16a214 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031697 Oct 28 14:31:23.995961 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3855/7798] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:31:24.940106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:24.940701 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:24.943442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:24.944587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:24.950179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:24.950656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:24.963346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:24.963346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:24.963346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:24.963346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:25.089103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:25.096991 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-524e4cd6-525e-4f7a-b98f-a8914d773c7b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1392 microversion: 2.1 time: 0.161390 Oct 28 14:31:25.097586 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3944/7799] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:24 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:26.117424 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:26.122983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:26.123931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:26.130409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:26.141730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:26.141730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:26.141730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:26.141730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:26.141730 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:26.284348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:26.292116 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9c302663-fb89-4311-ad91-92bd9b9f695c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1565 microversion: 2.1 time: 0.175985 Oct 28 14:31:26.292697 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3856/7800] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:26 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:26.314568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:26.315221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:26.322003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:26.322494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:26.322984 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:26.323681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:26.324193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:26.324579 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:26.480147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:26.488648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d7ffec7-70ed-4972-92cb-a2d1c5ad1611 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1565 microversion: 2.1 time: 0.177861 Oct 28 14:31:26.489239 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3945/7801] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:26 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:31:28.428821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:31:28.430052 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:28.431155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-2e6f635d-c457-4a29-b0d6-ad0cf48ee39a req-cb085dca-4852-4b49-b69d-657a341fca74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f18bd1-a1d5-4c85-91b4-2098917063aa", "tag": "956b8a14-ccfa-4f0d-8bdc-66b3075f3111"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:31:28.438100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:28.439513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:28.439943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:28.440668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:28.441139 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:28.441398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2e6f635d-c457-4a29-b0d6-ad0cf48ee39a req-cb085dca-4852-4b49-b69d-657a341fca74 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:28.441581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:28.441885 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2e6f635d-c457-4a29-b0d6-ad0cf48ee39a req-cb085dca-4852-4b49-b69d-657a341fca74 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:28.442322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-2e6f635d-c457-4a29-b0d6-ad0cf48ee39a req-cb085dca-4852-4b49-b69d-657a341fca74 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:28.455325 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-2e6f635d-c457-4a29-b0d6-ad0cf48ee39a req-cb085dca-4852-4b49-b69d-657a341fca74 service nova] Creating event network-changed:956b8a14-ccfa-4f0d-8bdc-66b3075f3111 for instance 13f18bd1-a1d5-4c85-91b4-2098917063aa on n-h2-862876-2 Oct 28 14:31:28.464470 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-2e6f635d-c457-4a29-b0d6-ad0cf48ee39a req-cb085dca-4852-4b49-b69d-657a341fca74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037229 Oct 28 14:31:28.466068 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3946/7802] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:31:28.583340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:31:28.591815 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5059d136-bc1c-48f8-a6f2-3b45f0be18e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1565 microversion: 2.1 time: 0.167184 Oct 28 14:31:28.592398 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3857/7803] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:31:28 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:31:49.856499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=7 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:49.857171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=46 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:31:49.861300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:31:49.863666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:31:49.869649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:49.875681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:49.875681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:49.875681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:31:49.875681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:31:49.875681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:31:49.922643 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c8e7c3a-0625-4159-b7a5-ae6296852604 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa/action" status: 200 len: 24574 microversion: 2.1 time: 0.068007 Oct 28 14:31:49.923321 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3947/7804] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:31:49 2022] POST /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:32:00.918572 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:32:00.920818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:00.922834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=7 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:00.923494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=34 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:00.928128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:00.928644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:00.929072 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:00.929778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:00.930241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:00.930676 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:01.113702 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b9e6b3b-944a-4530-b80c-05f69c886bd4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa/action" status: 202 len: 0 microversion: 2.1 time: 0.198950 Oct 28 14:32:01.114495 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3858/7805] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:32:00 2022] POST /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:32:01.123376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:01.124083 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:01.126765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:01.127409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:01.132529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:01.133058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:01.133511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:01.134227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:01.134691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:01.135159 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:01.310777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:01.319106 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a2dcee55-8ad2-4d11-8058-94d09350b5cc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1675 microversion: 2.1 time: 0.200210 Oct 28 14:32:01.319682 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3948/7806] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:01 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:02.344869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:02.345580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:02.353795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:02.354362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:02.354854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:02.355566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:02.356040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:02.356481 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:02.495514 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:02.504027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b437f915-43d0-44e6-bb71-9e3c54b7bdfe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.163424 Oct 28 14:32:02.508983 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3859/7807] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:02 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:03.527395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:03.528006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:03.536045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:03.536535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:03.536973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:03.542206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:03.542206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:03.542206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:03.676134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:03.683956 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4db4189e-e552-4da7-b5f9-e0e7b7a21333 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.160545 Oct 28 14:32:03.684530 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3949/7808] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:03 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:04.707051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:04.707687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:04.714810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:04.715318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:04.715776 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:04.716484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:04.716961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:04.717408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:04.854453 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:04.862656 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-cccd0382-3141-49a0-8601-7d51f4d5bc00 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.159543 Oct 28 14:32:04.863252 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3860/7809] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:04 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:05.886499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:05.887089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:05.894435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:05.894948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:05.895383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:05.896060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:05.896510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:05.896937 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:06.029225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:06.037050 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-07e80af8-7c77-4b09-8a0d-c463c7451697 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.154561 Oct 28 14:32:06.037630 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3950/7810] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:05 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:07.061043 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:07.061674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:07.068540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:07.069029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:07.069477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:07.070176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:07.070641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:07.071120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:07.203671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:07.212251 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e3a1245c-f1a2-4c50-9bb7-cdbb1bac7d84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.155078 Oct 28 14:32:07.212821 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3861/7811] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:07 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:08.235611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:08.236270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:08.243172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:08.243657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:08.244099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:08.244787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:08.245246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:08.245674 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:08.376511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:08.384703 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b90bd3a5-dea0-4cef-a825-aca0a828d340 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.153083 Oct 28 14:32:08.385284 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3951/7812] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:08 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:09.407985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:09.409226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:09.415434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:09.415938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:09.416393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:09.417102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:09.417576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:09.418016 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:09.547193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:09.555119 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2344ec3b-001b-4e07-b457-78c204f6074e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.151210 Oct 28 14:32:09.555686 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3862/7813] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:09 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:10.579216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:10.579849 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:10.586951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:10.587430 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:10.587859 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:10.588543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:10.588993 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:10.589414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:10.721376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:10.729042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a66e1639-2ee8-4b5f-963d-fb4a5d9017b2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.153731 Oct 28 14:32:10.729613 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3952/7814] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:10 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:11.752728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:11.753380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:11.760179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:11.760674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:11.761123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:11.761819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:11.762281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:11.762713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:11.895566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:11.903212 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bfa027b8-0c2d-45f4-85c6-bfaf758685ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.155036 Oct 28 14:32:11.903788 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3863/7815] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:11 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:12.927831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:12.928447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:12.935439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:12.935927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:12.936366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:12.937049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:12.937502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:12.937927 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:13.069748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:13.077648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4a1f5cf8-3e57-41ab-8155-9ea8e243bee3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.154287 Oct 28 14:32:13.078219 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3953/7816] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:12 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:14.101468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:14.102092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:14.108910 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:14.109403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:14.109848 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:14.110541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:14.111038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:14.111472 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:14.239440 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:14.247125 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-99363497-af78-4b0e-87da-9537651d417f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.149642 Oct 28 14:32:14.247694 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3864/7817] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:14 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:15.271152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:15.271769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:15.278737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:15.279247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:15.279688 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:15.280376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:15.280858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:15.281285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:15.413098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:15.420887 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6cd76aff-22f7-4f96-97dd-5f99f72355e1 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.153736 Oct 28 14:32:15.421461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3954/7818] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:15 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:16.445044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:16.445666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:16.452510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:16.453004 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:16.453452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:16.454144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:16.454603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:16.455650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:16.585658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:16.593690 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5b0ab7f3-4cb0-4849-ab74-6b3a55501ee7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.152598 Oct 28 14:32:16.594256 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3865/7819] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:16 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:17.617903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:17.618517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:17.625285 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:17.625766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:17.626199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:17.626918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:17.627374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:17.627797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:17.762548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:17.770916 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2581f63a-35af-48cb-a8c1-6c17cfc3504e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1680 microversion: 2.1 time: 0.157896 Oct 28 14:32:17.771488 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3955/7820] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:17 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:18.794699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:18.795254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:18.802732 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:18.803235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:18.803680 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:18.804376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:18.804836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:18.805267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:19.037946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:19.045770 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dd739ff7-fd02-41c6-97fc-143b512ba750 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1683 microversion: 2.1 time: 0.255031 Oct 28 14:32:19.046281 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3866/7821] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:18 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:41.243766 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:32:41.245970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:41.248075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:41.248742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=48 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:41.253929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:41.254414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:41.254881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:41.255572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:41.256030 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:41.256458 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:41.312450 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3c424455-7582-4ad5-8604-38c6f0d9ec1a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa/action" status: 200 len: 69157 microversion: 2.1 time: 0.072811 Oct 28 14:32:41.313124 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3956/7822] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:32:41 2022] POST /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa/action => generated 69157 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:32:48.525439 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:48.525970 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:48.528843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ef552868-8128-4dc1-876a-0b2f2c7391c3 req-21036add-09d8-4745-9ab4-167ba0df8725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f18bd1-a1d5-4c85-91b4-2098917063aa", "tag": "956b8a14-ccfa-4f0d-8bdc-66b3075f3111"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:32:48.529302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=18 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:48.530038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:32:48.540344 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:48.541003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:48.541715 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:48.542582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:48.543186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:48.543700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:48.549371 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ef552868-8128-4dc1-876a-0b2f2c7391c3 req-21036add-09d8-4745-9ab4-167ba0df8725 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:48.549856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ef552868-8128-4dc1-876a-0b2f2c7391c3 req-21036add-09d8-4745-9ab4-167ba0df8725 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:48.550381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ef552868-8128-4dc1-876a-0b2f2c7391c3 req-21036add-09d8-4745-9ab4-167ba0df8725 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:48.566016 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ef552868-8128-4dc1-876a-0b2f2c7391c3 req-21036add-09d8-4745-9ab4-167ba0df8725 service nova] Creating event network-changed:956b8a14-ccfa-4f0d-8bdc-66b3075f3111 for instance 13f18bd1-a1d5-4c85-91b4-2098917063aa on n-h2-862876-2 Oct 28 14:32:48.571777 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ef552868-8128-4dc1-876a-0b2f2c7391c3 req-21036add-09d8-4745-9ab4-167ba0df8725 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047358 Oct 28 14:32:48.572385 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3957/7823] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:32:48.572860 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:32:48.920466 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-627b24c0-6bfd-4d84-b912-3c82931fc9b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 204 len: 0 microversion: 2.1 time: 0.398031 Oct 28 14:32:48.925324 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3867/7824] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:32:48 2022] DELETE /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:32:48.933123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:48.934161 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:48.941891 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:48.942386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:48.942862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:48.943558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:48.944019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:48.944488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:49.139857 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:49.147610 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-70750984-548c-4307-9c1d-748d2b135070 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1689 microversion: 2.1 time: 0.220282 Oct 28 14:32:49.148194 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3958/7825] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:48 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:50.172326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:50.173063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:50.179979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:50.180482 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:50.180931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:50.181631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:50.182094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:50.182524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:50.323367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:50.328942 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b98fa43a-b7d3-4424-a924-2b99159cda80 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1689 microversion: 2.1 time: 0.161353 Oct 28 14:32:50.330150 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3868/7826] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:50 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:50.963571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8970b130-bc6e-4921-9172-b062aef2dae7 req-ee234671-f75f-433a-a807-0284bf83d970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f18bd1-a1d5-4c85-91b4-2098917063aa", "name": "network-vif-deleted", "tag": "956b8a14-ccfa-4f0d-8bdc-66b3075f3111"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:32:50.977572 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8970b130-bc6e-4921-9172-b062aef2dae7 req-ee234671-f75f-433a-a807-0284bf83d970 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:50.982696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8970b130-bc6e-4921-9172-b062aef2dae7 req-ee234671-f75f-433a-a807-0284bf83d970 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:50.982696 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8970b130-bc6e-4921-9172-b062aef2dae7 req-ee234671-f75f-433a-a807-0284bf83d970 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:50.991255 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8970b130-bc6e-4921-9172-b062aef2dae7 req-ee234671-f75f-433a-a807-0284bf83d970 service nova] Creating event network-vif-deleted:956b8a14-ccfa-4f0d-8bdc-66b3075f3111 for instance 13f18bd1-a1d5-4c85-91b4-2098917063aa on n-h2-862876-2 Oct 28 14:32:50.996112 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8970b130-bc6e-4921-9172-b062aef2dae7 req-ee234671-f75f-433a-a807-0284bf83d970 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096181 Oct 28 14:32:50.996724 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3959/7827] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:32:51.352587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:51.353216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:51.360088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:51.360591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:51.361037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:51.361742 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:51.362210 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:51.362650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:51.393336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:51.393826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:51.394301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:51.394778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lazy-loading 'fault' on Instance uuid 13f18bd1-a1d5-4c85-91b4-2098917063aa {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:32:51.763656 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:32:51.772178 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6eeb7f6e-88b8-46be-85f1-ea883e4c4a84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 200 len: 1356 microversion: 2.1 time: 0.423445 Oct 28 14:32:51.772757 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3869/7828] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:51 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 1356 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:32:52.796742 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:52.797440 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 13f18bd1-a1d5-4c85-91b4-2098917063aa] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:32:52.803663 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:52.804139 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:52.804568 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:52.805247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:32:52.805715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:32:52.806123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:32:52.819254 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] HTTP exception thrown: Instance 13f18bd1-a1d5-4c85-91b4-2098917063aa could not be found. Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Request method failure captured: Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa HTTP/1.1 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-djbicO_a8uKRdhpmXjWnbohIhvTz7I2xrDCfnsBlJjItv72kC-Dlf1jQ6CrN_NjSoLrQU3-izIfqwaEmCdLEWpkPpF6UEp5A6IfEbu7s9Aylg3LxrCSZ6d3Lg4HM1zK7_BIZtKzPlTQTZHIP7y5JDOn4jAs-RBIoMG93zzjv2k6MY Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e36afd88e27a46f4b3f82a9fc63cfb09", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0297a20d29894a10b39125e80260a31b Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 13f18bd1-a1d5-4c85-91b4-2098917063aa could not be found. Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '13f18bd1-a1d5-4c85-91b4-2098917063aa'} Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f18bd1-a1d5-4c85-91b4-2098917063aa could not be found. Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f18bd1-a1d5-4c85-91b4-2098917063aa could not be found. Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:32:52.820843 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f18bd1-a1d5-4c85-91b4-2098917063aa could not be found. Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Returning 404 to user: Instance 13f18bd1-a1d5-4c85-91b4-2098917063aa could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f72df320-a095-467e-9f1d-e03e30538ca7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa" status: 404 len: 111 microversion: 2.1 time: 0.030745 Oct 28 14:32:52.826519 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3960/7829] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:32:52 2022] GET /compute/v2.1/servers/13f18bd1-a1d5-4c85-91b4-2098917063aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:32:56.605951 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-de11184f-53f5-4af6-9fa3-9e2c6bcae941 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '.version_select at 0x7f27b8567af0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:32:56.693704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-de11184f-53f5-4af6-9fa3-9e2c6bcae941 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-686654233" status: 202 len: 0 microversion: 2.1 time: 0.091497 Oct 28 14:32:56.694320 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3870/7830] 10.222.0.25 () {58 vars in 1281 bytes} [Fri Oct 28 14:32:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-686654233 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:32:56.726408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23332352-7971-49a8-8519-0b5143d5b06a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: .version_select at 0x7f27b8246dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1720311884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaCj+vJH95p6HI8wwCAW90JSMfz6x+u92y8upDunXnvDd2AUq44VFwR3VgCCSjdr3Ngrk2qXJld0Mcgez86uBaEV2E4yeK+fAJVg4hmq2XbTnAp9c9krKJlyDbbiNva6Q=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:32:56.744639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-23332352-7971-49a8-8519-0b5143d5b06a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:32:56.750025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-23332352-7971-49a8-8519-0b5143d5b06a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:32:56.853531 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23332352-7971-49a8-8519-0b5143d5b06a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.130901 Oct 28 14:32:56.854315 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3961/7831] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:32:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:33:04.838192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:04.838655 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-403104236", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "6f5f80b2-8573-486a-9e63-691e5532e701"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1720311884", "security_groups": [{"name": "tempest-secgroup-smoke-1371377267"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:33:04.978581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] validate_networks() for [('6f5f80b2-8573-486a-9e63-691e5532e701', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:33:05.570234 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:33:05.570674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:33:05.571361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:33:05.571799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:33:05.572236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:33:05.582151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:05.583102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:05.583819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:05.584576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:05.585054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:05.585679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:05.605768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:33:05.612411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:33:05.626544 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:33:05.629946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:33:05.779744 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-be9321e2-c3ba-407a-afcc-6a66edf52dfd tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.948265 Oct 28 14:33:05.780588 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3871/7832] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:33:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 14:33:05.794454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7340c2c8-9d96-4778-8ca6-23d25d5d677a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:05.796320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7340c2c8-9d96-4778-8ca6-23d25d5d677a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:05.806114 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:05.895454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7340c2c8-9d96-4778-8ca6-23d25d5d677a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:05.903217 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7340c2c8-9d96-4778-8ca6-23d25d5d677a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1266 microversion: 2.1 time: 0.114238 Oct 28 14:33:05.905708 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3962/7833] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:05 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:06.930586 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:06.931299 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:06.938721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:06.939235 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:06.939880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:06.940607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:06.941084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:06.941535 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:07.009578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:07.018261 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-95de9b2d-c1b4-4a1e-86ba-fb7a46f2391d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1270 microversion: 2.1 time: 0.092431 Oct 28 14:33:07.019314 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3872/7834] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:06 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:08.043132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:08.043959 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:08.052735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:08.053438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:08.054246 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:08.055413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:08.056080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:08.056657 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:08.138221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:08.146730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e301bb11-b5cb-45a6-a1d0-c1a1ac8e056b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1336 microversion: 2.1 time: 0.108953 Oct 28 14:33:08.147656 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3963/7835] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:08 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:09.170469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:09.171159 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:09.177836 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:09.178338 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:09.178822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:09.179553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:09.180006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:09.180449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:09.318588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:09.326974 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f199df97-5754-4a0d-9009-5b964843ec84 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1392 microversion: 2.1 time: 0.160211 Oct 28 14:33:09.338866 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3873/7836] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:09 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:09.622971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1affbe62-00ea-40a2-9886-a8758d905ede req-3eecbf1a-4a2a-452b-adc3-9f0e4eb6ba80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:33:09.633768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1affbe62-00ea-40a2-9886-a8758d905ede req-3eecbf1a-4a2a-452b-adc3-9f0e4eb6ba80 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:09.634182 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1affbe62-00ea-40a2-9886-a8758d905ede req-3eecbf1a-4a2a-452b-adc3-9f0e4eb6ba80 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:09.634614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1affbe62-00ea-40a2-9886-a8758d905ede req-3eecbf1a-4a2a-452b-adc3-9f0e4eb6ba80 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:09.646104 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1affbe62-00ea-40a2-9886-a8758d905ede req-3eecbf1a-4a2a-452b-adc3-9f0e4eb6ba80 service nova] Creating event network-changed:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h1-862876-2 Oct 28 14:33:09.651195 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1affbe62-00ea-40a2-9886-a8758d905ede req-3eecbf1a-4a2a-452b-adc3-9f0e4eb6ba80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032113 Oct 28 14:33:09.651968 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3964/7837] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:33:10.351705 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:10.352447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:10.359864 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:10.361085 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:10.361551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:10.362267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:10.362976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:10.363495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:10.499143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:10.507051 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2bb39a91-cc26-42fe-8468-7cc1fbfba446 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1392 microversion: 2.1 time: 0.159290 Oct 28 14:33:10.507626 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3874/7838] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:10 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:11.530587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:11.531312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:11.534152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:11.539117 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:11.539633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:11.540065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:11.540754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:11.541205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:11.541622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:11.675647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:11.683213 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f23b5ecb-dfaa-42b7-8ebc-5b60b815f6fc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1392 microversion: 2.1 time: 0.156855 Oct 28 14:33:11.683783 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3965/7839] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:11 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:12.707164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:12.707793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:12.714924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:12.715423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:12.715880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:12.716582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:12.717177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:12.717489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:12.851764 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:12.860246 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96b20e80-8462-4488-9a41-5075324aed57 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1392 microversion: 2.1 time: 0.157612 Oct 28 14:33:12.860817 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3875/7840] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:12 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:13.884373 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:13.884906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:13.891821 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:13.892307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:13.892744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:13.893437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:13.893893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:13.894318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:14.023555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:14.031306 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ee04bc2f-4aa9-48c7-a01b-04618969e729 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1392 microversion: 2.1 time: 0.151047 Oct 28 14:33:14.032413 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3966/7841] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:13 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:33:14.580762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-57557d27-3740-44f9-b969-f01f0c5096d1 req-2ac21bb4-5098-4897-adec-035a10b1f533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "name": "network-vif-plugged", "status": "completed", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:33:14.590497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-57557d27-3740-44f9-b969-f01f0c5096d1 req-2ac21bb4-5098-4897-adec-035a10b1f533 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:14.591030 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-57557d27-3740-44f9-b969-f01f0c5096d1 req-2ac21bb4-5098-4897-adec-035a10b1f533 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:14.591495 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-57557d27-3740-44f9-b969-f01f0c5096d1 req-2ac21bb4-5098-4897-adec-035a10b1f533 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:14.603007 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-57557d27-3740-44f9-b969-f01f0c5096d1 req-2ac21bb4-5098-4897-adec-035a10b1f533 service nova] Creating event network-vif-plugged:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h1-862876-2 Oct 28 14:33:14.608703 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-57557d27-3740-44f9-b969-f01f0c5096d1 req-2ac21bb4-5098-4897-adec-035a10b1f533 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086611 Oct 28 14:33:14.613309 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3876/7842] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:33:15.054700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:15.055271 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:15.062073 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:15.062562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:15.063039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:15.064296 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:15.064759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:15.065190 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:15.200509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:15.208633 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0a9f9d87-e0f0-458b-9f40-d434e60b3f9f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1392 microversion: 2.1 time: 0.157903 Oct 28 14:33:15.209236 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3967/7843] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:15 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:16.232818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:16.233447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:16.236711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:16.237385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:16.242283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:16.242804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:16.249918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:16.249918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:16.249918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:16.249918 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:16.377510 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:16.385284 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b94ab780-f057-4afb-9ca8-edd83a062c72 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1565 microversion: 2.1 time: 0.156749 Oct 28 14:33:16.385858 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3877/7844] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:16 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:16.408447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:16.409063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:16.410997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:16.416777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:16.417269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:16.417710 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:16.418408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:16.418902 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:16.419332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:16.551014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:16.558738 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60239050-1cb6-4dc6-af0c-009f46e83ce8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1565 microversion: 2.1 time: 0.154737 Oct 28 14:33:16.559334 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3968/7845] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:16 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:18.447283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:18.448972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:18.449723 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-03e1f18e-bf13-43ec-9da3-ffc83b211c36 req-15df8ca1-fb53-4921-a699-60c096e6d318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:33:18.457356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:18.457968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:18.458489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:18.459497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:18.460066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:18.460745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:18.464358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-03e1f18e-bf13-43ec-9da3-ffc83b211c36 req-15df8ca1-fb53-4921-a699-60c096e6d318 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:18.464853 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-03e1f18e-bf13-43ec-9da3-ffc83b211c36 req-15df8ca1-fb53-4921-a699-60c096e6d318 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:18.465284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-03e1f18e-bf13-43ec-9da3-ffc83b211c36 req-15df8ca1-fb53-4921-a699-60c096e6d318 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:18.479049 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-03e1f18e-bf13-43ec-9da3-ffc83b211c36 req-15df8ca1-fb53-4921-a699-60c096e6d318 service nova] Creating event network-changed:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h1-862876-2 Oct 28 14:33:18.484777 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-03e1f18e-bf13-43ec-9da3-ffc83b211c36 req-15df8ca1-fb53-4921-a699-60c096e6d318 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039540 Oct 28 14:33:18.486360 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3969/7846] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:33:18.605772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:18.614531 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f63eb99e-3752-4312-8164-b2a4345ce12e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1565 microversion: 2.1 time: 0.171596 Oct 28 14:33:18.615257 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3878/7847] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:18 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:39.867631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=9 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:39.868375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=34 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:39.872555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:33:39.874921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:39.880957 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:39.881449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:39.881887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:39.882580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:39.883062 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:39.883488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:39.934968 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d2cbd655-d93a-45db-bdee-242bb36c969b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action" status: 200 len: 24565 microversion: 2.1 time: 0.069064 Oct 28 14:33:39.935632 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3970/7848] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:33:39 2022] POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action => generated 24565 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:33:51.042905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:33:51.045283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:51.047679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:51.048364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=40 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:51.053684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:51.054190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:51.059142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:51.059142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:51.059142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:51.059142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:51.095226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:51.101673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Old instance type m1.heat2, new instance type m1.heat {{(pid=127794) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 14:33:51.108142 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:33:51.108577 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:33:51.109069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:33:51.109491 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:33:51.109925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:33:51.312028 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-323b46e9-09ad-4f17-8fb7-7109c5aab19c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action" status: 202 len: 0 microversion: 2.1 time: 0.272949 Oct 28 14:33:51.312882 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3879/7849] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:33:51 2022] POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:33:51.321781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:51.323029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:51.325328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:33:51.330679 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:51.331697 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:51.332133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:51.332824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:51.333278 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:51.333706 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:51.466652 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:51.475196 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf4cf7f9-8c14-4ccb-b116-27baf3f9a68e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1692 microversion: 2.1 time: 0.157990 Oct 28 14:33:51.475780 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3971/7850] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:51 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:52.500861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:52.501502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:52.508536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:52.509034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:52.509489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:52.510193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:52.510666 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:52.511131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:52.643664 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:52.651406 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4678f153-bd48-48d4-807b-a2b2d5898795 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1692 microversion: 2.1 time: 0.155569 Oct 28 14:33:52.651984 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3880/7851] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:52 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:53.674691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:53.675346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:53.683085 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:53.683574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:53.684013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:53.684715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:53.685157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:53.685582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:53.815265 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:53.823579 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5e43b557-ca80-47cb-98a5-3721cf840550 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1692 microversion: 2.1 time: 0.152794 Oct 28 14:33:53.824144 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3972/7852] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:53 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:54.848275 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:54.848909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:54.855718 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:54.856248 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:54.856698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:54.857400 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:54.857870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:54.858308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:54.990127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:54.997901 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2519cae4-9a91-4b5d-8827-0c4209e0cca9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1692 microversion: 2.1 time: 0.154106 Oct 28 14:33:54.998474 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3881/7853] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:54 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:56.022044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:56.022639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:56.029610 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:56.030100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:56.030547 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:56.031270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:56.031733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:56.036176 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:56.167622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:56.175418 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c3305494-45c0-4e14-8070-b920a438b9b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1692 microversion: 2.1 time: 0.157883 Oct 28 14:33:56.175994 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3973/7854] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:56 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:33:57.200127 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:57.200902 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:57.208197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:57.208699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:57.209145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:57.209841 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:57.210353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:57.210784 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:57.347785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:57.355677 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b705a465-a2f4-48af-b10f-0dd027ce8777 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1692 microversion: 2.1 time: 0.159532 Oct 28 14:33:57.356294 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3882/7855] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:57 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:58.378691 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:58.379320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:58.385889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:58.386367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:58.386827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:58.387510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:58.387963 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:58.388383 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:58.525771 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:58.533613 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-79601d58-14e4-40f7-a2ac-4c99017863f4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.158792 Oct 28 14:33:58.534725 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3974/7856] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:58 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:33:59.557542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:33:59.558707 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:33:59.565683 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:59.566193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:59.566674 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:59.567411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:33:59.567884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:33:59.568322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:33:59.701040 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:33:59.709459 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8273576c-7523-481d-acb2-6abe0baa32c7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.155898 Oct 28 14:33:59.710024 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3883/7857] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:33:59 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:34:00.732664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:00.733269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:00.740015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:00.740494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:00.740929 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:00.741605 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:00.742057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:00.742474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:00.872529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:00.880814 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6944887d-c4f7-4930-8973-61c066587e53 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.152050 Oct 28 14:34:00.881383 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3975/7858] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:00 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:01.904445 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:01.904999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:01.912168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:01.912684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:01.913147 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:01.913882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:01.914359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:01.914830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:02.045355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:02.053749 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b60ef30e-c9cd-498a-83cc-44e7248c63e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.153311 Oct 28 14:34:02.054331 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3884/7859] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:01 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:03.076196 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:03.076817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:03.084446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:03.084940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:03.085393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:03.086089 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:03.086554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:03.087072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:03.222946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:03.230605 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-285b71e1-e112-4cb3-8e19-0d4c58902fee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.158337 Oct 28 14:34:03.233414 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3976/7860] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:03 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:04.255067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:04.255697 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:04.262465 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:04.262998 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:04.263454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:04.264156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:04.264625 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:04.265064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:04.397529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:04.405220 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7e02e6b1-edfc-4b41-8465-9f239a0d35a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.154547 Oct 28 14:34:04.405810 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3885/7861] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:04 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:05.428911 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:05.429509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:05.436304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:05.436786 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:05.437223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:05.437903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:05.438355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:05.438800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:05.569578 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:05.577322 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8a610beb-b0fe-4a5b-81ec-9a4764aa0352 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.152844 Oct 28 14:34:05.581161 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3977/7862] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:05 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:06.601216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:06.601786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:06.608609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:06.609109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:06.609565 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:06.610269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:06.610798 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:06.611222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:06.750771 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:06.759253 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ddc21e25-b80d-46db-911a-07073e197652 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.161999 Oct 28 14:34:06.759840 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3886/7863] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:06 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:07.785330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:07.785973 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:07.793298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:07.793805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:07.794307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:07.794996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:07.795460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:07.795895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:07.933645 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:07.942410 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-44162990-8337-48bd-a640-64f9072e3515 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.161670 Oct 28 14:34:07.943075 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3978/7864] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:07 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:08.966976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:08.967614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:08.975408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:08.975912 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:08.976371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:08.977077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:08.977553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:08.977999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:09.108672 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:09.117134 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6b6b1d50-7c86-4de1-bd16-5e65f8c3f3e4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1697 microversion: 2.1 time: 0.154391 Oct 28 14:34:09.117714 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3887/7865] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:08 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:10.141193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:10.141815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:10.149266 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:10.149759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:10.150205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:10.150942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:10.151406 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:10.151842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:10.313636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c26d001f-1b76-4114-acee-de711eb19f18 req-64314f27-32b2-4e43-b7a1-3e84a2f07786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "name": "network-vif-unplugged", "status": "completed", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:10.324545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c26d001f-1b76-4114-acee-de711eb19f18 req-64314f27-32b2-4e43-b7a1-3e84a2f07786 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:10.325122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c26d001f-1b76-4114-acee-de711eb19f18 req-64314f27-32b2-4e43-b7a1-3e84a2f07786 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:10.325576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c26d001f-1b76-4114-acee-de711eb19f18 req-64314f27-32b2-4e43-b7a1-3e84a2f07786 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:10.337634 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c26d001f-1b76-4114-acee-de711eb19f18 req-64314f27-32b2-4e43-b7a1-3e84a2f07786 service nova] Creating event network-vif-unplugged:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h2-862876-2 Oct 28 14:34:10.343712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [req-c26d001f-1b76-4114-acee-de711eb19f18 req-64314f27-32b2-4e43-b7a1-3e84a2f07786 service nova] Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127794) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:34:10.348881 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:10.355428 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c26d001f-1b76-4114-acee-de711eb19f18 req-64314f27-32b2-4e43-b7a1-3e84a2f07786 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045516 Oct 28 14:34:10.356393 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3888/7866] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:34:10.361982 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-42448062-5ff6-43b9-8c27-0c274070b65c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1696 microversion: 2.1 time: 0.222592 Oct 28 14:34:10.361982 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3979/7867] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:10 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1696 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:11.385646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:11.386371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:11.392550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:11.393050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:11.393515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:11.394216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:11.394687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:11.395157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:11.534316 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:11.542557 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-eb89957b-b470-4f20-9f99-d844454f9215 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1696 microversion: 2.1 time: 0.161974 Oct 28 14:34:11.543179 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3889/7868] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:11 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:12.371873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-03c23a75-0f6c-43ea-a185-18708d7b9476 req-481ac3a9-65ae-4ddc-8560-f89ca23b1746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:12.382668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-03c23a75-0f6c-43ea-a185-18708d7b9476 req-481ac3a9-65ae-4ddc-8560-f89ca23b1746 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:12.383180 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-03c23a75-0f6c-43ea-a185-18708d7b9476 req-481ac3a9-65ae-4ddc-8560-f89ca23b1746 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:12.383614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-03c23a75-0f6c-43ea-a185-18708d7b9476 req-481ac3a9-65ae-4ddc-8560-f89ca23b1746 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:12.395130 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-03c23a75-0f6c-43ea-a185-18708d7b9476 req-481ac3a9-65ae-4ddc-8560-f89ca23b1746 service nova] Creating event network-changed:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h2-862876-2 Oct 28 14:34:12.400366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [req-03c23a75-0f6c-43ea-a185-18708d7b9476 req-481ac3a9-65ae-4ddc-8560-f89ca23b1746 service nova] Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862876-2', 'n-h1-862876-2'} {{(pid=127793) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 14:34:12.410958 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-03c23a75-0f6c-43ea-a185-18708d7b9476 req-481ac3a9-65ae-4ddc-8560-f89ca23b1746 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042801 Oct 28 14:34:12.411542 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3980/7869] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:34:12.566657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:12.567353 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:12.574302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:12.574773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:12.575228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:12.575941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:12.576409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:12.576850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:12.708461 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:12.716588 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d8588d3e-5c40-4469-9f0b-dd550f2d7eb0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1694 microversion: 2.1 time: 0.153868 Oct 28 14:34:12.717166 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3890/7870] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:12 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:13.742971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:13.743669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:13.749817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:13.750301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:13.750738 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:13.751449 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:13.751903 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:13.752323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:13.886286 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:13.894531 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f992f297-fe44-4126-8a31-8198437e8b07 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1691 microversion: 2.1 time: 0.156611 Oct 28 14:34:13.895159 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3981/7871] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:13 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:13.917605 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:13.918138 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:13.924827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:13.925350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:13.925795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:13.926489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:13.926979 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:13.927411 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:14.130348 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e04b9ef7-6976-44f8-95a6-8d4a3078021d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action" status: 204 len: 0 microversion: 2.1 time: 0.216259 Oct 28 14:34:14.130945 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3891/7872] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:34:13 2022] POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:34:14.139523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:14.140212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:14.146775 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:14.147274 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:14.147716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:14.148414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:14.148872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:14.149301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:14.312512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:14.321160 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-88a09578-54f3-4aef-b7cb-bea860cec5f0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1691 microversion: 2.1 time: 0.185579 Oct 28 14:34:14.321752 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3982/7873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:14 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:14.345350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:14.346093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:14.352340 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:14.352847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:14.353296 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:14.354006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:14.354476 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:14.354948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:14.497519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:14.506098 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a3411fcc-78bf-4c1a-92b8-34c53fd3bfda tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1691 microversion: 2.1 time: 0.164885 Oct 28 14:34:14.506685 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3892/7874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:14 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:15.529748 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:15.530358 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:15.537515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:15.538003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:15.538436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:15.539232 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:15.539736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:15.540154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:15.677896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:15.685730 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1426c805-2601-42b5-aafd-86d9ad67d83c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1691 microversion: 2.1 time: 0.160375 Oct 28 14:34:15.686307 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3983/7875] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:15 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:34:16.710462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:16.711170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:16.718381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:16.718986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:16.719442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:16.720164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:16.720640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:16.721112 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:16.737359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:34:16.750289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-be5d56b5-82dc-4895-ab7d-8af884e76de5 req-986fee59-4441-4f4c-ad64-3562aac16203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "name": "network-vif-plugged", "status": "completed", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:16.761049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-be5d56b5-82dc-4895-ab7d-8af884e76de5 req-986fee59-4441-4f4c-ad64-3562aac16203 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:16.761612 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-be5d56b5-82dc-4895-ab7d-8af884e76de5 req-986fee59-4441-4f4c-ad64-3562aac16203 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:16.762042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-be5d56b5-82dc-4895-ab7d-8af884e76de5 req-986fee59-4441-4f4c-ad64-3562aac16203 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:16.774292 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-be5d56b5-82dc-4895-ab7d-8af884e76de5 req-986fee59-4441-4f4c-ad64-3562aac16203 service nova] Creating event network-vif-plugged:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h2-862876-2 Oct 28 14:34:16.779598 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-be5d56b5-82dc-4895-ab7d-8af884e76de5 req-986fee59-4441-4f4c-ad64-3562aac16203 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Oct 28 14:34:16.780283 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3984/7876] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:34:16.857832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:16.865862 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76b7add6-bce4-4521-90d2-c230438db718 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1683 microversion: 2.1 time: 0.160040 Oct 28 14:34:16.875222 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3893/7877] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:16 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:37.034471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:37.036825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:37.039035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=28 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:34:37.039695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=82 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:34:37.041036 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:34:37.041184 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action (ip 10.222.0.25) !!! Oct 28 14:34:37.047352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:37.055016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:37.055016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:37.055016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:37.055016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:37.055016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:37.103477 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51aaf944-adc5-4530-a15d-97737d9471c0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action" status: 200 len: 24577 microversion: 2.1 time: 0.073290 Oct 28 14:34:37.104169 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3985/7878] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:34:37 2022] POST /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e/action => generated 24577 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:34:44.459751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:44.460308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:44.462615 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-12befbe6-f2e1-4c49-b7de-da11a805a63c req-83c70e7d-2f99-4cbf-a2d5-45955245fd62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:44.463064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=34 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:34:44.469734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:44.470258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:44.470719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:44.471473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:44.472160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:44.472393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:44.476240 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-12befbe6-f2e1-4c49-b7de-da11a805a63c req-83c70e7d-2f99-4cbf-a2d5-45955245fd62 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:44.479398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-12befbe6-f2e1-4c49-b7de-da11a805a63c req-83c70e7d-2f99-4cbf-a2d5-45955245fd62 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:44.479398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-12befbe6-f2e1-4c49-b7de-da11a805a63c req-83c70e7d-2f99-4cbf-a2d5-45955245fd62 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:44.489767 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-12befbe6-f2e1-4c49-b7de-da11a805a63c req-83c70e7d-2f99-4cbf-a2d5-45955245fd62 service nova] Creating event network-changed:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h2-862876-2 Oct 28 14:34:44.495317 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-12befbe6-f2e1-4c49-b7de-da11a805a63c req-83c70e7d-2f99-4cbf-a2d5-45955245fd62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037002 Oct 28 14:34:44.496326 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3986/7879] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:34:44.500575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:34:44.776476 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8a74c57c-1786-4b38-9f53-18e6e4c9e4c4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 204 len: 0 microversion: 2.1 time: 0.320542 Oct 28 14:34:44.777496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3894/7880] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:34:44 2022] DELETE /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:34:44.786542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:44.787432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:44.794170 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:44.794669 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:44.795160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:44.795865 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:44.796330 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:44.796761 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:44.931894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:44.939746 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f367bd0-a08d-413a-baca-3ae9303c001e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1689 microversion: 2.1 time: 0.157984 Oct 28 14:34:44.940329 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3987/7881] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:44 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:45.964005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:45.964720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:45.971423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:45.971915 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:45.972360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:45.973058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:45.973522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:45.973955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:46.111723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:46.120242 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-476fbaa8-870d-4c86-a7e3-b65b59e3a522 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1689 microversion: 2.1 time: 0.160777 Oct 28 14:34:46.120819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3895/7882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:45 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:46.513850 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a3fedf6f-af83-4c4c-9b28-d8476e1e412b req-3024fffc-20b3-4a82-a14a-23dc52f68518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ef47a-b0ec-4f87-83d1-0c9751462d1e", "name": "network-vif-deleted", "tag": "24233e4a-ef3b-48f6-8326-cbce4d1721a8"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:46.527848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a3fedf6f-af83-4c4c-9b28-d8476e1e412b req-3024fffc-20b3-4a82-a14a-23dc52f68518 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:46.528328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a3fedf6f-af83-4c4c-9b28-d8476e1e412b req-3024fffc-20b3-4a82-a14a-23dc52f68518 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:46.528757 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a3fedf6f-af83-4c4c-9b28-d8476e1e412b req-3024fffc-20b3-4a82-a14a-23dc52f68518 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:46.540058 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a3fedf6f-af83-4c4c-9b28-d8476e1e412b req-3024fffc-20b3-4a82-a14a-23dc52f68518 service nova] Creating event network-vif-deleted:24233e4a-ef3b-48f6-8326-cbce4d1721a8 for instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e on n-h2-862876-2 Oct 28 14:34:46.545406 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a3fedf6f-af83-4c4c-9b28-d8476e1e412b req-3024fffc-20b3-4a82-a14a-23dc52f68518 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034789 Oct 28 14:34:46.545528 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3988/7883] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:34:47.145370 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:47.146132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:47.152924 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:47.155231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:47.155231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:47.155231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:47.155231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:47.155657 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:47.185573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:47.186059 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:47.186504 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:47.186986 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lazy-loading 'fault' on Instance uuid e88ef47a-b0ec-4f87-83d1-0c9751462d1e {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:34:47.237131 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:34:47.239348 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bcc82f82-5857-493a-a773-2d9eb643bbbb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 200 len: 1356 microversion: 2.1 time: 0.098597 Oct 28 14:34:47.239915 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3896/7884] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:47 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:34:48.265146 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:48.265838 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: e88ef47a-b0ec-4f87-83d1-0c9751462d1e] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:34:48.272532 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:48.273014 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:48.273448 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:48.274137 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:34:48.274587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:34:48.275039 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:34:48.289276 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] HTTP exception thrown: Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e could not be found. Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Request method failure captured: Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e HTTP/1.1 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-djbicO_a8uKRdhpmXjWnbohIhvTz7I2xrDCfnsBlJjItv72kC-Dlf1jQ6CrN_NjSoLrQU3-izIfqwaEmCdLEWpkPpF6UEp5A6IfEbu7s9Aylg3LxrCSZ6d3Lg4HM1zK7_BIZtKzPlTQTZHIP7y5JDOn4jAs-RBIoMG93zzjv2k6MY Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e36afd88e27a46f4b3f82a9fc63cfb09", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0297a20d29894a10b39125e80260a31b Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e could not be found. Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'e88ef47a-b0ec-4f87-83d1-0c9751462d1e'} Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e could not be found. Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e could not be found. Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:34:48.290999 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e could not be found. Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Returning 404 to user: Instance e88ef47a-b0ec-4f87-83d1-0c9751462d1e could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00123e5f-e0c8-4651-bb3d-19415651d909 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e" status: 404 len: 111 microversion: 2.1 time: 0.032498 Oct 28 14:34:48.308426 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3989/7885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:34:48 2022] GET /compute/v2.1/servers/e88ef47a-b0ec-4f87-83d1-0c9751462d1e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:34:52.042894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-43d9f438-cd57-40b2-9ce5-18f8175e2833 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '.version_select at 0x7f27b85a0dc0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:34:52.119336 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-43d9f438-cd57-40b2-9ce5-18f8175e2833 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1720311884" status: 202 len: 0 microversion: 2.1 time: 0.080179 Oct 28 14:34:52.119931 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3897/7886] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 14:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1720311884 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:34:52.147658 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dbc99986-7bc1-437b-bbd3-d5336bf934ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: .version_select at 0x7f27b886d3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1800054055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz8m5wJp7gC/+6D1kprUTdsKJI9yBwodegC55iBb12DKqj6rs39RyYYCzeiRRcJkcnsSkKijCWeaeZ8uC8d4EVPqV65Qxd5V96s5kUulUxQRIlqe0pAxUlnn0XTKUVuLw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:52.164364 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-dbc99986-7bc1-437b-bbd3-d5336bf934ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:34:52.170412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-dbc99986-7bc1-437b-bbd3-d5336bf934ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:34:52.279259 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dbc99986-7bc1-437b-bbd3-d5336bf934ce tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.135571 Oct 28 14:34:52.279808 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3990/7887] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:34:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:34:59.689576 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:34:59.694264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-96327298", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "ceac0cb6-a8ed-4b67-be61-4707d634bdcf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1800054055", "security_groups": [{"name": "tempest-secgroup-smoke-154765240"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:34:59.815190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] validate_networks() for [('ceac0cb6-a8ed-4b67-be61-4707d634bdcf', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:35:00.239744 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:35:00.240246 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:35:00.241923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:35:00.242373 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:35:00.243090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:35:00.252639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:00.254474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:00.255398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:00.256155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:00.256926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:00.257369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:00.276990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:35:00.283817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:35:00.297469 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:35:00.301294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:35:00.460117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d18fc83e-0237-47a8-8266-574f65e91add tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772158 Oct 28 14:35:00.461106 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3898/7888] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:34:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 14:35:00.476169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-182383d0-2d8c-4ba3-a44e-1d8c5713d2b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:00.476169 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-182383d0-2d8c-4ba3-a44e-1d8c5713d2b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:00.479988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:00.542300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-182383d0-2d8c-4ba3-a44e-1d8c5713d2b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:00.549314 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-182383d0-2d8c-4ba3-a44e-1d8c5713d2b4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1265 microversion: 2.1 time: 0.080715 Oct 28 14:35:00.550206 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3991/7889] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:00 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:01.573536 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:01.574162 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:01.581844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:01.582397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:01.582877 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:01.583584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:01.584051 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:01.584537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:01.651155 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:01.658992 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e854e07-4b9b-44b2-8011-efa535d95d29 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1269 microversion: 2.1 time: 0.089286 Oct 28 14:35:01.659575 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3899/7890] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:01 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:02.681716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:02.682343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:02.690769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:02.691843 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:02.692288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:02.693011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:02.693668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:02.694283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:02.943603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:02.951488 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-612dacfe-fd08-4e60-bf46-384c6018796a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1325 microversion: 2.1 time: 0.273775 Oct 28 14:35:02.952070 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3992/7891] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:02 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:03.975172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:03.975782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:03.982546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:03.983031 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:03.983479 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:03.984177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:03.984643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:03.985076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:04.117985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:04.126117 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7b0ce146-1914-4970-99f6-80e8d2482c0c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.154803 Oct 28 14:35:04.126704 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3900/7892] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:03 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:04.557950 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-65fcddbe-eee0-46c7-be9c-6d3c2ddde3f2 req-7edbc674-ce51-4760-b0f3-7518b40e735e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be48e24-833c-418b-9927-aea111dca26c", "tag": "0cbd4658-056b-4688-8e8c-a390eafe848a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:35:04.569958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-65fcddbe-eee0-46c7-be9c-6d3c2ddde3f2 req-7edbc674-ce51-4760-b0f3-7518b40e735e service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:04.570541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-65fcddbe-eee0-46c7-be9c-6d3c2ddde3f2 req-7edbc674-ce51-4760-b0f3-7518b40e735e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:04.571056 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-65fcddbe-eee0-46c7-be9c-6d3c2ddde3f2 req-7edbc674-ce51-4760-b0f3-7518b40e735e service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:04.582967 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-65fcddbe-eee0-46c7-be9c-6d3c2ddde3f2 req-7edbc674-ce51-4760-b0f3-7518b40e735e service nova] Creating event network-changed:0cbd4658-056b-4688-8e8c-a390eafe848a for instance 1be48e24-833c-418b-9927-aea111dca26c on n-h1-862876-2 Oct 28 14:35:04.588002 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-65fcddbe-eee0-46c7-be9c-6d3c2ddde3f2 req-7edbc674-ce51-4760-b0f3-7518b40e735e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034602 Oct 28 14:35:04.588606 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3993/7893] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:35:05.150225 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:05.150814 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:05.157545 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:05.158047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:05.158499 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:05.159241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:05.159720 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:05.160158 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:05.294180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:05.302636 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5845e218-64a3-4a2a-af27-349b9d68852f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.156433 Oct 28 14:35:05.307998 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3901/7894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:05 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:06.326818 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:06.327524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:06.334237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:06.334724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:06.335187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:06.335873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:06.336332 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:06.336773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:06.472231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:06.479952 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-fb9d75c2-3847-453d-9cbf-ece009afed20 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.158228 Oct 28 14:35:06.480537 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3994/7895] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:06 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:07.502901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:07.503946 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:07.510724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:07.511301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:07.511750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:07.512477 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:07.512942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:07.513377 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:07.643172 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:07.650872 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35a3966d-0b3f-4937-8aaf-dfd21afc09a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.152033 Oct 28 14:35:07.651435 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3902/7896] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:07 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:08.673502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:08.679826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:08.679826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:08.681634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:08.682115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:08.682554 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:08.683264 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:08.683716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:08.684135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:08.814316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:08.822975 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a4fe044d-afd3-4c51-8c78-485637181d06 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.153401 Oct 28 14:35:08.823565 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3995/7897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:08 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:09.847075 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:09.847736 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:09.853955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:09.854456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:09.854942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:09.855644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:09.856116 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:09.856555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:09.985968 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:09.994110 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-347fa479-e633-4c52-a39b-4466944e38dc tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.150981 Oct 28 14:35:09.994679 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3903/7898] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:09 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:11.094879 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:11.095551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:11.098335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:11.103288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:11.103781 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:11.104245 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:11.104920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:11.105384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:11.105814 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:11.133567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-b5bd269d-3f84-45a3-a3f7-c15c0f749176 req-98a953fe-74e9-42dd-a048-067279037b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be48e24-833c-418b-9927-aea111dca26c", "name": "network-vif-plugged", "status": "completed", "tag": "0cbd4658-056b-4688-8e8c-a390eafe848a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:35:11.138493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:11.142837 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:11.150083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b5bd269d-3f84-45a3-a3f7-c15c0f749176 req-98a953fe-74e9-42dd-a048-067279037b10 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:11.150551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b5bd269d-3f84-45a3-a3f7-c15c0f749176 req-98a953fe-74e9-42dd-a048-067279037b10 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:11.151073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-b5bd269d-3f84-45a3-a3f7-c15c0f749176 req-98a953fe-74e9-42dd-a048-067279037b10 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:11.163145 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-b5bd269d-3f84-45a3-a3f7-c15c0f749176 req-98a953fe-74e9-42dd-a048-067279037b10 service nova] Creating event network-vif-plugged:0cbd4658-056b-4688-8e8c-a390eafe848a for instance 1be48e24-833c-418b-9927-aea111dca26c on n-h1-862876-2 Oct 28 14:35:11.169050 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-b5bd269d-3f84-45a3-a3f7-c15c0f749176 req-98a953fe-74e9-42dd-a048-067279037b10 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039010 Oct 28 14:35:11.169688 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3904/7899] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:35:11.267473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:11.276127 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ac87a9a0-380a-4b34-83d3-297e8afc499c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.185075 Oct 28 14:35:11.278790 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3996/7900] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:11 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:12.302145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:12.418397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:12.418397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:12.418397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:12.418397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:12.418397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:12.418397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:12.418397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:12.444682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:12.452549 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-04b5ca40-57d9-4c27-977e-da5a88f850c2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1390 microversion: 2.1 time: 0.156740 Oct 28 14:35:12.453128 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3905/7901] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:12 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:13.476802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:13.477476 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:13.484956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:13.485437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:13.485866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:13.486544 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:13.487020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:13.487438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:13.621459 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:13.629117 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6baa8acb-919a-4d11-b5e6-a5fba480c7a0 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1561 microversion: 2.1 time: 0.156203 Oct 28 14:35:13.629902 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3997/7902] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:13 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:13.652786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:13.653444 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:13.660858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:13.661355 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:13.661802 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:13.662496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:13.662987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:13.663423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:13.797796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:13.805573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-455ee90f-c415-4c0b-bd74-dac48ec3f24f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1561 microversion: 2.1 time: 0.156827 Oct 28 14:35:13.806163 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3906/7903] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:13 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:15.666077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:15.666700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:15.669105 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0d228387-03ab-4306-9fc8-b0f7ced285c7 req-2a0aab1b-e424-424d-b267-6215fc4fb142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be48e24-833c-418b-9927-aea111dca26c", "tag": "0cbd4658-056b-4688-8e8c-a390eafe848a"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:35:15.673809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:15.674485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:15.674965 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:15.676115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:15.676587 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:15.676745 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:15.677020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:15.680954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0d228387-03ab-4306-9fc8-b0f7ced285c7 req-2a0aab1b-e424-424d-b267-6215fc4fb142 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:15.686095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0d228387-03ab-4306-9fc8-b0f7ced285c7 req-2a0aab1b-e424-424d-b267-6215fc4fb142 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:15.686095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0d228387-03ab-4306-9fc8-b0f7ced285c7 req-2a0aab1b-e424-424d-b267-6215fc4fb142 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:15.695360 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0d228387-03ab-4306-9fc8-b0f7ced285c7 req-2a0aab1b-e424-424d-b267-6215fc4fb142 service nova] Creating event network-changed:0cbd4658-056b-4688-8e8c-a390eafe848a for instance 1be48e24-833c-418b-9927-aea111dca26c on n-h1-862876-2 Oct 28 14:35:15.701111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0d228387-03ab-4306-9fc8-b0f7ced285c7 req-2a0aab1b-e424-424d-b267-6215fc4fb142 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036119 Oct 28 14:35:15.702358 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3907/7904] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:35:15.898672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:15.909127 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c8a43afe-8e4c-4523-99a0-b78e0ca3fa92 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1561 microversion: 2.1 time: 0.246993 Oct 28 14:35:15.921016 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3998/7905] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:15 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1561 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:37.195538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=48 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:37.200168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:35:37.202546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:37.208953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:37.214207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:37.214207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:37.214207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:37.214207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:37.214207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:37.261989 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2982570a-1548-46c9-84f6-05c47f951f1c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action" status: 200 len: 24567 microversion: 2.1 time: 0.068131 Oct 28 14:35:37.262630 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3908/7906] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:35:37 2022] POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action => generated 24567 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 14:35:43.685556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0f626cfd-1567-4b73-a7f9-78aa20999f41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:35:43.687837 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=7 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:43.688496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=38 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:35:43.693287 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f626cfd-1567-4b73-a7f9-78aa20999f41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:43.693765 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f626cfd-1567-4b73-a7f9-78aa20999f41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:43.694199 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0f626cfd-1567-4b73-a7f9-78aa20999f41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:43.717322 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0f626cfd-1567-4b73-a7f9-78aa20999f41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Going to try to stop instance {{(pid=127793) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 14:35:43.857627 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0f626cfd-1567-4b73-a7f9-78aa20999f41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action" status: 202 len: 0 microversion: 2.1 time: 0.176421 Oct 28 14:35:43.858373 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 3999/7907] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:35:43 2022] POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:35:43.867365 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:43.868090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:43.877260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:43.877772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:43.878252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:43.879076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:43.879549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:43.879990 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:44.014117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:44.022573 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74fc61b0-7773-4f8a-b0fe-66c936dc5f4d tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.159908 Oct 28 14:35:44.023190 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3909/7908] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:43 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:45.046997 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:45.047702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:45.054835 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:45.055326 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:45.055769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:45.056465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:45.056922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:45.057350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:45.188642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:45.196462 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-48515e83-926b-4258-b5e0-b25890db4f16 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.153770 Oct 28 14:35:45.197036 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4000/7909] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:45 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:46.221028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:46.221648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:46.228484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:46.228978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:46.229423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:46.230118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:46.230588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:46.231049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:46.359381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:46.367170 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0478bc4e-9bdd-4043-b1f2-728fdb3d8458 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.150242 Oct 28 14:35:46.367736 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3910/7910] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:46 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:47.391221 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:47.391845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:47.399236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:47.399744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:47.400186 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:47.400874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:47.401335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:47.401760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:47.535487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:47.544110 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e12b1512-191c-4f76-85e5-698c6d2a72f3 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.156888 Oct 28 14:35:47.544709 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4001/7911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:47 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:48.567124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:48.567754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:48.575568 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:48.576070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:48.576518 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:48.577211 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:48.577675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:48.578107 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:48.712537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:48.720536 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aab31f5f-2a6c-4168-bc01-579adb41b1b9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.157433 Oct 28 14:35:48.721111 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3911/7912] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:48 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:49.743205 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:49.743782 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:49.750496 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:49.751013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:49.751446 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:49.752132 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:49.752589 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:49.753016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:49.879815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:49.888018 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2743f218-1b47-49a2-9da2-11386bbde2fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.148864 Oct 28 14:35:49.888592 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4002/7913] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:49 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:50.911936 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:50.912563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:50.919822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:50.920314 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:50.920835 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:50.921533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:50.922001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:50.922434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:51.053084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:51.061407 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-85ecea89-4ddd-4786-9a8a-f83b19375cba tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.153463 Oct 28 14:35:51.061983 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3912/7914] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:50 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:52.085379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:52.086025 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:52.093055 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:52.093541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:52.093979 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:52.094668 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:52.095155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:52.095582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:52.230260 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:52.237997 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-06bd53b2-3671-4274-864c-d72e38b9f423 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.156551 Oct 28 14:35:52.238574 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4003/7915] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:52 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:53.261690 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:53.262376 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:53.269152 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:53.269651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:53.270094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:53.270819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:53.271285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:53.271717 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:53.407132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:53.414931 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3007ec5a-a802-43ba-b915-1d3774ea840c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1689 microversion: 2.1 time: 0.157640 Oct 28 14:35:53.415518 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3913/7916] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:53 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:54.438829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:54.439447 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:54.446933 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:54.447404 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:54.447842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:54.448523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:54.448978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:54.449403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:54.579317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:54.587831 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f706b5c5-8955-4e5e-ba13-93d36abb07da tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1666 microversion: 2.1 time: 0.152992 Oct 28 14:35:54.588420 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4004/7917] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:54 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:55.679579 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:35:55.681804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:55.688709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:55.689203 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:55.689651 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:55.690342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:55.690833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:55.691268 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:55.740661 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0f56ad3b-e1d8-4e40-abb1-35bf0c0dafb4 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action" status: 200 len: 35768 microversion: 2.1 time: 0.064872 Oct 28 14:35:55.741542 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3914/7918] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:35:55 2022] POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action => generated 35768 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:35:55.753026 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d4363a3e-b202-413d-93a9-af78b130cba6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:35:55.760021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4363a3e-b202-413d-93a9-af78b130cba6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:55.760509 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4363a3e-b202-413d-93a9-af78b130cba6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:55.760946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d4363a3e-b202-413d-93a9-af78b130cba6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:55.783422 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d4363a3e-b202-413d-93a9-af78b130cba6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Going to try to start instance {{(pid=127793) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 14:35:55.971849 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d4363a3e-b202-413d-93a9-af78b130cba6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action" status: 202 len: 0 microversion: 2.1 time: 0.222518 Oct 28 14:35:55.972616 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4005/7919] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:35:55 2022] POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:35:55.981767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:55.982490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:55.990401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:55.990931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:55.991379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:55.992086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:55.992551 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:55.993018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:56.129549 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:56.138130 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-38ca5920-c62a-4ce8-a2d7-348cc8d286a9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1675 microversion: 2.1 time: 0.160941 Oct 28 14:35:56.138950 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3915/7920] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:55 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:35:57.163495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:57.164983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:57.171112 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:57.171600 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:57.172072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:57.172793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:57.173241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:57.173661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:57.314586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:57.322985 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7630d32c-c1a5-4dba-928c-f724b67dfe11 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1675 microversion: 2.1 time: 0.164588 Oct 28 14:35:57.323563 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4006/7921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:57 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:35:58.347035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:35:58.347667 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:35:58.355501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:58.356003 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:58.356454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:58.357156 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:35:58.357626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:35:58.358070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:35:58.487073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:35:58.494678 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c507cca2-90c9-464a-a2c1-3a6f2cfdee43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1679 microversion: 2.1 time: 0.151741 Oct 28 14:35:58.495268 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3916/7922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:35:58 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:20.689351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:20.691752 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:20.694135 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:20.694968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:20.700218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:20.700714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:20.701219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:20.701847 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:20.702304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:20.702730 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:20.757315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2b72cd6c-9cb0-4ce2-88db-98589370a5d7 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action" status: 200 len: 60331 microversion: 2.1 time: 0.071906 Oct 28 14:36:20.757997 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4007/7923] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:36:20 2022] POST /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c/action => generated 60331 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:36:28.125109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:28.125650 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:28.134177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=19 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:28.134531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=50 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:28.137104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:28.137873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:28.138405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:28.139227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:28.139822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:28.140331 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:28.168360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:36:28.190297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e8eb39d5-1914-4376-8876-8fa22792afbf req-2685056c-236e-4116-9805-47b51e9d5c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be48e24-833c-418b-9927-aea111dca26c", "tag": "0cbd4658-056b-4688-8e8c-a390eafe848a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:28.203006 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e8eb39d5-1914-4376-8876-8fa22792afbf req-2685056c-236e-4116-9805-47b51e9d5c99 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:28.203531 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e8eb39d5-1914-4376-8876-8fa22792afbf req-2685056c-236e-4116-9805-47b51e9d5c99 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:28.203972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e8eb39d5-1914-4376-8876-8fa22792afbf req-2685056c-236e-4116-9805-47b51e9d5c99 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:28.215569 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e8eb39d5-1914-4376-8876-8fa22792afbf req-2685056c-236e-4116-9805-47b51e9d5c99 service nova] Creating event network-changed:0cbd4658-056b-4688-8e8c-a390eafe848a for instance 1be48e24-833c-418b-9927-aea111dca26c on n-h1-862876-2 Oct 28 14:36:28.220749 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e8eb39d5-1914-4376-8876-8fa22792afbf req-2685056c-236e-4116-9805-47b51e9d5c99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097812 Oct 28 14:36:28.221449 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4008/7924] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:36:28.437374 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bbb7ccde-7af3-48e7-940b-4492b673d901 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 204 len: 0 microversion: 2.1 time: 0.316529 Oct 28 14:36:28.438133 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3917/7925] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:36:28 2022] DELETE /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:36:28.451425 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:28.453534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:28.460409 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:28.460921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:28.461367 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:28.462686 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:28.463258 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:28.463693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:28.612601 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:28.620649 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b18bdd6b-b164-4719-bc7c-9fa5f8a84b15 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1685 microversion: 2.1 time: 0.177926 Oct 28 14:36:28.621231 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4009/7926] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:28 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:29.645871 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:29.647307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:29.654178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:29.654671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:29.655153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:29.655896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:29.656397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:29.656833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:29.796582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:29.804354 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-16f27d38-cf9d-46ef-b058-70223e695c41 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1685 microversion: 2.1 time: 0.163076 Oct 28 14:36:29.804935 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3918/7927] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:29 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:30.766106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-6630b891-1cea-4c8a-be06-da77333457e3 req-9b9f65fa-415e-43b8-8b99-320d552c80a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be48e24-833c-418b-9927-aea111dca26c", "name": "network-vif-deleted", "tag": "0cbd4658-056b-4688-8e8c-a390eafe848a"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:30.776629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6630b891-1cea-4c8a-be06-da77333457e3 req-9b9f65fa-415e-43b8-8b99-320d552c80a9 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:30.782072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6630b891-1cea-4c8a-be06-da77333457e3 req-9b9f65fa-415e-43b8-8b99-320d552c80a9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:30.782072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-6630b891-1cea-4c8a-be06-da77333457e3 req-9b9f65fa-415e-43b8-8b99-320d552c80a9 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:30.791376 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-6630b891-1cea-4c8a-be06-da77333457e3 req-9b9f65fa-415e-43b8-8b99-320d552c80a9 service nova] Creating event network-vif-deleted:0cbd4658-056b-4688-8e8c-a390eafe848a for instance 1be48e24-833c-418b-9927-aea111dca26c on n-h1-862876-2 Oct 28 14:36:30.796113 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-6630b891-1cea-4c8a-be06-da77333457e3 req-9b9f65fa-415e-43b8-8b99-320d552c80a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Oct 28 14:36:30.796698 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4010/7928] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:36:30.829199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:30.829849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:30.837069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:30.837595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:30.838042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:30.838770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:30.839236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:30.839734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:31.168195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:31.176285 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a7be6cd8-7623-46dd-a53a-fa0d7b87bb43 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 200 len: 1500 microversion: 2.1 time: 0.351151 Oct 28 14:36:31.176878 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3919/7929] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:30 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 1500 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:36:32.202324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:32.203191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: 1be48e24-833c-418b-9927-aea111dca26c] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:32.209398 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:32.209886 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:32.210324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:32.211041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:32.211500 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:32.211925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:32.225324 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] HTTP exception thrown: Instance 1be48e24-833c-418b-9927-aea111dca26c could not be found. Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Request method failure captured: Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c HTTP/1.1 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-djbicO_a8uKRdhpmXjWnbohIhvTz7I2xrDCfnsBlJjItv72kC-Dlf1jQ6CrN_NjSoLrQU3-izIfqwaEmCdLEWpkPpF6UEp5A6IfEbu7s9Aylg3LxrCSZ6d3Lg4HM1zK7_BIZtKzPlTQTZHIP7y5JDOn4jAs-RBIoMG93zzjv2k6MY Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e36afd88e27a46f4b3f82a9fc63cfb09", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: 0297a20d29894a10b39125e80260a31b Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 1be48e24-833c-418b-9927-aea111dca26c could not be found. Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '1be48e24-833c-418b-9927-aea111dca26c'} Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be48e24-833c-418b-9927-aea111dca26c could not be found. Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be48e24-833c-418b-9927-aea111dca26c could not be found. Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:36:32.226951 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be48e24-833c-418b-9927-aea111dca26c could not be found. Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Returning 404 to user: Instance 1be48e24-833c-418b-9927-aea111dca26c could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e726fe20-4972-4c16-9337-83439ef56b5f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c" status: 404 len: 111 microversion: 2.1 time: 0.031766 Oct 28 14:36:32.232763 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4011/7930] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:32 2022] GET /compute/v2.1/servers/1be48e24-833c-418b-9927-aea111dca26c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:36:35.710351 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c693b7c1-1116-4689-bef0-9dd1593e6c1b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '.version_select at 0x7f27b83135e0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:35.775550 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c693b7c1-1116-4689-bef0-9dd1593e6c1b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1800054055" status: 202 len: 0 microversion: 2.1 time: 0.068941 Oct 28 14:36:35.776062 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3920/7931] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 14:36:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1800054055 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:36:35.809017 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-602205f6-83d7-4003-9cb5-8cb52abb51b6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: .version_select at 0x7f27b83ed550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1182285455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3UYQPHlVCkbzkaa0p1kenewk6gYGcB4u3GSHR98yUqw5TiQ3hkQ+MQ8MDpqFPTIerDID8cx8wgreuvNkH5ioH+rx43wBxymDwCIEO3idaA0gnQqodKrjdKojpkFb48xQ=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:35.825342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-602205f6-83d7-4003-9cb5-8cb52abb51b6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:36:35.831485 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-602205f6-83d7-4003-9cb5-8cb52abb51b6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:36:35.901426 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-602205f6-83d7-4003-9cb5-8cb52abb51b6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.096970 Oct 28 14:36:35.901969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4012/7932] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:36:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:36:43.661700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:43.667584 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-961213528", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "networks": [{"uuid": "c2a29a2d-60c4-49bf-9333-af396af0dcaf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1182285455", "security_groups": [{"name": "tempest-secgroup-smoke-1978227017"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:43.795231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] validate_networks() for [('c2a29a2d-60c4-49bf-9333-af396af0dcaf', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:36:44.210865 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:36:44.211307 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:36:44.211795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:36:44.212219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:36:44.212696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:36:44.221653 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:44.222151 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:44.222601 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:44.223378 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:44.223850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:44.224287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:44.241750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:36:44.247490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Getting quotas for user 0297a20d29894a10b39125e80260a31b and project e36afd88e27a46f4b3f82a9fc63cfb09. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:36:44.260372 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:36:44.262801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:36:44.389361 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35db9c19-060d-4a85-8e43-9d21514a7ea9 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731470 Oct 28 14:36:44.390238 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3921/7933] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:36:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:36:44.401913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-32031717-c956-4a9c-a43a-d05986746251 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:44.406666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-32031717-c956-4a9c-a43a-d05986746251 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:44.436593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=16 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:44.516460 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-32031717-c956-4a9c-a43a-d05986746251 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:44.519776 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-32031717-c956-4a9c-a43a-d05986746251 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1266 microversion: 2.1 time: 0.122093 Oct 28 14:36:44.520406 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4013/7934] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:44 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:45.549169 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:45.549806 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:45.560432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:45.564122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:45.564122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:45.564122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:45.564122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:45.564122 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:45.627727 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:45.636157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-653964e5-b929-48ae-bdc2-7fa7bc953fc8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1262 microversion: 2.1 time: 0.092122 Oct 28 14:36:45.636849 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3922/7935] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:45 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:46.660538 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:46.661149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:46.668599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:46.669091 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:46.669524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:46.670211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:46.670681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:46.671134 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:46.736884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:46.745242 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-27468f69-6c3d-4b3f-8f0e-8524ba91e878 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1318 microversion: 2.1 time: 0.088961 Oct 28 14:36:46.745823 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4014/7936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:46 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:47.768037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:47.768725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:47.776280 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:47.776788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:47.777463 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:47.778189 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:47.778661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:47.779130 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:47.847597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:47.855602 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-07804e37-fae4-42cf-9409-703c1b4d1f7f tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1324 microversion: 2.1 time: 0.091454 Oct 28 14:36:47.856184 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3923/7937] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:47 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1324 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:48.879735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:48.880341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:48.887436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:48.887931 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:48.888370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:48.889070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:48.889539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:48.889960 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:49.079036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:49.086711 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f04f705a-2340-44de-92ad-b94585b5f422 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1392 microversion: 2.1 time: 0.211029 Oct 28 14:36:49.087911 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4015/7938] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:48 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:49.174273 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-3949d815-49e8-4995-89c2-d924bdac8f9e req-e6cd68af-84b6-46b5-a122-979686844494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff6227-d769-4de5-8825-5efec3c6cf95", "tag": "23369076-9e5b-4a99-86b7-a7ac7b5e7393"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:49.184500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3949d815-49e8-4995-89c2-d924bdac8f9e req-e6cd68af-84b6-46b5-a122-979686844494 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:49.184988 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3949d815-49e8-4995-89c2-d924bdac8f9e req-e6cd68af-84b6-46b5-a122-979686844494 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:49.185433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-3949d815-49e8-4995-89c2-d924bdac8f9e req-e6cd68af-84b6-46b5-a122-979686844494 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:49.197111 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-3949d815-49e8-4995-89c2-d924bdac8f9e req-e6cd68af-84b6-46b5-a122-979686844494 service nova] Creating event network-changed:23369076-9e5b-4a99-86b7-a7ac7b5e7393 for instance ebff6227-d769-4de5-8825-5efec3c6cf95 on n-h2-862876-2 Oct 28 14:36:49.202488 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-3949d815-49e8-4995-89c2-d924bdac8f9e req-e6cd68af-84b6-46b5-a122-979686844494 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031947 Oct 28 14:36:49.203282 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3924/7939] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:36:50.110534 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:50.111203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:50.117952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:50.118418 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:50.118944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:50.119635 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:50.120084 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:50.120507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:50.249583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:50.257315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3939a8e2-0b12-486e-b554-113085ed05d6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1392 microversion: 2.1 time: 0.150862 Oct 28 14:36:50.257881 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4016/7940] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:50 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:51.281318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:51.282037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:51.288270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:51.289756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:51.289756 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:51.290042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:51.290359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:51.290818 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:51.423258 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:51.431046 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6d144849-3ce5-44eb-a31c-c0c2d31c357e tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1392 microversion: 2.1 time: 0.154792 Oct 28 14:36:51.431605 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3925/7941] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:51 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:52.454504 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:52.455160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:52.457815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:52.462492 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:52.463016 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:52.463456 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:52.464141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:52.464599 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:52.465020 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:52.594294 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:52.602047 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b09fa452-31fc-4bad-8124-3a301f2cab94 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1392 microversion: 2.1 time: 0.151386 Oct 28 14:36:52.602551 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4017/7942] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:52 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:53.485405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-dba70a27-4135-4ed1-9ec3-59a6fb7727e7 req-c67c13aa-334b-417c-a2a2-06af6ac6b0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff6227-d769-4de5-8825-5efec3c6cf95", "name": "network-vif-plugged", "status": "completed", "tag": "23369076-9e5b-4a99-86b7-a7ac7b5e7393"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:53.497386 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dba70a27-4135-4ed1-9ec3-59a6fb7727e7 req-c67c13aa-334b-417c-a2a2-06af6ac6b0db service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:53.497886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dba70a27-4135-4ed1-9ec3-59a6fb7727e7 req-c67c13aa-334b-417c-a2a2-06af6ac6b0db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:53.498332 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-dba70a27-4135-4ed1-9ec3-59a6fb7727e7 req-c67c13aa-334b-417c-a2a2-06af6ac6b0db service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:53.512215 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-dba70a27-4135-4ed1-9ec3-59a6fb7727e7 req-c67c13aa-334b-417c-a2a2-06af6ac6b0db service nova] Creating event network-vif-plugged:23369076-9e5b-4a99-86b7-a7ac7b5e7393 for instance ebff6227-d769-4de5-8825-5efec3c6cf95 on n-h2-862876-2 Oct 28 14:36:53.516444 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-dba70a27-4135-4ed1-9ec3-59a6fb7727e7 req-c67c13aa-334b-417c-a2a2-06af6ac6b0db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034859 Oct 28 14:36:53.517044 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3926/7943] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:36:53.625671 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:53.626309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:53.633242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:53.633735 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:53.634172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:53.634904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:53.635361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:53.635784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:53.769898 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:53.777699 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9b269b43-3646-48b9-9d07-41720afe9b98 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1392 microversion: 2.1 time: 0.156352 Oct 28 14:36:53.778283 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4018/7944] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:53 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:54.798391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:54.799241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:54.804113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:54.804830 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:54.811663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:54.814032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:54.814032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:54.814032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:54.814032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:54.814456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:54.950209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:54.957928 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-62a03e76-a641-4b19-a49b-ddffec6b5835 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1565 microversion: 2.1 time: 0.160545 Oct 28 14:36:54.958502 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3927/7945] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:54 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:54.980508 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:54.981145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:54.983065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:36:54.988700 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:54.989178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:54.989611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:54.990292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:54.990760 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:54.991209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:55.124983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:55.132766 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-472445e4-f414-41ef-bf40-5f040492cd2a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1565 microversion: 2.1 time: 0.156605 Oct 28 14:36:55.133346 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4019/7946] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:54 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:36:57.011209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:36:57.012017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:36:57.016013 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-97ce5e90-3329-4060-816b-7c19dad748a7 req-e43c39f7-5347-471b-8602-6ebe00b7d557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff6227-d769-4de5-8825-5efec3c6cf95", "tag": "23369076-9e5b-4a99-86b7-a7ac7b5e7393"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:36:57.019320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:57.020447 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:57.021101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:57.022097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:57.022597 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:57.023062 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:57.027071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-97ce5e90-3329-4060-816b-7c19dad748a7 req-e43c39f7-5347-471b-8602-6ebe00b7d557 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:36:57.027549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-97ce5e90-3329-4060-816b-7c19dad748a7 req-e43c39f7-5347-471b-8602-6ebe00b7d557 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:36:57.028171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-97ce5e90-3329-4060-816b-7c19dad748a7 req-e43c39f7-5347-471b-8602-6ebe00b7d557 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:36:57.040128 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-97ce5e90-3329-4060-816b-7c19dad748a7 req-e43c39f7-5347-471b-8602-6ebe00b7d557 service nova] Creating event network-changed:23369076-9e5b-4a99-86b7-a7ac7b5e7393 for instance ebff6227-d769-4de5-8825-5efec3c6cf95 on n-h2-862876-2 Oct 28 14:36:57.046248 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-97ce5e90-3329-4060-816b-7c19dad748a7 req-e43c39f7-5347-471b-8602-6ebe00b7d557 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033934 Oct 28 14:36:57.047809 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4020/7947] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:36:57.172483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:36:57.186305 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-92abdad8-74a5-4848-b207-3c73df734da8 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1565 microversion: 2.1 time: 0.179514 Oct 28 14:36:57.187157 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3928/7948] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:36:57 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:18.440687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:18.442958 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:18.445103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=7 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:18.445745 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=38 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:18.450566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:18.451072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:18.451506 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:18.452189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:18.452642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:18.453060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:18.504122 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d068dc61-dcca-4ade-9e0a-1b5a20de76ee tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action" status: 200 len: 24567 microversion: 2.1 time: 0.067816 Oct 28 14:37:18.504753 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4021/7949] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:37:18 2022] POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action => generated 24567 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:37:29.536719 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:29.537310 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:29.539749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:29.540456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=36 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:29.545844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:29.546342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:29.546815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:29.560000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:29.560000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:29.560000 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:29.571402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lazy-loading 'flavor' on Instance uuid ebff6227-d769-4de5-8825-5efec3c6cf95 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:37:29.829196 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6aa32d20-2f5b-40b2-bd26-d9af17981a10 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action" status: 202 len: 0 microversion: 2.1 time: 0.296327 Oct 28 14:37:29.829850 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3929/7950] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:37:29 2022] POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:37:29.839650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:29.840919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:29.843942 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:29.844596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=4 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:29.849672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:29.852303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:29.852303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:29.852303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:29.852303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:29.852303 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:29.996173 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:30.005288 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aaa37bb8-d956-47da-8bde-ceab40b74201 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1691 microversion: 2.1 time: 0.170759 Oct 28 14:37:30.005867 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4022/7951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:29 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:31.032168 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:31.032888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:31.039053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:31.039591 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:31.040045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:31.040749 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:31.041224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:31.041661 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:31.236237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:31.243973 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f6fcd592-6ead-43f0-9f03-7e9221b911fe tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1674 microversion: 2.1 time: 0.218205 Oct 28 14:37:31.244544 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3930/7952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:31 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:32.341913 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:32.344995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:32.353324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:32.353809 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:32.354244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:32.354972 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:32.355435 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:32.365393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:32.408338 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-557befde-0bf6-42b9-911a-9ee3f3f2d70a tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action" status: 200 len: 38415 microversion: 2.1 time: 0.070908 Oct 28 14:37:32.409004 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4023/7953] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:37:32 2022] POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action => generated 38415 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 14:37:32.422222 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:32.422815 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:32.429641 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:32.430174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:32.430629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:32.431375 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:32.431851 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:32.432298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:32.673668 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-69252a24-14f2-496b-b080-c821fca059cb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action" status: 202 len: 0 microversion: 2.1 time: 0.255839 Oct 28 14:37:32.674717 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3931/7954] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:37:32 2022] POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:37:32.684293 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:32.685081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:32.692090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:32.695187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:32.695187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:32.695187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:32.695187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:32.695187 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:32.851683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:32.862397 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2834d35-8ac6-4bda-8910-eb0a16dab672 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1680 microversion: 2.1 time: 0.182990 Oct 28 14:37:32.863076 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4024/7955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:32 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:33.887824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:33.888451 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:33.894594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:33.895128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:33.895581 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:33.896285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:33.896755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:33.897199 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:34.038034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:34.045924 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-ddb80078-886f-4025-ba33-a55cad5939fb tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1680 microversion: 2.1 time: 0.163872 Oct 28 14:37:34.046499 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3932/7956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:33 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:35.069764 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:35.070370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:35.078833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:35.079327 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:35.079767 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:35.083344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:35.083344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:35.083344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:35.216454 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:35.224189 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-43900b06-9e1f-48f9-ad1f-01e0374170a2 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1683 microversion: 2.1 time: 0.158720 Oct 28 14:37:35.224755 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4025/7957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:35 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:35.325781 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:35.327937 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:35.335002 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:35.335497 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:35.335942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:35.336644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:35.337109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:35.337542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:35.377665 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c754f0b3-67f8-4c89-a27f-13fecf7636f6 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action" status: 200 len: 38415 microversion: 2.1 time: 0.056339 Oct 28 14:37:35.378548 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3933/7958] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:37:35 2022] POST /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95/action => generated 38415 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 14:37:36.407392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:36.408471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:36.410068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7c0abc37-58fc-4832-b476-6c1a1fd1f8a8 req-2b7c54fd-6402-4736-8675-36552bb49164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff6227-d769-4de5-8825-5efec3c6cf95", "tag": "23369076-9e5b-4a99-86b7-a7ac7b5e7393"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:36.415442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:36.415953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:36.416632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:36.417333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:36.418001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:36.418436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:36.422402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7c0abc37-58fc-4832-b476-6c1a1fd1f8a8 req-2b7c54fd-6402-4736-8675-36552bb49164 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:36.423167 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7c0abc37-58fc-4832-b476-6c1a1fd1f8a8 req-2b7c54fd-6402-4736-8675-36552bb49164 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:36.423824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7c0abc37-58fc-4832-b476-6c1a1fd1f8a8 req-2b7c54fd-6402-4736-8675-36552bb49164 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:36.435418 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7c0abc37-58fc-4832-b476-6c1a1fd1f8a8 req-2b7c54fd-6402-4736-8675-36552bb49164 service nova] Creating event network-changed:23369076-9e5b-4a99-86b7-a7ac7b5e7393 for instance ebff6227-d769-4de5-8825-5efec3c6cf95 on n-h2-862876-2 Oct 28 14:37:36.440674 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7c0abc37-58fc-4832-b476-6c1a1fd1f8a8 req-2b7c54fd-6402-4736-8675-36552bb49164 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034770 Oct 28 14:37:36.441276 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3934/7959] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:37:36.458895 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:37:36.735743 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c2b0a62a-13de-4842-9d0e-9f254d2d0178 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 204 len: 0 microversion: 2.1 time: 0.332987 Oct 28 14:37:36.736828 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4026/7960] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:37:36 2022] DELETE /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 14:37:36.747480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:36.748216 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:36.754684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:36.755483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:36.756019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:36.756678 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:36.757393 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:36.758099 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:36.895467 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:36.903555 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8f7c51fe-8b12-4ea4-a437-f7290e37a28b tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1689 microversion: 2.1 time: 0.161787 Oct 28 14:37:36.904140 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3935/7961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:36 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:37.929359 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:37.930093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:37.936906 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:37.937384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:37.937824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:37.938593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:37.939078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:37.939512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:38.126551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:38.134341 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dcfbb6ff-89e2-4564-9aed-7103453885e5 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1689 microversion: 2.1 time: 0.209286 Oct 28 14:37:38.134942 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4027/7962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:37 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:38.792850 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-664a101c-8c75-4c83-a579-f8aefa80f08f req-dd0b9935-3883-4f43-b910-fbaaddff844c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff6227-d769-4de5-8825-5efec3c6cf95", "name": "network-vif-deleted", "tag": "23369076-9e5b-4a99-86b7-a7ac7b5e7393"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:38.803853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-664a101c-8c75-4c83-a579-f8aefa80f08f req-dd0b9935-3883-4f43-b910-fbaaddff844c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:38.804593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-664a101c-8c75-4c83-a579-f8aefa80f08f req-dd0b9935-3883-4f43-b910-fbaaddff844c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:38.804821 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-664a101c-8c75-4c83-a579-f8aefa80f08f req-dd0b9935-3883-4f43-b910-fbaaddff844c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:38.815804 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-664a101c-8c75-4c83-a579-f8aefa80f08f req-dd0b9935-3883-4f43-b910-fbaaddff844c service nova] Creating event network-vif-deleted:23369076-9e5b-4a99-86b7-a7ac7b5e7393 for instance ebff6227-d769-4de5-8825-5efec3c6cf95 on n-h2-862876-2 Oct 28 14:37:38.820893 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-664a101c-8c75-4c83-a579-f8aefa80f08f req-dd0b9935-3883-4f43-b910-fbaaddff844c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031751 Oct 28 14:37:38.821494 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3936/7963] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:37:39.158228 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:39.158884 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:39.165925 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:39.166414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:39.166889 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:39.167593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:39.168087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:39.168517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:39.201729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:39.202225 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:39.202662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:39.203143 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lazy-loading 'fault' on Instance uuid ebff6227-d769-4de5-8825-5efec3c6cf95 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:37:39.247709 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0297a20d29894a10b39125e80260a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36afd88e27a46f4b3f82a9fc63cfb09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:37:39.255402 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b374c627-ca23-4636-8b4d-ced290c90e01 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 200 len: 1356 microversion: 2.1 time: 0.101185 Oct 28 14:37:39.255978 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4028/7964] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:39 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:37:40.281084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:40.281896 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] [instance: ebff6227-d769-4de5-8825-5efec3c6cf95] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:37:40.288117 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:40.288618 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:40.289076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:40.289787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:37:40.290262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:37:40.290768 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:37:40.304912 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] HTTP exception thrown: Instance ebff6227-d769-4de5-8825-5efec3c6cf95 could not be found. Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Request method failure captured: Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 HTTP/1.1 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-djbicO_a8uKRdhpmXjWnbohIhvTz7I2xrDCfnsBlJjItv72kC-Dlf1jQ6CrN_NjSoLrQU3-izIfqwaEmCdLEWpkPpF6UEp5A6IfEbu7s9Aylg3LxrCSZ6d3Lg4HM1zK7_BIZtKzPlTQTZHIP7y5JDOn4jAs-RBIoMG93zzjv2k6MY Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e36afd88e27a46f4b3f82a9fc63cfb09", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e36afd88e27a46f4b3f82a9fc63cfb09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: e36afd88e27a46f4b3f82a9fc63cfb09 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2140094649 Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: 0297a20d29894a10b39125e80260a31b Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2140094649-project Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance ebff6227-d769-4de5-8825-5efec3c6cf95 could not be found. Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': 'ebff6227-d769-4de5-8825-5efec3c6cf95'} Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebff6227-d769-4de5-8825-5efec3c6cf95 could not be found. Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebff6227-d769-4de5-8825-5efec3c6cf95 could not be found. Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:37:40.306570 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebff6227-d769-4de5-8825-5efec3c6cf95 could not be found. Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Returning 404 to user: Instance ebff6227-d769-4de5-8825-5efec3c6cf95 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-284faacb-5e90-429b-a8ff-7c62a6e63733 tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95" status: 404 len: 111 microversion: 2.1 time: 0.032734 Oct 28 14:37:40.315454 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3937/7965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:37:40 2022] GET /compute/v2.1/servers/ebff6227-d769-4de5-8825-5efec3c6cf95 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:37:44.069866 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6b53e392-8ea6-41ea-a41a-809bc386235c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] Calling method '.version_select at 0x7f27b8140160>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:37:44.140678 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6b53e392-8ea6-41ea-a41a-809bc386235c tempest-TestNetworkAdvancedServerOps-2140094649 tempest-TestNetworkAdvancedServerOps-2140094649-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1182285455" status: 202 len: 0 microversion: 2.1 time: 0.074672 Oct 28 14:37:44.141277 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4029/7966] 10.222.0.25 () {58 vars in 1284 bytes} [Fri Oct 28 14:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1182285455 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:37:58.955615 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=18 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:58.956366 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:37:59.123259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-550e72ce-ae61-4a04-a963-cb5ed876e475 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'create', calling method: .version_select at 0x7f27b8545430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1532473216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo6ro+fsRoUu52ZlU9RR4y8Y96CFLFT12nYfnT411eIFMWhgzPh9rrcBRupWlj5xE5q+FU9sAXZwEhqpDvC07G+CF4PPGdjAslGLIbtg03EVKPbDaKWXzE+xTydrQQoTw=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:37:59.141791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-550e72ce-ae61-4a04-a963-cb5ed876e475 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for project 38003b5845c44c20a82490a2709c47dc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:37:59.147070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-550e72ce-ae61-4a04-a963-cb5ed876e475 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for user badca10c1163492a890ff636d10ba19b and project 38003b5845c44c20a82490a2709c47dc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:37:59.238121 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-550e72ce-ae61-4a04-a963-cb5ed876e475 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.288795 Oct 28 14:37:59.238787 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3938/7967] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:37:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:38:01.649223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:38:01.650133 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:38:01.651284 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:38:01.651446 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:38:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Oct 28 14:38:01.656978 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-904623653", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1532473216", "security_groups": [{"name": "tempest-secgroup-smoke-1762154755"}], "networks": [{"uuid": "ad8bb132-4c8f-4283-80a6-1a69b768e715"}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:38:01.889737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] validate_networks() for [('ad8bb132-4c8f-4283-80a6-1a69b768e715', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:38:02.369633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:38:02.370052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:38:02.370526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:38:02.371633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:38:02.372010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:38:02.380971 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:02.381437 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:02.381871 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:02.382583 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:02.383064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:02.383486 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:02.400983 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for project 38003b5845c44c20a82490a2709c47dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:38:02.406800 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for user badca10c1163492a890ff636d10ba19b and project 38003b5845c44c20a82490a2709c47dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:38:02.419648 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:38:02.422035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:38:02.542135 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ad31c903-77d2-44e7-bbb1-a1368ac64a38 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.894544 Oct 28 14:38:02.550363 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4030/7968] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:38:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:38:02.554939 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6954c896-916f-4c9a-b2c4-f48c53e0b7b3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:02.555822 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6954c896-916f-4c9a-b2c4-f48c53e0b7b3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:02.636909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6954c896-916f-4c9a-b2c4-f48c53e0b7b3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:02.648728 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6954c896-916f-4c9a-b2c4-f48c53e0b7b3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1246 microversion: 2.1 time: 0.096977 Oct 28 14:38:02.649836 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3939/7969] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:02 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:38:03.674028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-38b7ab6e-8c19-498a-b0e7-6a0cda6a53f8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:03.674639 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-38b7ab6e-8c19-498a-b0e7-6a0cda6a53f8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:03.732687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-38b7ab6e-8c19-498a-b0e7-6a0cda6a53f8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:03.739737 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-38b7ab6e-8c19-498a-b0e7-6a0cda6a53f8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1246 microversion: 2.1 time: 0.070582 Oct 28 14:38:03.740466 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4031/7970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:03 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:04.763999 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:04.764528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:04.771985 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:04.772484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:04.772932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:04.773630 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:04.774097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:04.774540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:04.838698 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:04.846974 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-adc35c68-6e33-4d7b-b069-9b98670d03d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1298 microversion: 2.1 time: 0.087557 Oct 28 14:38:04.847552 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3940/7971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:04 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:05.869948 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:05.870560 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:05.878316 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:05.878934 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:05.879375 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:05.880080 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:05.880529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:05.880946 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:06.022123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:06.030613 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ccac3079-4ec4-4f4c-bc0b-5c494c99668a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1372 microversion: 2.1 time: 0.164845 Oct 28 14:38:06.031241 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4032/7972] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:05 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:06.623092 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-418991db-1671-4b2e-8c27-356135151d44 req-706fc10c-6d30-47a6-9c7f-0bd2f68d9040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:38:06.634849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-418991db-1671-4b2e-8c27-356135151d44 req-706fc10c-6d30-47a6-9c7f-0bd2f68d9040 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:06.635474 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-418991db-1671-4b2e-8c27-356135151d44 req-706fc10c-6d30-47a6-9c7f-0bd2f68d9040 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:06.636022 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-418991db-1671-4b2e-8c27-356135151d44 req-706fc10c-6d30-47a6-9c7f-0bd2f68d9040 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:06.651315 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-418991db-1671-4b2e-8c27-356135151d44 req-706fc10c-6d30-47a6-9c7f-0bd2f68d9040 service nova] Creating event network-changed:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h1-862876-2 Oct 28 14:38:06.656944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-418991db-1671-4b2e-8c27-356135151d44 req-706fc10c-6d30-47a6-9c7f-0bd2f68d9040 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037742 Oct 28 14:38:06.657566 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3941/7973] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:38:07.053896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:07.054516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:07.062684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:07.063346 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:07.063892 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:07.064685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:07.065502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:07.066023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:07.197043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:07.205476 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eb5083fb-be3d-4fb4-bfe4-e75cc5d48297 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1372 microversion: 2.1 time: 0.155584 Oct 28 14:38:07.206060 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4033/7974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:07 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:08.229452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:08.230180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:08.237713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:08.238212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:08.238660 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:08.239390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:08.239858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:08.240295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:08.381533 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:08.389919 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0320716a-b3ca-464e-a3e5-ad00f0794c69 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1372 microversion: 2.1 time: 0.164896 Oct 28 14:38:08.390496 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3942/7975] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:08 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:09.414970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:09.415552 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:09.423569 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:09.424053 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:09.424480 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:09.425156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:09.425602 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:09.426023 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:09.560317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:09.567990 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5893e94-1446-40a8-937d-6cdbe9a6a6bc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1372 microversion: 2.1 time: 0.157009 Oct 28 14:38:09.568564 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4034/7976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:09 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:10.591559 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:10.592646 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:10.599318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:10.599838 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:10.600287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:10.601078 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:10.601552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:10.602019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:10.741823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:10.749741 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a753075d-c68d-4305-96c3-be21e18e2133 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1372 microversion: 2.1 time: 0.162059 Oct 28 14:38:10.750336 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3943/7977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:10 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:11.772395 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:11.773018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:11.779878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:11.780368 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:11.780807 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:11.781495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:11.781955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:11.782384 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:11.915239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:11.923533 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-aabac422-df53-4b74-a8a4-2ae3c0023af7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1372 microversion: 2.1 time: 0.155055 Oct 28 14:38:11.924104 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4035/7978] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:11 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:12.075583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-6ff6bb78-7f14-446e-8e8a-ca0a3433895c req-642af8b9-039a-4f88-b571-f32e4c664f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "name": "network-vif-plugged", "status": "completed", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:38:12.085872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ff6bb78-7f14-446e-8e8a-ca0a3433895c req-642af8b9-039a-4f88-b571-f32e4c664f06 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:12.086360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ff6bb78-7f14-446e-8e8a-ca0a3433895c req-642af8b9-039a-4f88-b571-f32e4c664f06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:12.086833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-6ff6bb78-7f14-446e-8e8a-ca0a3433895c req-642af8b9-039a-4f88-b571-f32e4c664f06 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:12.098052 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-6ff6bb78-7f14-446e-8e8a-ca0a3433895c req-642af8b9-039a-4f88-b571-f32e4c664f06 service nova] Creating event network-vif-plugged:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h1-862876-2 Oct 28 14:38:12.103164 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-6ff6bb78-7f14-446e-8e8a-ca0a3433895c req-642af8b9-039a-4f88-b571-f32e4c664f06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Oct 28 14:38:12.103745 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3944/7979] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:38:12.946773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:12.947407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:12.949873 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:38:12.955575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:12.959998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:12.959998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:12.959998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:12.959998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:12.959998 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:13.093665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:13.101386 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a46e5b33-8e85-46bc-977e-6ca025932b5e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1372 microversion: 2.1 time: 0.158939 Oct 28 14:38:13.102073 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4036/7980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:12 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:14.125401 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:14.126039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:14.128010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:38:14.133741 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:14.134238 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:14.134685 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:14.135402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:14.135869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:14.136303 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:14.270292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:14.278704 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-63f93f70-5537-4035-85b8-8dd7c67607fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1556 microversion: 2.1 time: 0.158270 Oct 28 14:38:14.279310 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3945/7981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:14 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:14.306571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:38:14.307223 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:38:14.309795 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=8 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:38:14.315495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:14.315985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:14.316426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:14.317121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:14.317574 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:14.318009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:14.447495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:38:14.455361 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9d7a128a-aded-483a-9c9b-8a5704f4131a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1556 microversion: 2.1 time: 0.152801 Oct 28 14:38:14.455948 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4037/7982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:38:14 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:38:16.663629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-f8694faf-4d11-469b-9a82-81cebcd22fdd req-67444b41-09e0-41b9-85ca-fb115d651ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:38:16.674583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f8694faf-4d11-469b-9a82-81cebcd22fdd req-67444b41-09e0-41b9-85ca-fb115d651ff1 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:38:16.675035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f8694faf-4d11-469b-9a82-81cebcd22fdd req-67444b41-09e0-41b9-85ca-fb115d651ff1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:38:16.675478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-f8694faf-4d11-469b-9a82-81cebcd22fdd req-67444b41-09e0-41b9-85ca-fb115d651ff1 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:38:16.686779 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-f8694faf-4d11-469b-9a82-81cebcd22fdd req-67444b41-09e0-41b9-85ca-fb115d651ff1 service nova] Creating event network-changed:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h1-862876-2 Oct 28 14:38:16.692071 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-f8694faf-4d11-469b-9a82-81cebcd22fdd req-67444b41-09e0-41b9-85ca-fb115d651ff1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032290 Oct 28 14:38:16.692694 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3946/7983] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:40:10.690181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:10.691032 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=38 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:10.692688 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 14:40:10.693966 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:40:10.694092 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:40:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0/action (ip 10.222.0.25) !!! Oct 28 14:40:10.700212 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:40:10.709537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:10.709537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:10.709537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:10.709537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:10.710007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:10.710226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:10.710650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:10.737996 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lazy-loading 'flavor' on Instance uuid 9c84cc30-5a7a-44ae-b488-420b51df2ea0 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:40:11.242413 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-6361502d-561c-406f-8c6c-97c7b04ac71c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0/action" status: 202 len: 0 microversion: 2.1 time: 0.553993 Oct 28 14:40:11.243073 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4038/7984] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:40:10 2022] POST /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:40:11.250389 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:40:11.251254 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:40:11.251875 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:11.252635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=30 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:11.254039 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 14:40:11.256688 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:40:11.256829 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 (ip 10.222.0.25) !!! Oct 28 14:40:11.261636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:11.263053 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:11.274281 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:11.274834 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:11.275292 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:11.276010 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:11.276488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:11.276935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:11.412174 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:11.419985 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2c7c5da6-30e6-4bfe-8d10-91cb217c82ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.171774 Oct 28 14:40:11.420560 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3947/7985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:11 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:40:12.446603 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:12.524646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:12.524646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:12.524646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:12.524646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:12.524646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:12.524646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:12.524646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:12.597378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:12.605100 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-77e4441d-efd7-424e-aa06-872f60fd0cff tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.164889 Oct 28 14:40:12.605669 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4039/7986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:12 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:13.629454 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:13.630687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:13.640350 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:13.640852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:13.641305 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:13.642017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:13.642485 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:13.643437 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:13.648009 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56278. Oct 28 14:40:13.650239 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56276. Oct 28 14:40:13.779783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:13.787772 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-389ac805-1fb4-4ac9-967a-8c3f59012d56 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.162616 Oct 28 14:40:13.789520 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3948/7987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:13 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:14.811768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:14.812411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:14.820086 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:14.820689 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:14.821130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:14.821819 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:14.822282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:14.822729 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:14.952319 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:14.960189 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f50869a0-bb12-4854-8583-0d2107377d74 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.152325 Oct 28 14:40:14.960771 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4040/7988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:14 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:15.984675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:15.985308 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:15.992575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:15.993070 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:15.993516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:15.994209 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:15.994675 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:15.995136 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:16.126541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:16.134930 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74003281-b8d3-484b-bf4f-7a1d93d381f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.154464 Oct 28 14:40:16.135524 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3949/7989] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:15 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:17.157357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:17.157977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:17.164867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:17.165350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:17.165785 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:17.166469 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:17.166955 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:17.167380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:17.297255 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:17.305335 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3322352c-4b16-4c20-886d-4f10fb625041 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.151842 Oct 28 14:40:17.307693 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4041/7990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:17 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:18.329624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:18.330217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:18.337623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:18.338128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:18.338578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:18.339311 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:18.339783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:18.340220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:18.471228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:18.479554 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-74549c9c-25b4-4508-9d57-994238250379 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.153988 Oct 28 14:40:18.480131 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3950/7991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:18 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:19.503414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:19.504038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:19.511501 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:19.511995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:19.512438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:19.513152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:19.513611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:19.514040 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:19.650498 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:19.658534 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7066db53-5c62-4b89-81dc-9d377b5893d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.159424 Oct 28 14:40:19.659135 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4042/7992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:19 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:20.681475 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:20.682115 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:20.688914 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:20.689419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:20.689872 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:20.690575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:20.691080 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:20.691520 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:20.822592 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:20.830469 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-600e5d1a-e67e-45d4-b347-fb8babc7914f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.152893 Oct 28 14:40:20.831079 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3951/7993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:20 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:21.855380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:21.855928 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:21.862836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:21.863323 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:21.863759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:21.864441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:21.865526 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:21.865968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:21.995592 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:22.003431 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-dc5c3f5a-31bb-47b7-87f1-90ef650a282b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1701 microversion: 2.1 time: 0.152108 Oct 28 14:40:22.004009 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4043/7994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:21 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:23.027446 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:23.028028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:23.034901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:23.035391 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:23.035846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:23.036552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:23.037073 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:23.037543 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:23.167894 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:23.175590 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-55500cbe-fccd-4b94-99fc-fd02251144ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1701 microversion: 2.1 time: 0.152220 Oct 28 14:40:23.176159 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3952/7995] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:23 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:24.199737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:24.200356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:24.207099 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:24.207580 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:24.208011 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:24.209342 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:24.209797 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:24.210216 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:24.352119 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:24.360013 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-4f455472-e406-4160-920e-43e143df9502 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.164184 Oct 28 14:40:24.360591 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4044/7996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:24 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:24.683891 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-7aa7489b-8cab-4713-bc3a-18abe602e395 req-3743f52a-9297-4f5c-886e-9e0e2dafacd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "name": "network-vif-plugged", "status": "completed", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:40:24.694602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7aa7489b-8cab-4713-bc3a-18abe602e395 req-3743f52a-9297-4f5c-886e-9e0e2dafacd2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:24.695267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7aa7489b-8cab-4713-bc3a-18abe602e395 req-3743f52a-9297-4f5c-886e-9e0e2dafacd2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:24.695782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-7aa7489b-8cab-4713-bc3a-18abe602e395 req-3743f52a-9297-4f5c-886e-9e0e2dafacd2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:24.710121 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-7aa7489b-8cab-4713-bc3a-18abe602e395 req-3743f52a-9297-4f5c-886e-9e0e2dafacd2 service nova] Creating event network-vif-plugged:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h1-862876-2 Oct 28 14:40:24.714038 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-7aa7489b-8cab-4713-bc3a-18abe602e395 req-3743f52a-9297-4f5c-886e-9e0e2dafacd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096086 Oct 28 14:40:24.714975 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3953/7997] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:40:25.392694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:25.392694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:25.399651 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:25.400283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:25.400724 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:25.401794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:25.402253 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:25.402953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:25.558923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:25.567972 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-047dce31-b5db-4b1a-9334-c88386ca6992 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.182292 Oct 28 14:40:25.569344 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4045/7998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:25 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:26.594301 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:26.595141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:26.602948 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:26.603863 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:26.604397 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:26.605374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:26.605922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:26.606441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:26.765984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:26.775221 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a95fe108-0e16-44f5-9acc-3f8e0ce694ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.186567 Oct 28 14:40:26.790780 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3954/7999] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:26 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:27.802523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:27.803803 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:27.810120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:27.810613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:27.811078 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:27.811806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:27.812267 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:27.812845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:27.972763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:27.981506 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f4bc5d5d-e587-4711-8c01-c0cdf3c2e533 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.186839 Oct 28 14:40:27.996258 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4046/8000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:27 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:29.005566 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:29.006193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:29.014045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:29.018819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:29.018819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:29.018819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:29.018819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:29.018819 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:29.170550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:29.179046 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-41ef09d4-451c-444a-8cba-6dcf49f553ea tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.177710 Oct 28 14:40:29.179649 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3955/8001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:29 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:30.202896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:30.204310 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:30.212072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:30.212586 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:30.213147 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:30.213848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:30.214304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:30.214732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:30.365511 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:30.373532 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-5bafc5b9-63e9-4845-87cb-9b297b38e2f5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.174822 Oct 28 14:40:30.374103 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4047/8002] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:30 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:31.398880 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:31.399524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:31.406971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:31.407480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:31.407940 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:31.408662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:31.409132 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:31.409752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:31.571212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:31.579967 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e14d8ea-5f4b-419f-971f-111cd58254d4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.185004 Oct 28 14:40:31.581134 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3956/8003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:31 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:32.606042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:32.606662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:32.613695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:32.614185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:32.614613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:32.615413 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:32.615862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:32.616282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:32.790348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:32.800714 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1d068a17-32eb-4fe9-8d6f-48b3715d0648 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.198965 Oct 28 14:40:32.801413 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4048/8004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:32 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:40:33.824204 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:33.824833 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:33.831905 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:33.832407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:33.832861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:33.834083 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:33.834640 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:33.835102 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:33.986283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:33.995587 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c07e5779-838f-4613-9d10-ca72cbd72788 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.175237 Oct 28 14:40:34.011274 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3957/8005] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:33 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:35.020878 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:35.022100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:35.028992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:35.029471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:35.029899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:35.030577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:35.031060 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:35.031488 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:35.164537 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:35.172232 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-addecbfb-5ec5-4e5b-a29d-40a25aca23ed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1696 microversion: 2.1 time: 0.155243 Oct 28 14:40:35.172806 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4049/8006] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:35 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:36.196713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:36.197381 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:36.204176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:36.204679 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:36.205140 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:36.205849 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:36.206326 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:36.206794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:36.335327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:36.343040 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-125acbed-d24f-4cae-a8d0-1adbbf357b0f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1678 microversion: 2.1 time: 0.150905 Oct 28 14:40:36.343623 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3958/8007] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:36 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:37.367301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:37.367919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:37.374991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:37.375481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:37.375915 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:37.376640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:37.377096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:37.377518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:37.515043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:37.523055 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-23e40029-ac70-4531-9566-ec61924f0dfc tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1678 microversion: 2.1 time: 0.160290 Oct 28 14:40:37.523659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4050/8008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:37 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:38.546714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:38.546714 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:38.553621 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:38.554119 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:38.554590 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:38.555335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:38.555808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:38.556241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:38.646008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-78ef4c70-6520-4daf-9ac2-661123030f8c req-65717945-11b6-46d7-9018-eed5b888855f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "name": "network-vif-unplugged", "status": "completed", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:40:38.657856 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-78ef4c70-6520-4daf-9ac2-661123030f8c req-65717945-11b6-46d7-9018-eed5b888855f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:38.660514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-78ef4c70-6520-4daf-9ac2-661123030f8c req-65717945-11b6-46d7-9018-eed5b888855f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:38.660514 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-78ef4c70-6520-4daf-9ac2-661123030f8c req-65717945-11b6-46d7-9018-eed5b888855f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:38.671172 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.compute.server_external_events [req-78ef4c70-6520-4daf-9ac2-661123030f8c req-65717945-11b6-46d7-9018-eed5b888855f service nova] Unable to find a host for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0. Dropping event network-vif-unplugged {{(pid=127793) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 14:40:38.672157 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-78ef4c70-6520-4daf-9ac2-661123030f8c req-65717945-11b6-46d7-9018-eed5b888855f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030207 Oct 28 14:40:38.672869 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4051/8009] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 14:40:38.698419 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:38.707177 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a4aa9564-c6e9-49b6-bfca-f9afdc4ad058 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1621 microversion: 2.1 time: 0.165435 Oct 28 14:40:38.707765 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3959/8010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:38 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1621 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:38.730590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:40:38.731209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:38.737214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:38.737694 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:38.738126 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:38.738829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:38.739304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:38.739726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:38.786065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127793) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 14:40:38.888072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:39.068249 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7a368bb2-b459-4ca9-bd58-d04fbed6c2cd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0/action" status: 202 len: 0 microversion: 2.1 time: 0.341393 Oct 28 14:40:39.069019 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4052/8011] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:40:38 2022] POST /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:40:39.077150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:39.077785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:39.083723 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:39.084785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:39.085236 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:39.085962 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:39.086409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:39.086869 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:39.220409 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:39.228897 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c1f55667-ed6d-4be2-ad40-6f6c4e952b7f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1629 microversion: 2.1 time: 0.155665 Oct 28 14:40:39.229474 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3960/8012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:39 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1629 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:40.252527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:40.253107 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:40.260154 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:40.260629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:40.261058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:40.261736 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:40.262191 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:40.262608 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:40.395036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:40.403288 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b9c61599-0d4f-48e5-80ad-056f4fea63f7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1629 microversion: 2.1 time: 0.154716 Oct 28 14:40:40.406422 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4053/8013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:40 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1629 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:41.427552 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:41.428226 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:41.435205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:41.435711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:41.436166 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:41.436874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:41.437348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:41.437793 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:41.441921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=81 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:41.575602 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:41.583424 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-667c3154-c5d6-41a2-9920-69480822c074 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.159828 Oct 28 14:40:41.584608 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3961/8014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:41 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:42.014617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-7f53aa0e-3770-4158-b1e0-0c86c390f4fc req-0547ef8e-dc03-48e6-b1f9-7fc3738cb838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:40:42.020300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:42.025523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7f53aa0e-3770-4158-b1e0-0c86c390f4fc req-0547ef8e-dc03-48e6-b1f9-7fc3738cb838 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:42.026001 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7f53aa0e-3770-4158-b1e0-0c86c390f4fc req-0547ef8e-dc03-48e6-b1f9-7fc3738cb838 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:42.026467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-7f53aa0e-3770-4158-b1e0-0c86c390f4fc req-0547ef8e-dc03-48e6-b1f9-7fc3738cb838 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:42.038420 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-7f53aa0e-3770-4158-b1e0-0c86c390f4fc req-0547ef8e-dc03-48e6-b1f9-7fc3738cb838 service nova] Creating event network-changed:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h2-862876-2 Oct 28 14:40:42.043555 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-7f53aa0e-3770-4158-b1e0-0c86c390f4fc req-0547ef8e-dc03-48e6-b1f9-7fc3738cb838 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092750 Oct 28 14:40:42.044170 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4054/8015] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:40:42.606978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:42.608908 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:42.617208 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:42.617867 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:42.618317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:42.619405 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:42.619879 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:42.620322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:42.770029 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:42.778607 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-761c423b-2736-4c04-a507-6c2eeb34e1f3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.175520 Oct 28 14:40:42.779262 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3962/8016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:42 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:43.805779 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:43.806551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:43.813100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:43.813596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:43.814041 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:43.814754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:43.815283 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:43.818888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:43.959794 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:43.967760 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-67f9c51b-777f-40e9-ba16-6b6ea43c26ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.168759 Oct 28 14:40:43.968335 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4055/8017] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:43 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:44.994562 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:44.996019 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:44.998767 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=33 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:40:45.004537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:45.005385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:45.006725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:45.007748 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:45.008462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:45.009135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:45.164786 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:45.173632 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-96a59357-1c09-4708-918b-c8ef7ab258fe tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.184726 Oct 28 14:40:45.174226 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3963/8018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:44 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:46.198769 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:46.199479 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:46.206619 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:46.207136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:46.207621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:46.208352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:46.208815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:46.209858 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:46.348035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:46.356187 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-19f45349-06f1-4690-9772-ee0fbb9a8fc6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.161397 Oct 28 14:40:46.357417 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4056/8019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:46 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:47.383654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:47.385320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:47.394146 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:47.395038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:47.395498 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:47.396227 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:47.396702 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:47.397145 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:47.541192 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:47.549110 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5721f193-9c12-46e6-9372-680718567380 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.171557 Oct 28 14:40:47.549690 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3964/8020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:47 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:40:48.574345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:48.575049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:48.583124 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:48.583611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:48.584685 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:48.585378 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:48.585842 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:48.586268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:48.794953 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:48.794953 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-66c795e6-c44f-4e84-a6af-35c2e2b28469 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.175033 Oct 28 14:40:48.794953 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4057/8021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:48 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:49.822554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:49.822554 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:49.826269 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:49.826906 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:49.827458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:49.828228 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:49.828775 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:49.829294 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:49.967259 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:49.975369 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-00f99c2c-4555-4bb6-8b92-e52e2ecfb1de tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.161803 Oct 28 14:40:49.975934 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3965/8022] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:49 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:51.000209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:51.001072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:51.009352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:51.009863 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:51.012515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:51.012515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:51.012515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:51.012515 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:51.157665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:51.166062 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d7921710-b822-4873-898f-e787a655f4dd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.170713 Oct 28 14:40:51.166639 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4058/8023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:50 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:52.189486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:52.190103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:52.196934 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:52.197434 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:52.197886 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:52.198593 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:52.199088 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:52.199529 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:52.331014 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:52.338809 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-7a85e682-48e8-47a8-a576-33e126124781 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.153242 Oct 28 14:40:52.339380 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3966/8024] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:52 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:53.364394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:53.365042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:53.371754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:53.372233 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:53.372662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:53.373345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:53.373793 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:53.374211 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:53.507995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:53.515936 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ff822c8f-2ade-4afb-9ed7-3889f7725948 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.155499 Oct 28 14:40:53.516495 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4059/8025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:53 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:54.540398 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:54.541038 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:54.548006 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:54.548505 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:54.548952 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:54.549654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:54.550118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:54.550575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:54.685747 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:54.693522 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8276231d-0fa6-4019-be1f-eadfe306bf78 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.157714 Oct 28 14:40:54.694099 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3967/8026] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:54 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:55.717424 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:55.718034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:55.725920 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:55.726399 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:55.726872 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:55.727549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:55.727999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:55.728416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:55.860471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:55.868944 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e9843762-744e-485e-b231-0468b67ae353 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.155452 Oct 28 14:40:55.869520 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4060/8027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:55 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:56.864684 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-e6af4c3b-a805-4467-9be8-944a06547572 req-5b6bbb18-a029-411c-a5b8-f3e4baa649e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "name": "network-vif-plugged", "status": "completed", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:40:56.877367 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e6af4c3b-a805-4467-9be8-944a06547572 req-5b6bbb18-a029-411c-a5b8-f3e4baa649e5 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:56.877900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e6af4c3b-a805-4467-9be8-944a06547572 req-5b6bbb18-a029-411c-a5b8-f3e4baa649e5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:56.878339 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-e6af4c3b-a805-4467-9be8-944a06547572 req-5b6bbb18-a029-411c-a5b8-f3e4baa649e5 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:56.890060 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-e6af4c3b-a805-4467-9be8-944a06547572 req-5b6bbb18-a029-411c-a5b8-f3e4baa649e5 service nova] Creating event network-vif-plugged:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h2-862876-2 Oct 28 14:40:56.895002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:56.895002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:56.895607 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-e6af4c3b-a805-4467-9be8-944a06547572 req-5b6bbb18-a029-411c-a5b8-f3e4baa649e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035118 Oct 28 14:40:56.896020 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3968/8028] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:40:56.901904 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:56.902394 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:56.902855 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:56.903577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:56.904046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:56.904687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:57.051162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:57.059174 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-46e1c27e-4e1a-44db-b1b4-cdd3e7bb10e2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.171242 Oct 28 14:40:57.059752 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4061/8029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:56 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:40:58.084957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:58.085721 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:58.093261 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:58.093773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:58.094671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:58.095407 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:58.097202 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:58.097652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:58.241267 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:58.249913 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fd2dd8fc-63b8-4189-9840-35ab9f9c610f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.170089 Oct 28 14:40:58.250499 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3969/8030] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:58 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:40:59.273507 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:40:59.274044 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:40:59.280813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:59.285392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:59.285392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:59.285392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:40:59.285392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:40:59.285392 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:40:59.419070 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:40:59.426703 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0dc57306-96c0-4b37-a105-3876d188a974 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1687 microversion: 2.1 time: 0.157252 Oct 28 14:40:59.427795 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4062/8031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:40:59 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:41:00.451272 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:41:00.451900 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:41:00.458693 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:41:00.459217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:41:00.459662 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:41:00.460362 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:41:00.460827 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:41:00.461263 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:41:00.593796 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:41:00.602374 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-134543f5-ecbb-4afe-b655-69b11a66b7fd tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1674 microversion: 2.1 time: 0.154984 Oct 28 14:41:00.602975 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3970/8032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:41:00 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:11.524198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:11.525396 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:11.527689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=15 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:11.528153 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=17 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:11.529028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:11.529184 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=55 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:11.538551 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:11.539453 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:11.539970 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:11.540883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:11.541520 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:11.542121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:11.573545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Going to try to terminate instance {{(pid=127793) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:42:11.610515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-0f7820f6-81b2-4a07-861e-2eff38e87f4c req-4bdfeccd-35aa-48b2-85fb-20c606754f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:42:11.620298 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0f7820f6-81b2-4a07-861e-2eff38e87f4c req-4bdfeccd-35aa-48b2-85fb-20c606754f74 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:11.625762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0f7820f6-81b2-4a07-861e-2eff38e87f4c req-4bdfeccd-35aa-48b2-85fb-20c606754f74 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:11.625762 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-0f7820f6-81b2-4a07-861e-2eff38e87f4c req-4bdfeccd-35aa-48b2-85fb-20c606754f74 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:11.633643 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-0f7820f6-81b2-4a07-861e-2eff38e87f4c req-4bdfeccd-35aa-48b2-85fb-20c606754f74 service nova] Creating event network-changed:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h2-862876-2 Oct 28 14:42:11.638394 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-0f7820f6-81b2-4a07-861e-2eff38e87f4c req-4bdfeccd-35aa-48b2-85fb-20c606754f74 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116553 Oct 28 14:42:11.639042 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3971/8033] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:42:11.836183 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-1797c554-4dfb-4dc0-9721-840f01b31e19 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 204 len: 0 microversion: 2.1 time: 0.317128 Oct 28 14:42:11.836927 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4063/8034] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:42:11 2022] DELETE /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:42:11.846546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:11.847573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:11.854069 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:11.854582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:11.855063 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:11.855882 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:11.856427 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:11.856873 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:11.996200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:12.004963 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-df861e0b-5bf6-4b6c-9d9a-814d903b9bd8 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.162884 Oct 28 14:42:12.005772 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3972/8035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:11 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:13.029416 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:13.030268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:13.037813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:13.038304 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:13.038833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:13.039545 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:13.040008 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:13.040436 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:13.208636 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:13.215445 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-eaa42ca9-ecdd-49a4-8573-394298a4f2e1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1680 microversion: 2.1 time: 0.190405 Oct 28 14:42:13.216027 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4064/8036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:13 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:13.653408 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-aa1acdcc-504b-4deb-821b-3ad327e97413 req-6c40c7c9-01a1-4bf6-a5b4-977485aa4f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c84cc30-5a7a-44ae-b488-420b51df2ea0", "name": "network-vif-deleted", "tag": "0050e291-85af-49e7-b589-57cad9b5e875"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:42:13.663045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aa1acdcc-504b-4deb-821b-3ad327e97413 req-6c40c7c9-01a1-4bf6-a5b4-977485aa4f7c service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:13.663546 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aa1acdcc-504b-4deb-821b-3ad327e97413 req-6c40c7c9-01a1-4bf6-a5b4-977485aa4f7c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:13.663987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-aa1acdcc-504b-4deb-821b-3ad327e97413 req-6c40c7c9-01a1-4bf6-a5b4-977485aa4f7c service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:13.675357 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-aa1acdcc-504b-4deb-821b-3ad327e97413 req-6c40c7c9-01a1-4bf6-a5b4-977485aa4f7c service nova] Creating event network-vif-deleted:0050e291-85af-49e7-b589-57cad9b5e875 for instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 on n-h2-862876-2 Oct 28 14:42:13.680808 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-aa1acdcc-504b-4deb-821b-3ad327e97413 req-6c40c7c9-01a1-4bf6-a5b4-977485aa4f7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Oct 28 14:42:13.681405 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3973/8037] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:42:14.239664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:14.240273 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:14.247095 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:14.247575 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:14.248007 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:14.248680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:14.249130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:14.249548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:14.279830 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:14.280305 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:14.280732 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:14.281171 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lazy-loading 'fault' on Instance uuid 9c84cc30-5a7a-44ae-b488-420b51df2ea0 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:42:14.326035 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:14.334223 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-beb4cafa-2591-48f4-ad2f-230f96e9e7e9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 200 len: 1336 microversion: 2.1 time: 0.098536 Oct 28 14:42:14.343941 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4065/8038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:14 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:15.360289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:15.361045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 9c84cc30-5a7a-44ae-b488-420b51df2ea0] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:15.367888 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:15.368385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:15.368828 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:15.369527 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:15.370025 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:15.370459 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:15.383731 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.wsgi [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] HTTP exception thrown: Instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 could not be found. Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Request method failure captured: Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: request: GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 HTTP/1.1 Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: Accept: application/json Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: Accept-Encoding: identity Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: Connection: close Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: Content-Length: 0 Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: Content-Type: application/json Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: Host: 10.222.0.25 Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: Openstack-System-Scope: None Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: User-Agent: python-urllib3/1.26.12 Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Auth-Token: gAAAAABjW-lAY7vg-LkUasp2QRyOkyVnXXgoIUcctcTYNqtCKLoxpKcVX8VvV484JCPa9s5HlNoZ88PP4dkddU0gQSESID0lZUZwEt73oDVzxyuEm81e0wOKxdxwNaGM-dQreCEg6vWgHy1lSAgh1BunvNL2gSWQlpKfOMzPccukCamcPLp6KCM Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Id: None Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Domain-Name: None Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Identity-Status: Confirmed Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Is-Admin-Project: True Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Id: default Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Domain-Name: Default Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Id: 38003b5845c44c20a82490a2709c47dc Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Project-Name: tempest-TestShelveInstance-522475558 Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Role: member,reader Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Roles: member,reader Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38003b5845c44c20a82490a2709c47dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38003b5845c44c20a82490a2709c47dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38003b5845c44c20a82490a2709c47dc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38003b5845c44c20a82490a2709c47dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant: tempest-TestShelveInstance-522475558 Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Id: 38003b5845c44c20a82490a2709c47dc Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-Tenant-Name: tempest-TestShelveInstance-522475558 Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-User: tempest-TestShelveInstance-522475558-project Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Id: default Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-User-Domain-Name: Default Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-User-Id: badca10c1163492a890ff636d10ba19b Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: X-User-Name: tempest-TestShelveInstance-522475558-project Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: method: > Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: exception: Instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 could not be found. Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: action_args: {'id': '9c84cc30-5a7a-44ae-b488-420b51df2ea0'} Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 could not be found. Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 could not be found. Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:42:15.385441 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 could not be found. Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: ERROR nova.api.openstack.wsgi Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Returning 404 to user: Instance 9c84cc30-5a7a-44ae-b488-420b51df2ea0 could not be found. {{(pid=127794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-f992a39d-b48a-47a3-bc1c-438ecf5ce67f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0" status: 404 len: 111 microversion: 2.1 time: 0.031874 Oct 28 14:42:15.391484 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3974/8039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:15 2022] GET /compute/v2.1/servers/9c84cc30-5a7a-44ae-b488-420b51df2ea0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:42:15.601103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-a9738d15-5daa-4075-9f0f-7feae2397759 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '.version_select at 0x7f27b852c9d0>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:15.676615 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-a9738d15-5daa-4075-9f0f-7feae2397759 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532473216" status: 202 len: 0 microversion: 2.1 time: 0.080066 Oct 28 14:42:15.677219 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4066/8040] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Oct 28 14:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532473216 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:42:15.701921 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0317bf44-c374-456d-9ca2-5d5de1ae7b89 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'create', calling method: .version_select at 0x7f27b889b4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1913693021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOJOy4a7H+ADbY3f/mIPs15wMtzeqEd1ky7wpmmsegnG4EpMsTfY6OzCu34hH+/vpjsvvXVWXRaiw/Yp9VNWZ/UrbjEUoRpWxvd6foQqLjCSQ+PuoN4hSAIQ1O1Z/vjow=="}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:42:15.718046 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0317bf44-c374-456d-9ca2-5d5de1ae7b89 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for project 38003b5845c44c20a82490a2709c47dc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:42:15.725096 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-0317bf44-c374-456d-9ca2-5d5de1ae7b89 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for user badca10c1163492a890ff636d10ba19b and project 38003b5845c44c20a82490a2709c47dc. Resources: {'key_pairs'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:42:15.790277 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0317bf44-c374-456d-9ca2-5d5de1ae7b89 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.092421 Oct 28 14:42:15.790893 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3975/8041] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:42:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:42:38.991268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:38.992019 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:38.996542 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-275602157", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1913693021", "security_groups": [{"name": "tempest-secgroup-smoke-1791512386"}], "networks": [{"uuid": "ad8bb132-4c8f-4283-80a6-1a69b768e715"}], "block_device_mapping_v2": [{"uuid": "f88f29c3-a801-46ca-b8b8-729c37b25354", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:42:39.108151 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.network.neutron [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] validate_networks() for [('ad8bb132-4c8f-4283-80a6-1a69b768e715', None, None, None, None, None)] {{(pid=127793) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:42:39.491687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Flavor limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:42:39.492715 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Image limits 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:42:39.493189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Flavor pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:42:39.493722 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Image pref 0:0:0 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:42:39.494009 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.virt.hardware [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:42:39.502623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:39.503193 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:39.503624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:39.504338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:39.504789 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:39.505214 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:39.522428 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for project 38003b5845c44c20a82490a2709c47dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:42:39.528234 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Getting quotas for user badca10c1163492a890ff636d10ba19b and project 38003b5845c44c20a82490a2709c47dc. Resources: {'ram', 'cores', 'instances'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:42:39.585611 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Going to run 1 instances... {{(pid=127793) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:42:39.588407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f88f29c3-a801-46ca-b8b8-729c37b25354',volume_size=None,volume_type=None)] {{(pid=127793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:42:39.950982 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e0c19787-ff19-4e7e-a0dd-7b5029191fa2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.961478 Oct 28 14:42:39.951641 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4067/8042] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:42:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:42:39.961457 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=12 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:39.962284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=4 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:39.962942 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:39.966823 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e06b1482-69b7-41e0-b561-328fdbb0f229 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:39.967540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e06b1482-69b7-41e0-b561-328fdbb0f229 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:40.127318 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e06b1482-69b7-41e0-b561-328fdbb0f229 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:40.135027 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e06b1482-69b7-41e0-b561-328fdbb0f229 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1088 microversion: 2.1 time: 0.175848 Oct 28 14:42:40.135597 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3976/8043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:39 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1088 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:41.158357 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:41.163682 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:41.165665 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:41.166149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:41.166581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:41.167312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:41.167770 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:41.168209 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:41.230631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:41.238308 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3b3ea08f-e392-4a38-8375-c08a512f4525 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1130 microversion: 2.1 time: 0.084714 Oct 28 14:42:41.238885 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4068/8044] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:41 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:42:42.263489 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:42.264200 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:42.274418 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:42.274960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:42.275423 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:42.276150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:42.276620 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:42.277060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:42.365153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:42.374343 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e93e5a2-bcef-4b40-83f8-09a9dc12ced1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1204 microversion: 2.1 time: 0.114808 Oct 28 14:42:42.375040 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3977/8045] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:42 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1204 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:43.400021 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:43.401239 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:43.408344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:43.408918 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:43.409539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:43.410206 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:43.410737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:43.411243 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:43.558408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:43.566310 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2c59aa5b-3f6f-435a-b8a2-f0999fae1977 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1272 microversion: 2.1 time: 0.170422 Oct 28 14:42:43.567211 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4069/8046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:43 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:43.661508 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-5e4d8db8-a3e0-4e8a-971e-54ba987dc531 req-1d12ac6f-9c3b-4daf-9e0d-ddd9cd4c5c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03552e06-ac8d-436a-929e-fbadb0c9c349", "tag": "db2359ec-2432-41cb-b775-0e83ba701c83"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:42:43.673180 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e4d8db8-a3e0-4e8a-971e-54ba987dc531 req-1d12ac6f-9c3b-4daf-9e0d-ddd9cd4c5c6a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:43.673671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e4d8db8-a3e0-4e8a-971e-54ba987dc531 req-1d12ac6f-9c3b-4daf-9e0d-ddd9cd4c5c6a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:43.674124 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-5e4d8db8-a3e0-4e8a-971e-54ba987dc531 req-1d12ac6f-9c3b-4daf-9e0d-ddd9cd4c5c6a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:43.686685 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-5e4d8db8-a3e0-4e8a-971e-54ba987dc531 req-1d12ac6f-9c3b-4daf-9e0d-ddd9cd4c5c6a service nova] Creating event network-changed:db2359ec-2432-41cb-b775-0e83ba701c83 for instance 03552e06-ac8d-436a-929e-fbadb0c9c349 on n-h1-862876-2 Oct 28 14:42:43.691958 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-5e4d8db8-a3e0-4e8a-971e-54ba987dc531 req-1d12ac6f-9c3b-4daf-9e0d-ddd9cd4c5c6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034181 Oct 28 14:42:43.692836 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3978/8047] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:42:44.590312 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:44.591096 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:44.599473 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:44.599894 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:44.600335 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:44.601028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:44.601491 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:44.601919 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:45.064478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:45.073138 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-209752f0-b255-4c4a-bb58-5e37ca595c7b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1272 microversion: 2.1 time: 0.487489 Oct 28 14:42:45.073716 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4070/8048] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:44 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1272 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:46.097327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:46.098057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:46.104824 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:46.105329 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:46.105778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:46.106502 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:46.107023 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:46.107468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:46.244128 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:46.252000 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-8042ceb9-cc95-42c1-96be-3e54087e03ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1272 microversion: 2.1 time: 0.160139 Oct 28 14:42:46.252583 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3979/8049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:46 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:47.275703 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:47.276317 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:47.282924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:47.284954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:47.284954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:47.284954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:47.285288 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:47.285467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:47.420695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:47.428648 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-58500f20-64b7-47ca-90d5-813c43916ab7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1272 microversion: 2.1 time: 0.157529 Oct 28 14:42:47.429222 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4071/8050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:47 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:42:48.451330 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:48.451958 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:48.458773 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:48.459279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:48.464957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:48.464957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:48.464957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:48.464957 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:48.591632 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:48.600538 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-98a37d77-319f-4781-bc77-cda8a3fab2d2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.153174 Oct 28 14:42:48.601134 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3980/8051] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:48 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:49.623407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:49.624046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:49.626702 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:49.627380 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:49.632140 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:49.632617 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:49.633051 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:49.633733 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:49.634774 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:49.635195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:49.767352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:49.775874 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-00b0104a-4757-410c-8d18-ccaa0cc2e1ee tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.156348 Oct 28 14:42:49.776456 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4072/8052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:49 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:50.798037 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:50.798609 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:50.801513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:42:50.806394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:50.806927 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:50.807383 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:50.808094 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:50.808564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:50.809050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:50.942633 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:50.950378 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-398d4476-93ab-412e-b545-9be2fbbcb483 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.156340 Oct 28 14:42:50.950971 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3981/8053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:50 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:51.974178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:51.974841 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:51.982106 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:51.982590 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:51.983098 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:51.983792 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:51.984248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:51.984673 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:52.113298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:52.121628 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-326eb7c7-e2e4-4a5c-bb44-847732ab74c4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.151591 Oct 28 14:42:52.122200 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4073/8054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:51 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:53.143614 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:53.144242 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:53.151093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:53.151588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:53.152033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:53.152726 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:53.153196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:53.153626 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:53.281304 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:53.288975 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fa37d764-c812-4f05-8b1f-98dff4e0da04 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.149266 Oct 28 14:42:53.289531 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3982/8055] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:53 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:54.311670 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:54.312270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:54.319079 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:54.319565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:54.320003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:54.320687 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:54.321145 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:54.321564 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:54.454450 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:54.462765 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-61b22cae-3a64-43d4-9c7f-fb9ad5a2e710 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.154460 Oct 28 14:42:54.463359 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4074/8056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:54 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:55.486578 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:55.487414 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:55.494669 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:55.495197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:55.495648 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:55.496354 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:55.496846 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:55.497288 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:55.631108 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:55.639785 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-72a41001-75fa-4a7d-844b-1752812212ae tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.157059 Oct 28 14:42:55.640379 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3983/8057] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:55 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:56.662442 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:56.663097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:56.670519 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:56.671034 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:56.671471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:56.672158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:56.672620 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:56.673045 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:56.806867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:56.814706 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-94eda4b0-e2ef-49d8-907f-66a031cc663d tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.156197 Oct 28 14:42:56.815306 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4075/8058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:56 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:57.414953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-8596e623-1cb7-4b0e-9fa3-4a5daa7a7bdd req-b6c0ffe2-a311-4051-b1fe-080f968ccfae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03552e06-ac8d-436a-929e-fbadb0c9c349", "name": "network-vif-plugged", "status": "completed", "tag": "db2359ec-2432-41cb-b775-0e83ba701c83"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:42:57.425165 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8596e623-1cb7-4b0e-9fa3-4a5daa7a7bdd req-b6c0ffe2-a311-4051-b1fe-080f968ccfae service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:57.425659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8596e623-1cb7-4b0e-9fa3-4a5daa7a7bdd req-b6c0ffe2-a311-4051-b1fe-080f968ccfae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:57.426101 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-8596e623-1cb7-4b0e-9fa3-4a5daa7a7bdd req-b6c0ffe2-a311-4051-b1fe-080f968ccfae service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:57.437944 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-8596e623-1cb7-4b0e-9fa3-4a5daa7a7bdd req-b6c0ffe2-a311-4051-b1fe-080f968ccfae service nova] Creating event network-vif-plugged:db2359ec-2432-41cb-b775-0e83ba701c83 for instance 03552e06-ac8d-436a-929e-fbadb0c9c349 on n-h1-862876-2 Oct 28 14:42:57.443058 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-8596e623-1cb7-4b0e-9fa3-4a5daa7a7bdd req-b6c0ffe2-a311-4051-b1fe-080f968ccfae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Oct 28 14:42:57.443661 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3984/8059] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:42:57.837510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:57.838291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:57.844177 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:57.844653 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:57.845081 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:57.845759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:57.846474 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:57.846924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:57.983827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:57.992386 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bf45d27b-c83d-4591-a0fe-e9f1b9892740 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1260 microversion: 2.1 time: 0.159117 Oct 28 14:42:57.992972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4076/8060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:57 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:59.065483 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:59.066205 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:59.073071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:59.073573 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:59.074026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:59.074731 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:59.075224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:59.075668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:59.204380 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:59.212152 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4fb99c6f-f515-4df6-9f2a-9e6b8885d9ec tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1445 microversion: 2.1 time: 0.199530 Oct 28 14:42:59.212722 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3985/8061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:59 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1445 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:42:59.234481 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:42:59.235393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:42:59.241874 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:59.242361 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:59.242831 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:59.244031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:42:59.244494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:42:59.244922 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:42:59.378061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:42:59.385878 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-364eae65-9523-4fae-8650-f846c888ba28 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1445 microversion: 2.1 time: 0.155258 Oct 28 14:42:59.386447 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4077/8062] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:42:59 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:43:01.212844 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-bc5f0d9f-d1a8-461c-a717-06be17e31872 req-aace6622-9833-47ca-9893-5938503d6abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03552e06-ac8d-436a-929e-fbadb0c9c349", "tag": "db2359ec-2432-41cb-b775-0e83ba701c83"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:43:01.224095 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bc5f0d9f-d1a8-461c-a717-06be17e31872 req-aace6622-9833-47ca-9893-5938503d6abf service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:43:01.224595 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bc5f0d9f-d1a8-461c-a717-06be17e31872 req-aace6622-9833-47ca-9893-5938503d6abf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:43:01.225462 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-bc5f0d9f-d1a8-461c-a717-06be17e31872 req-aace6622-9833-47ca-9893-5938503d6abf service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:43:01.236718 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-bc5f0d9f-d1a8-461c-a717-06be17e31872 req-aace6622-9833-47ca-9893-5938503d6abf service nova] Creating event network-changed:db2359ec-2432-41cb-b775-0e83ba701c83 for instance 03552e06-ac8d-436a-929e-fbadb0c9c349 on n-h1-862876-2 Oct 28 14:43:01.241866 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-bc5f0d9f-d1a8-461c-a717-06be17e31872 req-aace6622-9833-47ca-9893-5938503d6abf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033195 Oct 28 14:43:01.242481 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3986/8063] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:45:19.623636 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:45:19.624508 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 14:45:19.625076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:19.625836 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=62 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:19.626770 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:45:19.626924 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349/action (ip 10.222.0.25) !!! Oct 28 14:45:19.628698 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:45:19.628828 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349/action (ip 10.222.0.25) !!! Oct 28 14:45:19.630305 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:45:19.630426 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349/action (ip 10.222.0.25) !!! Oct 28 14:45:19.640105 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:45:19.640641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:19.656518 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:19.656995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:19.658090 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:19.658824 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:19.659292 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:19.663015 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:19.682120 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.objects.instance [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lazy-loading 'flavor' on Instance uuid 03552e06-ac8d-436a-929e-fbadb0c9c349 {{(pid=127793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:45:19.933826 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-3d1be515-a4f8-4ee2-bbf1-9af32b9f925a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349/action" status: 202 len: 0 microversion: 2.1 time: 0.312041 Oct 28 14:45:19.934402 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4078/8064] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:45:19 2022] POST /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:45:19.942624 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:45:19.943636 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:45:19.944496 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=24 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:19.945254 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=48 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:19.946140 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:45:19.946289 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 (ip 10.222.0.25) !!! Oct 28 14:45:19.948584 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:45:19.948712 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 (ip 10.222.0.25) !!! Oct 28 14:45:19.950032 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:45:19.950203 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 (ip 10.222.0.25) !!! Oct 28 14:45:19.961153 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:19.961870 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:19.975782 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:19.977980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:19.977980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:19.977980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:19.977980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:19.978416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:20.121217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:20.129744 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-76c434ce-f530-46f9-8d2f-f82f2e8f6773 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.189768 Oct 28 14:45:20.131859 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3987/8065] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:19 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:21.153621 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:21.154324 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:21.165352 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:21.165845 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:21.166281 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:21.167072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:21.167529 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:21.167954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:21.177115 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56842. Oct 28 14:45:21.187228 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56840. Oct 28 14:45:21.356429 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:21.364903 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d40981f4-b049-4d25-8107-bc7ed8cedac9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.215551 Oct 28 14:45:21.365483 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4079/8066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:21 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:22.388394 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:22.389032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:22.398701 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:22.399231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:22.399686 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:22.400399 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:22.400874 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:22.401320 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:22.407398 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56850. Oct 28 14:45:22.408221 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 56852. Oct 28 14:45:22.537703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:22.545773 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-35f8b3c2-ff89-4042-a043-282cb13b429e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.161332 Oct 28 14:45:22.546397 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3988/8067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:22 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:23.569058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:23.569676 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:23.576539 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:23.577029 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:23.577464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:23.578158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:23.578613 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:23.579061 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:23.723659 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:23.723659 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bee29ad2-09ea-4e1f-9110-6d854bd2b5f1 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.155364 Oct 28 14:45:23.723659 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4080/8068] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:23 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:24.766524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:24.883285 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:24.891017 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-904e80b3-b7c4-4695-9f86-a5280b40ea67 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.149523 Oct 28 14:45:24.891588 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3989/8069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:24 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:25.915662 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:25.916464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:25.923790 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:25.924279 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:25.924717 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:25.925536 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:25.925994 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:25.926419 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:26.056510 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:26.064294 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-158c1679-a40f-481d-b11a-57cfc3149fa3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.153032 Oct 28 14:45:26.065408 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4081/8070] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:25 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:27.089266 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:27.089933 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:27.097018 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:27.097519 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:27.097972 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:27.099044 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:27.099528 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:27.099971 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:27.233797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:27.242307 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-910b9757-777a-403b-be9c-b37d94f05317 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.157042 Oct 28 14:45:27.243004 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3990/8071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:27 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:28.265755 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:28.266337 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:28.273136 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:28.273622 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:28.274057 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:28.274739 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:28.275217 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:28.275647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:28.411768 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:28.419599 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-24d21f79-edd8-463c-bc91-62f8fc0e2447 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.157859 Oct 28 14:45:28.420173 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4082/8072] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:28 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:29.442709 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:29.443361 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:29.450058 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:29.450553 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:29.451032 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:29.451728 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:29.452195 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:29.452629 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:29.587033 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:29.594965 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b42852e7-24c8-43cb-98a5-af64a9ffdb71 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.156818 Oct 28 14:45:29.595544 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3991/8073] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:29 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:30.619439 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:30.620048 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:30.626896 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:30.627924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:30.628355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:30.629036 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:30.629484 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:30.629899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:30.763104 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:30.770977 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-454c3f10-9c79-489d-8d3e-abc858c3e879 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.155890 Oct 28 14:45:30.771530 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4083/8074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:30 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:31.794410 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:31.795144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:31.803300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:31.803300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:31.804120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:31.804249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:31.804671 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:31.805832 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:31.936643 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:31.944747 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-fc345554-2379-4f1e-ac90-83254fa69f8e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.154407 Oct 28 14:45:31.945324 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3992/8075] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:31 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:45:32.968345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:32.969075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:32.976318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:32.976799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:32.977489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:32.978195 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:32.978650 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:32.979097 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:33.116121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:33.124343 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2f398712-c6bf-4720-a3bf-578b6aa68016 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.160040 Oct 28 14:45:33.124935 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4084/8076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:32 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:34.148217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:34.148800 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:34.155780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:34.156291 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:34.156746 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:34.157464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:34.157941 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:34.158923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:34.292795 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:34.301273 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1e414d9e-b4f7-457c-a26a-b8f8a7fe5fd4 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.157365 Oct 28 14:45:34.301849 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3993/8077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:34 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:35.324806 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:35.325438 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:35.332744 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:35.333227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:35.333661 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:35.334343 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:35.334815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:35.335237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:35.469677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:35.478112 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d5f9c0a6-80b0-43ee-8b00-ce1efc11d068 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1511 microversion: 2.1 time: 0.157153 Oct 28 14:45:35.478690 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4085/8078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:35 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:35.502639 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:45:35.503283 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:35.510056 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:35.510550 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:35.511026 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:35.511725 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:35.512191 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:35.512631 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:35.595541 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127794) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 14:45:35.926480 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3688f97f-9feb-44df-8a0c-623cb4e2440f tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "POST /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349/action" status: 202 len: 0 microversion: 2.1 time: 0.428178 Oct 28 14:45:35.927143 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3994/8079] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:45:35 2022] POST /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:45:35.935269 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:35.935883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:35.942464 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:35.943817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:35.943817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:35.944065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:35.944495 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:35.944917 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:36.109403 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:36.116767 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-237eebe5-12dd-456e-8943-40227cc4c912 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1519 microversion: 2.1 time: 0.185350 Oct 28 14:45:36.126105 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4086/8080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:35 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:45:36.211994 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-997e3472-62c4-4ee1-8589-acfe2ce0ec2a req-be14d291-fadb-45e1-bd15-a8ee568fce04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03552e06-ac8d-436a-929e-fbadb0c9c349", "name": "network-vif-unplugged", "status": "completed", "tag": "db2359ec-2432-41cb-b775-0e83ba701c83"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:45:36.222133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-997e3472-62c4-4ee1-8589-acfe2ce0ec2a req-be14d291-fadb-45e1-bd15-a8ee568fce04 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:36.222623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-997e3472-62c4-4ee1-8589-acfe2ce0ec2a req-be14d291-fadb-45e1-bd15-a8ee568fce04 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:36.223097 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-997e3472-62c4-4ee1-8589-acfe2ce0ec2a req-be14d291-fadb-45e1-bd15-a8ee568fce04 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:36.234415 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.compute.server_external_events [req-997e3472-62c4-4ee1-8589-acfe2ce0ec2a req-be14d291-fadb-45e1-bd15-a8ee568fce04 service nova] Unable to find a host for instance 03552e06-ac8d-436a-929e-fbadb0c9c349. Dropping event network-vif-unplugged {{(pid=127794) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 14:45:36.235341 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-997e3472-62c4-4ee1-8589-acfe2ce0ec2a req-be14d291-fadb-45e1-bd15-a8ee568fce04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.074686 Oct 28 14:45:36.235912 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3995/8081] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 14:45:37.140632 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:37.141566 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:37.148747 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:37.149238 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:37.154075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:37.154075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:37.154075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:37.154075 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:37.304235 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:37.304235 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-883bbc38-0bf2-4c28-b0a2-cbb1f0612f52 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1519 microversion: 2.1 time: 0.161024 Oct 28 14:45:37.304235 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4087/8082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:37 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:38.321817 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:38.322494 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:38.329750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:38.330885 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:38.331039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:38.331961 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:38.332270 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:38.332712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:38.464442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:38.473066 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6484328e-872d-49ef-8a79-01beb9fb5277 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1519 microversion: 2.1 time: 0.155219 Oct 28 14:45:38.477136 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3996/8083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:38 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:39.497065 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:39.497868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:39.505250 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:39.505740 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:39.506174 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:39.506968 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:39.507355 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:39.516432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:39.643149 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:39.651051 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-e449fbc2-3a27-485d-9042-99778f3b3f26 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1519 microversion: 2.1 time: 0.157932 Oct 28 14:45:39.651628 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4088/8084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:39 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:40.674682 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:40.675334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:40.682219 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:40.682713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:40.683187 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:40.683884 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:40.684348 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:40.684780 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:41.154086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:41.163368 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0eaf62d0-16d2-4035-83bd-2ce0772325a0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1519 microversion: 2.1 time: 0.493096 Oct 28 14:45:41.163960 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3997/8085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:40 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1519 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:42.186494 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:42.187493 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:42.195156 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:42.195647 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:42.196092 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:42.196787 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:42.197251 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:42.197680 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:42.343672 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:42.352518 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-0490c687-5f06-43c9-bb03-6d76f1df93fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1521 microversion: 2.1 time: 0.169857 Oct 28 14:45:42.353262 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4089/8086] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:42 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:43.378513 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:43.379170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:43.386500 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:43.387035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:43.387492 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:43.389448 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:43.391785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:43.392295 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:43.529892 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:43.540951 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1b9e8278-07ae-4512-a2cd-c6fc43c75a5b tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1521 microversion: 2.1 time: 0.166440 Oct 28 14:45:43.541636 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3998/8087] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:43 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:44.566397 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:44.567076 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:44.573954 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:44.574441 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:44.574899 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:44.575930 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:44.576388 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:44.576811 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:44.707420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:44.715271 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-60a87ed2-760a-4b26-8fb1-3ae1db43ed90 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1521 microversion: 2.1 time: 0.152811 Oct 28 14:45:44.715846 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4090/8088] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:44 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:45.740801 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:45.741421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:45.748687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:45.749197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:45.749647 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:45.750364 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:45.750922 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:45.751279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:45.900856 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:45.908756 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-59873fa6-eb48-4072-a661-14ee2838164a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1521 microversion: 2.1 time: 0.172429 Oct 28 14:45:45.909328 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 3999/8089] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:45 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:46.932976 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:46.933594 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:46.941194 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:46.942341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:46.942341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:46.944472 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:46.944941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:46.945381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:47.085502 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:47.093398 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7c7d56f7-493c-44a2-af14-31b66ec26408 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.164569 Oct 28 14:45:47.094012 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4091/8090] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:46 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:48.117371 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:48.118001 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:48.124845 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:48.125346 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:48.125794 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:48.126493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:48.127035 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:48.127511 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:48.260337 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:48.268757 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d073d9b5-531f-49d1-acb5-2d1e36d6c39a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.155593 Oct 28 14:45:48.269324 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4000/8091] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:48 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:49.291940 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:49.292562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:49.300121 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:49.300597 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:49.301028 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:49.301726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:49.302155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:49.302571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:49.319985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:49.432129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:49.439881 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9ccd5846-73fc-4419-91f1-971b2527f5fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.151819 Oct 28 14:45:49.440461 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4092/8092] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:49 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:50.463854 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:50.464488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:50.467196 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:50.474057 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:50.474563 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:50.475054 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:50.475770 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:50.476244 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:50.476753 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:50.479450 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:50.608636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:50.616826 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-101f7670-16c0-4b1d-a188-cf77bb2211be tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.156953 Oct 28 14:45:50.617395 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4001/8093] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:50 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:51.640773 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:51.641389 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:51.643923 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=31 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:45:51.648646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:51.649130 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:51.649565 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:51.650248 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:51.650704 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:51.651158 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:51.782049 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:51.790370 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2affbd47-25b0-44a9-8a20-4a72a649aa9a tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.153657 Oct 28 14:45:51.790969 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4093/8094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:51 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:52.813464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:52.814190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:52.821176 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:52.821711 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:52.822164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:52.822909 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:52.823385 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:52.823825 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:52.955322 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:52.963148 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3059dc71-0bb3-4c8a-b48d-000c4201814c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.153703 Oct 28 14:45:52.963714 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4002/8095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:52 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:53.987596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:53.988202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:53.995219 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:53.995695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:53.996123 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:53.996799 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:53.997247 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:53.997664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:54.125964 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:54.134198 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-9cf29999-68be-4f0a-a99f-b6b8f582b8a9 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.151033 Oct 28 14:45:54.134786 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4094/8096] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:53 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:55.157484 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:55.158164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:55.165055 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:55.165558 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:55.166012 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:55.166713 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:55.167214 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:55.167654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:55.298179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:55.305997 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3e4e5976-08b8-4c41-b2d3-1cd196dcb0e0 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.152463 Oct 28 14:45:55.306574 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4003/8097] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:55 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:56.330549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:56.331282 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:56.338523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:56.339058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:56.339513 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:56.340556 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:56.341027 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:56.341457 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:56.448170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-c4d3df61-b656-43a5-a362-07f1e3276c29 req-6c37aebc-87ee-4974-8130-1d6762450800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03552e06-ac8d-436a-929e-fbadb0c9c349", "name": "network-vif-plugged", "status": "completed", "tag": "db2359ec-2432-41cb-b775-0e83ba701c83"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:45:56.459253 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c4d3df61-b656-43a5-a362-07f1e3276c29 req-6c37aebc-87ee-4974-8130-1d6762450800 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:56.460034 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c4d3df61-b656-43a5-a362-07f1e3276c29 req-6c37aebc-87ee-4974-8130-1d6762450800 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:56.460754 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-c4d3df61-b656-43a5-a362-07f1e3276c29 req-6c37aebc-87ee-4974-8130-1d6762450800 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:56.473152 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-c4d3df61-b656-43a5-a362-07f1e3276c29 req-6c37aebc-87ee-4974-8130-1d6762450800 service nova] Creating event network-vif-plugged:db2359ec-2432-41cb-b775-0e83ba701c83 for instance 03552e06-ac8d-436a-929e-fbadb0c9c349 on n-h1-862876-2 Oct 28 14:45:56.480277 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-c4d3df61-b656-43a5-a362-07f1e3276c29 req-6c37aebc-87ee-4974-8130-1d6762450800 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035816 Oct 28 14:45:56.481030 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4004/8098] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:45:56.485576 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:56.494019 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-bc94a745-789e-4d6e-b863-ba83322bdeed tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.168241 Oct 28 14:45:56.507171 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4095/8099] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:56 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:57.520064 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:57.520788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:57.526995 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:57.527493 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:57.527967 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:57.528677 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:57.529144 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:57.529613 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:57.667368 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:57.675312 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a886446a-fb90-42e3-a42d-05ec7d0a3e6c tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1577 microversion: 2.1 time: 0.160361 Oct 28 14:45:57.675896 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4005/8100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:57 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:45:58.698681 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:45:58.699455 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:45:58.706227 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:58.706714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:58.707181 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:58.707868 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:45:58.708329 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:45:58.708753 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:45:58.840268 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:45:58.848488 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-753a1a66-8898-4ea0-a4d8-981978c401ac tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1564 microversion: 2.1 time: 0.153751 Oct 28 14:45:58.849326 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4096/8101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:45:58 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:47:35.155256 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=9 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:47:35.156039 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=25 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:47:35.158307 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=7 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:47:35.159218 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=26 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:47:35.160976 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:35.161501 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:35.169923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:35.169923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:35.169923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:35.169923 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:35.170347 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:35.170555 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:35.200959 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:47:35.234157 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-1561f080-0286-41e7-86d8-ca1c8c666210 req-3bf6a829-7d51-4271-9bef-c122c0f8be0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03552e06-ac8d-436a-929e-fbadb0c9c349", "tag": "db2359ec-2432-41cb-b775-0e83ba701c83"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:47:35.244050 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1561f080-0286-41e7-86d8-ca1c8c666210 req-3bf6a829-7d51-4271-9bef-c122c0f8be0a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:35.244527 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1561f080-0286-41e7-86d8-ca1c8c666210 req-3bf6a829-7d51-4271-9bef-c122c0f8be0a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:35.245160 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-1561f080-0286-41e7-86d8-ca1c8c666210 req-3bf6a829-7d51-4271-9bef-c122c0f8be0a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:35.256488 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-1561f080-0286-41e7-86d8-ca1c8c666210 req-3bf6a829-7d51-4271-9bef-c122c0f8be0a service nova] Creating event network-changed:db2359ec-2432-41cb-b775-0e83ba701c83 for instance 03552e06-ac8d-436a-929e-fbadb0c9c349 on n-h1-862876-2 Oct 28 14:47:35.262434 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-1561f080-0286-41e7-86d8-ca1c8c666210 req-3bf6a829-7d51-4271-9bef-c122c0f8be0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105889 Oct 28 14:47:35.263115 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4097/8102] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:47:35.468194 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-3d557616-f9c8-411d-9209-4db3706d770e tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 204 len: 0 microversion: 2.1 time: 0.314541 Oct 28 14:47:35.469014 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4006/8103] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:47:35 2022] DELETE /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:47:35.479947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:35.479947 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:35.485988 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:35.486478 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:35.486941 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:35.487641 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:35.488129 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:35.488555 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:35.629162 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:47:35.638020 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-c0e973e1-58cc-41f6-bbc6-671f4e1f47fa tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.164532 Oct 28 14:47:35.638610 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4098/8104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:35 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:47:36.662919 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:36.663696 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:36.670580 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:36.671109 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:36.671564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:36.672271 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:36.672740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:36.673178 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:36.873468 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:47:36.881410 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4be3c2c4-63e6-4c47-8af5-0d7dc2386d45 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1570 microversion: 2.1 time: 0.222813 Oct 28 14:47:36.881996 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4007/8105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:36 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1570 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:47:37.721042 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-3ff518e5-7481-4b7c-a871-6bf406b15fa8 req-274ae2dc-5414-4d3b-8190-8fbeb5b724bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03552e06-ac8d-436a-929e-fbadb0c9c349", "name": "network-vif-deleted", "tag": "db2359ec-2432-41cb-b775-0e83ba701c83"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:47:37.732002 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ff518e5-7481-4b7c-a871-6bf406b15fa8 req-274ae2dc-5414-4d3b-8190-8fbeb5b724bc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:37.732490 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ff518e5-7481-4b7c-a871-6bf406b15fa8 req-274ae2dc-5414-4d3b-8190-8fbeb5b724bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:37.732926 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-3ff518e5-7481-4b7c-a871-6bf406b15fa8 req-274ae2dc-5414-4d3b-8190-8fbeb5b724bc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:37.744985 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-3ff518e5-7481-4b7c-a871-6bf406b15fa8 req-274ae2dc-5414-4d3b-8190-8fbeb5b724bc service nova] Creating event network-vif-deleted:db2359ec-2432-41cb-b775-0e83ba701c83 for instance 03552e06-ac8d-436a-929e-fbadb0c9c349 on n-h1-862876-2 Oct 28 14:47:37.750211 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-3ff518e5-7481-4b7c-a871-6bf406b15fa8 req-274ae2dc-5414-4d3b-8190-8fbeb5b724bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083935 Oct 28 14:47:37.750890 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4099/8106] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:47:37.906374 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:37.907668 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:37.914644 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:37.915177 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:37.915627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:37.916343 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:37.916816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:37.917252 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:37.986212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:47:37.992833 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-9cf5bcb6-c0cc-4855-ac20-513aa0d013f2 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1219 microversion: 2.1 time: 0.090465 Oct 28 14:47:37.993608 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4008/8107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:37 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:47:39.017261 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:39.017883 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:39.024103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:39.025141 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:39.025577 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:39.026270 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:39.026726 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:39.027178 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:39.092487 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:47:39.100374 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-133ee27c-2882-43a4-b11f-adb3ba57ed70 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1219 microversion: 2.1 time: 0.088378 Oct 28 14:47:39.101219 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4100/8108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:39 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:47:40.123302 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:40.123944 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:40.130926 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:40.131432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:40.131883 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:40.132596 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:40.133066 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:40.134028 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:40.252752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:47:40.265213 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e23ec5e4-896b-41a4-9183-7ce5852816a6 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1219 microversion: 2.1 time: 0.145770 Oct 28 14:47:40.265819 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4009/8109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:40 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:47:41.288802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:41.289411 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:41.296867 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:41.297348 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:41.297777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:41.298467 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:41.298949 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:41.299374 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:41.360956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:47:41.368996 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51d4490a-5807-4b9d-8d80-21e7dc090b23 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1219 microversion: 2.1 time: 0.084167 Oct 28 14:47:41.370932 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4101/8110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:41 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:47:42.391778 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:42.392402 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:42.410861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:42.411237 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:42.411704 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:42.412458 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:42.412931 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:42.413369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:42.450441 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:42.451024 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:42.451478 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:42.452076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lazy-loading 'fault' on Instance uuid 03552e06-ac8d-436a-929e-fbadb0c9c349 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:47:42.493334 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badca10c1163492a890ff636d10ba19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38003b5845c44c20a82490a2709c47dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:47:42.502020 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6cb3b193-3f39-41d5-8c4e-c3ca5ea88ac3 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 200 len: 1224 microversion: 2.1 time: 0.113936 Oct 28 14:47:42.502605 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4010/8111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:42 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:47:43.524916 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:43.525813 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] [instance: 03552e06-ac8d-436a-929e-fbadb0c9c349] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:47:43.532975 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:43.533581 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:43.534127 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:43.535058 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:47:43.535678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:47:43.536202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:47:43.550628 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] HTTP exception thrown: Instance 03552e06-ac8d-436a-929e-fbadb0c9c349 could not be found. Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Request method failure captured: Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 HTTP/1.1 Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-lAY7vg-LkUasp2QRyOkyVnXXgoIUcctcTYNqtCKLoxpKcVX8VvV484JCPa9s5HlNoZ88PP4dkddU0gQSESID0lZUZwEt73oDVzxyuEm81e0wOKxdxwNaGM-dQreCEg6vWgHy1lSAgh1BunvNL2gSWQlpKfOMzPccukCamcPLp6KCM Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 38003b5845c44c20a82490a2709c47dc Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestShelveInstance-522475558 Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38003b5845c44c20a82490a2709c47dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/38003b5845c44c20a82490a2709c47dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_38003b5845c44c20a82490a2709c47dc", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/38003b5845c44c20a82490a2709c47dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestShelveInstance-522475558 Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 38003b5845c44c20a82490a2709c47dc Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestShelveInstance-522475558 Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestShelveInstance-522475558-project Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: badca10c1163492a890ff636d10ba19b Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestShelveInstance-522475558-project Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 03552e06-ac8d-436a-929e-fbadb0c9c349 could not be found. Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '03552e06-ac8d-436a-929e-fbadb0c9c349'} Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03552e06-ac8d-436a-929e-fbadb0c9c349 could not be found. Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03552e06-ac8d-436a-929e-fbadb0c9c349 could not be found. Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:47:43.552351 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03552e06-ac8d-436a-929e-fbadb0c9c349 could not be found. Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Returning 404 to user: Instance 03552e06-ac8d-436a-929e-fbadb0c9c349 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f956e166-656c-48a7-aeb5-d0c9c11f93d5 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349" status: 404 len: 111 microversion: 2.1 time: 0.032843 Oct 28 14:47:43.558185 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4102/8112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:47:43 2022] GET /compute/v2.1/servers/03552e06-ac8d-436a-929e-fbadb0c9c349 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:47:43.781161 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-bdf6262f-137a-4252-9cd1-4d96800157c7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] Calling method '.version_select at 0x7f27b873cee0>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:47:43.865698 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-bdf6262f-137a-4252-9cd1-4d96800157c7 tempest-TestShelveInstance-522475558 tempest-TestShelveInstance-522475558-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1913693021" status: 202 len: 0 microversion: 2.1 time: 0.088388 Oct 28 14:47:43.866304 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4011/8113] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Oct 28 14:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1913693021 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 14:48:05.602102 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=12 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:48:05.602952 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=24 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:48:05.769407 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-33d12d2f-f303-4e39-93fa-9d2ef10ec097 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Action: 'create', calling method: .version_select at 0x7f27b840b1f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1576424882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgioyMGfxSerMXtZDcZxMt7gDzkI6d1CKmYFVbmyyMgMKGh0LdEPYU+b2qOAOPKAj+PeB8B7oW1ak5t+5iOioanr+oB/bOIeAPf0UoSvQTcJG0aHI2tT/Jl4iBv3psQnw=="}} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:48:05.785817 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-33d12d2f-f303-4e39-93fa-9d2ef10ec097 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Getting quotas for project 8c9198ca048342d1b12721911dfc90a2. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:48:05.791125 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.quota [None req-33d12d2f-f303-4e39-93fa-9d2ef10ec097 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Getting quotas for user fd2c4ed4d1d44072994ab478267f2fd4 and project 8c9198ca048342d1b12721911dfc90a2. Resources: {'key_pairs'} {{(pid=127793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:48:05.922874 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-33d12d2f-f303-4e39-93fa-9d2ef10ec097 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.326031 Oct 28 14:48:05.923484 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4103/8114] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Oct 28 14:48:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:48:08.449429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:48:08.450861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:48:08.455126 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-764341377", "imageRef": "65e1a51d-1f44-4651-86a6-90233a26cd48", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1576424882", "security_groups": [{"name": "tempest-secgroup-smoke-9984356"}], "networks": [{"uuid": "f6881d9c-77ec-4eb7-b963-eb87b7c48ce4"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:48:08.568284 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] validate_networks() for [('f6881d9c-77ec-4eb7-b963-eb87b7c48ce4', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:48:08.960090 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:48:08.960538 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:48:08.961036 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:48:08.961470 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:48:08.961904 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:48:08.971531 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:08.972045 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:08.972708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:08.973587 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:08.976788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:08.976788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:08.995276 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Getting quotas for project 8c9198ca048342d1b12721911dfc90a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:48:09.001182 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Getting quotas for user fd2c4ed4d1d44072994ab478267f2fd4 and project 8c9198ca048342d1b12721911dfc90a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:48:09.014582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:48:09.017071 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='65e1a51d-1f44-4651-86a6-90233a26cd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:48:09.112260 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-1c5a6bbf-608b-488a-abff-b50f3772ed6c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.664793 Oct 28 14:48:09.119130 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4012/8115] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:48:08 2022] POST /compute/v2.1/servers => generated 403 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:48:09.126633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-f0b0218d-63f2-41bb-b6d4-951068e0a16b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:09.127366 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-f0b0218d-63f2-41bb-b6d4-951068e0a16b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:09.189664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-f0b0218d-63f2-41bb-b6d4-951068e0a16b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:09.197486 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-f0b0218d-63f2-41bb-b6d4-951068e0a16b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1248 microversion: 2.1 time: 0.076988 Oct 28 14:48:09.198392 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4104/8116] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:09 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:10.222287 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:10.222953 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:10.230808 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:10.231317 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:10.231772 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:10.232480 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:10.232954 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:10.233430 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:10.296359 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:10.304400 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-99e2ae7c-a292-404b-a15e-6c992699176a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1252 microversion: 2.1 time: 0.086131 Oct 28 14:48:10.306626 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4013/8117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:10 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1252 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:11.326656 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:11.327299 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:11.336887 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:11.337376 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:11.337815 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:11.338512 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:11.339003 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:11.339432 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:11.412649 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:11.420906 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d8c02e8c-c688-4a8a-9bc9-7793c8ea5d89 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1300 microversion: 2.1 time: 0.098138 Oct 28 14:48:11.421494 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4105/8118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:11 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:48:12.446289 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:12.446974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:12.454913 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:12.455342 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:12.455791 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:12.456503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:12.456974 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:12.457507 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:12.685706 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:12.694133 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6e8ad96d-a15d-465e-bb80-cb1f508d2ad6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1371 microversion: 2.1 time: 0.251841 Oct 28 14:48:12.694644 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4014/8119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:12 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:13.233242 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-85a3b395-32e5-451d-8257-dc506f9f40a9 req-b8a1f981-f439-4e5c-9762-a504b26dab95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbfc578-f91c-4104-a584-178be68888a9", "tag": "e249c714-f2f8-441d-9959-e74c6ba022df"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:48:13.243593 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85a3b395-32e5-451d-8257-dc506f9f40a9 req-b8a1f981-f439-4e5c-9762-a504b26dab95 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:13.244072 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85a3b395-32e5-451d-8257-dc506f9f40a9 req-b8a1f981-f439-4e5c-9762-a504b26dab95 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:13.244618 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-85a3b395-32e5-451d-8257-dc506f9f40a9 req-b8a1f981-f439-4e5c-9762-a504b26dab95 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:13.256393 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-85a3b395-32e5-451d-8257-dc506f9f40a9 req-b8a1f981-f439-4e5c-9762-a504b26dab95 service nova] Creating event network-changed:e249c714-f2f8-441d-9959-e74c6ba022df for instance bfbfc578-f91c-4104-a584-178be68888a9 on n-h1-862876-2 Oct 28 14:48:13.261362 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-85a3b395-32e5-451d-8257-dc506f9f40a9 req-b8a1f981-f439-4e5c-9762-a504b26dab95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031904 Oct 28 14:48:13.261972 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4106/8120] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:48:13.717456 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:13.718118 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:13.725241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:13.725755 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:13.726241 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:13.727260 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:13.727734 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:13.728179 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:13.942473 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:13.950550 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-86dd2827-8dd6-4dee-9952-d91858ebf73f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1371 microversion: 2.1 time: 0.237130 Oct 28 14:48:13.951154 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4015/8121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:13 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:14.973921 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:14.974634 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:14.982678 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:14.983202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:14.983646 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:14.984341 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:14.984805 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:14.985237 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:15.120291 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:15.127921 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b18f219b-0546-4143-8faa-589a0d230089 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1371 microversion: 2.1 time: 0.158337 Oct 28 14:48:15.128500 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4107/8122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:14 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:16.150567 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:16.151164 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:16.158537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:16.159068 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:16.159516 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:16.160212 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:16.161042 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:16.161486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:16.292820 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:16.300522 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4e646819-e1fe-405d-a305-043b17adcb5b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1371 microversion: 2.1 time: 0.153890 Oct 28 14:48:16.301125 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4016/8123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:16 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:17.323623 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:17.324150 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:17.331344 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:17.331827 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:17.332289 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:17.333018 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:17.333471 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:17.333888 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:17.467571 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:17.475503 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-8b8fd0fe-e746-4c56-a0df-883c89531a90 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1371 microversion: 2.1 time: 0.155847 Oct 28 14:48:17.476094 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4108/8124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:17 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:18.499978 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:18.500627 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:18.507490 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:18.507983 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:18.508433 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:18.509193 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:18.509673 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:18.510106 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:18.648224 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:18.657169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-77b74fbb-4d58-4dd9-ab61-d772930ef98d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1371 microversion: 2.1 time: 0.161866 Oct 28 14:48:18.657755 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4017/8125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:18 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:19.156052 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-82519b54-6e87-485d-85a8-2a4a9b5a10ea req-55938e7d-6579-4aca-a309-c490dc801691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbfc578-f91c-4104-a584-178be68888a9", "name": "network-vif-plugged", "status": "completed", "tag": "e249c714-f2f8-441d-9959-e74c6ba022df"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:48:19.166300 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-82519b54-6e87-485d-85a8-2a4a9b5a10ea req-55938e7d-6579-4aca-a309-c490dc801691 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:19.166802 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-82519b54-6e87-485d-85a8-2a4a9b5a10ea req-55938e7d-6579-4aca-a309-c490dc801691 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:19.167244 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-82519b54-6e87-485d-85a8-2a4a9b5a10ea req-55938e7d-6579-4aca-a309-c490dc801691 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:19.177933 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-82519b54-6e87-485d-85a8-2a4a9b5a10ea req-55938e7d-6579-4aca-a309-c490dc801691 service nova] Creating event network-vif-plugged:e249c714-f2f8-441d-9959-e74c6ba022df for instance bfbfc578-f91c-4104-a584-178be68888a9 on n-h1-862876-2 Oct 28 14:48:19.182971 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-82519b54-6e87-485d-85a8-2a4a9b5a10ea req-55938e7d-6579-4aca-a309-c490dc801691 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031452 Oct 28 14:48:19.183548 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4109/8126] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:48:19.680858 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:19.681486 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:19.683369 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:48:19.684610 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:48:19.690215 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:19.696982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:19.696982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:19.696982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:19.696982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:19.696982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:19.827532 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:19.835231 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d3c24651-8510-44a3-9433-79ffa4fdcf4f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1371 microversion: 2.1 time: 0.158256 Oct 28 14:48:19.835811 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4018/8127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:19 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:20.854759 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=6 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:48:20.860684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:20.861381 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:20.867405 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:20.867880 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:20.868309 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:20.868985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:20.872408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:20.872408 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:21.005582 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:21.013599 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-01c07425-bb8c-4fb9-9c06-0650824fbe23 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1555 microversion: 2.1 time: 0.159716 Oct 28 14:48:21.014180 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4110/8128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:20 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:21.036239 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:48:21.036878 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:48:21.044537 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:21.045049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:21.045503 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:21.046220 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:21.046699 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:21.047170 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:21.177113 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:48:21.184940 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-d6601778-6cf5-4073-800d-c9183e48a92c tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1555 microversion: 2.1 time: 0.152579 Oct 28 14:48:21.185520 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4019/8129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:48:21 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:48:23.431981 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-00827fab-4131-47f3-939d-ff19eaa4e0ea req-b4462830-c727-46ff-94c8-a53520df7403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbfc578-f91c-4104-a584-178be68888a9", "tag": "e249c714-f2f8-441d-9959-e74c6ba022df"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:48:23.442115 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-00827fab-4131-47f3-939d-ff19eaa4e0ea req-b4462830-c727-46ff-94c8-a53520df7403 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:48:23.442596 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-00827fab-4131-47f3-939d-ff19eaa4e0ea req-b4462830-c727-46ff-94c8-a53520df7403 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:48:23.443038 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-00827fab-4131-47f3-939d-ff19eaa4e0ea req-b4462830-c727-46ff-94c8-a53520df7403 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:48:23.454543 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-00827fab-4131-47f3-939d-ff19eaa4e0ea req-b4462830-c727-46ff-94c8-a53520df7403 service nova] Creating event network-changed:e249c714-f2f8-441d-9959-e74c6ba022df for instance bfbfc578-f91c-4104-a584-178be68888a9 on n-h1-862876-2 Oct 28 14:48:23.459782 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-00827fab-4131-47f3-939d-ff19eaa4e0ea req-b4462830-c727-46ff-94c8-a53520df7403 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031309 Oct 28 14:48:23.460365 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4111/8130] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:50:18.679017 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:18.681750 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=44 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:18.685279 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-306650615"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:50:18.690421 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:18.703585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:18.708160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:18.708160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:18.708160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:18.708160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:18.708160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:19.034079 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e637f4ab-018e-4b03-bbfc-24aeacb25c6f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "POST /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9/action" status: 202 len: 0 microversion: 2.1 time: 0.357110 Oct 28 14:50:19.034734 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4020/8131] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:50:18 2022] POST /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 14:50:25.634725 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:50:25.639356 n-d-862876-2 devstack@n-api.service[127793]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:50:25.639356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:25.639356 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=30 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:25.639356 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:50:25.639356 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 28 14:50:25.639356 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 14:50:25.639356 n-d-862876-2 devstack@n-api.service[127793]: Fri Oct 28 14:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Oct 28 14:50:25.645654 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ce98fb92-589e-44b4-9420-2965624e543b req-5bf9f6f1-83be-4e43-9432-b8cb8b5dd57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbfc578-f91c-4104-a584-178be68888a9", "name": "network-vif-plugged", "status": "completed", "tag": "e249c714-f2f8-441d-9959-e74c6ba022df"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:50:25.659108 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ce98fb92-589e-44b4-9420-2965624e543b req-5bf9f6f1-83be-4e43-9432-b8cb8b5dd57d service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:25.659505 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ce98fb92-589e-44b4-9420-2965624e543b req-5bf9f6f1-83be-4e43-9432-b8cb8b5dd57d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:25.659944 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ce98fb92-589e-44b4-9420-2965624e543b req-5bf9f6f1-83be-4e43-9432-b8cb8b5dd57d service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:25.673405 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ce98fb92-589e-44b4-9420-2965624e543b req-5bf9f6f1-83be-4e43-9432-b8cb8b5dd57d service nova] Creating event network-vif-plugged:e249c714-f2f8-441d-9959-e74c6ba022df for instance bfbfc578-f91c-4104-a584-178be68888a9 on n-h1-862876-2 Oct 28 14:50:25.679123 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ce98fb92-589e-44b4-9420-2965624e543b req-5bf9f6f1-83be-4e43-9432-b8cb8b5dd57d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045776 Oct 28 14:50:25.679684 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4112/8132] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:50:33.669914 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:50:33.670856 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:50:33.671395 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:33.672751 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:33.676987 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2005114203", "imageRef": "403d83e0-4530-4f31-ba4a-cf35e16f036d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1576424882", "security_groups": [{"name": "tempest-secgroup-smoke-9984356"}], "networks": [{"uuid": "f6881d9c-77ec-4eb7-b963-eb87b7c48ce4"}]}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:50:33.787583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.network.neutron [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] validate_networks() for [('f6881d9c-77ec-4eb7-b963-eb87b7c48ce4', None, None, None, None, None)] {{(pid=127794) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 14:50:34.152938 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Flavor limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 14:50:34.153412 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Image limits 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 14:50:34.153901 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Flavor pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 14:50:34.154333 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Image pref 0:0:0 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 14:50:34.154788 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.virt.hardware [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 14:50:34.163695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:34.164134 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:34.164585 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:34.165327 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:34.165799 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:34.166264 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:34.184050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Getting quotas for project 8c9198ca048342d1b12721911dfc90a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 14:50:34.189935 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.quota [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Getting quotas for user fd2c4ed4d1d44072994ab478267f2fd4 and project 8c9198ca048342d1b12721911dfc90a2. Resources: {'ram', 'cores', 'instances'} {{(pid=127794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 14:50:34.202133 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Going to run 1 instances... {{(pid=127794) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 14:50:34.204738 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='403d83e0-4530-4f31-ba4a-cf35e16f036d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 14:50:34.318319 n-d-862876-2 devstack@n-api.service[127794]: ERROR oslo.messaging._drivers.impl_rabbit [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [4a3f207e-cc75-4fac-aca5-e2695f7c666e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 14:50:34.679400 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc4e59f7-de43-4a92-8be9-9ad8df5688cd] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57380. Oct 28 14:50:34.680138 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] [f392440f-ab43-4b80-9543-b831b8849f4c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57382. Oct 28 14:50:35.325531 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [4a3f207e-cc75-4fac-aca5-e2695f7c666e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57384. Oct 28 14:50:35.329782 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-05ddd111-5851-48a7-a57c-ee478943f53b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.661300 Oct 28 14:50:35.330450 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4021/8133] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Oct 28 14:50:33 2022] POST /compute/v2.1/servers => generated 403 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 14:50:35.344320 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-881e8ed0-390f-4772-8334-eba5a607aa0d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:35.345524 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-881e8ed0-390f-4772-8334-eba5a607aa0d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:35.364609 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb629dfb-0abd-4356-938f-8800cb8f227c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57388. Oct 28 14:50:35.366655 n-d-862876-2 devstack@n-api.service[127793]: INFO oslo.messaging._drivers.impl_rabbit [-] [113c9c6b-e9c7-4edc-a4d8-510ebbb3b568] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 57390. Oct 28 14:50:35.539010 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-881e8ed0-390f-4772-8334-eba5a607aa0d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:35.548914 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-881e8ed0-390f-4772-8334-eba5a607aa0d tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1249 microversion: 2.1 time: 0.211023 Oct 28 14:50:35.551291 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4113/8134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:35 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1249 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:35.618857 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-786ff0dc-26bd-47cf-86b7-14ec6be7430d req-4198fa42-76d6-411b-b5ff-e1b5adc32036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbfc578-f91c-4104-a584-178be68888a9", "name": "network-vif-unplugged", "status": "completed", "tag": "e249c714-f2f8-441d-9959-e74c6ba022df"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:50:35.633464 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-786ff0dc-26bd-47cf-86b7-14ec6be7430d req-4198fa42-76d6-411b-b5ff-e1b5adc32036 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:35.633955 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-786ff0dc-26bd-47cf-86b7-14ec6be7430d req-4198fa42-76d6-411b-b5ff-e1b5adc32036 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:35.634396 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-786ff0dc-26bd-47cf-86b7-14ec6be7430d req-4198fa42-76d6-411b-b5ff-e1b5adc32036 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:35.644500 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-786ff0dc-26bd-47cf-86b7-14ec6be7430d req-4198fa42-76d6-411b-b5ff-e1b5adc32036 service nova] Creating event network-vif-unplugged:e249c714-f2f8-441d-9959-e74c6ba022df for instance bfbfc578-f91c-4104-a584-178be68888a9 on n-h1-862876-2 Oct 28 14:50:35.649521 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-786ff0dc-26bd-47cf-86b7-14ec6be7430d req-4198fa42-76d6-411b-b5ff-e1b5adc32036 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034662 Oct 28 14:50:35.650110 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4022/8135] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:50:36.571363 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:36.571969 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:36.583063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:36.583548 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:36.583977 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:36.584664 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:36.585116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:36.585535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:36.648677 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:36.656373 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-24fd563b-a47f-44a7-8bc7-aef2d0752811 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1245 microversion: 2.1 time: 0.088879 Oct 28 14:50:36.656951 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4114/8136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:36 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:37.679390 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:37.680654 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:37.687636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:37.688135 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:37.688582 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:37.689286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:37.689752 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:37.690186 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:37.771797 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:37.779934 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-81ca543a-c75e-4159-a362-5243645f77c5 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1307 microversion: 2.1 time: 0.104936 Oct 28 14:50:37.780509 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4023/8137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:37 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:38.804071 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:38.804846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:38.818077 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:38.819241 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:38.820231 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:38.823549 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:38.824482 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:38.825499 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:39.024640 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:39.032340 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-ae7ad111-3e54-4388-8138-1635c38342d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.233085 Oct 28 14:50:39.033532 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4115/8138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:38 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:39.451379 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [req-735f13b4-edfd-4807-baba-3c255c385689 req-c9f341d4-3a08-4d23-911b-1ad061999ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d", "tag": "eab395a1-d27b-4fba-a670-7d0cfc0ede32"}]} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:50:39.463050 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-735f13b4-edfd-4807-baba-3c255c385689 req-c9f341d4-3a08-4d23-911b-1ad061999ca2 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:39.463703 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-735f13b4-edfd-4807-baba-3c255c385689 req-c9f341d4-3a08-4d23-911b-1ad061999ca2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:39.464249 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [req-735f13b4-edfd-4807-baba-3c255c385689 req-c9f341d4-3a08-4d23-911b-1ad061999ca2 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:39.476749 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.compute.server_external_events [req-735f13b4-edfd-4807-baba-3c255c385689 req-c9f341d4-3a08-4d23-911b-1ad061999ca2 service nova] Creating event network-changed:eab395a1-d27b-4fba-a670-7d0cfc0ede32 for instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d on n-h2-862876-2 Oct 28 14:50:39.488797 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [req-735f13b4-edfd-4807-baba-3c255c385689 req-c9f341d4-3a08-4d23-911b-1ad061999ca2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041148 Oct 28 14:50:39.489734 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4024/8139] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:50:40.055683 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:40.056333 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:40.063412 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:40.064004 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:40.064452 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:40.065163 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:40.065631 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:40.066063 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:40.203370 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:40.211923 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-de1f151c-5e64-4af0-aa72-1c311bc95643 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.160273 Oct 28 14:50:40.212519 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4116/8140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:40 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:41.237624 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:41.238335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:41.244623 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:41.245123 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:41.245634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:41.246336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:41.246826 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:41.247262 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:41.396689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:41.405215 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-4ceacb05-6cf8-427e-8b63-b03a480645c4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.173248 Oct 28 14:50:41.405808 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4025/8141] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:41 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:42.429956 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:42.430695 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:42.437825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:42.438328 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:42.438833 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:42.439543 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:42.439995 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:42.440426 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:42.582138 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:42.591215 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-179a3e1d-2a1a-454c-81c0-32142e65655f tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.165033 Oct 28 14:50:42.591810 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4117/8142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:42 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:43.614663 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:43.615336 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:43.622356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:43.622903 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:43.623360 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:43.624114 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:43.624695 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:43.625173 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:43.767588 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:43.777455 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-c75a0ec7-cf77-400b-9917-c19f2fa0f009 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.167095 Oct 28 14:50:43.778230 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4026/8143] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:43 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:44.803345 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:44.803893 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:44.810846 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:44.811338 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:44.811777 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:44.812477 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:44.812985 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:44.813414 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:44.977379 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:44.986308 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7d0dc25b-f62f-46a0-a067-74fa6489eda0 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.187585 Oct 28 14:50:45.002319 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4118/8144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:44 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 14:50:46.010067 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:46.010449 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:46.012197 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:46.012855 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell0:SELECT=6 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:46.018524 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:46.020583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:46.020583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:46.020583 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:46.020853 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:46.021060 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:46.193149 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:46.202309 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-a6328b69-57ef-45fc-aec3-7f615705ffbe tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.196518 Oct 28 14:50:46.202991 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4027/8145] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:46 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:47.225386 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:47.225999 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:47.227862 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell0:SELECT=2 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:50:47.233754 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:47.238829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:47.238829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:47.238829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:47.238829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:47.238829 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:47.366350 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:47.374088 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-7b291e8a-10f6-4646-9b3a-7930c051df6b tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.152563 Oct 28 14:50:47.374666 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4119/8146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:47 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:48.399104 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:48.399839 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:48.407084 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-6eb9c6ed-a78f-4997-9975-99c4865644aa tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.166810 Oct 28 14:50:48.565804 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4028/8147] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:48 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:49.585924 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:49.586541 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:49.593567 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:49.598711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:49.598711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:49.598711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:49.598711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:49.598711 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:49.742179 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:49.750368 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-169a64e1-b984-4a34-b05b-22ac045a2788 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.168701 Oct 28 14:50:49.751011 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4120/8148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:49 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:50.773980 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:50.774652 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:50.781658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:50.782157 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:50.782599 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:50.783315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:50.783783 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:50.784217 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:50.914984 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:50.922626 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-aa714c55-0789-4a77-995d-2849b22cffa7 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.152555 Oct 28 14:50:50.923247 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4029/8149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:50 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:51.730517 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-646da018-5e06-431d-ac61-326c8ea90179 req-4244092c-2d66-4547-bec0-2a75fbd0635f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d", "name": "network-vif-plugged", "status": "completed", "tag": "eab395a1-d27b-4fba-a670-7d0cfc0ede32"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:50:51.740614 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-646da018-5e06-431d-ac61-326c8ea90179 req-4244092c-2d66-4547-bec0-2a75fbd0635f service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:51.741093 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-646da018-5e06-431d-ac61-326c8ea90179 req-4244092c-2d66-4547-bec0-2a75fbd0635f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:51.741523 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-646da018-5e06-431d-ac61-326c8ea90179 req-4244092c-2d66-4547-bec0-2a75fbd0635f service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:51.752278 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-646da018-5e06-431d-ac61-326c8ea90179 req-4244092c-2d66-4547-bec0-2a75fbd0635f service nova] Creating event network-vif-plugged:eab395a1-d27b-4fba-a670-7d0cfc0ede32 for instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d on n-h2-862876-2 Oct 28 14:50:51.757173 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-646da018-5e06-431d-ac61-326c8ea90179 req-4244092c-2d66-4547-bec0-2a75fbd0635f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085108 Oct 28 14:50:51.757774 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4121/8150] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:50:51.944925 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:51.945547 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:51.952357 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:51.952852 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:51.953300 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:51.953996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:51.954996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:51.955432 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:52.083689 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:52.091542 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-83ca733e-de4b-4198-a46c-fb2ccc2e64d6 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1372 microversion: 2.1 time: 0.150492 Oct 28 14:50:52.092120 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4030/8151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:51 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:53.117642 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:53.118347 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:53.124553 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:53.125046 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:53.125489 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:53.126202 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:53.126655 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:53.127155 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:53.257393 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:53.265042 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-877717b4-54a5-4c1f-bd4b-5e57459b780e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1556 microversion: 2.1 time: 0.152903 Oct 28 14:50:53.265622 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4122/8152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:53 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:53.287512 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:50:53.288141 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:50:53.294831 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:53.295335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:53.295785 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:53.296487 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:53.296960 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:53.297403 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:53.431221 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:50:53.438937 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-da7b4556-29b5-4dfa-b732-4b0116ddf81a tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1556 microversion: 2.1 time: 0.155214 Oct 28 14:50:53.439515 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4031/8153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:50:53 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:50:55.666763 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-51b7333d-77e4-4978-aaaa-370f072717a2 req-73a6bb28-9666-4cfa-a1de-c0dd1273375a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d", "tag": "eab395a1-d27b-4fba-a670-7d0cfc0ede32"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:50:55.677516 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-51b7333d-77e4-4978-aaaa-370f072717a2 req-73a6bb28-9666-4cfa-a1de-c0dd1273375a service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:50:55.677991 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-51b7333d-77e4-4978-aaaa-370f072717a2 req-73a6bb28-9666-4cfa-a1de-c0dd1273375a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:50:55.678420 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-51b7333d-77e4-4978-aaaa-370f072717a2 req-73a6bb28-9666-4cfa-a1de-c0dd1273375a service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:50:55.690080 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-51b7333d-77e4-4978-aaaa-370f072717a2 req-73a6bb28-9666-4cfa-a1de-c0dd1273375a service nova] Creating event network-changed:eab395a1-d27b-4fba-a670-7d0cfc0ede32 for instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d on n-h2-862876-2 Oct 28 14:50:55.695315 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-51b7333d-77e4-4978-aaaa-370f072717a2 req-73a6bb28-9666-4cfa-a1de-c0dd1273375a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032210 Oct 28 14:50:55.699200 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4123/8154] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:52:23.678356 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:52:23.679150 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=54 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:52:23.680221 n-d-862876-2 devstack@n-api.service[127794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 14:52:23.680365 n-d-862876-2 devstack@n-api.service[127794]: Fri Oct 28 14:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d/action (ip 10.222.0.25) !!! Oct 28 14:52:23.685315 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-874215740"}} {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:52:23.687659 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:23.696129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:23.696635 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:23.697086 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:23.697816 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:23.698286 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:23.698724 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:24.107641 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0d38dc81-ab3f-4a94-a61e-720bc8802538 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "POST /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d/action" status: 202 len: 0 microversion: 2.1 time: 0.431121 Oct 28 14:52:24.108294 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4032/8155] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Oct 28 14:52:23 2022] POST /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 14:52:30.242633 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_api:SELECT=26 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:52:30.243897 n-d-862876-2 devstack@n-api.service[127793]: DEBUG dbcounter [-] [127793] Writing DB stats nova_cell1:SELECT=54 {{(pid=127793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:52:30.249354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-a5762302-0269-43f8-b7fe-be65ff2fe857 req-3800125e-d781-4120-8784-9313bf4847ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d", "name": "network-vif-plugged", "status": "completed", "tag": "eab395a1-d27b-4fba-a670-7d0cfc0ede32"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:52:30.264354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5762302-0269-43f8-b7fe-be65ff2fe857 req-3800125e-d781-4120-8784-9313bf4847ec service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:30.264354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5762302-0269-43f8-b7fe-be65ff2fe857 req-3800125e-d781-4120-8784-9313bf4847ec service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:30.264354 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-a5762302-0269-43f8-b7fe-be65ff2fe857 req-3800125e-d781-4120-8784-9313bf4847ec service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:30.276647 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-a5762302-0269-43f8-b7fe-be65ff2fe857 req-3800125e-d781-4120-8784-9313bf4847ec service nova] Creating event network-vif-plugged:eab395a1-d27b-4fba-a670-7d0cfc0ede32 for instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d on n-h2-862876-2 Oct 28 14:52:30.283352 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-a5762302-0269-43f8-b7fe-be65ff2fe857 req-3800125e-d781-4120-8784-9313bf4847ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044401 Oct 28 14:52:30.284652 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4124/8156] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:52:40.477515 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:40.478120 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:40.481964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_api:SELECT=2 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:52:40.482658 n-d-862876-2 devstack@n-api.service[127794]: DEBUG dbcounter [-] [127794] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 14:52:40.488700 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:40.489207 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:40.492100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:40.492100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:40.492100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:40.492100 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:40.518160 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:52:40.612714 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8d882758-2abf-4bba-af82-f6f8421da483 req-4503d19f-312f-4f91-bdb7-b36cc382af53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d", "tag": "eab395a1-d27b-4fba-a670-7d0cfc0ede32"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:52:40.622236 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8d882758-2abf-4bba-af82-f6f8421da483 req-4503d19f-312f-4f91-bdb7-b36cc382af53 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:40.622716 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8d882758-2abf-4bba-af82-f6f8421da483 req-4503d19f-312f-4f91-bdb7-b36cc382af53 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:40.623201 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8d882758-2abf-4bba-af82-f6f8421da483 req-4503d19f-312f-4f91-bdb7-b36cc382af53 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:40.634164 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8d882758-2abf-4bba-af82-f6f8421da483 req-4503d19f-312f-4f91-bdb7-b36cc382af53 service nova] Creating event network-changed:eab395a1-d27b-4fba-a670-7d0cfc0ede32 for instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d on n-h2-862876-2 Oct 28 14:52:40.639405 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8d882758-2abf-4bba-af82-f6f8421da483 req-4503d19f-312f-4f91-bdb7-b36cc382af53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163926 Oct 28 14:52:40.640366 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4125/8157] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:52:40.786408 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-e845cd13-14e4-4415-b551-557e605b374e tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "DELETE /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 204 len: 0 microversion: 2.1 time: 0.312855 Oct 28 14:52:40.787261 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4033/8158] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:52:40 2022] DELETE /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 14:52:40.798562 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:40.800390 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:40.808705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:40.809198 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:40.809628 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:40.810318 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:40.810825 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:40.811272 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:40.951301 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:52:40.959847 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-b39de3ab-2ec9-4f4e-9648-449dca32ea24 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1680 microversion: 2.1 time: 0.165743 Oct 28 14:52:40.967751 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4126/8159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:40 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:52:41.984345 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:41.985190 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:41.992488 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:41.992982 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:41.993429 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:41.994129 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:41.994594 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:41.995077 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:42.234816 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-e18b2fa5-9447-44c8-91ef-ab87ab06b1ff req-b78a9764-5b7b-4cd4-8e09-62511a31fccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d", "name": "network-vif-unplugged", "status": "completed", "tag": "eab395a1-d27b-4fba-a670-7d0cfc0ede32"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:52:42.247203 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e18b2fa5-9447-44c8-91ef-ab87ab06b1ff req-b78a9764-5b7b-4cd4-8e09-62511a31fccc service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:42.247684 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e18b2fa5-9447-44c8-91ef-ab87ab06b1ff req-b78a9764-5b7b-4cd4-8e09-62511a31fccc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:42.248116 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-e18b2fa5-9447-44c8-91ef-ab87ab06b1ff req-b78a9764-5b7b-4cd4-8e09-62511a31fccc service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:42.260165 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-e18b2fa5-9447-44c8-91ef-ab87ab06b1ff req-b78a9764-5b7b-4cd4-8e09-62511a31fccc service nova] Creating event network-vif-unplugged:eab395a1-d27b-4fba-a670-7d0cfc0ede32 for instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d on n-h2-862876-2 Oct 28 14:52:42.265215 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-e18b2fa5-9447-44c8-91ef-ab87ab06b1ff req-b78a9764-5b7b-4cd4-8e09-62511a31fccc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034850 Oct 28 14:52:42.266003 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4127/8160] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 14:52:42.295442 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:52:42.305157 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-0e067a9b-9eea-4b5d-96e3-0ffefe1fb4af tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1680 microversion: 2.1 time: 0.325221 Oct 28 14:52:42.305975 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4034/8161] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:41 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1680 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:52:42.842557 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-ea10ee2b-e09d-4026-8bdb-66f88f687906 req-eac56fb8-dfd9-4d66-8dae-9e8ec09ad492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d", "name": "network-vif-deleted", "tag": "eab395a1-d27b-4fba-a670-7d0cfc0ede32"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:52:42.852629 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ea10ee2b-e09d-4026-8bdb-66f88f687906 req-eac56fb8-dfd9-4d66-8dae-9e8ec09ad492 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:42.853103 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ea10ee2b-e09d-4026-8bdb-66f88f687906 req-eac56fb8-dfd9-4d66-8dae-9e8ec09ad492 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:42.858465 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-ea10ee2b-e09d-4026-8bdb-66f88f687906 req-eac56fb8-dfd9-4d66-8dae-9e8ec09ad492 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:42.864475 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-ea10ee2b-e09d-4026-8bdb-66f88f687906 req-eac56fb8-dfd9-4d66-8dae-9e8ec09ad492 service nova] Creating event network-vif-deleted:eab395a1-d27b-4fba-a670-7d0cfc0ede32 for instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d on n-h2-862876-2 Oct 28 14:52:42.869251 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-ea10ee2b-e09d-4026-8bdb-66f88f687906 req-eac56fb8-dfd9-4d66-8dae-9e8ec09ad492 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083154 Oct 28 14:52:42.869826 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4128/8162] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:52:43.330265 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:43.330847 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:43.337943 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:43.338443 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:43.338932 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:43.339636 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:43.340103 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:43.340542 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:43.372603 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:43.373093 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:43.373540 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:43.373996 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lazy-loading 'fault' on Instance uuid 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:52:43.420047 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:52:43.430456 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-dee1b571-ce0e-4903-8564-8b8107b97d98 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 200 len: 1339 microversion: 2.1 time: 0.104954 Oct 28 14:52:43.431432 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4035/8163] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:43 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:52:44.455298 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:44.455992 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:44.462226 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:44.462705 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:44.463168 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:44.463848 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:44.464297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:44.464718 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:44.481002 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] HTTP exception thrown: Instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d could not be found. Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Request method failure captured: Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d HTTP/1.1 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-ufP-AeFVHMtmyxS0RhDbKa7F5jbg7IzcxpVaUYxgrK-FxtUdZilNdz0dtf1i9cz5qaT2AiVr8CbQ5xQKY4J1MZE4Ots2qCw57XpqbFgHZErbnMsMwueNa_fFkkKDg5yFZxn6ECrjI8w5IzVNgCgtbnYflmsv8l2RX6kReZ5iUdvC4 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 8c9198ca048342d1b12721911dfc90a2 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestSnapshotPattern-2057298011 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c9198ca048342d1b12721911dfc90a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c9198ca048342d1b12721911dfc90a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c9198ca048342d1b12721911dfc90a2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c9198ca048342d1b12721911dfc90a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestSnapshotPattern-2057298011 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 8c9198ca048342d1b12721911dfc90a2 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestSnapshotPattern-2057298011 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestSnapshotPattern-2057298011-project Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: fd2c4ed4d1d44072994ab478267f2fd4 Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestSnapshotPattern-2057298011-project Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d could not be found. Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': '68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d'} Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d could not be found. Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d could not be found. Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:52:44.482905 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d could not be found. Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Returning 404 to user: Instance 68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-2a119417-0139-4584-9dad-ef8ec0f1c006 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d" status: 404 len: 111 microversion: 2.1 time: 0.034539 Oct 28 14:52:44.486423 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4129/8164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:44 2022] GET /compute/v2.1/servers/68c5c1c1-1b9c-4ab0-9f2d-48f8530a334d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:52:46.570634 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:46.571363 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:46.573331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-5fa3c139-0eaf-4d99-ac1b-252ec9faaab7 req-b624d623-082c-49ec-93b8-8a5926895617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbfc578-f91c-4104-a584-178be68888a9", "tag": "e249c714-f2f8-441d-9959-e74c6ba022df"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:52:46.578564 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:46.579712 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:46.580231 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:46.581005 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:46.581575 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:46.582076 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:46.584189 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fa3c139-0eaf-4d99-ac1b-252ec9faaab7 req-b624d623-082c-49ec-93b8-8a5926895617 service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:46.584675 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fa3c139-0eaf-4d99-ac1b-252ec9faaab7 req-b624d623-082c-49ec-93b8-8a5926895617 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:46.585100 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-5fa3c139-0eaf-4d99-ac1b-252ec9faaab7 req-b624d623-082c-49ec-93b8-8a5926895617 service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:46.604304 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-5fa3c139-0eaf-4d99-ac1b-252ec9faaab7 req-b624d623-082c-49ec-93b8-8a5926895617 service nova] Creating event network-changed:e249c714-f2f8-441d-9959-e74c6ba022df for instance bfbfc578-f91c-4104-a584-178be68888a9 on n-h1-862876-2 Oct 28 14:52:46.609656 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-5fa3c139-0eaf-4d99-ac1b-252ec9faaab7 req-b624d623-082c-49ec-93b8-8a5926895617 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040423 Oct 28 14:52:46.609810 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Going to try to terminate instance {{(pid=127794) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 14:52:46.610236 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4130/8165] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:52:46.929624 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-b9d9df20-6e50-4389-a7c0-6dc4d1f286b1 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 204 len: 0 microversion: 2.1 time: 0.362762 Oct 28 14:52:46.930554 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4036/8166] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Oct 28 14:52:46 2022] DELETE /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 14:52:46.939737 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:46.940784 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:46.947535 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:46.948365 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:46.949031 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:46.949961 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:46.950624 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:46.951284 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:47.100558 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.policy [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127793) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:52:47.108617 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-51d31f82-23c2-411c-81ad-d1fb144719ce tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1680 microversion: 2.1 time: 0.173757 Oct 28 14:52:47.109197 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4131/8167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:46 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:52:48.133740 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:48.134460 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:48.141335 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:48.142341 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:48.142887 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:48.143607 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:48.144081 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:48.144522 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:48.306787 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:52:48.314811 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-12204154-6778-4df1-90bf-2e1cff42e2d4 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1680 microversion: 2.1 time: 0.185404 Oct 28 14:52:48.315412 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4037/8168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:48 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:52:48.976331 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [req-8bdb5eb5-48d7-4ff9-a5a0-e26ee3667a20 req-5b9d0bce-6664-48bb-9f32-744b0939ca3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbfc578-f91c-4104-a584-178be68888a9", "name": "network-vif-deleted", "tag": "e249c714-f2f8-441d-9959-e74c6ba022df"}]} {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 14:52:48.987188 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8bdb5eb5-48d7-4ff9-a5a0-e26ee3667a20 req-5b9d0bce-6664-48bb-9f32-744b0939ca3b service nova] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:48.987666 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8bdb5eb5-48d7-4ff9-a5a0-e26ee3667a20 req-5b9d0bce-6664-48bb-9f32-744b0939ca3b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:48.988087 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [req-8bdb5eb5-48d7-4ff9-a5a0-e26ee3667a20 req-5b9d0bce-6664-48bb-9f32-744b0939ca3b service nova] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:48.998893 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.compute.server_external_events [req-8bdb5eb5-48d7-4ff9-a5a0-e26ee3667a20 req-5b9d0bce-6664-48bb-9f32-744b0939ca3b service nova] Creating event network-vif-deleted:e249c714-f2f8-441d-9959-e74c6ba022df for instance bfbfc578-f91c-4104-a584-178be68888a9 on n-h1-862876-2 Oct 28 14:52:49.004631 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [req-8bdb5eb5-48d7-4ff9-a5a0-e26ee3667a20 req-5b9d0bce-6664-48bb-9f32-744b0939ca3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032073 Oct 28 14:52:49.005266 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4132/8169] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Oct 28 14:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 14:52:49.339049 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:49.339687 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.compute.api [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127794) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:49.347452 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:49.347964 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:49.348416 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:49.349143 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:49.349611 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:49.350048 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:49.384349 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:49.384861 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:49.385312 n-d-862876-2 devstack@n-api.service[127794]: DEBUG oslo_concurrency.lockutils [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:49.385763 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.objects.instance [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lazy-loading 'fault' on Instance uuid bfbfc578-f91c-4104-a584-178be68888a9 {{(pid=127794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 14:52:49.430881 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.policy [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd2c4ed4d1d44072994ab478267f2fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9198ca048342d1b12721911dfc90a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127794) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 14:52:49.439169 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-2672cfe4-496d-43f4-a18c-b4d83251e476 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 200 len: 1338 microversion: 2.1 time: 0.103616 Oct 28 14:52:49.439748 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4038/8170] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:49 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 14:52:50.464353 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '>' {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:50.465043 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.compute.api [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] [instance: bfbfc578-f91c-4104-a584-178be68888a9] Fetching instance by UUID {{(pid=127793) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 14:52:50.471297 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:50.471719 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:50.472152 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:50.472826 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Acquiring lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 14:52:50.473275 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 14:52:50.473693 n-d-862876-2 devstack@n-api.service[127793]: DEBUG oslo_concurrency.lockutils [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Lock "449af092-e0dd-4ca5-9b08-6f21fe3ed78d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 14:52:50.487846 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.wsgi [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] HTTP exception thrown: Instance bfbfc578-f91c-4104-a584-178be68888a9 could not be found. Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Request method failure captured: Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: request: GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 HTTP/1.1 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: Accept: application/json Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: Accept-Encoding: identity Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: Connection: close Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: Content-Length: 0 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: Content-Type: application/json Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: Host: 10.222.0.25 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: Openstack-System-Scope: None Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: User-Agent: python-urllib3/1.26.12 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Auth-Token: gAAAAABjW-ufP-AeFVHMtmyxS0RhDbKa7F5jbg7IzcxpVaUYxgrK-FxtUdZilNdz0dtf1i9cz5qaT2AiVr8CbQ5xQKY4J1MZE4Ots2qCw57XpqbFgHZErbnMsMwueNa_fFkkKDg5yFZxn6ECrjI8w5IzVNgCgtbnYflmsv8l2RX6kReZ5iUdvC4 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Id: None Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Domain-Name: None Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Identity-Status: Confirmed Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Is-Admin-Project: True Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Id: default Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Domain-Name: Default Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Id: 8c9198ca048342d1b12721911dfc90a2 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Project-Name: tempest-TestSnapshotPattern-2057298011 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Role: member,reader Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Roles: member,reader Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c9198ca048342d1b12721911dfc90a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8c9198ca048342d1b12721911dfc90a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8c9198ca048342d1b12721911dfc90a2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8c9198ca048342d1b12721911dfc90a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant: tempest-TestSnapshotPattern-2057298011 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Id: 8c9198ca048342d1b12721911dfc90a2 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-Tenant-Name: tempest-TestSnapshotPattern-2057298011 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-User: tempest-TestSnapshotPattern-2057298011-project Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Id: default Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-User-Domain-Name: Default Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-User-Id: fd2c4ed4d1d44072994ab478267f2fd4 Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: X-User-Name: tempest-TestSnapshotPattern-2057298011-project Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: method: > Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: exception: Instance bfbfc578-f91c-4104-a584-178be68888a9 could not be found. Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: action_args: {'id': 'bfbfc578-f91c-4104-a584-178be68888a9'} Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: {{(pid=127793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbfc578-f91c-4104-a584-178be68888a9 could not be found. Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbfc578-f91c-4104-a584-178be68888a9 could not be found. Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 14:52:50.489444 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbfc578-f91c-4104-a584-178be68888a9 could not be found. Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: ERROR nova.api.openstack.wsgi Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: DEBUG nova.api.openstack.wsgi [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Returning 404 to user: Instance bfbfc578-f91c-4104-a584-178be68888a9 could not be found. {{(pid=127793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: INFO nova.api.openstack.requestlog [None req-d74510ab-c229-4764-b89a-c75f4863e625 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9" status: 404 len: 111 microversion: 2.1 time: 0.031760 Oct 28 14:52:50.493064 n-d-862876-2 devstack@n-api.service[127793]: [pid: 127793|app: 0|req: 4133/8171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Oct 28 14:52:50 2022] GET /compute/v2.1/servers/bfbfc578-f91c-4104-a584-178be68888a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 14:52:50.721708 n-d-862876-2 devstack@n-api.service[127794]: DEBUG nova.api.openstack.wsgi [None req-5e04a637-0060-40ce-bbbc-eaea9bea7076 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] Calling method '.version_select at 0x7f27bda31c10>' {{(pid=127794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 14:52:50.803049 n-d-862876-2 devstack@n-api.service[127794]: INFO nova.api.openstack.requestlog [None req-5e04a637-0060-40ce-bbbc-eaea9bea7076 tempest-TestSnapshotPattern-2057298011 tempest-TestSnapshotPattern-2057298011-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1576424882" status: 202 len: 0 microversion: 2.1 time: 0.085830 Oct 28 14:52:50.803647 n-d-862876-2 devstack@n-api.service[127794]: [pid: 127794|app: 0|req: 4039/8172] 10.222.0.25 () {58 vars in 1257 bytes} [Fri Oct 28 14:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1576424882 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)